VisitorType
← All posts

Should I block GPTBot? A decision guide for 2026

gptbotai-crawlersgeo

"Block GPTBot" advice usually comes with a hidden assumption: that GPTBot is the thing connecting your site to ChatGPT. It isn't. OpenAI runs three different agents, and blocking the wrong one costs you visibility without protecting anything.

The three OpenAI agents, and what blocking each one does

Agent What it does If you block it
GPTBot Crawls for model training Your content stops feeding future models. ChatGPT can still cite you via search
OAI-SearchBot Indexes for ChatGPT search You disappear from ChatGPT's search results — the AI equivalent of de-indexing from Google
ChatGPT-User Fetches a page live, for a user who asked about it A real person's assistant gets an error instead of your pricing page

So the honest version of the question is three questions. Most sites that "blocked AI" in robots.txt blocked all three — and then wondered why AI referrals dried up while competitors got cited.

A data-first way to decide

  1. Measure first. How often does each agent actually visit, and which pages does it read? (Server logs work; most tag managers don't, because crawlers don't run JavaScript.)
  2. Split the decision. Training (GPTBot) is a philosophy-and-licensing question. Search (OAI-SearchBot) and live fetches (ChatGPT-User) are distribution — blocking them is turning away customers' assistants at the door.
  3. Verify before you trust. User agents are free to fake. Any bot can claim to be GPTBot. OpenAI publishes the real IP ranges — decisions should be based on verified visits, not log-file cosplay.

Where VisitorType fits

VisitorType classifies every visit — GPTBot, OAI-SearchBot, ChatGPT-User, and 30+ other AI agents — and verifies claimed crawlers against their vendors' published IP ranges, so spoofed agents are downgraded instead of polluting your data. Server-side collection catches the crawlers that never execute JavaScript. You see exactly who reads what, weekly, before you touch robots.txt.

Decide with a month of real data instead of a hot take: create a free account and watch which AI agents are already on your site.

See which AI agents visit your site — free.

Start with VisitorType