What is GPTBot?
GPTBot is OpenAI's crawler for gathering content that may be used to train its models. It is not the same as OAI-SearchBot, which fetches pages so ChatGPT can answer with live web content, or ChatGPT-User, which fetches a page when a user asks about it directly. Each can be allowed or blocked separately in robots.txt.
Why the three OpenAI bots matter separately
Blocking GPTBot keeps content out of future training runs. Blocking OAI-SearchBot removes you from ChatGPT search retrieval, which means fewer chances to be cited in answers. Sites that block everything with one rule often mean to stop training but accidentally remove themselves from AI search too.
- GPTBot: training data collection
- OAI-SearchBot: indexing and retrieval for ChatGPT search
- ChatGPT-User: on-demand fetches triggered by a user request
What to do for GEO
If you want AI visibility, allow at least OAI-SearchBot and ChatGPT-User explicitly in robots.txt. Whether to allow GPTBot is a business decision about training use, but for most brands trying to be recommended by AI, being in the training data helps.