13.5%
of the world's top 1,000 sites block GPTBot
5.6%
of India's top 1,000 sites block GPTBot
From our study of 2,000 sites, 20 October 2026.
Allow or block GPTBot in robots.txt
robots.txt is a plain text file at the top of your site (yoursite.com/robots.txt). Add one of these groups. If GPTBot isn't mentioned at all, it follows your rules for all crawlers.
To allow it
User-agent: GPTBot Allow: /
To block it
User-agent: GPTBot Disallow: /
Not the same as OAI-SearchBot. OAI-SearchBot finds websites to show in ChatGPT search answers. Blocking one doesn't block the other. See OAI-SearchBot.
Questions
What is GPTBot?
GPTBot is run by OpenAI. Collects content that may be used to train OpenAI's models.
Should I block GPTBot?
Your choice. Blocking it keeps your future content out of that company's AI training. It doesn't remove you from AI search answers, which use separate crawlers.
How do I block GPTBot?
Add "User-agent: GPTBot" followed by "Disallow: /" to the robots.txt file at the top of your site. To allow it, use "Allow: /" instead, or simply don't mention it.
Is GPTBot the same as OAI-SearchBot?
No. They're separate. Blocking one doesn't block the other, so check both lines in your robots.txt.
Other crawlers of this kind: ClaudeBot, Google-Extended, CCBot. All crawlers.