Skip to main content
DiwaliFree checklist

AI crawlers · Fetches pages for a user · OpenAI

ChatGPT-User

ChatGPT-User is OpenAI's crawler that fetches pages for a user. Opens a page when a ChatGPT user's question needs it. Usually leave it allowed. It only visits when a person asks the assistant about a page. Some companies say robots.txt may not apply to these visits.

By Praveen Kumar, Vectura Digital · Checked against OpenAI's documentation on 20 October 2026.

9.1%

of the world's top 1,000 sites block ChatGPT-User

3.5%

of India's top 1,000 sites block ChatGPT-User

From our study of 2,000 sites, 20 October 2026.

Allow or block ChatGPT-User in robots.txt

robots.txt is a plain text file at the top of your site (yoursite.com/robots.txt). Add one of these groups. If ChatGPT-User isn't mentioned at all, it follows your rules for all crawlers.

To allow it

User-agent: ChatGPT-User
Allow: /

To block it

User-agent: ChatGPT-User
Disallow: /

OpenAI says robots.txt may not apply to ChatGPT-User, because it visits when a person asks for a page.

Check if your site blocks ChatGPT-UserMake a full robots.txt

Questions

What is ChatGPT-User?

ChatGPT-User is run by OpenAI. Opens a page when a ChatGPT user's question needs it.

Should I block ChatGPT-User?

Usually leave it allowed. It only visits when a person asks the assistant about a page. Some companies say robots.txt may not apply to these visits.

How do I block ChatGPT-User?

Add "User-agent: ChatGPT-User" followed by "Disallow: /" to the robots.txt file at the top of your site. To allow it, use "Allow: /" instead, or simply don't mention it.

Does ChatGPT-User follow robots.txt?

OpenAI says robots.txt may not apply to these visits, because they happen when a person asks for a page.

Other crawlers of this kind: Claude-User, Perplexity-User. All crawlers.

Source