12.3%
of the world's top 1,000 sites block Google-Extended
5%
of India's top 1,000 sites block Google-Extended
From our study of 2,000 sites, 20 October 2026.
Allow or block Google-Extended in robots.txt
robots.txt is a plain text file at the top of your site (yoursite.com/robots.txt). Add one of these groups. If Google-Extended isn't mentioned at all, it follows your rules for all crawlers.
To allow it
User-agent: Google-Extended Allow: /
To block it
User-agent: Google-Extended Disallow: /
Not the same as Googlebot. Googlebot crawls for Google Search, including AI Overviews and AI Mode. Blocking one doesn't block the other. See Googlebot.
Questions
What is Google-Extended?
Google-Extended is run by Google. A control, not a separate crawler. Covers Gemini model training and grounding in the Gemini apps. It does not affect Google Search or AI Overviews.
Should I block Google-Extended?
Your choice. Blocking it keeps your future content out of that company's AI training. It doesn't remove you from AI search answers, which use separate crawlers.
How do I block Google-Extended?
Add "User-agent: Google-Extended" followed by "Disallow: /" to the robots.txt file at the top of your site. To allow it, use "Allow: /" instead, or simply don't mention it.
Is Google-Extended the same as Googlebot?
No. They're separate. Blocking one doesn't block the other, so check both lines in your robots.txt.
Other crawlers of this kind: GPTBot, ClaudeBot, CCBot. All crawlers.