Skip to main content
DiwaliFree checklist

AI crawlers · Fetches pages for a user · Perplexity

Perplexity-User

Perplexity-User is Perplexity's crawler that fetches pages for a user. Opens a page when a Perplexity user's question needs it. Usually leave it allowed. It only visits when a person asks the assistant about a page. Some companies say robots.txt may not apply to these visits.

By Praveen Kumar, Vectura Digital · Checked against Perplexity's documentation on 20 October 2026.

9.9%

of the world's top 1,000 sites block Perplexity-User

3.7%

of India's top 1,000 sites block Perplexity-User

From our study of 2,000 sites, 20 October 2026.

Allow or block Perplexity-User in robots.txt

robots.txt is a plain text file at the top of your site (yoursite.com/robots.txt). Add one of these groups. If Perplexity-User isn't mentioned at all, it follows your rules for all crawlers.

To allow it

User-agent: Perplexity-User
Allow: /

To block it

User-agent: Perplexity-User
Disallow: /

Perplexity says robots.txt may not apply to Perplexity-User, because it visits when a person asks for a page.

Questions

What is Perplexity-User?

Perplexity-User is run by Perplexity. Opens a page when a Perplexity user's question needs it.

Should I block Perplexity-User?

Usually leave it allowed. It only visits when a person asks the assistant about a page. Some companies say robots.txt may not apply to these visits.

How do I block Perplexity-User?

Add "User-agent: Perplexity-User" followed by "Disallow: /" to the robots.txt file at the top of your site. To allow it, use "Allow: /" instead, or simply don't mention it.

Does Perplexity-User follow robots.txt?

Perplexity says robots.txt may not apply to these visits, because they happen when a person asks for a page.

Other crawlers of this kind: ChatGPT-User, Claude-User. All crawlers.

Source