Perplexity-User
Perplexity's real-time user agent crawler. When a Perplexity user requests to browse a web page, it fetches the page content on that user's behalf.
Timeline (last 90 days)
Perplexity has two crawlers: PerplexityBot for displaying and linking websites in search results, and Perplexity-User for supporting user actions.
Perplexity states that Perplexity-User generally ignores robots.txt, because the crawling is requested by the user.
A misspelling in the user-agent name will cause the rule to fail silently; the correct names include GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, and Perplexity-User.
Anthropic says that disallowing Claude-User will prevent Claude from retrieving pages for user queries, but OpenAI and Perplexity say their own user-triggered fetchers may not obey robots.txt
AI crawler user agents can be divided into three categories: training (GPTBot, ClaudeBot, CCBot, Google-Extended, Applebot-Extended), search indexing (OAI-SearchBot, Claude-SearchBot, PerplexityBot), and user-triggered (ChatGPT-User, Claude-User, Perplexity-User).
All Facts (5)
Perplexity has two crawlers: PerplexityBot for displaying and linking websites in search results, and Perplexity-User for supporting user actions.
50%UnverifiedPerplexity states that Perplexity-User generally ignores robots.txt, because the crawling is requested by the user.
50%UnverifiedA misspelling in the user-agent name will cause the rule to fail silently; the correct names include GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, and Perplexity-User.
50%UnverifiedAnthropic says that disallowing Claude-User will prevent Claude from retrieving pages for user queries, but OpenAI and Perplexity say their own user-triggered fetchers may not obey robots.txt
50%UnverifiedAI crawler user agents can be divided into three categories: training (GPTBot, ClaudeBot, CCBot, Google-Extended, Applebot-Extended), search indexing (OAI-SearchBot, Claude-SearchBot, PerplexityBot), and user-triggered (ChatGPT-User, Claude-User, Perplexity-User).
50%