Separate Anthropic crawling from Claude user fetches
See whether an Anthropic request matches model-development crawling, search discovery, or a page fetched on behalf of a Claude user.
Anthropic distinguishes automated model-development crawling, search discovery, and page retrieval initiated by a Claude user.
3 reviewed crawlersCompare Anthropic crawlers
ClaudeBot, Claude-SearchBot, and Claude-User describe different access patterns. Talivia preserves those identities so you can compare ongoing discovery with a page fetched for a live user interaction.
ClaudeBot is Anthropic’s automated crawler for model development and improvement.
Official crawler guidanceClaude-SearchBot accesses pages to improve search relevance and discovery for Claude experiences.
Official crawler guidanceClaude-User represents a page retrieval initiated by a person using Claude.
Official crawler guidance
ClaudeBot
GPTBotOAI-SearchBot
PerplexityBotClaude-SearchBotChatGPT-UserPerplexity-UserClaude-UserOAI-AdsBotAnalyze Anthropic in one view
Compare different crawlers, pages, and response outcomes from the same provider while preserving the purpose of each request.
- Crawler-specific trends
- Top requested pages
- Verification confidence
A request is not a citation
Anthropic crawler traffic does not prove that the page was indexed, used for training, shown to a user, or included in an answer.
See how Anthropic reaches your website
Start with requests from your own server.
Add your website