What you can conclude
- The request matched the ClaudeBot User-Agent token.
- Talivia recorded the path, method, timing, and response status.
- The request is separated from Claude search and user fetches.
Track ClaudeBot crawling on your website
Measure Anthropic’s automated crawler separately from Claude search discovery and page retrieval initiated by a user.
See ClaudeBot requests over time
ClaudeBot is Anthropic’s automated crawler for model development and improvement.
Bot traffic
ClaudeBot
GPTBotOAI-SearchBot
PerplexityBotClaude-SearchBotChatGPT-UserPerplexity-UserClaude-UserOAI-AdsBotWhat a ClaudeBot request means
A ClaudeBot token identifies automated crawling described by Anthropic. Without a trusted, crawler-specific network match, Talivia keeps the request explicitly unverified rather than presenting User-Agent text as proof.
What it does not prove
- The source identity is cryptographically guaranteed.
- The page was selected for model training.
- The crawl produced a citation or recommendation.
Technical reference
User-Agent
ClaudeBot/1.0Talivia looks for the stable ClaudeBot token in the normalized User-Agent.
robots.txt
User-agent: ClaudeBot
Allow: /
# To block instead:
# Disallow: /Use robots.txt to express an allow or block preference for this crawler.
Verification
The provider publishes crawler behavior guidance, but Talivia does not claim network identity is verified from a User-Agent token alone.
View official sourceTrack ClaudeBot with Talivia
- 1Enable Bot Traffic
Turn on collection in website settings.
- 2Pass the server token
Send the minimal event from trusted server code or middleware.
- 3Inspect crawler activity
Review pages, statuses, trends, and verification confidence.
Related Anthropic crawlers
ClaudeBot questions
How do I know a request came from ClaudeBot?
Talivia matches the ClaudeBot User-Agent token and labels the verification confidence explicitly. User-Agent text can be spoofed, so a token match alone is not an identity guarantee.
How can I allow or block ClaudeBot?
Add a rule for ClaudeBot in robots.txt and check the provider’s official documentation for behavior. robots.txt expresses crawl preferences; it is not access control or identity verification.
What does Talivia store?
Talivia stores the hostname, sanitized path, method, User-Agent, optional status, classification, and verification result. It does not store page bodies, cookies, authorization headers, query strings, or raw IP addresses.
See ClaudeBot in your own traffic
Start recording real requests with server-side tracking.
Add your website