What you can conclude
- The request matched Claude-SearchBot.
- The requested path and HTTP outcome are visible.
- Search discovery can be compared with other Claude activity.
See where Claude-SearchBot discovers your site
Follow Anthropic search crawler activity by page and response status without treating discovery as proof of indexing or citation.
See Claude-SearchBot requests over time
Claude-SearchBot accesses pages to improve search relevance and discovery for Claude experiences.
Bot traffic
Claude-SearchBot
GPTBotOAI-SearchBotClaudeBot
PerplexityBotChatGPT-UserPerplexity-UserClaude-UserOAI-AdsBotWhat a Claude-SearchBot request means
The crawler identity indicates search-oriented discovery described by Anthropic. It belongs in indexing analytics, not in model-training or user-triggered request totals.
What it does not prove
- The page was indexed or ranked.
- The page appeared in a Claude answer.
- A User-Agent match alone proves the network identity.
Technical reference
User-Agent
Claude-SearchBot/1.0Talivia looks for the stable Claude-SearchBot token in the normalized User-Agent.
robots.txt
User-agent: Claude-SearchBot
Allow: /
# To block instead:
# Disallow: /Use robots.txt to express an allow or block preference for this crawler.
Verification
The provider publishes crawler behavior guidance, but Talivia does not claim network identity is verified from a User-Agent token alone.
View official sourceTrack Claude-SearchBot with Talivia
- 1Enable Bot Traffic
Turn on collection in website settings.
- 2Pass the server token
Send the minimal event from trusted server code or middleware.
- 3Inspect crawler activity
Review pages, statuses, trends, and verification confidence.
Related Anthropic crawlers
Claude-SearchBot questions
How do I know a request came from Claude-SearchBot?
Talivia matches the Claude-SearchBot User-Agent token and labels the verification confidence explicitly. User-Agent text can be spoofed, so a token match alone is not an identity guarantee.
How can I allow or block Claude-SearchBot?
Add a rule for Claude-SearchBot in robots.txt and check the provider’s official documentation for behavior. robots.txt expresses crawl preferences; it is not access control or identity verification.
What does Talivia store?
Talivia stores the hostname, sanitized path, method, User-Agent, optional status, classification, and verification result. It does not store page bodies, cookies, authorization headers, query strings, or raw IP addresses.
See Claude-SearchBot in your own traffic
Start recording real requests with server-side tracking.
Add your website