What you can conclude
- OAI-SearchBot reached the recorded URL.
- The response status shows whether the crawler could access it.
- Official IP ranges are available for stronger verification.
Track OAI-SearchBot visits and page discovery
Measure OpenAI search crawler activity separately from training and user-triggered requests, down to the requested path and response status.
See OAI-SearchBot requests over time
OAI-SearchBot discovers and indexes web content for search experiences in OpenAI products.
Bot traffic
OAI-SearchBotGPTBot
ClaudeBot
PerplexityBotClaude-SearchBotChatGPT-UserPerplexity-UserClaude-UserOAI-AdsBotWhat a OAI-SearchBot request means
A request shows that the search crawler fetched a URL for discovery or index maintenance. It should be evaluated separately from GPTBot training traffic and ChatGPT-User page retrieval.
What it does not prove
- The URL was added to a search index.
- The page appeared in a ChatGPT search answer.
- More requests will improve ranking or visibility.
Technical reference
User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbotTalivia looks for the stable OAI-SearchBot token in the normalized User-Agent.
robots.txt
User-agent: OAI-SearchBot
Allow: /
# To block instead:
# Disallow: /Use robots.txt to express an allow or block preference for this crawler.
Verification
When the integration supplies a source IP from a trusted network boundary, Talivia can compare it with provider-published ranges.
View official sourceTrack OAI-SearchBot with Talivia
- 1Enable Bot Traffic
Turn on collection in website settings.
- 2Pass the server token
Send the minimal event from trusted server code or middleware.
- 3Inspect crawler activity
Review pages, statuses, trends, and verification confidence.
Related OpenAI crawlers
OAI-SearchBot questions
How do I know a request came from OAI-SearchBot?
Talivia first matches the OAI-SearchBot User-Agent token. When a trusted source IP matches provider-published ranges, the request can receive stronger verification confidence.
How can I allow or block OAI-SearchBot?
Add a rule for OAI-SearchBot in robots.txt and check the provider’s official documentation for behavior. robots.txt expresses crawl preferences; it is not access control or identity verification.
What does Talivia store?
Talivia stores the hostname, sanitized path, method, User-Agent, optional status, classification, and verification result. It does not store page bodies, cookies, authorization headers, query strings, or raw IP addresses.
See OAI-SearchBot in your own traffic
Start recording real requests with server-side tracking.
Add your website