OAI-SearchBot: what it is and how to see it
OpenAI describes OAI-SearchBot as the crawler that surfaces sites in ChatGPT search. You can allow it and still block GPTBot.
- Operator
- OpenAI
- How we classify it
- AI search crawler
- User agent token
- OAI-SearchBot
- Visible in traffic
- Yes, by user agent
- Operator documentation
- OpenAI: Overview of OpenAI crawlers
Block or allow it in robots.txt
User-agent: OAI-SearchBot
Disallow: /
User-agent: OAI-SearchBot
Allow: /
Rules for one crawler don’t affect the others from the same company.
Why GA4 doesn’t show it
OAI-SearchBot fetches your HTML without running the JavaScript in it, so a browser tag never fires. Crawler requests only show up in server, CDN or edge logs.
How Wholetally counts it
The edge collector (a Cloudflare Worker or Next.js middleware) recognises AI crawlers by user agent and counts their hits per page in the AI report, outside your visitor numbers. It does not check IP ranges, so a bot that pretends to be OAI-SearchBot is counted as OAI-SearchBot.
Others from OpenAI
- GPTBot: AI training crawler
- ChatGPT-User: Fetches a page when a person asks an assistant
Count the visitors you’ve been missing.
30-day free trial, no card needed. Create an account with your email and add your first site.