Google-Extended: what it is and how to see it
Google documents Google-Extended as a robots.txt token with no HTTP user agent of its own. Google crawls under its existing user agents, so there is nothing separate to count in your logs.
- Operator
- How we classify it
- AI training crawler
- User agent token
- None: a robots.txt token only
- Visible in traffic
- No
- Note
- robots.txt product token only; Google crawls with Googlebot UA, so Google-Extended usage is not visible in traffic
- Operator documentation
- Google Search Central: Google’s common crawlers
Block or allow it in robots.txt
User-agent: Google-Extended
Disallow: /
User-agent: Google-Extended
Allow: /
Rules for one crawler don’t affect the others from the same company.
Why GA4 doesn’t show it
It has no user agent of its own, so no analytics tool can count it.
Count the visitors you’ve been missing.
30-day free trial, no card needed. Create an account with your email and add your first site.