Google-Extended: what it is and how to see it

Google documents Google-Extended as a robots.txt token with no HTTP user agent of its own. Google crawls under its existing user agents, so there is nothing separate to count in your logs.

Operator
Google
How we classify it
AI training crawler
User agent token
None: a robots.txt token only
Visible in traffic
No
Note
robots.txt product token only; Google crawls with Googlebot UA, so Google-Extended usage is not visible in traffic
Operator documentation
Google Search Central: Google’s common crawlers

Block or allow it in robots.txt

robots.txt: block
User-agent: Google-Extended
Disallow: /
robots.txt: allow
User-agent: Google-Extended
Allow: /

Rules for one crawler don’t affect the others from the same company.

Why GA4 doesn’t show it

It has no user agent of its own, so no analytics tool can count it.

Count the visitors you’ve been missing.

30-day free trial, no card needed. Create an account with your email and add your first site.

Start 30-day trial