ChatGPT
OpenAI documents three crawlers. GPTBot collects training data, OAI-SearchBot powers ChatGPT search results, and ChatGPT-User fetches pages for user actions in ChatGPT.
Free · open source · 35 checks
See what ChatGPT, Claude, Perplexity and Google's AI features can reach and read on your site, and the fix for every gap.
No signup. About 5 seconds. Shareable report.
Whether AI crawlers can reach, fetch and index the site without being denied, challenged, redirected excessively or served a degraded response.
Whether the useful page content exists in the raw server response read by non-JavaScript AI crawlers, rather than appearing only after client-side rendering.
Whether machines can identify the page, its subject, language, canonical URL, publisher and content type without inferring them from presentation alone.
Whether an AI system can fetch and cite the page over a valid, consistently secure connection.
Whether the page contains substantial, clear and evidence-backed material that a generative engine can extract and cite in an answer.
These signals are shown in every report for context. They never change the score.
| Dimension | Share |
|---|---|
| Crawler access | 25% |
| Rendering | 20% |
| Structured data | 30% |
| Trust & security | 10% |
| Content (GEO) | 15% |
Grades come from the 0-100 score. The share next to each grade is live, from the sites in the stats above.
AI crawlers can reach, read and cite the page. Remaining findings are polish.
53% of sitesReadable by AI crawlers, with gaps that make the page less likely to be quoted.
36% of sitesAI crawlers reach the page but miss important content or signals.
11% of sitesAI crawlers are blocked or find little they can use.
0% of sitesEach assistant documents its own crawlers. The checker tests access for every token below, and these are the vendors' own descriptions.
OpenAI documents three crawlers. GPTBot collects training data, OAI-SearchBot powers ChatGPT search results, and ChatGPT-User fetches pages for user actions in ChatGPT.
Anthropic documents three crawlers. ClaudeBot collects training content, Claude-SearchBot crawls to improve search results, and Claude-User retrieves pages when a Claude user's question needs it.
PerplexityBot indexes pages for Perplexity search results, and Perplexity-User fetches pages for user actions in Perplexity.
To be shown as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to be shown in Google Search with a snippet. Google also says:
You don't need to create new machine readable files, AI text files, or markup to appear in these features.Google Search Central, AI features and your website
Google states that Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search.