01
Find silent blocks
See when robots.txt allows a crawler but a firewall, CDN, or response header quietly returns a block.
AI crawler access diagnostics
Is your websiteinvisible to ChatGPT& other AI crawlers?
Your robots.txt can say allow while your firewall says 403. Run a free, evidence-first check to see what AI bots can actually reach.
Free · no account required · server-side private-network protection
02
Understand the evidence
We compare robots.txt, page metadata, response headers, infrastructure files, and live User-Agent probes.
03
Turn insight into action
Get a prioritized result, a deterministic Fix Kit, and a clear next step for deeper GEO visibility.
Bot directory
Know the crawlers behind the answer.
Browse the 219-bot registry and see why each user-agent matters to search, assistants, and training workflows.
219+ catalogued · 19 core live probes
GPTBotTraining
OpenAI GPT web crawler bot
Read bot profile →claudebotTraining
Anthropic Claude web crawler bot
Read bot profile →OAI-SearchBotSearch
OpenAI search web crawler bot
Read bot profile →PerplexityBotSearch
Perplexity AI web crawler for search
Read bot profile →BytespiderTraining
ByteDance Bytespider web crawler bot
Read bot profile →CCBotTraining
Common Crawl web crawler for indexing
Read bot profile →Policy is not reachability
A green robots.txt is not the same as an accessible site.
AIBotCheck separates declared policy from observed reachability. The result stays honest when evidence is missing, partial, or contradictory.