OAI-SearchBot

AI Search / Retrieval OpenAI robots.txt behaviour unknown

OpenAI search web crawler bot

User-Agent

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot

Allow OAI-SearchBot in robots.txt

User-agent: OAI-SearchBot
Allow: /

Block OAI-SearchBot in robots.txt

User-agent: OAI-SearchBot
Disallow: /

Blocking removes your site from this engine's AI answers and citations — you lose AI search traffic. It does not affect model training.

Official documentation: https://platform.openai.com/docs/bots

Is OAI-SearchBot blocked on your site — even by accident?

Free dual-engine check: robots.txt verdicts for all 222 bots plus live User-Agent probes. Finds WAF blocks your robots.txt doesn't show.