PetalBot

Scraper / HTTP Client Huawei robots.txt behaviour unknown

Petal search engine web crawler bot

User-Agent

Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)

Allow PetalBot in robots.txt

User-agent: PetalBot
Allow: /

Block PetalBot in robots.txt

User-agent: PetalBot
Disallow: /

Blocking affects this tool's ability to access your site for its stated purpose.

Official documentation: https://webmaster.petalsearch.com/site/petalbot

Check your site's bot access

Free dual-engine check: robots.txt verdicts for all 222 bots plus live User-Agent probes. Finds WAF blocks your robots.txt doesn't show.