About GidoraBot

GidoraBot is the crawler for the gidora search engine. It respects RFC 9309, robots.txt, per-host crawl-delay limits, Retry-After, and Sitemap discovery.

User-Agent: GidoraBot/1.0 (+https://search.gidora.com/about/bot; mailto:crawler@gidora.com)

Contact: mailto:crawler@gidora.com

To stop crawling, block the required paths for the GidoraBot product token in /robots.txt. robots.txt is not an access-control or privacy mechanism.