User-agent: * Disallow: /cdn-cgi/ Disallow: /q/ Disallow: /q? Disallow: /area51/ Disallow: /xhr/ Disallow: /login/ Disallow: /logout/ Disallow: /admin/ User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MegaIndex Disallow: / User-agent: MJ12bot Disallow: / User-agent: grapeshot Disallow: / User-agent: DomainCrawler Disallow: /