User-agent: * Disallow: /raw/ # AI Crawler Access - Allow AI search engines to index this site User-Agent: GPTBot Allow: / User-Agent: OAI-SearchBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ClaudeBot Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Google-Extended Allow: / User-Agent: Googlebot Allow: / User-Agent: bingbot Allow: / User-Agent: Amazonbot Allow: / User-Agent: CCBot Allow: / User-Agent: Bytespider Allow: / User-Agent: Applebot-Extended Allow: / User-Agent: FacebookExternalHit Allow: / Sitemap: https://reports.aisqltuner.com/sitemap.xml