# robots.txt for LLM Cutover. AI policy: allow. See /ai.txt and /llms.txt. User-agent: * Allow: / Disallow: /offline/ # AI search / answer engines (cite + link back) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Claude-User User-agent: Claude-SearchBot Allow: / # AI training crawlers User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot User-agent: Applebot-Extended User-agent: Meta-ExternalAgent User-agent: Bytespider Allow: / Sitemap: https://llmcutover.com/sitemap-index.xml