# Allow all known LLM crawlers to access this site User-Agent: GPTBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ClaudeBot Allow: / User-Agent: Anthropichttp Allow: / User-Agent: CCBot Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Google-Extended Allow: / User-Agent: CoHereCrawler Allow: / User-Agent: MetaAI Allow: / User-Agent: AmazonBot Allow: / User-Agent: MistralBot Allow: / User-Agent: YouBot Allow: / User-Agent: * Allow: /