User-Agent: * Disallow: # --- OPENAI --- User-Agent: GPTBot Allow: / User-Agent: ChatGPT-User Allow: / # --- ANTHROPIC --- User-Agent: ClaudeBot Allow: / # --- GOOGLE --- User-Agent: Google-Extended Allow: / # --- META --- User-Agent: MetaAI Allow: / # --- PERPLEXITY --- User-Agent: PerplexityBot Allow: / # --- MISTRAL --- User-Agent: MistralBot Allow: / # --- X.AI --- User-Agent: GrokBot Allow: / # --- COHERE --- User-Agent: CohereBot Allow: / # --- YOU.COM --- User-Agent: YouBot Allow: / # --- DUCKDUCKGO --- User-Agent: DuckDuckGo-AI Allow: / # --- APPLE AI --- User-Agent: AppleAI Allow: / # --- AMAZON --- User-Agent: AlexaLLM Allow: / # --- BAIDU --- User-Agent: BaiduBot Allow: / # --- TENCENT --- User-Agent: TencentAI Allow: / # Optional: Crawl-delay if you want to control server load Crawl-delay: 2 # Optional: Let bots know who to contact for licensing or questions Contact: seo@globalreach.com