User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /invoice Disallow: /invoice/ Disallow: /contact-submitted # Google User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Google-Extended Allow: / User-agent: AdsBot-Google Allow: / User-agent: Googlebot-Video Allow: / # Bing / Microsoft User-agent: bingbot Allow: / User-agent: msnbot Allow: / User-agent: MicrosoftPreview Allow: / # DuckDuckGo User-agent: DuckDuckBot Allow: / # Apple User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # OpenAI User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic / Claude User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Anthropic-AI Allow: / # Perplexity User-agent: PerplexityBot Allow: / # Cohere User-agent: cohere-ai Allow: / # Meta User-agent: Meta-ExternalAgent Allow: / User-agent: facebookexternalhit Allow: / # Amazon User-agent: Amazonbot Allow: / # Common Crawl (used by AI training datasets) User-agent: CCBot Allow: / # AI2 / Allen Institute User-agent: AI2Bot Allow: / # You.com User-agent: YouBot Allow: / # Bytedance User-agent: Bytespider Allow: / # Mistral AI User-agent: MistralBot Allow: / # Tavily (AI search) User-agent: Tavilybot Allow: / # Exa AI User-agent: ExaBot Allow: / # Brave Search User-agent: Brave-SearchBot Allow: / # Archive.org User-agent: ia_archiver Allow: / Sitemap: https://sixhour.co/sitemap.xml LLMs: https://sixhour.co/llms.txt