User-agent: * Allow: / # Amazon bots User-agent: Amazonbot Allow: / # Anthropic AI bots User-agent: Anthropic-ai Allow: / # Apple bots User-agent: Applebot-Extended Allow: / # Awario bots User-agent: AwarioRssBot Allow: / User-agent: AwarioSmartBot Allow: / # ByteDance bot User-agent: Bytespider Allow: / # Common Crawl bot User-agent: CCBot Allow: / # OpenAI and ChatGPT bots User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / # Claude bots (Anthropic) User-agent: Claude Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / # Cohere AI bot User-agent: Cohere-ai Allow: / # DataForSeo bot User-agent: DataForSeoBot Allow: / # Meta (Facebook) bots User-agent: FacebookBot Allow: / User-agent: Meta AI Allow: / # Google bots User-agent: Google-Extended Allow: / User-agent: Google Gemini Allow: / # Grok bot (Samsung) User-agent: Grok Allow: / # Imagesift bot User-agent: ImagesiftBot Allow: / # Magpie bot User-agent: Magpie-crawler Allow: / # Microsoft bots User-agent: Microsoft Copilot Allow: / # Omgili bots User-agent: Omgili Allow: / User-agent: Omgilibot Allow: / # Peer39 crawlers User-agent: Peer39_crawler Allow: / User-agent: Peer39_crawler/1.0 Allow: / # Perplexity bot User-agent: PerplexityBot Allow: / # You.com bot User-agent: YouBot Allow: / # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://viewtanks.co.za/sitemap_index.xml # --------------------------- # END YOAST BLOCK