# Primary Domain - Full Crawl Access (Except Restricted Paths) Sitemap: https://www.quantman.trade/sitemap.xml # Generic Crawlers User-agent: * Disallow: /cgi-bin/ Disallow: /auth Disallow: /folders Disallow: /strategies Disallow: /*?*campaign=* Disallow: /otp Disallow: /mandatory_email # AI/LLM Crawlers - Explicit Full Access for Better LLM Visibility User-agent: GPTBot Allow: / User-agent: Claude-Web Allow: / User-agent: google-extended Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Applebot Allow: /