# AI crawlers — explicit named entries for known indexers User-agent: GPTBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Google-Extended User-agent: CCBot User-agent: Applebot-Extended User-agent: cohere-ai Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /flows Disallow: /images Disallow: /settings # All other crawlers User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /flows Disallow: /images Disallow: /settings Sitemap: https://stackbilder.com/sitemap.xml Schemamap: https://stackbilder.com/schemamap.xml