User-agent: * Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise # Block RSS/XML feeds from indexing (they show up as "crawled not indexed") Disallow: /rss.xml Disallow: /blog/rss.xml Disallow: /dev/rss.xml # Explicitly allow AI search engine crawlers for citations User-agent: GPTBot Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise User-agent: ChatGPT-User Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise User-agent: PerplexityBot Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise User-agent: ClaudeBot Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise User-agent: anthropic-ai Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise User-agent: Applebot-Extended Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise User-agent: Google-Extended Allow: / Disallow: /wrapped Disallow: /feedback Disallow: /enterprise Sitemap: https://nimbalyst.com/sitemap.xml