# Robots.txt for California Cannabis Supply Chain Intelligence # Compatible with Cloudflare AI Crawl Control & AI Indexing Standards User-agent: * Allow: / Allow: /api/ Allow: /llms.txt Allow: /llms-full.txt Allow: /index.md Allow: /openapi.json # AI Bots & Crawlers (Explicitly permitted for research and retrieval) User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Omgilibot Allow: / # Direct links to machine-readable documentation Sitemap: https://cannabis-supply-chain.pages.dev/sitemap.xml LLMs-Txt: https://cannabis-supply-chain.pages.dev/llms.txt LLMs-Full-Txt: https://cannabis-supply-chain.pages.dev/llms-full.txt