# Default / Global Rules User-agent: * Allow: /llms.txt Allow: /.well-known/ard.json Allow: /*.md$ # Search and AI Search Indexers (Citations & Answers) User-agent: Googlebot User-agent: bingbot User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: meta-webindexer User-agent: Applebot Allow: / # User-Initiated Fetchers (Live Assistant Browsing) User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User User-agent: meta-externalfetcher User-agent: facebookexternalhit Allow: / # Model Training Crawlers User-agent: GPTBot User-agent: ClaudeBot User-agent: meta-externalagent User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Diffbot Allow: / # Sitemaps & Context Sitemap: https://www.maxwellthomason.com/sitemap.xml Sitemap: https://feeds.stacktxt.com/maxwellthomason.com/llms.txt