# Robots.txt for Synapse MCP (https://synapse-mcp.dev) # Configured for standard search crawlers & AI model retrieval agents User-agent: * Allow: / # Explicit AI Training & Retrieval Agents Allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Bytespider Allow: / User-agent: Amazonbot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Cohere-ai Allow: / User-agent: CCBot Allow: / # Sitemap & LLM Specification Entry Points Sitemap: https://synapse-mcp.dev/sitemap.xml Link: https://synapse-mcp.dev/llms.txt Link: https://synapse-mcp.dev/llms-full.txt # RSS/Atom Feed Feed: https://synapse-mcp.dev/blog/feed.xml