# Default Flywheel robots file User-agent: * Disallow: /calendar/action* Disallow: /events/action* Allow: /*.css Allow: /*.js Disallow: /*? Crawl-delay: 3 # ============================= # SITEMAPS # ============================= Sitemap: https://scphotel.com/sitemap.xml Sitemap: https://scphotel.com/laguna/sitemap.xml Sitemap: https://scphotel.com/seven4one/sitemap.xml Sitemap: https://scphotel.com/mendocino-coast/sitemap.xml Sitemap: https://scphotel.com/mendocino/sitemap.xml Sitemap: https://scphotel.com/colorado-springs/sitemap.xml Sitemap: https://scphotel.com/hilo/sitemap.xml Sitemap: https://scphotel.com/depoe-bay/sitemap.xml Sitemap: https://scphotel.com/redmond/sitemap.xml Sitemap: https://scphotel.com/corcovado/sitemap.xml # ============================= # AI & LLM CRAWLER POLICIES # ============================= # OpenAI (GPTBot) User-agent: GPTBot Disallow: / # Anthropic (ClaudeBot) User-agent: ClaudeBot Disallow: / # Perplexity User-agent: PerplexityBot Disallow: / # Common Crawl (feeds many AI datasets) User-agent: CCBot Disallow: / # Google AI / Google-Extended (training toggle) User-agent: Google-Extended Disallow: / # Friendly summary-oriented bots (adjust as desired) User-agent: ChatGPT-User Disallow: /