# ---------- AI crawler access (explicit allows) ---------- User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / User-agent: Applebot Allow: / # ---------- Image crawler (keep fully allowed) ---------- User-agent: Googlebot-Image Disallow: # ---------- Default rules (unchanged from your file) ---------- User-agent: * Disallow: /helpfile/ Disallow: /help/ Disallow: /ads/ Disallow: /partner/ Disallow: /com/ Disallow: /register/ Disallow: /pubfiles/ Disallow: /test/ Disallow: /admin/ Disallow: /download/interim/ Disallow: /cgi-bin/ Disallow: /HelpFile_old/ # ---------- Sitemaps ---------- Sitemap: https://www.quotewerks.com/dynamicsitemap.asp?format=xml Sitemap: https://blog.quotewerks.com/sitemap.xml Sitemap: https://info.quotewerks.com/sitemap.xml Sitemap: https://web.quotewerks.com/sitemap.xml # ---------- AI Structured Data Feeds ---------- # These feeds contain product, integration, and software metadata for AI indexing. Sitemap: https://www.quotewerks.com/ai-feed.json Sitemap: https://www.quotewerks.com/integrations.json