User-agent: * Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings # AI Search Crawlers - Explicitly Allowed User-agent: GPTBot Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: OAI-SearchBot Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: ChatGPT-User Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: Google-Extended Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: PerplexityBot Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: ClaudeBot Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: Applebot-Extended Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: cohere-ai Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings User-agent: Bytespider Allow: / Disallow: /favorites Disallow: /profile Disallow: /settings Disallow: /e-alerts Disallow: /unsubscribe Disallow: /communication-preferences Disallow: /api/listings Sitemap: https://www.mandygoldteam.com/sitemap.xml Sitemap: https://www.mandygoldteam.com/blogs-sitemap.xml