User-agent: * Allow: / # AI search bots — allow crawling and citation User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / # Common Crawl (AI training dataset) — allow; site policy is ai-train=yes User-agent: CCBot Allow: / Sitemap: https://idolinfohub.com/sitemap.xml Content-Signal: ai-train=yes, search=yes, ai-input=yes