# https://syncrostore.com/robots.txt User-agent: * Allow: / Disallow: /contact/thanks/ Disallow: /_to_delete/ # --------------------------------------------------------------------------- # Answer engines and AI crawlers are explicitly welcome. # # The rule above already permits them, but naming them matters: it records the # decision, and it stops a future blanket "Disallow" from quietly removing # Syncrostore from the systems buyers increasingly ask before they search. # # Note the two kinds. Search/answer crawlers (OAI-SearchBot, PerplexityBot, # ClaudeBot, Bingbot) fetch pages to answer questions and cite sources — those # are traffic. Google-Extended and Applebot-Extended control training-data use # only; they do not affect ranking either way. Both are allowed here. To opt # out of training while staying in answers, Disallow those two and leave the # rest alone. # --------------------------------------------------------------------------- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Bingbot Allow: / User-agent: meta-externalagent Allow: / User-agent: Amazonbot Allow: / User-agent: cohere-ai Allow: / User-agent: YouBot Allow: / Sitemap: https://syncrostore.com/sitemap.xml