# boothcheck robots policy.
#
# Answer engines and search crawlers are WELCOME to retrieve and index this site
# (that is how readers find and cite the research). AI model TRAINING is declined
# via the content signal below. Retrieval/grounding (search=yes) and training
# (ai-train=no) are independent: declining training costs no search visibility.
#
# IMPORTANT: this file is the source of truth ONLY when Cloudflare's "Block AI
# bots" / managed-robots.txt edge feature is OFF. While that feature is ON,
# Cloudflare overrides this file at the edge and Disallows the AI crawlers
# (Google-Extended, GPTBot, ClaudeBot, etc.) and 403s page fetches. To let
# answer engines open and cite the site, that edge feature must be turned off
# (or set to allow) in the Cloudflare dashboard. See the AEO/GEO remediation notes.

User-agent: *
Content-Signal: search=yes,ai-train=no
Allow: /

Sitemap: https://boothcheck.com/api/leaderboard?action=sitemap