# robots.txt for 1ClickReport
# Allow all crawlers to index the site.
#
# Crawl-delay was removed on 2026-08-27. It asked every crawler to pause a
# second between requests, which on 200+ pages meaningfully slows re-crawling.
# Freshness is a weighted ranking factor on all four AI answer surfaces
# (measured: AI-cited content runs ~25.7% fresher than organic top-10), so
# slowing the crawl costs us more than the server load it was saving. The host
# is nowhere near capacity.
#
# The Sitemap directive below is not decoration: it is how BraveBot discovers
# our sitemap, and Brave's index is what Claude's web search reads from
# (~86.7% citation overlap). Claude is currently our single largest signup
# source, so this line is load-bearing. Do not remove it.

User-agent: *
Allow: /

Sitemap: https://www.1clickreport.com/sitemap.xml

# Disallow specific paths (if any)
# Uncomment and add paths you don't want indexed
# Disallow: /api/
# Disallow: /admin/