AvocadoScoreBot

Why we visit

AvocadoScore is a free website audit: performance, SEO and how ready a site is for AI answer engines like ChatGPT, Claude and Perplexity. There are two reasons our bot requests your pages:

• Someone asked us to. A person ran the audit tool on your URL. That is a one-off scan on their behalf, made when they ask for it.
• The AI Readiness leaderboards. We publish a public leaderboard of about a thousand well-known sites, ranked by how readable they are to AI crawlers. Each listed site’s public homepage is re-checked roughly once a week.

What it requests

A handful of ordinary GET/HEAD requests per check — never a crawl of your whole site:

• your homepage, and one extra homepage request that identifies as an AI crawler, to see whether AI bots get a different page than browsers do;
• /robots.txt, /llms.txt, /llms-full.txt and /sitemap.xml;
• one deliberately nonexistent URL, to check that your 404 behaves well for agents.

We run a few sites at a time and each site sees roughly ten requests per check. We don’t log in, submit forms, run scripts against your pages, or follow links around your site.

What we keep

For the leaderboards we store scores and a pass/warn/fail result for each check, plus which AI crawlers your robots.txt allows or blocks. We do not store your page content.

Opting out

• robots.txt. Add this and our scheduled leaderboard crawl stops requesting your site and removes any data we hold for it:

  User-agent: AvocadoScoreBot
  Disallow: /

  A blanket User-agent: * + Disallow: / is honored the same way.
• Email. Write to hello@avocadoscore.io with your domain and we’ll take it off the leaderboards.