How does nih.gov score?
How ready is nih.gov for AI answer engines? We rate its homepage the way ChatGPT, Claude and Perplexity crawlers see it — plus a 12-point SEO check.
#23 of 30 in Health, science & public sector · #782 of 932 overall on the AI Readiness Index
Which AI crawlers can read nih.gov?
nih.gov’s robots.txt doesn’t block any of the 10 AI crawlers we check. A firewall or bot filter can still turn crawlers away; robots.txt is only the polite half. It doesn’t publish an llms.txt, the plain-text guide some AI tools look for.
| Crawler | Used for | robots.txt |
|---|---|---|
| ChatGPT-UserChatGPT (live browsing) | AI search and answers | Allowed (no rule) |
| Claude-UserClaude (live browsing) | AI search and answers | Allowed (no rule) |
| OAI-SearchBotChatGPT Search | AI search and answers | Allowed (no rule) |
| Perplexity-UserPerplexity (live browsing) | AI search and answers | Allowed (no rule) |
| PerplexityBotPerplexity answers | AI search and answers | Allowed (no rule) |
| Applebot-ExtendedApple Intelligence | Model training | Allowed (no rule) |
| CCBotCommon Crawl corpus | Model training | Allowed (no rule) |
| ClaudeBotClaude (training) | Model training | Allowed (no rule) |
| Google-ExtendedGemini apps & Vertex AI | Model training | Allowed (no rule) |
| GPTBotChatGPT (training) | Model training | Allowed (no rule) |
Read from nih.gov’s public robots.txt on 2026-10-18. “Blocked” means a Disallow: / rule for that crawler. Check your own site →
How does your site compare?
Put your site head to head with nih.gov on AI readiness — free, about 10 seconds.
Improve a score like this
A homepage-only AI + SEO readiness check (no Core Web Vitals). Run the free scan for the full picture, including performance. Scored from the public homepage by AvocadoScoreBot — how we crawl. Want this scorecard removed? Email hello@avocadoscore.io.