Dev Tools · 15h ago
AI Readiness Audit: Major Sites Score Low on Crawler Access
A new audit scoring websites on AI readiness found that many fail basic checks like llms.txt files and AI crawler permissions. The Irish Times scored 33/100, blocking GPTBot and lacking an llms.txt file. WordPress.org scored 88, while Stripe and Anthropic docs scored 75 and 85 respectively.
Meridian48 take
The audit highlights a growing gap between marketing hype around AI visibility and the technical groundwork needed to actually be found by AI assistants.
Read the full reporting
We scored major websites on AI readiness. A national newspaper got 33/100. →
DEV Community
ai-readinessllms-txt