Policy · 2h ago
Cloudflare to Block AI Crawlers That Scrape Ad-Supported Content
Cloudflare will block web crawlers that combine search, AI agent activity, and model training from ad-supported pages. This move could force AI companies to pay publishers for using their content. The policy aims to protect publishers' revenue from unauthorized scraping.
Meridian48 take
Cloudflare's move is a pragmatic step, but enforcement and compliance remain unclear, and it may not fully address the broader debate over fair compensation for training data.
Read the full reporting
AI Companies Could Soon Have to Pay Publishers for Using Their Content →
ProPakistani
cloudflareai-crawlers