Cloudflare debuts “Pay per Crawl”, a marketplace that lets sites charge AI crawlers per crawl; new sites using Cloudflare will now block AI crawlers by default
Cloudflare, a cloud infrastructure provider that serves 20% of the web, announced Tuesday the launch of a new marketplace …
TechCrunch Maxwell Zeff
Related Coverage
- Introducing pay per crawl: enabling content owners to charge AI crawlers for access Cloudflare · Will Allen
- Cloudflare Introduces Default Blocking of A.I. Data Scrapers New York Times · Natallie Rocha
- Cloudflare will now block AI crawlers by default The Verge · Emma Roth
- Pay up or stop scraping: Cloudflare program charges bots for each crawl Ars Technica · Ashley Belanger
- Content Independence Day: no AI crawl without compensation! Cloudflare · Matthew Prince
- Cloudflare Is Blocking AI Crawlers by Default Wired · Kate Knibbs
- Cloudflare experiment will block AI bot scrapers unless they pay a fee Engadget · Mariella Moon
- Millions of websites to get ‘game-changing’ AI bot blocker BBC · Chris Vallance
- Cloudflare says AI companies have been “scraping content without limits” - now it's letting website owners block crawlers and force them to pay ITPro · Ross Kelly
- Cloudflare to block AI crawlers by default, introduces ‘Pay Per Crawl’ for publishers Moneycontrol
- Cloudflare Now Blocks AI Web Scraping by Default Infosecurity · Alessandro Mascellino
- Cloudflare launches tool to help publishers charge AI firms for content use Proactive · Ian Lyall
- Web giant Cloudflare to block AI bots from scraping content by default CNBC · Ryan Browne
- Cloudflare to block AI crawler bots by default UPI · Andrew Sookdeo
- Cloudflare Targets Media Firms, Content Creators Amid AI Boom Investor's Business Daily · Reinhardt Krause
- Web giant Cloudflare bans AI bots from scraping content by default Cryptopolitan · Florence Muchai
- CloudFlare To The AI Industry: Pay Up! John Battelle's Search Blog · John Battelle
- Cloudflare To Block AI Crawlers By Default & Pay Per Crawl Model Search Engine Roundtable · Barry Schwartz
- Cloudflare Introduces a Pay-to-Scrape Beta Program for Web Publishers MacStories · John Voorhees
- Why ‘do not scrape’ policies matter more than you think Digital Content Next
- Control content use for AI training with Cloudflare's managed robots.txt and blocking for monetized content Cloudflare · Jin-Hee Lee
- Major UK and US publishers join forces to block AI scrapers Press Gazette · Charlotte Tobitt
- Cloudflare will now block AI web scrapers that don't pay for data Notebookcheck · Rohith Bhaskar
- Cloudflare to block AI bot crawlers by default and let websites demand payment for access Business Insider · Alistair Barr
- Cloudflare Just Changed How AI Crawlers Scrape the Internet-at-Large; Permission-Based Approach Makes Way for A New Business Model Business Wire
- Cloudflare launches tool to help website owners monetise AI bot crawler access Reuters
- Cloudflare offers to make AI pay to crawl websites Computerworld · Lynn Greiner
- Cloudflare will now, by default, block AI bots from crawling its clients' websites MIT Technology Review · Peter Hall
- Publishers, website owners to block AI ‘crawlers’ that don't pay Australian Financial Review · Paul Smith
- Time will tell how this shakes out...... https://blog.cloudflare.com/ ... @arch@floofy.tech
- Cloudflare is launching a new feature for websites it hosts to charge AI chatbots for crawling called Pay per Crawl. This goes along with a change to block AI crawlers by default on new websites. — The current model is unsustainable and I expect the best content on the web to eventually be paywalled for both humans and bots outside of a few large scale ad supported services. … @carnage4life@mas.to · Dare Obasanjo
- Happy to see TIME join this initiative with Cloudflare to protect journalism. — “Mark Howard, the chief operating officer of TIME, said he welcomed Cloudflare's move. … Sam Jacobs
- For everyone in the publishing space and content creation, look no further. — Cloudflare is changing the way the internet works. … Björn Rudling
Discussion
-
@reckless
Nilay Patel
on bluesky
Big move here - AI firms are all facing down an existential content theft reckoning and still haven't explained what applications will generate enough value to make it worth it www.theverge.com/news/695501/ ...
-
@mergesort.me
Joe Fabisevich
on bluesky
Really hoping for the sake of @plinky.app that this new opt-into scraping default doesn't mean small well-intentioned scrapers like mine don't suddenly stop working. 😬
-
@brandrick
Chris Brandrick
on bluesky
This sorta thing felt like an inevitability — interesting to see someone actually have a go at it. Be curious to see how it plays out. [embedded post]
-
@iaaa.org
@iaaa.org
on bluesky
arstechnica.com/tech-policy/ ... In a blog Tuesday, Cloudflare explained that its “pay-per-crawl” feature is currently in a private beta. A small number of publishers and content creators will participate in the experiment.
-
@cloudflare.social
@cloudflare.social
on bluesky
Pay per crawl is a new feature to allow content creators to charge AI crawlers for access to their content. blog.cloudflare.com/introducing- ...
-
@michaelweinberg.org
Michael Weinberg
on bluesky
I really do not like this “a small number of entities get to monetize being scraped on the open internet” approach to AI training data conflicts — arstechnica.com/tech-policy/ ...
-
@nixCraft@mastodon.social
@nixCraft@mastodon.social
on mastodon
Cloudflare introduces pay-per-crawl for AI bots https://blog.cloudflare.com/ ... We don't need another technical solution to this madness. We need legislation that blocks all batshit crazy AI companies like OpenAI, Microsoft, Google, and others from stealing from artists & writ…
-
@mer__edith
Meredith Whittaker
on x
How to be classy, how to be cute, how to actually walk the walk... Love you for this @Cloudflare ❤️ https://www.nytimes.com/...