/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

days · browse · Enter similar · o open

The UK CMA proposes measures to let publishers opt out of content scraping for Google's AI Overviews and AI training without losing visibility in search results

News organisations hope proposals will increase leverage to get paid if content is used in AI summaries

The Guardian Robert Booth

Context & Ripple Effects

Google had already separated AI-training access from ordinary Search indexing through a robots.txt-based training opt-out, but publishers argued that AI Overviews created a new trade-off between protecting content and retaining search distribution.

The CMA proposal follows the Independent Publishers Alliance's complaint alleging misuse of web content in AI Overviews. It shifts the issue from a publisher-by-publisher technical setting toward a competition remedy over whether Google can bundle AI use with search visibility.

First-order effects

  • UK publishers would gain a proposed ability to withhold content from AI Overviews and AI training without automatically sacrificing their presence in Google Search, improving their negotiating position over AI use.
  • Google would need to develop more granular publisher controls; it said it was exploring opt-out controls for AI Overviews and AI Mode.

Second-order effects

  • Publishers can make a clearer commercial choice: permit AI use in exchange for terms they consider adequate, or preserve search referral access while declining it. That makes payment discussions more credible.
  • Google's AI-search product may face a less uniform content supply if publishers adopt different permissions, increasing the importance of reliably applying site-level preferences.

Third-order effects

  • If implemented and replicated, AI-search distribution could move away from a single crawl-and-index permission toward separable rights for indexing, AI answers, and model training.
  • The proposal tests whether competition remedies can rebalance publisher leverage without requiring AI-search providers to pay by default; its practical impact will depend on how usable the controls are and how publishers exercise them.

The trend: AI search is turning publisher permission from a technical crawling setting into a commercial and competition-policy question about control over downstream AI use.

Discussion

  • @jeffjarvis @jeffjarvis on bluesky
    Media hide heads in sand and hope someone will come looking for them.  —  UK media groups should be allowed to opt out of Google AI Overviews, CMA says  —  www.theguardian.com/media/2026/ j...