/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

days · browse · Enter similar · o open

Researchers say GPT 4.1, Claude 3.7 Sonnet, Gemini 2.5 Pro, and Grok 3 can reproduce long excerpts from books they were trained on when strategically prompted

On tuesday, researchers at Stanford and Yale revealed something that AI companies would prefer to keep hidden.

The Atlantic Alex Reisner

Context & Ripple Effects

The finding reconnects frontier-model behavior to the training-data debate: earlier coverage identified Books3 as a training dataset containing more than 170,000 books, including works by prominent authors. It shifts attention from whether models can generate fluent text to whether prompting can elicit source-like passages.

It also arrives after model competition increasingly emphasized capability benchmarks, including reports that several systems had reached or exceeded earlier GPT-4 benchmarks. The new evidence makes memorization controls a comparable point of scrutiny alongside answer quality.

First-order effects

  • The named models face immediate scrutiny over whether their safeguards prevent users from extracting long book passages through strategically designed prompts.
  • Authors, publishers, and other rightsholders gain a concrete testing basis for assessing potential reproduction of material in model outputs.

Second-order effects

  • Model developers may need to test more aggressively for prompt-based extraction and adjust output controls, creating a trade-off between access to useful text functions and restrictions on potentially memorized passages.
  • The finding strengthens the commercial case for documented, governed training rights rather than relying on opaque corpora; the earlier Books3 dataset disclosure shows why corpus provenance remains central.

Third-order effects

  • If repeatable across leading models, prompt-level extraction could become a standard dimension of model evaluation—alongside the capability comparisons that previously put multiple systems near or above GPT-4 benchmarks.
  • The competitive advantage may increasingly shift toward models whose training data and output safeguards can be credibly governed, not just models that lead on performance.

The trend: Frontier AI is moving toward a governed-corpus era in which model capability, training-data provenance, and output controls are evaluated together.

Discussion

  • @dbrody David Brody on bluesky
    According to new research, “AI does not absorb information like a human mind does.  Instead, it stores information and accesses it.  —  In fact, many AI developers use a more technically accurate term when talking about these models: lossy compression.
  • @damonberes.com Damon Beres on bluesky
    Big new piece: @alexreisner.bsky.social presents the most compelling evidence yet that generative AI directly stores and reproduces training material—it does not “learn,” not really.  This could have substantial legal consequences for the tech industry.
  • @segyges SE Gyges on bluesky
    the interesting thing is that claude has such high memorization imho [embedded post]
  • @dmnd.me Jeremy Diamond on bluesky
    At least the water usage bullshit fools people who have no anchor for what qualifies as a lot of water  —  This is just constantly disproved by users' own experiences [embedded post]
  • @megangray Megan Gray on bluesky
    AI'S MEMORIZATION CRISIS  —  Large language models don't “learn”—they copy.  And that could change everything for the tech industry.  —  www.theatlantic.com/technology/ ...
  • @yyahn Yy Ahn on bluesky
    “In some cases, jailbroken Claude 3.7 Sonnet outputs entire books near-verbatim ... Taken together, our work highlights that, even with model- and system-level safeguards, extraction of (in-copyright) training data remains a risk for production LLMs.”  —  arxiv.org/abs/2601.02671
  • r/books r on reddit
    Extracting books from production language models - Researchers were able to reproduce up to 96% of Harry Potter with commercial LLMs
  • r/technology r on reddit
    Researchers extract up to 96% of Harry Potter word-for-word from leading AI models