/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

days · browse · Enter similar · o open

How AI's post-training process suppresses the creativity and whimsicality seen in earlier models, like GPT-2, leading to poor writing from many top AI models

Why can't language models write well?  —  In a certain, strange way, generative AI peaked with OpenAI's GPT-2 seven years ago.

The Atlantic Jasmine Sun

Discussion

  • @noahpinion Noah Smith on x
    I actually believe an AI could be trained to write just like me. But it's not clear why anyone would want to.
  • @shallowbrigade Kim O'Connor on x
    I'd be so interested to know who wrote the “personalized” edits that this writer fed to the chatbot. Because it sure sounds like she input the labor of her past human editors...?
  • @stefanfschubert Stefan Schubert on x
    This is exaggerated, imo. Opus is decent at writing, even though its judgement is in some ways imperfect. [image]
  • @nxthompson @nxthompson on x
    This is a cool example of how you can use AI to help your writing—without relying on it for any actual writing. From @jasminewsun https://www.theatlantic.com/ ... [image]
  • @akoustov Alexander Kustov on x
    Always a great read from @jasminewsun. I agree that AI is still a better editor than a writer. But as someone whose most successful post was written by AI, I have to push back on the idea that “LLMs may never be capable of great writing themselves.” I think they already are.
  • @cardiffgarcia Cardiff Garcia on x
    @ModeledBehavior Today's piece in the Atlantic from @jasminewsun is about this question: https://www.theatlantic.com/ ... [image]
  • @kshartnett Kevin Hartnett on x
    As recently as a few years ago, my impression is, knowledgeable people thought AI would be better at writing than coding. Obviously hasn't turned out that way. I think it all comes down to surprise. Great writing constantly surprises you. Within a single sentence it takes turns
  • @jasminewsun Jasmine Sun on x
    I am generally quite bullish on AI capabilities, so this piece was as much about LLM training as it is about the ineffable, unpredictable qualities that make good writing good [image]
  • @jamesjyu James Yu on x
    was fun to chat with @jasminewsun as part of this piece - it's still day 0 when it comes to creative writing LLMs
  • @thomashobohm Thomas on x
    stupid and bad
  • @_alice_evans Alice Evans on x
    “Modern LLMs are built in a way that is antagonistic to great writing; they are engineered to be rule-following teacher's pets that always have the right answer in hand.” The brilliant @jasminewsun has written a compelling diagnosis of why LLM writing is so tight-lipped:
  • @imurtazashvili Ilia Murtazashvili on x
    I would say that if AI cannot write well, then the overwhelming majority of students and faculty cannot write well.
  • @jasminewsun Jasmine Sun on x
    somehow the same AIs that can do PhD-level math and superhuman coding can only write as well as “a real poet's okay poem” (sama's words, not mine!) I talked to the people training AIs to write about what makes it so hard: new from me for @TheAtlantic: https://www.theatlantic.com/…
  • @nikkimcr Nikki Mccann Ramírez on x
    “'I do not want to be de-skilled,' I remind the machine” is perhaps the bleakest sentence I have read this year
  • @damonberes.com Damon Beres on bluesky
    “Sam Altman has predicted that large language models will soon be capable of 'fixing the climate, establishing a space colony, and the discovery of all of physics” — but, “might be able to extrude only something equivalent to 'a real poet's okay poem'” @jasmine.bsky.social on wha…
  • @frankpasquale Frank Pasquale on bluesky
    “Chatbots produce meaningless metaphors, endless 'it's not this, but that' constructions, and a cloyingly sycophantic tone”  —  www.theatlantic.com/technology/ 2...