How AI's post-training process suppresses the creativity and whimsicality seen in earlier models, like GPT-2, leading to poor writing from many top AI models
Why can't language models write well? — In a certain, strange way, generative AI peaked with OpenAI's GPT-2 seven years ago.
The Atlantic Jasmine Sun
Related Coverage
- Daniel Biss Wins in Illinois Despite Student Dating Scandal Reason · Elizabeth Nolan Brown
Discussion
-
@noahpinion
Noah Smith
on x
I actually believe an AI could be trained to write just like me. But it's not clear why anyone would want to.
-
@shallowbrigade
Kim O'Connor
on x
I'd be so interested to know who wrote the “personalized” edits that this writer fed to the chatbot. Because it sure sounds like she input the labor of her past human editors...?
-
@stefanfschubert
Stefan Schubert
on x
This is exaggerated, imo. Opus is decent at writing, even though its judgement is in some ways imperfect. [image]
-
@nxthompson
@nxthompson
on x
This is a cool example of how you can use AI to help your writing—without relying on it for any actual writing. From @jasminewsun https://www.theatlantic.com/ ... [image]
-
@akoustov
Alexander Kustov
on x
Always a great read from @jasminewsun. I agree that AI is still a better editor than a writer. But as someone whose most successful post was written by AI, I have to push back on the idea that “LLMs may never be capable of great writing themselves.” I think they already are.
-
@cardiffgarcia
Cardiff Garcia
on x
@ModeledBehavior Today's piece in the Atlantic from @jasminewsun is about this question: https://www.theatlantic.com/ ... [image]
-
@kshartnett
Kevin Hartnett
on x
As recently as a few years ago, my impression is, knowledgeable people thought AI would be better at writing than coding. Obviously hasn't turned out that way. I think it all comes down to surprise. Great writing constantly surprises you. Within a single sentence it takes turns
-
@jasminewsun
Jasmine Sun
on x
I am generally quite bullish on AI capabilities, so this piece was as much about LLM training as it is about the ineffable, unpredictable qualities that make good writing good [image]
-
@jamesjyu
James Yu
on x
was fun to chat with @jasminewsun as part of this piece - it's still day 0 when it comes to creative writing LLMs
-
@thomashobohm
Thomas
on x
stupid and bad
-
@_alice_evans
Alice Evans
on x
“Modern LLMs are built in a way that is antagonistic to great writing; they are engineered to be rule-following teacher's pets that always have the right answer in hand.” The brilliant @jasminewsun has written a compelling diagnosis of why LLM writing is so tight-lipped:
-
@imurtazashvili
Ilia Murtazashvili
on x
I would say that if AI cannot write well, then the overwhelming majority of students and faculty cannot write well.
-
@jasminewsun
Jasmine Sun
on x
somehow the same AIs that can do PhD-level math and superhuman coding can only write as well as “a real poet's okay poem” (sama's words, not mine!) I talked to the people training AIs to write about what makes it so hard: new from me for @TheAtlantic: https://www.theatlantic.com/…
-
@nikkimcr
Nikki Mccann Ramírez
on x
“'I do not want to be de-skilled,' I remind the machine” is perhaps the bleakest sentence I have read this year
-
@damonberes.com
Damon Beres
on bluesky
“Sam Altman has predicted that large language models will soon be capable of 'fixing the climate, establishing a space colony, and the discovery of all of physics” — but, “might be able to extrude only something equivalent to 'a real poet's okay poem'” @jasmine.bsky.social on wha…
-
@frankpasquale
Frank Pasquale
on bluesky
“Chatbots produce meaningless metaphors, endless 'it's not this, but that' constructions, and a cloyingly sycophantic tone” — www.theatlantic.com/technology/ 2...