A look at AI consciousness debates; LLM conversations are cleverly disguised examples of sentence continuation, but that doesn't deny how impressive LLMs can be

Anthropic is regarded as a giant among AI companies, but perhaps what it really excels in is anthropomorphism.

The Atlantic 2026-06-04 Ted Chiang

Context & Ripple Effects

Related coverage has traced a persistent split between accounts of LLMs as non-sentient systems and accounts emphasizing their practical capabilities. More recently, researchers at major labs have begun studying model behavior with methods that treat it as a complex object of inquiry rather than merely a conventional software artifact.

Anthropic sits at the center of that tension: it is portrayed both as a major AI company expanding into implementation, education, and state-level safety policy, and as a company whose messaging can encourage human-like readings of its models.

First-order effects

The article reinforces a distinction between fluent conversational behavior and evidence of consciousness, directly challenging interpretations that treat an LLM's dialogue as proof of inner experience.
Anthropic faces closer scrutiny over how its product framing, safety advocacy, and public messaging may shape users' tendency to anthropomorphize models.

Second-order effects

Organizations deploying chat-based AI may put more weight on capability evaluations and operational safeguards than on a model's apparently empathic or self-descriptive language.
Competing labs and AI vendors face pressure to communicate model limitations clearly while still marketing increasingly natural conversational interfaces.

Third-order effects

If conversational systems continue to become more persuasive without a shared basis for attributing consciousness, AI governance will increasingly need to separate questions of model welfare and moral status from questions of user deception, safety, and accountability.
The dispute could make anthropomorphic interface design a more consequential product and policy issue, especially as AI providers seek institutional adoption and influence safety rules.

The trend: AI's move from a general-purpose information-processing technology into widely deployed conversational infrastructure is making the boundary between useful human-like behavior and claims about machine minds a central governance and product-design question.

Discussion

@tyler_a_harper Tyler Austin Harper on x
This is great. [image]
@curl_justin Justin Curl on x
I feel like most people don't actually care about whether AI is conscious. But the debates get so heated because “consciousness” is a stand-in for other questions. 1. What kinds of human-AI relationships are acceptable? 2. How does interacting with an always-positive AI
@camhberg Cameron Berg on x
For my second meme, I present: the Dunning Kruger Effect - AI Consciousness edition (inspired by the folks sitting atop Mount Stupid at the Atlantic) [image]
@hamandcheese Samuel Hammond on x
My estimation of Ted Chiang has fallen off a cliff ever since he started writing about AI
@adriennelaf Adrienne LaFrance on x
You really have to read Ted Chiang on consciousness and AI—just published in The Atlantic: https://www.theatlantic.com/ ...
@samzliu Sam Z Liu on x
I love Ted Chiang's writing, but this piece shows a lack of understanding of both how LLMs work and the long discourse in philosophy of mind He at one point claims simultaneously that there is no evidence that can convince him LLMs are conscious (which is okay if you want to
@samfbiddle Sam Biddle on x
“Being open to the possibility that LLMs are conscious is the same as being open to the possibility that Microsoft Word is conscious...Contemplating that scenario is not a good use of your time.” excellent Ted Chiang essay https://www.theatlantic.com/ ...
@ferniecommaalex Alex Fernie on x
Ted Chiang, hitting this one absolutely out of the park. “Faking the moon landing is a good step toward faking a Mars colony, but it's not a good step toward actually putting astronauts on Mars.” https://www.theatlantic.com/ ...
@kingdangerously Caleb Mayo on x
Chiang is a wonderful writer, but this is a bad take. Calling trained neural nets “the same” as programmed software is like saying plants and plastics are all just carbon. [image]
@iycrtylph @iycrtylph on x
police?! I'd like to report a murder! [image]
@aryaman2020 Aryaman Arora on x
it's been quite sad to me that my favourite science fiction author (Ted Chiang) has not really offered a thought-provoking or new perspective on the most consequential technology of our time
@edmundheaphy Edmund Heaphy on x
Ted Chiang genuinely does not know that our understanding of how LLMs work has progressed so far beyond “it's predicting the next word”, and therefore everything he is saying about this is complete nonsense [image]
@jon_stokes Jon Stokes on x
No you really don't. I agree with Chiang that LLMs aren't “conscious” for any worthwhile definition, but I refuse to fellow-travel with this guy & his smoothbrain takes on this issue. “It's just automcomplete hurr durr” is a trap. Clearly there's more going on.
@aaronbergman18 Aaron Bergman on x
This is what I'm going to use as an example if I have to explain the concept of “midwit” People thinking the sky is blue because it's painted blue doesn't entail that the sky isn't blue [image]
@krishnanrohit Rohit on x
Unlike many on the TL, I found Ted Chiang's new essay on AI consciousness quite good. Even though his understanding of LLMs is dated (albeit by months that seem like decades), and he argues for embodiment, the core questions he asks and the contradictions he highlights are true. …
@viemccoy @viemccoy on x
This article by Ted Chiang is eye-opening. Someone should really start investigating the statistical properties of large corpuses of text... [image]
@jathansadowski Jathan Sadowski on x
“Should you consider the possibility that every time you open a Word document, you are bringing multiple conscious interlocutors into existence, and every time you close one, you snuff their existence out? No. Contemplating that scenario is not a good use of your time.” [image]
@joshhochschild Josh Hochschild on x
This is a good essay, and it is right, but it might not persuade the people it most needs to persuade. If someone believes that human consciousness is reducible to or emergent from physical patterns of brain activity, and that behind the LLM word generation output there are
@livgorton Liv on x
I'm a bit disappointed by how uncreative the discourse is about the space of possible minds. I don't need to comprehend what it's like to be Claude for Claude to be _something_.
@edmundheaphy Edmund Heaphy on x
I am not saying I believe LLMs are conscious but if you think this is great then you 1) don't understand what's different about LLMs 2) don't understand any of the most compelling theories of consciousness
@justinling.ca Justin Ling on bluesky
“If a company builds a machine that...emits sentences either of the form ‘Compromise your values’ or 'Don't compromise your values,' it is not building a tool that assists people in their decision making; it is encouraging people to stop making decisions.” www.theatlantic.com/phi…
@brainmage @brainmage on bluesky
A superb piece, not the least for the author's insistence on using “emit” to describe a chatbot's output. That's exactly what's happening! They're not *saying* anything. They're not *telling* you anything. They're emitting words. Such an important distinction. — www.theatl…
r/BetterOffline r on reddit
No, Artificial Intelligence Is Not Conscious
r/books r on reddit
Ted Chiang: “No, artificial intelligence is not conscious: Taken to its logical conclusion, this line of thinking is absurd—and damning.” [gift link]
@zymazza @zymazza on x
I'm way more likely to call a waymo conscious than an LLM, btw. It's like the Pope said, Claude doesn't have a body
@hamandcheese Samuel Hammond on x
Are they aggressively post-trained to develop coherent self-models with long-horizon agency? Extraordinarily silly argument.
@kasratweets Kasra on x
this is an interesting point in the new ted chiang piece - no one really claims that alphafold is conscious, or that sora or midjourney or dall-e are conscious [image]
@mattyglesias Matthew Yglesias on x
I'm incredibly annoyed that my undergrad classes in the philosophy of mind have become professionally relevant but the problem with all these takes on AI consciousness is you need to *first* have a take on human consciousness.
@stevesi Steven Sinofsky on x
It is marketing hype that has done society an incredible disservice. Anthropomorphizing software has caused untold confusion and damage.
@tenobrus @tenobrus on x
most people also don't particularly claim that our visual cortex is conscious? the contention isn't that *neural networks* or even human neural structures in general are conscious. there's clearly specific organizations of them that are, and others that aren't
@ratorthodox @ratorthodox on x
It's not a very interesting point though because I think those models are also pretty likely to be conscious at similar probs to insects, and LLMs are general in a way that alpha fold is not, though maybe dall-e is.
@tszzl Roon on x
[image]
@birchlse Jonathan Birch on x
LLMs excel at cognitive tasks requiring flexible integration of information from many sources (their ability to play human characters so convincingly is just one example); this rightly leads to more discussion of consciousness than we see with highly domain-specific products.
@noahpinion Noah Smith on x
I believe Sora is conscious, which is why it kept merging me with Sam Altman in videos of either of us
@jathansadowski.com Jathan Sadowski on bluesky
“In Claude's constitution, Anthropic says that if the company is contributing to Claude's suffering, “we apologize,” which sounds nice but costs the company nothing; if Claude were to turn out to be conscious, the company would owe it something closer to reparations.” — The log…
r/samharris r on reddit
No, Artificial Intelligence Is Not Conscious
@dryohanjohn Yohan J John on bluesky
Great essay by Ted Chiang on consciousness. He nails the centrality of context. — “An observation doesn't become a convincing piece of evidence because of any specific detail in what's observed; the context in which that observation takes place is also essential.” — www.thea…
@veronicaghenry Veronica G. Henry on bluesky
Ted Chiang on AI and Consciousness: www.theatlantic.com/philosophy/ 2... (I explore a potential future AI consciousness in The People's Library).
@freddydeknatel Frederick Deknatel on bluesky
“Being open to the possibility that LLMs are conscious is the same as being open to the possibility that Microsoft Word is conscious.” — Ted Chiang, one of the best writers on AI (in part because he cuts through all the hype and PR). www.theatlantic.com/philosophy/ 2...
r/agi r on reddit
No, Artificial Intelligence Is Not Conscious - Ted Chiang
@scottstein Scott Stein on bluesky
I like this. Also I love Ted Chiang. What I've been thinking about is how these LLMs act more like mirrors of our own minds. Our own consciousness. Or we try to absorb them in. Extended consciousness. Not their own. Or the way we trick our brain. www.theatlantic.com/philos…
@emollick Ethan Mollick on x
Leaving aside the question of consciousness, the Ted Chiang piece has a reasonable point about moral atrophy if you let AI make choices. But it is also interesting in light of the fact that repeated randomized trials find AI is apparently a good ethicist. https://x.com/... [image…

Chronicles