/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

← β†’ days Β· ↑ ↓ browse Β· Enter similar Β· o open

LLMs aren't sentient; they lack the physiological states required for sensations like hunger and pain, and thus can't have subjective experiences of such states

Artificial general intelligence (AGI) is the term used to describe an artificial agent that is at least as intelligent as a human … Bluesky: @motomatters.bsky.social and @zitron.bsky.social X: @vsikka , @eshear , @landay , @mattrosoff , @oshanjarow , @dioscuri , @idavidrein , @ericlandgrebe , @jonasmtzgr , @hamandcheese , @drfeifei , @dioscuri , @sean_a_mcclure , @eshear , @psychosort , @ylecun , @mealreplacer , and @chrszegedy . LinkedIn: Ross Dawson Bluesky: David Emmett / @motomatters.bsky.social : This is a fantastic piece on why Large Language Models are not in any way, shape, or form, sentient.Β  And this is also why they are the wrong direction if you were really interested in building actual Artificial General Intelligence [embedded post] Ed Zitron / @zitron.bsky.social : Yeah there's no way that generative AI gets us to approaching AGI.Β  They are not building it and it is not what's coming out of ChatGPT or anything related to ChatGPT [embedded post] X: Vishal Sikka / @vsikka : A wonderful writeup in @time by John Etchemendy, a great teacher of my life, and my friend @drfeifei both co-directors of @StanfordHAI on the non-sentience of LLMs. https://time.com/... Emmett Shear / @eshear : In colloquial language of course this might be seen as the same thing, but if you expect to write about these things as an intellectual you need to be more precise or I just can't take you seriously. The article doesn't even start to grapple with the real questions. James Landay / @landay : Yes, LLMs are not sentient. Amazing that people need this explained to them... Matt Rosoff / @mattrosoff : Nobody thinks they are. @oshanjarow : As the article briefly alludes to β€” asking whether a particular version of AI is conscious distracts from the real question. The more interesting β€” & actually unsettled/ debated by relevant experts β€” question is whether consciousness is possible in non-biological substrates. [image] Henry Shevlin / @dioscuri : I disagree with claims that we *know* LLMs aren't conscious. Fairly unlikely, perhaps, but not inconceivable that the functional dynamics constitutive of subjectivity could be realised in large Transformers. Not enough scientific consensus about consciousness to rule it out. David Rein / @idavidrein : @drfeifei ... there are so, so many things wrong with this article. β€œOne of the essential characteristics of general intelligence is β€˜sentience’” False! We're confident that animals without human reasoning capabilities are sentient, and it's perfectly coherent to consider intelligent Eric Landgrebe / @ericlandgrebe : I like this view a lot. I think it's also relevant for more broad questions in alignment around where the agency in ML models is. It especially becomes tricky due to conditional generation, where the behavior depends heavily on the prompt itself. Jonas Metzger / @jonasmtzgr : @drfeifei ... your argument boils down to β€œAI doesn't have a body and hallucinates statements about experiences it cannot possibly have, therefore it can't be sentient”. But how do we know these are dealbreakers? You say yourself that we don't know how sentience emerges. Except in one way, Samuel Hammond / @hamandcheese : This is a bad argument imo. Humans have physiological signals of pain, hunger, etc., but the conscious states are all processes in the brain. Hence phantom limb syndrome, dreaming, or the ability to induce tastes and smells from neural stimulation. The truth is that we simply [image] Fei-Fei Li / @drfeifei : Is AI sentient? My friend and colleague Prof. John Etchemendy, a renowned professor and co-Director of @StanfordHAI , just co-authored this piece to debunk the claim that today's LLMs are sentient @TIME https://time.com/... Henry Shevlin / @dioscuri : @mealreplacer β€œAll sensations... are the result of physiological states that an LLM simply doesn't have. Consequently we know that an LLM cannot have subjective experiences of those states.” So I guess someone who's had an arm amputated can't possibly feel any kind of β€˜phantom pains’ there πŸ˜‰ Sean McClure / @sean_a_mcclure : @drfeifei ... His argument rests on the assumption that physiological states like hunger can only be embodied in the specific manner humans embody them. He should be asking if an AI can be hungry for *resources* not food. And the β€œonly predicts the next symbol” argument has always been Emmett Shear / @eshear : LLMs are simulators. They might contain sentient beings or not, but the LLM itself is no more sentient than the laws of physics are. If there's sentience, it's existing a layer up. Brian Chau / @psychosort : I will bite the bullet. The Bible, Hamlet, and Oyasumi Punpun are definitely sentient Yann LeCun / @ylecun : @ChrSzegedy No they don't. They simply don't have the required architecture for it. Julian / @mealreplacer : Though I highly doubt current LLMs are capable of having subjective experiences, it's an important and poorly understood question β€” one that deserves better than a β€œdebunking” by an op-ed that doesn't even really attempt to engage with different theories of consciousness. Christian Szegedy / @chrszegedy : I think the arguments in this article only support that LLMs don't have a human-like sentience. It does not rule out that they have some different kind: maybe LLMs feel some β€œsatistfaction” when it produces the sentence β€œI feel terrible”, as it enjoys predicting text. LinkedIn: Ross Dawson : The debates on whether AI is or will be sentient have started and will never end.Β  Here Stanford luminary Fei-Fei Li argues that AI isn't sentient as it doesn't have subjective experiences. …

TIME

Discussion

  • @sethcjayson Seth Jayson on threads
    I have been saying this for *years* about β€œself driving,” but months about LLMs.Β  And I am not an expert.Β  I can just see the obvious.Β  FWIW, it's probably better to not call this a β€œlast 20%” problem and admit that, in terms of work required, it's the last 90%.Β  IE, 80% of respo…
  • @zitron.bsky.social Ed Zitron on bluesky
    Yeah there's no way that generative AI gets us to approaching AGI.Β  They are not building it and it is not what's coming out of ChatGPT or anything related to ChatGPT [embedded post]
  • @vsikka Vishal Sikka on x
    A wonderful writeup in @time by John Etchemendy, a great teacher of my life, and my friend @drfeifei both co-directors of @StanfordHAI on the non-sentience of LLMs. https://time.com/...
  • @eshear Emmett Shear on x
    In colloquial language of course this might be seen as the same thing, but if you expect to write about these things as an intellectual you need to be more precise or I just can't take you seriously. The article doesn't even start to grapple with the real questions.
  • @landay James Landay on x
    Yes, LLMs are not sentient. Amazing that people need this explained to them...
  • @mattrosoff Matt Rosoff on x
    Nobody thinks they are.
  • @oshanjarow @oshanjarow on x
    As the article briefly alludes to β€” asking whether a particular version of AI is conscious distracts from the real question. The more interesting β€” & actually unsettled/ debated by relevant experts β€” question is whether consciousness is possible in non-biological substrates. [ima…
  • @dioscuri Henry Shevlin on x
    I disagree with claims that we *know* LLMs aren't conscious. Fairly unlikely, perhaps, but not inconceivable that the functional dynamics constitutive of subjectivity could be realised in large Transformers. Not enough scientific consensus about consciousness to rule it out.
  • @idavidrein David Rein on x
    @drfeifei ... there are so, so many things wrong with this article. β€œOne of the essential characteristics of general intelligence is β€˜sentience’” False! We're confident that animals without human reasoning capabilities are sentient, and it's perfectly coherent to consider intelli…
  • @ericlandgrebe Eric Landgrebe on x
    I like this view a lot. I think it's also relevant for more broad questions in alignment around where the agency in ML models is. It especially becomes tricky due to conditional generation, where the behavior depends heavily on the prompt itself.
  • @jonasmtzgr Jonas Metzger on x
    @drfeifei ... your argument boils down to β€œAI doesn't have a body and hallucinates statements about experiences it cannot possibly have, therefore it can't be sentient”. But how do we know these are dealbreakers? You say yourself that we don't know how sentience emerges. Except i…
  • @hamandcheese Samuel Hammond on x
    This is a bad argument imo. Humans have physiological signals of pain, hunger, etc., but the conscious states are all processes in the brain. Hence phantom limb syndrome, dreaming, or the ability to induce tastes and smells from neural stimulation. The truth is that we simply [im…
  • @drfeifei Fei-Fei Li on x
    Is AI sentient? My friend and colleague Prof. John Etchemendy, a renowned professor and co-Director of @StanfordHAI , just co-authored this piece to debunk the claim that today's LLMs are sentient @TIME https://time.com/...
  • @dioscuri Henry Shevlin on x
    @mealreplacer β€œAll sensations... are the result of physiological states that an LLM simply doesn't have. Consequently we know that an LLM cannot have subjective experiences of those states.” So I guess someone who's had an arm amputated can't possibly feel any kind of β€˜phantom pa…
  • @sean_a_mcclure Sean McClure on x
    @drfeifei ... His argument rests on the assumption that physiological states like hunger can only be embodied in the specific manner humans embody them. He should be asking if an AI can be hungry for *resources* not food. And the β€œonly predicts the next symbol” argument has alway…
  • @eshear Emmett Shear on x
    LLMs are simulators. They might contain sentient beings or not, but the LLM itself is no more sentient than the laws of physics are. If there's sentience, it's existing a layer up.
  • @psychosort Brian Chau on x
    I will bite the bullet. The Bible, Hamlet, and Oyasumi Punpun are definitely sentient
  • @ylecun Yann LeCun on x
    @ChrSzegedy No they don't. They simply don't have the required architecture for it.
  • @mealreplacer Julian on x
    Though I highly doubt current LLMs are capable of having subjective experiences, it's an important and poorly understood question β€” one that deserves better than a β€œdebunking” by an op-ed that doesn't even really attempt to engage with different theories of consciousness.
  • @chrszegedy Christian Szegedy on x
    I think the arguments in this article only support that LLMs don't have a human-like sentience. It does not rule out that they have some different kind: maybe LLMs feel some β€œsatistfaction” when it produces the sentence β€œI feel terrible”, as it enjoys predicting text.