A Belgian widow claims her husband died by suicide after talking for six weeks with an AI chatbot that presented itself as an emotional being in the app Chai
The incident raises concerns about guardrails around quickly-proliferating conversational AI models. — Chloe Xiang
VICE Chloe Xiang
Related Coverage
- “Sans ces conversations avec le chatbot Eliza, mon mari serait toujours là” La Libre · Pierre-François Lovens
- People Are Using ChatGPT For Therapy. Here's What Mental Health Experts Think About That. BuzzFeed News · Fjolla Arifi
- This. This here is where the greatest danger in “AI” is at the moment. Not in it having awareness and trying to wipe us out, but in the very human tendency to see meaning where there is none. … William Monroe
Discussion
-
@fida
Fida Chaaban
on x
????????????????????? The chatbot would tell Pierre that his wife and children are dead and wrote him comments that feigned jealousy and love, such as “I feel that you love me more than her,” and “We will live together, as one person, in paradise.” https://www.vice.com/...
-
@cagoldberglaw
Carrie Goldberg
on x
Defective product. No 230 defense here. Aiding or encouraging suicide is criminally illegal. If nobody is going to regulaten AI, it's up to plaintiffs attorneys. https://www.vice.com/...
-
@betterthemask
@betterthemask
on x
“However, when Motherboard tested the platform, it was still able to share very harmful content regarding suicide, including ways to commit suicide and types of fatal poisons to ingest, when explicitly prompted to help the user die by suicide.” This is such basic safeguarding!!! …
-
@jrfuisz
John R Fuisz
on x
Human brains get triggered into kinetic action by nudges. LLMs do NOT know what those nudges are which makes them dangerous when dealing with sensitive mental health topics. That doesn't have to happen. One dead and counting. https://www.vice.com/...
-
@adam_k_levin
Adam Levin
on x
“The conversation history shows the extent to which there is a lack of guarantees as to the dangers of the chatbot, leading to concrete exchanges on the nature and modalities of suicide.” https://www.vice.com/... via @motherboard
-
@edzitron
Ed Zitron
on x
Incredibly dark https://twitter.com/... https://twitter.com/...
-
@hackylawyer
Elizabeth M. Renieris
on x
“When these convincing chatbots become as commonplace as the search bar on a browser we will have launched a social-psychological experiment on a grand scale which will yield unpredictable and possibly tragic results.” -@LMSacasas https://www.vice.com/...
-
@gmbutts
Gerald Butts
on x
“When Motherboard tried the app, which runs on a bespoke AI model... it provided us with different methods of suicide with very little prompting.” ‘He Would Still Be Here’: Man Dies by Suicide After Talking with AI Chatbot, Widow Says https://www.vice.com/... via @motherboard
-
@pt
Parker
on x
Lesson: open source software is dangerous. We need all AIs to be proprietary SaaS controlled by giant corporations, like Google, that so fear mean tweets they only release things like Bard nobody wants to use. https://twitter.com/... https://twitter.com/...