While OpenAI has become more upfront about ChatGPT's limitations, the company should do more to make clear the bot can't reliably distinguish fact from fiction
“May occasionally generate incorrect information.” — This is the warning OpenAI pins to the homepage of its AI chatbot ChatGPT …
The Verge James Vincent
Related Coverage
- ChatGPT should include inline tips Simon Willison's Weblog
- How I finally learned to love ChatGPT Fast Company · Harry McCracken
- A lawyer used ChatGPT to prepare a court filing. It went horribly awry. CBS News · Megan Cerullo
- @Techmeme — I suppose, because it is fun, we can laugh at lawyers getting wrong answers or bad school essays, but the fact remains this is the very same tech lauded far and wide as our Last Chance for climate action, for vaccines, for a long list of things that won't be nearly as cute and humorous as embarrassing a lawyer. … @teledyn@mstdn.ca
- This from James Vincent is pretty on-point. LLMs can be quite useful but need much more attention to warnings/labeling of the information they generate. — Unlike paperclip maximizers, that's a very acute risk that any company integrating LLMs can mitigate today. Of course, doing so might increase the user bounce rate ... … @eloquence@social.coop · Erik Moeller
Discussion
-
@jjvincent
James Vincent
on x
here's my take on last week's lawyer-cites-fake-lawsuits-generated- by-ChatGPT debacle: OpenAI needs to do more to inform users about ChatGPT's limitations https://www.theverge.com/... [image]
-
@simonw
Simon Willison
on x
I posted a mockup of a design change for ChatGPT that I think could help address the risk of people being lead astray by its incredible ability to invent faleshoods: ChatGPT should include inline tips https://simonwillison.net/... [image]
-
@alexgsmith
@alexgsmith
on x
Because people want to either disrupt the Google's or see the search interface as the UX users spend most time in, we're creating a dangerous blurring of intent and outcome ... https://twitter.com/... [image]
-
@cfiesler
Dr. Casey Fiesler
on x
I've been making a lot of TikTok/Instagram videos about the limitations of ChatGPT. When I've talked about misinformation, the number of people who INSIST that “everyone knows that!” would make you roll your eyes out of your head. https://twitter.com/...
-
@harrymccracken
Harry McCracken
on x
ChatGPT briefly alarmed me this weekend by informing me of the tragic death of someone who's very much still with us. https://www.theverge.com/...
-
@fabiochiusi
Fabio Chiusi
on x
“Why, for example, can ChatGPT simply not recognize when it's being asked to generate factual citations and caution the user to “check my sources”?” https://www.theverge.com/...
-
@mikebutcher
Mike Butcher
on x
These are just all the mistakes that have made the media. Imagine what else is going on... https://www.theverge.com/...
-
@mmitchell_ai
@mmitchell_ai
on x
Another good from @jjvincent. 2 important points: (1/2ish) - These systems are being used as search, whether or not it's what OpenAI intended. By recognizing the *use* (both intended & unintended but foreseeable), companies can do much more to situate their products responsibly. …
-
@russellbrandom
Russell Brandom
on x
This is understandably less juicy than the apocalypse warnings, but I think it's a more realistic assessment of the problem right now https://www.theverge.com/...
-
@rjcc
Richard Lawler
on x
Using ChatGPT and other AI bots without understanding what they are and are not capable of will get your fired (or maybe disbarred, idk https://www.theverge.com/... ) https://twitter.com/...