A New York lawyer faces sanctions for using ChatGPT to write his legal brief that had “bogus judicial decisions, with bogus quotes and bogus internal citations”
Thanks, ChatGPT? Maya Posch / Hackaday : ChatGPT v. The Legal System: Why Trusting ChatGPT Gets You Sanctioned CourtListener : Mata v. Avianca, Inc. (1:22-cv-01461) Igor Bonifacic / Engadget : A lawyer faces sanctions after he used ChatGPT to write a brief riddled with fake citations Faustine Ngila / Quartz : A US attorney faces punishment for citing fake cases ChatGPT fed him Charlesarthur / The Overspill : Start Up No.2015: ChatGPT in court (unfortunately), Zelda's amazing game physics, trying out Meta's VR headset, and more Onur Demirkol / gHacks Technology News : ChatGPT's made-up cases puts a lawyer's career in danger Ciaran Lyons / Cointelegraph : Lawyer uses ChatGPT in court and now ‘greatly regrets’ it Duncan Riley / SiliconANGLE : Lawyer's reliance on ChatGPT leads to false case citations in airline lawsuit Jimmy Pezzone / TechSpot : ChatGPT found guilty of fabricating cases and citations for a Manhattan lawyer's Federal Court filing Techlusive : US lawyer penalised for using ChatGPT: Here's why Dazza Greenwood / DazzaGreenwood Weblog : What's the Matter With Mata v. Avianca, Inc Omer Dursun / Neowin : A lawyer used ChatGPT for legal research, but later found the chatbot created fake cases The Sun : Shock as judge catches lawyer using AI to prepare for case - and chat bot makes fatal error ChinaTechNews.com : ‘I apologize for the confusion earlier’: Here's what happens when your lawyer uses ChatGPT Alan Friedman / PhoneArena : Lawyer faces punishment after ChatGPT gave him fake cases to cite on a court-submitted brief Slashdot : Lawyer ‘Greatly Regrets’ Relying on ChatGPT After Filing Motion Citing Six Non-Existent Cases Siamak Masnavi / Tech News Outlet : ChatGPT's Erroneous Legal Citations Land Lawyer in Trouble LinkedIn: Aleksandr Tiulkanov : This is what happens when you don't read ChatGPT disclaimers and when you don't follow the flowchart (https://www.linkedin.com/... … Hilary Gerzhoy : It was only a matter of time. — Today, the NYT reported that a lawyer in SDNY used ChatGPT to generate his opposition brief and it included citations to six cases, none of which exists. … Gary S. Lesser : So it turns out that an attorney using AI to generate pleadings is still legally and ethically responsible for what they file in the Court system. … Greg Siskind : Holy moly! Will this be the first lawyer disciplined over his use of ChatGPT? It DOES make up cases and will even write opinions … David J. Kozlowski : ChatGPT isn't coming for lawyers' jobs just yet, but it can certainly cost them their job if they blindly rely upon it... … Jennifer C. : Lawyer with three decades of experience - but never used ChatGPT before- decides to use the AI tool to find cases in support of a response brief in a motion to dismiss in U.S. federal court. … Edward Albe : AI caveat emptor! — If you're going to pride yourself on being on the leading edge when it comes to using innovations like ChatGPT, you better be sure to sprinkle in a bit of human “sensemaking” … Mastodon: Kendra Albert / @kendraserra@dair-community.social : And it's supposedly an 11th Circuit opinion. On page 2, it says “Before Jordan, Rosenbaum, and Higginbotham, *Circuit Judges.” — One issue. Higginbotham isn't an 11th Circuit judge. There is a Patrick Higginbotham who is a federal judge. … Kendra Albert / @kendraserra@dair-community.social : On April 26, the day after the affidavit with he cases is filed, BB, the lawyer for the defendant, files a letter with questions. They literally can't find the cases anywhere else. The docket numbers don't line up. … Kendra Albert / @kendraserra@dair-community.social : On April 25, PL files a response. It's amazing. — First, he says, he's attached the copies of the cases that he previously cited. (We'll come back to that.) — Second, that he couldn't find one of the cases that was cited by the court in one of those opinions. … Dare Obasanjo / @carnage4life@mas.to : I keep saying the real AI risk is people mistaking fancy autocomplete as actual intelligence. This is more likely to cause problems than ChatGPT suddenly get self aware and start dropping nukes and building Terminators. … Tweets: Daniel Feldman / @d_feldman : A lawyer used ChatGPT to do “legal research” and cited a number of nonexistent cases in a filing, and is now in a lot of trouble with the judge 🤣 [image] Mike Dunford / @questauthority : Hey, lawtwitter - Check out the last few entries on this docket. Trust me. ChatGPT making up citations, notary fraud, this has it all. Oh and an incandescent federal judge. https://www.courtlistener.com/ ... @timnitgebru : The thing is OpenI +Sam Altman “existential risk” + “powerful AI god” marketing are leading to this. But they get to do that with zero consequences. All you gotta do is read what they write on their websites about how such models would understand legal documents soon. https://twitter.com/... Yann LeCun / @ylecun : Haha. Auto-Regressive LLMs gonna auto-regress. Your hands must remain on the keyboard at all time. Level-2 Writing assistance? Yes! Level-5 autonomous writing? No! “Here's What Happens When Your Lawyer Uses ChatGPT” https://www.nytimes.com/... Tom Goodwin / @tomfgoodwin : It's taking a very long time for smart people to realize generative AI is designed to create plausible not accurate replies . It's accuracy in my experience has been woeful More details on the Lawyer / fake citations case thanks to @swardley https://simonwillison.net/... @roxanadaneshjou : Every talk I've given about ChatGPT in medicine includes a discussion of what the model was trained to do (create human believable language). Accuracy is NOT guaranteed. Then I show some examples of things it makes up. https://twitter.com/... James Surowiecki / @jamessurowiecki : This is why I don't get the argument that AI “knows” more than humans do. It has no idea of what's real and what's imagined, and no ability to distinguish between the two. So there's some real sense in which it doesn't know anything. It's always just guessing. Ilan Schwartz MD PhD / @germhuntermd : Now imagine it being used to as a “clinical co-pilot” as promoted https://twitter.com/... Adrian Weckler / @adrianweckler : This US lawyer who used ChatGPT for legal citations (all made up) had 30 years' experience — he wasn't some rookie. If you think a % of seasoned pros and colleagues aren't already using ChatGPT for shortcuts, you're deluded https://www.nytimes.com/... Eliezer Yudkowsky / @esyudkowsky : A human faker would handwave, not confabulate citations so that their sentence sounds indistinguishably like a standard legal argument. A human faker would ask “what if someone Googled”? There's cues of ignorance which people expect from humans, and LLMs don't give those cues. https://twitter.com/... Karen Hao / @_karenhao : Rather than making fun of the lawyer, we should really be asking how these technologies are being marketed in a way that misleads people about the extent of their capabilities and use this as a case study to understand how that can cause real-world harm. https://twitter.com/... Paul Kedrosky / @pkedrosky : As my investing partner @defrag likes to say, there is a tsunami rearing up in the dark, and we're only seeing its silhouette blotting out the stars as it nears. Lawyer uses ChatGPT and is sanctioned for false citations and claims https://www.nytimes.com/... [image] James Surowiecki / @jamessurowiecki : Lawyer asked Chat GPT to find cases he could cite in a brief. It invented six decisions, including quotes and internal citations from the imaginary opinions, and when asked if they were real, said yes. https://www.nytimes.com/... Dominic White / @singe : Oof. ChatGPT hallucinated case law and this 30 year tenure lawyer just used it sans validation. Now the judge is asking why he and his firm shouldn't be sanctioned for submitting false unvalidated information to the court. https://twitter.com/... [image] Navjot Pal Kaur / @navjotpkaur : In case you ever have imposter syndrome about anything, think about the fact that someone invested years of their life, several thousand dollars (maybe even more) and their professional credibility to use AI to do their job and it went horribly wrong. https://twitter.com/... Simon Willison / @simonw : I tried to pull together the various strands of this wild ChatGPT legal story - including a detailed timeline and the juiciest screenshots from the filings so far https://simonwillison.net/... Michael McCann / @mccannsportslaw : A lawyer used ChatGPT and submitted a brief citing fake cases, with bogus quotes, that ChatGPT assured him were all real. He faces discipline from the bar and, I imagine, a malpractice lawsuit. Note to my students: do not become that kind of lawyer! https://www.nytimes.com/... Dror Poleg / @drorpoleg : AI will make idiots dumber. https://twitter.com/... Massimo Banzi / @mbanzi : Epic: A Lawyer in New York used ChatGPT to write a sumbission and the AI made up a bunch of non existent cases to support it.. The Judge wasn't impressed. When caught he had to admit using ChatGPT oops https://www.courtlistener.com/ ... @jeffjarvis : To read the documents—the lawyer's original filing, the opponent's letter looking for fake cases, the judge's demand for documentation, the case files ChatGPT made up, the lawyer's uh-oh confession, the angry judge setting a hearing, it's all here: https://www.courtlistener.com/ ... Simon Willison / @simonw : I dug through the various court filings and tried to pull together my own timeline of how this all played out - it's a fascinating story https://simonwillison.net/... Matt McGee / @mattmcgee : I wonder how soon until a real estate agent faces discipline because the property description written by ChatGPT...or the blog post...or the email...has bogus claims/info? https://twitter.com/... @greg_johnston : Always remember: ChatGPT, Bard, etc. will simply make things up with incredible confidence. They do not “know” if the things they are saying are true or not, because they do not “know” anything. They're great at composing prose; they're very bad at facts. https://twitter.com/... Jackie Barbosa / @jackiebarbosa : ChatGPT is not a research assistant. It doesn't check its answers against known facts because it can't “know” which text it has been fed is fact and which is fiction. It therefore makes up “citations” based on probability and you will never get anything remotely resembling facts. https://twitter.com/... Steve Puiszis / @stevepuiszis : A lawyer's duty of competence requires understanding the risks and benefits of the technology used to provide legal services. One of ChatGPT's risks is that it makes mistakes and sources that don't exist. It's output must be thoroughly checked. Here's what can happen if you don't https://twitter.com/... Morgan L. Stringer / @mostring : I cannot believe a lawyer used ChatGPT and just copied and pasted without verifying anything. The cases it gave were fake. Imagine screwing up so bad that the New York Times writes about it lmao. https://www.nytimes.com/... @martinsfp : Oh. My. God. “Mr. Schwartz said that he had never used ChatGPT, and ‘therefore was unaware of the possibility that its content could be false.’” https://twitter.com/... Sushant Sinha / @sushantsinha : When a lawyer used ChatGPT: “Judge Castel said in an order that he had been presented with “an unprecedented circumstance,” a legal submission replete with “bogus judicial decisions, with bogus quotes and bogus internal citations.” ” https://www.nytimes.com/... Jim Meskauskas / @mediadarwin : I love this. It's the George Santos of legal assistants. “There was just one hitch: No one... could find the decisions or the quotations cited and summarized in the brief. “That was because ChatGPT had invented everything.” https://www.nytimes.com/... Gi Dalor / @gi_dalor : @questauthority I love that ChatGPT just keeps doubling down like a human compulsive liar would. [image] @glimmerstomp : grabbed the funniest bit of that legal case where someone used ChatGPT to write a brief [image] Brodie Butland / @bmb_esq : Lawyer uses ChatGPT to prepare a legal brief in federal court. ChatGPT makes up non-existent cases and gets others completely wrong. Federal judge is incensed and scheduled a sanctions hearing. I anticipate we're going to see quite a few of these in the next few years. https://twitter.com/... Ross Guberman / @legalwritingpro : Tomorrow's litigator today? Imagine if I asked ChatGPT to analyze and critique a section of a brief and to perform legal and factual research. https://www.buzzsprout.com/... 1/3 [image] Gene Kim / @realgenekim : Oof. All of the half -dozen case citations in the 10 page brief that a lawyer filed were untrue ("hallucinations") A Man Sued Avianca Airline. His Lawyer Used ChatGPT. - The New York Times https://www.nytimes.com/... @crimegiri : This lawyer got ChatGPT to write the submissions (plainly nonsense) and in doing so, it fabricated authority citations. When the (angry) Judge requested the cases, the lawyer went back and got ChatGPT to FABRICATE THE CASES. Someone is going to jail.... 👀 https://twitter.com/... Scott Monty / @scottmonty : Be careful out there. ChatGPT isn't ready for prime time. “No one — not the airline's lawyers, not even the judge himself — could find the decisions or the quotations cited and summarized in the brief. That was because ChatGPT had invented everything.” https://www.nytimes.com/... Benjamin Weiser / @benweisernyt : BREAKING: A lawyer representing a man who sued an airline relied on #ChatGPT to help prepare a court brief. It did not go well. https://www.nytimes.com/... Amy Salyzyn / @amysalyzyn : 1st of many/some? “The lawyer's colleague, who drafted the filing, says he relied on ChatGPT to draft filing & provide the text of the cases & neglected to check them” A Lawyer's Filing “Is Replete with Citations to Non-Existent Cases”;Thanks, ChatGPT? https://reason.com/...