A test of ChatGPT Health and Claude for Healthcare with data from Apple Health finds the chatbots provided questionable and inconsistent responses
ChatGPT now says it can answer personal questions about your health using data from your fitness tracker and medical records.
Washington Post Geoffrey A. Fowler
Related Coverage
- Start Up No.2596: how the cloud is replacing Windows, TikTok's new owner struggles, B-road badger bother, sport camera!, and more The Overspill · Charlesarthur
- New report reveals why giving your Apple Watch data to AI doctors might be a bad idea PhoneArena · Johanna Romero
- Apple Watch user gave ChatGPT Health his data, with troubling results 9to5Mac · Ryan Christoffel
- Early tests suggest ChatGPT Health's assessment of your fitness data may cause unnecessary panic Digital Trends · Pranob Mehrotra
- ChatGPT's Apple Health Integration Flaws Exposed in New Report MacRumors · Tim Hardwick
- If you give ChatGPT your health data, have your doctor on speed-dial AppleInsider · William Gallagher
- ChatGPT's Apple Health Feature Sparks Concern After Giving Wrong Heart Score The Mac Observer · Rajat Saini
- ChatGPT's Apple Health Integration Flaws Exposed in New Report MacRumors Forums
- ChatGPT Health misread Apple Watch data, raising concerns over AI health advice Moneycontrol · Ayush Mukherjee
- This guy fed years of Apple Watch health data to ChatGPT — with disastrous results Cult of Mac · David Snow
- Flaws in ChatGPT Health Can Lead to Baseless Health Analyses WinBuzzer · Markus Kasanmascheff
Discussion
-
@geoffreyfowler
Geoffrey A. Fowler
on x
You can now connect ChatGPT to an Apple Watch. So I imported 29 mil steps and 6 mil heartbeats into the new ChatGPT Health. It graded my heart an F. Cardiologist @erictopol called it “baseless.” Any bot claiming to give health insights shouldn't be this clueless. Even in beta. 🧵 …
-
@mweinbach
Max Weinbach
on x
I'm sorry but ChatGPT Health is worthless It gave me an F because my RHR is higher than usual (it's not) and I don't do enough steps (I do) I have no idea what's wrong with it. I like ChatGPT a lot but this an absurd. I think OpenAI should pull it down for a bit. [image]
-
@erictopol
Eric Topol
on x
The performance of the newly released ChatGPT Health, via a thorough assessment by @geoffreyfowler with his health data, is very disappointing gift link https://www.washingtonpost.com/ ... [image]
-
@hypervisible.blacksky.app
@hypervisible.blacksky.app
on bluesky
“...when it comes to your fitness tracker and some health records, the new Dr. ChatGPT seems to be winging it. That fits a disturbing trend: AI companies launching products that are broken, fail to deliver or are even dangerous.”
-
@four4thefire
Andrew Donaldson
on bluesky
The hardest thing about medicine is every single human being is a special, unique, unreplicatible case. — LLM search engines are uniquely designed to be particularly terrible at the one thing everyone needs from their medical provider: personalized care www.washingtonpost.com/t…
-
@geoffreyfowler
Geoffrey A. Fowler
on x
I asked @EricTopol to look at ChatGPT's analysis. His view: “This is not ready for any medical advice.” The bot leaned heavily on Apple Watch VO₂ max estimates — which independent studies show can run ~13% low on average — and treated fuzzy metrics like hard facts.
-
@geoffreyfowler
Geoffrey A. Fowler
on x
The more I used ChatGPT Health, the worse its answers got. When I asked it the same heart-health question repeatedly, its analysis changed. My grade bounced back and forth between F and a B. Same data, same body. Different answers. [image]
-
@jaredrosenblum
Jared Rosenblum
on x
Spot on, @geoffreyfowler —this highlights the core risk of AI in medicine: opaque black boxes where more data might refine or degrade outputs unpredictably, with no transparency to verify. At Neurosimplicity, we prioritize rigor and reproducibility in neuroscience imaging,