Security researchers successfully prompted the AI system behind a Utah prescription renewal pilot to reclassify meth as an “unrestricted therapeutic”, and more
Security researchers used relatively simple jailbreaking techniques to trick the AI system powering Utah's new prescription refill bot.
The jailbreak was done on the company's public bot, not the one inside the state system, but researchers “were able to make the bot spread vaccine conspiracy theories, triple a patient's prescribed pain medication dosage, and recommend methamphetamine as treatment.”
Utah's new prescription AI bot was easily compromised. — Using basic jailbreaking, researchers at Mindgard tricked the system into tripling OxyContin doses and recommending meth. For a tool legally allowed to renew meds, that's a massive safety gap that can't be ignored. — #…
Researchers trick #AI repeat medication scripts bot — “Security researchers used relatively simple jailbreaking techniques to trick the AI system powering #Utah's new prescription refill bot. — Researchers were able to make the bot spread vaccine conspiracy theories, triple a…