Scammers are using voice-cloning AI to impersonate distressed loved ones, sometimes spoofing specific phone numbers to further the ruse, and victims fall for it
Scammers are using artificial intelligence to sound more like family members in distress. People are falling for it and losing thousands of dollars.
Families receiving purported emergency calls face a more convincing payment scam because both the caller's voice and displayed number can appear familiar.
Banks and fintechs must treat voice-based claims and caller ID as weaker fraud signals as AI-assisted impersonation reaches consumer victims.
Customer-support systems become a more valuable target for scammers when legitimate automated messages can be incorporated into a broader impersonation script.
Third-order effects
If voice cloning and number spoofing continue to be combined, authentication will shift away from recognizing a voice or phone number toward verification methods that do not rely on easily copied identity signals.
The pattern points to an escalating fraud-defense cycle in which AI lowers the cost of convincing impersonation and financial firms deploy AI to detect it.
The trend:Generative AI is turning voice impersonation from a business-fraud tactic into a broader consumer-payment threat, pushing verification beyond familiar identity cues.
They thought loved ones were calling for help. It was an #AI #scam. - https://www.washingtonpost.com/ ... whoa, if it's this good now, imagine how it will be next year...
new: AI voice-cloning tech is making phone scams frighteningly believable. I talked to some who got duped. They were elderly + heard their loved one needed cash now. They felt it might be a scam, but the voice sounded too real to ignore. One lost $21k. https://www.washingtonpost.…
Powered by AI, a slew of cheap online tools can translate an audio file into a replica of a voice, allowing a swindler to make it “speak” whatever they type. https://www.washingtonpost.com/ ...
Interesting, but it's not 100pc clear that AI cloning was used in the cases described. Possible that people are just easier to dupe with impersonation by a human over the phone. https://twitter.com/...
scammers are using AI deepfakes to clone a family member's voice, call up their relatives, and tell them they're in trouble and ask for money now. this sort of scam is now trivial to pull off and we have so few safeguards against it —> https://www.washingtonpost.com/ ...
This is something we talked about in there first Alexa Confrence talk in 2015. This will only get worse. A family code word is absolutely crucial to establish today. Also ask a question that only someone the family could know. https://twitter.com/...
This is scary. A couple years ago it was still extremely difficult (if not impossible) for the average person to carry out this kind of AI-assisted scam. Not anymore. https://www.washingtonpost.com/ ...
We'll see more stories like this As with any new technology, it changes society in good and bad ways Good people use the tech to make things better, bad people use it to make things worse Always been like this in history https://twitter.com/...
When I wrote a profile of ElevenLabs back in October, I didn't think they'd reach this kind of impact so quickly. It feels like the kind of tech you're best keeping limited to specific B2B uses for good reasons. https://twitter.com/...
This just happened to my MIL. She told us the man on the phone sounded exactly like my husband, that he'd been in an accident that resulted in the death of a pregnant woman. All the while, she couldn't get a hold of me or my husband. None of her calls came through to us. https://…
AI is going to create a post-truth world where the evidence for anything or against anything can simply be customized and machine-fabricated. I'm not sure what society can do in response to this. https://twitter.com/...
“If a loved one tells you they need money, put that call on hold and try calling your family member separately, he said. If a suspicious call comes from a family member's number, understand that too can be spoofed.” https://twitter.com/...
With the rise of deep fakes, a reliable digital authentication system is needed asap. And not just for public figures and organizations, but for everyone. https://www.washingtonpost.com/ ...
Like I keep saying, with current generation AI, fraud has found scalable product/market fit. And every piece of voice or text data of yours is a potential training set. This will get much worse. #xp https://twitter.com/...
Something I've tried to warn about on the rise. “Technology is making it easier and cheaper for bad actors to mimic voices, convincing people, often the elderly, that their loved ones are in distress.” 🙁 https://www.washingtonpost.com/ ...
i had a couple friends working on / investing in precisely this kind of hyper realistic synthesized speech that could be trained on super small voice samples, a few years back. i was v dismayed to learn that they had barely considered ethical ramifications https://www.washingtonp…