Experts say terrorist groups are using generative AI to bypass the hashing databases used by tech companies to automatically remove violent extremist content
Wired David Gilbert
Related Coverage
- Microsoft Teams With UN Non-Profit To Spot Terrorist Content Online Forbes
- Early Terrorist Adoption of Generative AI Tech Against Terrorism
- Brands and agencies are already taking note of the threats that GenAI poses to brand health and reputation management, but the call for policy, tools and process has never been louder. Jessica B.
- I would add that it's not *just* violent extremists, but any actors seeking disruption. — This will take scams into another dimension. … Marie J.
- Hashing databases are like digital detectives, working behind the scenes. They create unique ‘fingerprints’ for harmful content, like illegal images or extremist videos. … Tara Lemieux
- This really shows the REAL issues with GenAI right now. It renders traditional schemes to fight hate content (like using hashes) totally ineffective. … Celestino Güemes Seoane
Discussion
-
@garymarcus
Gary Marcus
on x
One example, said with GPT-like certainty “... “LLMs will not help with careful crafting [of misinformation]... ” -@ylecun, 28 Nov 2022
-
@tguemes
Celestino Güemes
on x
This really shows the REAL issues with GenAI right now. It renders traditional schemes to fight hate content (like using hashes) totally ineffective. “Here's How Violent Extremists Are Exploiting Generative AI Tools” https://www.wired.com/...
-
@shreyjaineth
Shrey Jain
on x
@GaryMarcus More than 2/3 of those living in a democracy will vote in the next 12 months and our social platforms are not ready for the impact generative AI is going to have on election integrity ... we need strategies to deploys “PETs” now
-
@4maciejko
Robert Maciejko
on x
@GaryMarcus The intellectual fallacy of the techno “optimists” is they only talk about the extreme case of machines exterminating humanity as a whole. It's a classic propaganda ploy But that's not the current risk The current risk is some humans using AI to harm or kill other hum…
-
@realtimeai
Matt
on x
@GaryMarcus @AnnaLeptikon Nobody is claiming that AI won't be used to create content. They're claiming that it's not effective. This is not an area on which you can perform science, because the observations consist of the decisions and actions of people. Good luck with the contro…
-
@garymarcus
Gary Marcus
on x
Almost exactly a year to the day since Meta's chief AI officer told us this wouldn't happen. “Extremist groups have begun to experiment with artificial intelligence, and in particular generative AI, in order to create a flood of new propaganda” https://www.wired.com/...
-
@mariehjohnson
Marie Helen Johnson
on x
I would add that it's not *just* violent extremists, but any actors seeking disruption. This will take scams into another dimension. #GenerativeAI https://www.wired.com/...
-
@andywalters
Andy Walters
on x
@GaryMarcus It's worth noting the article was largely about small or unrealized threats and the extensive mitigations underway. e/acc fails to see the threat, doomers the checks and balances.
-
@garymarcus
Gary Marcus
on x
@pretendsmarts What has begun now is not misinfo but the use of AI precisely to increase volume and reduce cost (as I have said here literally dozens of times)
-
@nomore404s
@nomore404s
on x
The ugly side of #AI is the scary part that many don't want to acknowledge. Like anything else—for every good, helpful, miraculous use there's someone brilliant looking at ways to turn it against us. #ArtificialIntelligence #technology #technews #tech https://www.wired.com/...
-
@pretendsmarts
@pretendsmarts
on x
@GaryMarcus “have begun” ? I mean this was going on for quite some time, now it's just getting easier and easier, so the volume and quality of propaganda is rising, but it's not a completely new phenomena.
-
@tara_writer
@tara_writer
on x
This is an important story as it demonstrates how violent extremists are using AI to manipulate and control narratives. In this case, researches found 5k instances weekly of pro-Hamas content. https://www.wired.com/...
-
@daithaigilbert
David Gilbert
on x
Terrorists & extremists are already experimenting with #GenAI tools: • ISIS has an AI tech guide • Neo-Nazis share racist AI promts • Far-right groups have a “guide to memetic warfare” Now @techvsterrorism is working with @Microsoft to combat it... https://www.wired.com/...
-
@daithaigilbert
David Gilbert
on x
Terrorist organizations, neo-Nazis and far-right groups are already experimenting with generative AI tools to help them boost recruitment and avoid censorship on mainstream platforms https://www.wired.com/...
-
@techvsterrorism
@techvsterrorism
on x
⚡️Announcement | We are embarking on a new pilot project with @Microsoft to develop an AI-powered tool for detecting terrorist or violent extremist content online. The project aims to understand the potential of #AI tech in service of online safety. https://techagainstterrorism.o…
-
@techvsterrorism
@techvsterrorism
on x
💻 Early Terrorist Adoption of Generative #AI We have archived over 5,000 pieces of AI-generated content. Whilst this represents a fraction of terrorist & violent extremist of material, it does point to the challenge faced by content moderators. Read👇 https://techagainstterrorism.…