Facebook says it will use the same tactics that it uses to remove bot networks to target real-user accounts engaging in tactics like mass reporting
but it's got bigger problems from its past James Farrell / SiliconANGLE : Facebook introduces new tactic to fight ‘social harm’ DW.COM : Facebook deletes accounts of German anti-lockdown group Tweets: Thomas Rid / @ridt : Here we go: a network linked to Germany's fringe Querdenker movement is Facebook's proof-of-concept. Curious to see effects, reactions, next cases in line https://about.fb.com/... https://twitter.com/... Renee DiResta / @noupside : FB's own post on the policy here. Overall, this seems like a solid step to create a policy for behaviors that have existed for a very long time, which have largely been dealt with in more whack-a-mole individual enforcement actions. https://about.fb.com/... Renee DiResta / @noupside : This is a very interesting new policy from FB that recognizes that inauthenticity is not always present in harmful coordinated activity. Since networked activism is also coordinated activity, policies in this area have often been very vague. No clear line. https://www.reuters.com/... Craig Silverman / @craigsilverman : Glad to see the Reuters story on Facebook's new policy about “coordinated harm” connects it back to the internal FB Jan. 6 report revealed by me, @RMac18 & @JaneLytv. The report's findings clearly influenced this new policy. https://www.reuters.com/... Mahmoud Salem / @sandmonkey : This is a slippery slope yo.. @joey_shea https://www.reuters.com/... David Agranovich / @davidagranovich : 1/ Today, we shared an enforcement under a new protocol designed to extend our network disruptions to new types of adversarial groups. We still have a lot of work to do, but this is a first step into a new space https://about.fb.com/... 🧵 Nathaniel Gleicher / @ngleicher : 1/ Today we shared removed a coordinated network of accounts, Pages and groups linked to individuals associated with the German Querdenken movement. They systematically violated our policies and coordinated to drive severe social harm. https://about.fb.com/... Alistair Coleman / @alistaircoleman : “The people behind this activity used authentic & duplicate accounts to post & amplify content, primarily focused on promoting the conspiracy that the German government's COVID-19 restrictions are part of a larger plan to strip citizens of their freedoms” https://about.fb.com/... E. Rosalie / @novelsci : 1/ Facebook could start here. https://about.fb.com/... https://twitter.com/... David Agranovich / @davidagranovich : A worthwhile read on some of the work our team is driving towards at FB https://twitter.com/... Alistair Coleman / @alistaircoleman : Facebook says it's going to target harmful behaviour from coordinated networks. Of course, with all things Facebook, we need to see results to match the tough talk. https://www.reuters.com/... Thomas Rid / @ridt : The gloves are coming off. Good. https://www.reuters.com/...
Context & Ripple Effects
Facebook had already built pattern-based detection around fake accounts used to spread misinformation and manipulate rankings and later tied coordinated activity to artificial amplification of content and sentiment. Its new policy extends that enforcement logic beyond account authenticity to coordinated behavior by real users.
The reported removal of a network linked to Germany’s Querdenken movement makes the policy operational rather than theoretical. Facebook is treating mass reporting and other coordinated-harm tactics as a trust-and-safety problem even when the accounts behind them are genuine.
First-order effects
- Facebook can disrupt coordinated networks of real-user accounts, Pages, and groups using tactics previously reserved for bot networks, including the Querdenken-linked network cited in the related coverage.
- Users who organize mass reporting or coordinated harm face enforcement based on their collective activity patterns rather than solely on whether their accounts are fake.
Second-order effects
- Facebook’s enforcement teams must distinguish coordinated harmful conduct from legitimate collective activity, raising the importance of the activity-pattern systems it had developed for fake-account networks.
- Groups seeking to manipulate Facebook through real accounts lose a key way to evade anti-bot enforcement, shifting the platform’s moderation focus from account identity to network behavior.
Third-order effects
- If applied consistently, the policy moves platform governance toward behavior-based network enforcement: authentic accounts no longer provide a safe boundary for coordinated manipulation.
- That shift makes trust infrastructure depend less on detecting fake profiles and more on judging coordinated conduct across users, Pages, and groups.
The trend: Platform trust-and-safety systems are expanding from removing inauthentic accounts to disrupting harmful coordination regardless of who operates the accounts.