How Facebook's stance that it won't ban posts unless they “cause imminent harm”, reversed in Feb. 2021, has led people to believe dangerous lies about COVID-19
Mark Zuckerberg wanted to make his social network a reliable source about the pandemic. Tweets: @bw , @chafkin , @karenkornbluh , @ryanmarino , @dcodedemocracy , @bw , @center4inquiry , @basuashis , @rzgreenfield , @sarahfrier , @jason_kint , @timothycoulter2 , @phat_controller , @scottnations , and @karenkornbluh Tweets: @bw : Mark Zuckerberg wanted to make Facebook and Instagram a reliable source of news about the pandemic. Instead he's helped spread misinformation about vaccines https://www.bloomberg.com/... Max Chafkin / @chafkin : this story by @sarahfrier and @sarahkopit about facebook's complicity with the antivax movement is devastating https://www.bloomberg.com/... Karen Kornbluh / @karenkornbluh : Another great @sarahfrier piece - this one on online COVID conspiracies. My contribution: “the misinfo was infinitely more shareable. The folks who are supporting the science have to get better at telling the story” @gmfus https://www.bloomberg.com/... Ryan Marino / @ryanmarino : “Talk to doctors who've spent the last year in the COVID wards & they'll say they're spending more & more time talking their patients out of something wildly untrue they read on Facebook.” Thanks to @sarahfrier for this look at social media misinfo https://www.bloomberg.com/... Decode Democracy / @dcodedemocracy : Once again, Facebook's efforts to counter disinformation are too little, too late. This reactive approach is exactly in line with our research showing FB often waits to make changes until after online disinfo results in real-world damage. https://decode.org/... https://twitter.com/... @bw : Mark Zuckerberg wanted to make his social network a reliable source about the pandemic. Instead he's helped spread misinformation about vaccines causing infertility https://www.bloomberg.com/... @center4inquiry : Bloomberg Businessweek has a feature by @sarahfrier and @SarahKopit on “the power of Facebook and Instagram to provide all the necessary tools for anti-vaccine activists and other wellness hucksters to suck in converts.” https://www.bloomberg.com/... Ashis Basu / @basuashis : Mark Zuckerberg wanted to make his social network a reliable source about the pandemic. Instead he's helped spread misinformation about vaccines causing infertility. @sarahfrier @SarahKopit https://www.bloomberg.com/... Rebecca Greenfield / @rzgreenfield : This story is a damning indictment of the garbage FB lets circulate on its platform that continues to cause very real world harm. https://www.bloomberg.com/... Sarah Frier / @sarahfrier : NEW IN @BW: In the race to end the Covid-19 pandemic, there's a major roadblock: the lies on Facebook and Instagram that encourage fear of the vaccine, especially among women. Facebook is finally banning the worst accounts, but that won't be enough. https://www.bloomberg.com/... Jason Kint / @jason_kint : On a related note, as @mariaressa spoke about how facts and lies are presented the same way. So amplification and velocity go to the posts that drive engagement and ultimately you end up with global information crisis. Outstanding report here: https://www.bloomberg.com/... Timothy Coulter / @timothycoulter2 : NEW: Mark Zuckerberg wanted to make Facebook and Instagram a reliable source of news about the pandemic. Instead he's helped spread misinformation about vaccines https://www.bloomberg.com/... via @BW Tony Roberts / @phat_controller : Avaaz found hundreds of posts sharing calls from far-right actors to attack the Capitol made by people Facebook banned years earlier. Banning offenders & not enforcing the ban lets Facebook signal virtue but still benefit financially from the traffic. https://www.vice.com/... Scott Nations / @scottnations : I don't know if Facebook should censor this stuff but I know the answer for me was to delete the FB app from my phone and to quit signing in. It was a GREAT decision. Facebook Built the Perfect Platform for Covid Vaccine Conspiracies https://www.bloomberg.com/... Karen Kornbluh / @karenkornbluh : @sarahfrier @SarahKopit nail it with this piece on COVID misinfo. Not a fair fight for accurate medical info. https://www.bloomberg.com/...
Context & Ripple Effects
The Bloomberg investigation lands at the midpoint of a documented arc: back in 2019 Facebook responded to vaccine misinformation with ranking-level demotions of anti-vaccine Pages and groups rather than removals, and by 2020 the company was reportedly shelving internal research on its polarizing effects. The 'imminent harm' threshold — and its quiet reversal in February 2021 — explains why those softer tools left dangerous COVID-19 claims standing.
What makes the piece consequential is that the harm was measurable: a Chicago Tribune story linking a doctor's death to vaccines became Facebook's most-viewed story of Q1 2021, and Avaaz had already traced a disproportionate share of false viral posts to a small cluster of accounts. The policy wasn't failing in the abstract; it was amplifying at scale.
First-order effects
- Users saw COVID-19 and vaccine misinformation persist on Facebook and Instagram through the worst months of the pandemic, because posts stayed up unless they met an 'imminent harm' bar the company itself set and only abandoned in February 2021.
Second-order effects
- The White House publicly confronted Facebook over vaccine misinformation, and the company's VP of Integrity answered with what critics called bluster and obfuscation — dragging enforcement failures into an open political fight rather than a quiet policy fix.
Third-order effects
- The pattern — rank-don't-remove, delay bans, suppress inconvenient internal findings — points toward platforms losing the benefit of the doubt, with moderation thresholds set by political pressure and external audits rather than internal policy alone.
The trend: Platform content moderation is shifting from narrow 'imminent harm' removal thresholds toward pre-emptive ranking interventions, driven by documented misinformation amplification and escalating government pressure.