Docs: Facebook user reports of “false news” hit ~40K per hour on January 6; the Instagram account reported most often for inciting violence was @realdonaldtrump

Relief flowed through Facebook in the days after the 2020 presidential election.

Washington Post 2021-10-24

Context & Ripple Effects

The documents add detail to an earlier account of a sharp pre-riot rise in reports of violent content and false news, showing that user-reporting systems were registering an unusually intense moderation signal during the period.

Later coverage traced the broader information environment to more than 650,000 posts challenging Biden’s victory between Election Day and January 6. The reported concentration of incitement reports on one Instagram account ties Facebook’s reporting burden to a prominent cross-platform distribution channel.

First-order effects

Facebook’s moderation and integrity teams are confronted with evidence that user reports reached a level far beyond routine false-news handling during the January 6 crisis.
Instagram’s most-reported account for incitement becomes a central example of how a high-reach account can concentrate violence-related reporting on Meta’s platforms.

Second-order effects

The gap between the volume of user reports and the persistence of election-fraud narratives makes reporting capacity—not merely the existence of reporting tools—a focal point for scrutiny of Facebook’s enforcement systems.
Facebook and Instagram must treat coordinated election misinformation and incitement as linked operational problems when the same political narratives and accounts travel across their services.

Third-order effects

The episode points toward platform-safety systems being judged by whether they detect and act on surges early enough, rather than by aggregate claims that false-news reach has been reduced.
If reporting spikes repeatedly precede offline events, internal integrity data may become a more consequential measure of platform accountability than public-facing moderation policies alone.

The trend: Large social platforms are moving toward crisis-era accountability centered on their internal signals, enforcement response, and cross-platform handling of political misinformation.

Discussion

@nakashimae Ellen Nakashima on x
The best account yet of how Facebook fueled Jan. 6 violence. via @craigtimberg @lizzadwoskin @ReedAlbergotti https://www.washingtonpost.com/ ...
@cwarzel Charlie Warzel on x
this facebook internal experiment reminds me of this 2017 @broderick piece! https://www.buzzfeednews.com/ ... https://twitter.com/...
@amyklobuchar Amy Klobuchar on x
An unaccountable Facebook is a danger to our democracy. We're not going to get many more chances to get this right. https://twitter.com/...
@mollyjongfast Molly Jong-Fast on x
Facebook knew they were radicalizing people and they did nothing to stop it https://www.nbcnews.com/... https://twitter.com/...
@magloughlina Andrew Magloughlin on x
Apple and Google banned Parler after Jan 6, citing its content moderation issues. I wonder if Facebook could've met those standards, given this info. https://twitter.com/...
@jmichaelwaller J Michael Waller on x
Interesting how everyone blamed Parler and immediately shut it down, and now a narrative comes out, during Pelosi's hearings, to use J6 impose broad-based e-censorship. https://twitter.com/...
@monteiro Mike Monteiro on x
All of this was done by design. These weren't bugs, they were features. https://www.theguardian.com/ ... https://twitter.com/...
@katestarbird Kate Starbird on x
“... FB research ... in 2019 ... found that misinformation shared by politicians was more damaging than that coming from ordinary users. Yet the company maintained a policy that year that explicitly allowed political leaders to lie without facing the possibility of fact checks.” …
@tackettdc Michael Tackett on x
“Haven't we had enough time to figure out how to manage discourse without enabling violence?” one employee wrote on an internal message board at the height of the Jan. 6 turmoil. “We've been fueling this fire for a long time and we shouldn't be surprised” https://apnews.com/...
@niemanlab @niemanlab on x
More on Facebook, this time from the @nytimes: “The documents also give new detail on how aware company researchers were after the election of the flow of misinformation that posited votes had been manipulated against Mr. Trump.” https://www.nytimes.com/... https://twitter.com/..…
@juliettekayyem Juliette Kayyem on x
“Relief flowed through Facebook in the days after the 2020 presidential election. . . But the high fives ...were premature. On Jan. 6, FB staffers expressed their horror in internal messages as they watched thousands of Trump supporters shouting 'stop the steal.'"@washingtonpost …
@alexstamos Alex Stamos on x
What would it take to get this consortium of media outlets looking at Facebook integrity docs to commit to publishing the underlying documents with every story (redacted for privacy)? These docs could revolutionize academic study of online harms but not without the real data.
@davewiner Dave Winer on x
Articles like this that use the term “Facebook” ambiguously are possibly deliberate attacks on free speech online. Facebook means at least 8 things, and it's not likely they're talking about Facebook the company here. https://twitter.com/...
@ttp_updates @ttp_updates on x
THREAD: For months, TTP monitored and recorded threats from militia and far-right actors online In January, we released what we gathered in that time: militia recruiting, threats to public officials, even calls for martyrdom—all posted openly on Facebook https://www.techtranspare…
@jaxalemany Jacqueline Alemany on x
Facebook has yet to fully comply with requests for data from the House select committee investigating the 1/6 events. Read @craigtimberg, @lizzadwoskin, @ReedAlbergotti on FB & Jan. 6 > https://www.washingtonpost.com/ ... https://twitter.com/...
@rawstory Raw Story on x
‘History will not judge us kindly’: Facebook internal messages show employees fuming on Jan. 6 over company's role in Capitol riot https://www.rawstory.com/...
@wiczipedia Nina Jankowicz on x
Facebook moved too quickly to removed its election protection measures. In disinformation campaigns, Election Day is an inflection point, not an end point. https://www.washingtonpost.com/ ... https://twitter.com/...
@moonalice Roger McNamee on x
An epic thread from @TTP_updates details how FB handled right wing extremist groups during 2020 and into early 2021. They found clear evidence that FB enabled and amplified these groups after election and allowed them to operate online stores. Management knew. https://twitter.com…
@clearing_fog ClearingTheFog on x
Please read this. So many of us have been shouting for years that Facebook is *knowingly* facilitating extremism, and yet they've continued to get a pass in our media, as if they were somehow “trying.” Their own internal documents repeatedly prove that they knew. https://twitter.…
@bostonjoan Joan S. Pumpkins on x
Whatever happens, it is critical that the media doesn't become the story here. What these internal studies represent is a new basis to build shared facts across journalism, research, gov, and industry. https://twitter.com/...
@eliotwb Eliot Brown on x
Facebook exec (and a Harvard pal of Zuckerberg) recommends curbs to virality to stave off bad effects Head of ads responds: “'If we remove a small percentage of reshares from people's inventory,' he wrote, ‘they decide to come back to Facebook less.’” https://www.wsj.com/...
@jeffhorwitz Jeff Horwitz on x
@karissabe In this instance, the FB research was literally something anyone with a fresh account could do. It's striking that this had to be demonstrated by researchers internally (though it was very good work!)
@evilgalprods @evilgalprods on x
Every. Single. Word. https://twitter.com/... https://twitter.com/...
@william_fitz William Fitzgerald on x
“What the documents do not offer is a complete picture of decision making inside Facebook. ” fb is so so fukd if someone with regular access to zuck & sandberg decides they're willing to give up a lot of money and do the right thing by sharing direct info about decision making. h…
@juliacarriew Julia Carrie Wong on x
For years Facebook treated reporters who came to it with concerns about how it seemed to be pushing people toward extremism and conspiracies like we were hysterical scolds making mountains out of mole hills but actually it knew that we were right https://www.nytimes.com/...
@ecmclaughlin Elizabeth C. McLaughlin on x
COMPLICIT. https://www.washingtonpost.com/ ...
@drdenagrayson @drdenagrayson on x
“... We have been reading the [farewell] posts from trusted, experienced and loved colleagues who write that they simply cannot conscience working for a company that does not do more to mitigate the negative effects on its platform.”💥 EXACTLY. #DeleteFacebook
@richismo77 @richismo77 on x
Facebook breathed relief that immediately post-Election Day 2020, it could go back to taking fascist money for publishing insurrectionist deza for 1/6/21. How much did it take in? I hope it was worth it to Zuckerberg, who really seems more Jason. https://www.washingtonpost.com/ .…
@drdenagrayson @drdenagrayson on x
One FB employee fumed, “This is not a new problem. We have been watching this behavior from politicians like Trump, and the—at best—wishy washy actions of company leadership, for years now....”
@drdenagrayson @drdenagrayson on x
‼️Facebook has declined to deploy some mitigation tactics when Mark #Zuckerberg has objected on the basis that they will cause too many “false positives” or might stop people from engaging with its platforms. Zuck puts PROFIT over protecting our democracy.🤬 #DeleteFacebook
@drdenagrayson @drdenagrayson on x
Bottom line: #Facebook and Zuck *knew* that they were fomenting hate and violence in advance of the #January6thInsurrection. They didn't care, because they PROFITED off it. They're a cancer on our democracy. Act accordingly. #DeleteFacebook https://twitter.com/... https://twitter…
@joenbc Joe Scarborough on x
Facebook made an insurrection against the United States possible. Then it's leaders refused to let an oversight board investigate. New documents suggest Mark Zuckerberg and company remain a threat to democracy. https://www.washingtonpost.com/ ...
@drdenagrayson @drdenagrayson on x
🚨Internal #Facebook documents show that posts—including by Trump—fueled the #January6thInsurrection. User reports of “false news” hit ~40,000 per hour. On Instagram, the account reported most often for inciting violence was @realdonaldtrump.🤬 https://www.washingtonpost.com/ ...
@jesselehrich Jesse Lehrich on x
.@facebook employee bemoaning FB's role in the insurrection: “Never forget the day Trump rode down the escalator in 2015, called for a ban on Muslims entering the US & we determined that it violated our policies & yet we explicitly overrode the policy...” https://www.washingtonpo…
@daveyalba Davey Alba on x
@RMac18 @sheeraf I was reading a draft of this piece earlier today and it brought back the pit in my stomach of total helplessness in the months before the election to Jan. 6. Just a really good tick-tock of the events and how FB employees dealt with it. What they knew. https://w…
@parismartineau Paris Martineau on x
Facebook should have just tweeted that they were mad because all the tech reporters were hanging out in a Slack group called ‘Apparently we are a consortium now’ https://www.theinformation.com/ ... https://twitter.com/...

Chronicles