A look at the history of online content moderation, which has become a top culture war issue since the 2016 election and is the subject of multiple court cases
Online content moderation wasn't always a partisan issue. That began to change in 2016. — Early last year …
Washington PostWill Oremus
Context & Ripple Effects
When The Verge walked through the history of content moderation and the laws governing internet speech in April 2016, it read as an operational explainer — how safety teams work, which statutes apply. Six years later, the Washington Post revisits the same history as a political one: since the 2016 election, moderation decisions have become culture-war flashpoints and the subject of multiple court cases.
The arc between those two moments runs through the coverage: Facebook's QAnon ban and other late-2020 moderation calls were widely read as positioning ahead of a possible Biden administration push for regulation, while by early 2021 the Wall Street Journal described moderation as an existential crisis for many services, some writing rules specifically to pre-empt costly enforcement.
First-order effects
Platforms whose individual takedown and ban decisions are now litigated in court face a new cost structure: every high-profile moderation call carries legal exposure on top of reputational risk.
Facebook's moderation choices are being made with regulatory anticipation in mind, not just user-safety policy — enforcement cadence becomes a signal to both political camps.
Second-order effects
As platform-level decisions get contested, moderation pressure migrates down the stack: the Washington Post's analysis of infrastructure companies from CDNs to ISPs shows hosts and carriers being forced to define responsibilities they never priced in.
Smaller services respond by designing policies that avoid the need for expensive human moderation at all — governance shaped by litigation and labor costs rather than by what speech the community wants.
Third-order effects
With Section 230 reform proposals circulating since at least the New Yorker's 2020 overview, the end state is moderation becoming a legally accountable function — gatekeeping that courts, not just trust-and-safety teams, can review.
If court cases keep multiplying, moderation capacity itself becomes a moat: only firms that can afford enforcement at scale plus legal defense can operate open public feeds, consolidating speech infrastructure around the largest platforms.
The trend: Content moderation is shifting from a back-office trust-and-safety practice into a politically contested, legally testable layer of internet infrastructure.
“Content moderation” was once industry jargon. Now it's a front line in the culture war and the subject of multiple potential Supreme Court cases. Here's my attempt to trace the story of how that happened, from 1996 to today, in 3,000 words. https://www.washingtonpost.com/ ...
This is a really good overview by @WillOremus. So much to unpack in this one line: “tech companies were making up the rules as they went, with one finger held to the political winds and one eye on their rivals as each jostled to avoid sticking its neck out alone.” https://twitter…
@katieharbath @WillOremus Right — how'd suppressing the Hunter Biden story go, or banning Covid vaccine misinfo? Can you think of a time at Facebook where the censorship debates involved actual ability to be heard rather than posturing?
Very good primer from @WillOremus on how content moderation went from a mid-90's statutory bolt-on to a mainstream hyper partisan wedge issue. https://www.washingtonpost.com/ ...
“We're approaching a pivotal moment for online speech,” said Daphne Keller, who directs the Program on Platform Regulation at Stanford University's Cyber Policy Center. Good read: https://www.washingtonpost.com/ ...
@JeffHorwitz @WillOremus In terms of the platform if anything it's helped more views surface to more people which is also good and bad. I don't think deplatforming really silences people but I also worry about the symbolism of cutting speech off and how others will use it to just…
As a first cut, if the framing keeps authority or opportunity to speak with the people who already have it, that's reason to assume the lens should be broader.
We all need to be more cognizant of what expertise we are centering — and marginalizing — when we call things “AI” issues, or “content moderation” or “integrity” or “trust and safety” or “platform regulation” or “ethics” or “consumer harm” or “democracy” issues. https://twitter.c…
Musk buying twitter is really bad. Twitter is far from perfect, but it was also the most socially responsible of the major social media companies—both in terms of content moderation and dialing back its algorithms. With Musk all of that will be gone. /1
A characteristically astute account by @WillOremus of the @washingtonpost of the evolution of social media content moderation. One key theme: the platforms' lack of candor about what they're doing. https://www.washingtonpost.com/ ...
If it means reforming 230, I'll hold my nose and work with the likes of Ted Cruz, even though his claims of bias against conservatives is total bullshit. As much as I hate to say it, the enemy of my enemy is my friend. #ReformSocialMedia https://www.washingtonpost.com/ ...
To his credit he cites a number of experts. But one could easily assume by this framing that the “social” is only a ceasepool". Only a sociopath would defend these platforms. https://twitter.com/...
There are no clean solutions here. We've allowed private companies to take control of our communication space. Any and all regulation walks an extremely slippery slope. Optimally we find a way to unplug our communication from private hands...but that seems unlikely. https://twitt…
@katieharbath @WillOremus I agree with this, but have a new question: can you think of an example of a platform making a content moderation decision that squelched an idea or point of view? Do platforms even have that power? The closest I can come is the Patriot Party situation, …
Will's column - along with a few other pieces this weekend - inspired this week's newsletter about politicians and the internet. This will be a series over the next few weeks. Next week it will look at if Trump should be let back on the platforms. https://anchorchange.substack.co…
This could be an inflection point. I agree with @daphnehk, who told @WillOremus “we're approaching a pivotal moment” for speech, online & off: https://www.washingtonpost.com/ ... @meta & @twitter, reluctant to ban a celebrity or world leaders, want @kanyewest to engage us, not en…
@JeffHorwitz @WillOremus You mean where they didn't have other avenues in which to get their POV across? That's where I think this actually starts to get harder and more interesting if cloud services or domain name providers start denying people. Where in the stack is it debilita…
this is a good read on how online content moderation became a central issue in the culture wars (and political battles) in the us https://www.washingtonpost.com/ ...