The history of content moderation, the laws that govern internet speech, and how safety works online
The secret rules of the internet — Julie Mora-Blanco remembers the day, in the summer of 2006, when the reality of her new job sunk in. A recent grad of California State University …
Context & Ripple Effects
This 2016 Verge feature is the early, foundational account in a coverage arc that kept growing: it opens with Julie Mora-Blanco's 2006 start as a content moderator to expose the hidden human labor behind internet safety rules, then maps the laws that govern internet speech. At the time, moderation was largely an invisible back-office function with no public constituency.
What makes the piece matter in retrospect is everything the related coverage shows came after: by 2022, moderation had become a top culture war issue since the 2016 election and the subject of multiple court cases, OneZero had interviewed fifteen moderators at YouTube and Facebook about the job's personal toll, and analysts were tracing responsibility up the entire infrastructure stack from platforms to CDNs to ISPs. This article is the baseline those later reckonings measure against.
First-order effects
- Platforms' moderation work is pulled out of secrecy into public view: the feature documents, through Mora-Blanco's experience, that safety online rests on individual human judgment applied under rules most users never see.
- Readers get a consolidated map of the laws governing internet speech — the legal scaffolding that determines what platforms can and must remove.
Second-order effects
- Follow-on reporting treats moderators themselves as a subject: the 2019 interviews with YouTube and Facebook moderators examine the day-to-day and personal cost of the labor this feature first surfaced.
- Techdirt's later pieces reframe the debate, arguing moderation in open forums can support free speech by making spaces where more people feel free to talk — pushing back on the removal-only framing.
Third-order effects
- If the pattern holds, moderation migrates from a platform-internal practice to a contested public-policy domain: litigated in court cases, debated as a culture war fault line, and scrutinized across the infrastructure layer where CDNs and ISPs face their own responsibility questions.
- The durable shift is conceptual: trust and safety stops being customer support and becomes core platform infrastructure, with the humans who do it — and the rules they enforce — treated as objects of journalism, law, and politics rather than trade secrets.
The trend: Content moderation has moved from an invisible operational function governed by obscure laws to a publicly contested pillar of internet governance, with courts, culture warriors, and infrastructure providers all claiming a stake.