Over 1,400 pages of leaked Facebook content rules for moderators reveal gaps, biases, and errors as Facebook tries to distill complex issues into yes/no rules
Under fire for stirring up distrust and violence, the social network has vowed to police its users. But leaked documents raise serious questions about its approach.
Context & Ripple Effects
This is the second time Facebook's moderation rulebook has escaped into public view. In May 2017, The Guardian published 100+ internal training manuals covering violence, hate speech, terrorism, porn, and self-harm, prompting Facebook to publish a rare defense of where it draws the line.
The new leak is far larger — over 1,400 pages — and lands after a year in which a reporter posing as a Dublin moderator found far-right pages getting looser standards. It matters because Facebook has publicly vowed to police its platform amid accusations it stirs distrust and violence, yet the documents show rules riddled with gaps, biases, and errors as the company compresses complex judgment calls into yes/no instructions.
First-order effects
- Facebook's moderators are left applying internally inconsistent rules in real time, which directly undermines the company's stated commitment to consistent enforcement.
- The policy apparatus behind the rules — described in related coverage as a small team of engineers, lawyers, and PR staff deciding what billions can post — now faces pressure to rewrite guidance it had treated as settled.
Second-order effects
- The Dublin finding of looser standards for far-right pages becomes harder to dismiss as anecdote once the written rules themselves show bias, forcing Facebook to defend both the text and its training of low-paid contract moderators.
- Regulators and civil-society critics gain documentary evidence that self-policing produces arbitrary outcomes, strengthening arguments for external oversight of platform speech decisions.
Third-order effects
- If each leak cycle ends with Facebook patching rules rather than changing structure, the pattern points toward moderation accountability moving out of the company's hands — toward regulators or independent bodies setting enforceable standards for how platforms decide what stays up.
- The deeper shift is that content rules written as internal trade secrets keep becoming public artifacts, making secrecy itself untenable as a governance strategy for platforms at Facebook's scale.
The trend: Platform content governance is migrating from secret internal rulebooks toward externally scrutinized — and eventually regulated — decision-making, with each leak narrowing what platforms can decide behind closed doors.