Facebook partners with safety orgs in Australia, Canada, the UK, and the US to expand revenge porn reporting tool that asks users to submit photos proactively
Do You Trust Facebook Enough to Use It? Charlie Warzel / BuzzFeed : Facebook Expands Its Efforts Against Revenge Porn Claire Reilly / CNET : Facebook expands its protection of potential revenge porn photos Eric Abent / SlashGear : Facebook's AI now filters out those photos you trusted your ex with Tweets: @buzzfeednews : Just months after it was rocked by a massive privacy scandal, Facebook is offering people a chance to upload their nudes to “specially-trained representatives” in an effort to fight revenge porn. http://www.buzzfeed.com/... Mat Honan / @mat : I do think what Facebook is *trying* to do here is commendable, but this is just a bizarre program. http://www.buzzfeed.com/... Sarah Frier / @sarahfrier : Meanwhile, Facebook tells people to securely upload the intimate images they are concerned about someone sharing as revenge porn. Then Facebook will create a hash of the image and automatically block anyone who tries. http://www.facebook.com/... http://twitter.com/...
Context & Ripple Effects
Facebook has been building toward this for over a year: first it allowed flagging and removal using photo-matching tech on Messenger and Instagram, then it ran an Australian test where users messaged themselves nude photos so Facebook could hash them and block future uploads — with a promise that humans would review any uncensored images. Today's move takes that pilot global, adding safety organizations in Australia, Canada, the UK, and the US as intake partners.
The timing is awkward by design of circumstance: the announcement lands just months after the Cambridge Analytica scandal, and coverage like BuzzFeed's 'Do You Trust Facebook Enough to Use It?' frames the core tension — the company is asking users to hand it their most sensitive images precisely when trust in its data handling is at its lowest.
First-order effects
- Potential victims in four countries gain a preemptive option: submit an intimate photo through a partner safety organization before it spreads, rather than filing a takedown after the fact.
- Facebook's partner safety organizations become the trusted front door for submissions, keeping users from uploading nudes directly to Facebook itself during a trust crisis.
Second-order effects
- The hashing pipeline built for this tool strengthens enforcement across Facebook-owned surfaces — the same photo-matching approach already blocks re-shares on Messenger and Instagram, and later feeds the AI detection system Facebook shipped in 2019.
- Rival platforms face pressure to adopt comparable hash-based blocking or risk becoming the fallback venue for images blocked on Facebook.
Third-order effects
- Intimate-image abuse shifts from a reactive moderation problem to an infrastructure one: dedicated teams (Facebook later staffed a 25-person unit handling hundreds of thousands of monthly reports), NGO partnerships, and shared hashing databases become the standard architecture.
- The model points toward cross-platform prevention — realized in Meta's later StopNCII.org partnership with the UK Revenge Porn Helpline — where a single submission can block matching images across participating services.
The trend: Platform safety is moving from reactive takedowns to preemptive image-blocking built on hashing, dedicated teams, and NGO partnerships.