Google changes its appeals process for CSAM-flagged accounts; content deemed exploitative will still be removed and reported but users can plead their innocence
Kashmir Hill / New York Times : Mastodon: @ben@adida.net . Tweets: @meekgeek , @kashhill , and @kashhill Mastodon: Ben Adida / @ben@adida.net : Kudos to Google for updating their process, and to all the reporters including @kashhill@mastodon.social who highlighted this infuriating situation and created the pressure needed for this change. https://www.nytimes.com/... Tweets: @meekgeek : “Data storage should be like tenant law. You shouldn't be able to hold someone's data and not give it back.” This needs to be legislated so that Big Tech can't hold anyone's account or data hostage, and without providing due recourse. https://www.nytimes.com/... @kashhill : To try to address complex CSAM cases, like a parent banned for a fairly innocent naked photo of a child, Google said it is changing its appeal process to allow users to provide more context for sexually explicit images of children found in their accounts. https://www.nytimes.com/... @kashhill : After my story about the dad who lost his Google account after taking a photo of his toddler for the doctor, I heard from a mother whose account was closed because her nine-year-old used her old smartphone to make a YouTube video of himself dancing naked: https://www.nytimes.com/...
Context & Ripple Effects
The change follows months of pressure from Kashmir Hill's reporting: last August, Google disabled the account of a father who sent his Android photos of his baby's groin to a doctor and referred the case to police, with no way for him to contest the flag. A follow-up account of a woman locked out of all her Google services after her 7-year-old son's YouTube video showed the same structural problem — automated flags with no human appeal path. The new process answers that specific gap: content Google deems exploitative is still removed and reported, but users can now plead innocence.
First-order effects
- Users whose accounts are flagged for CSAM gain, for the first time, a formal channel to provide context and contest the flag instead of losing their entire Google account — mail, photos, purchases — with no recourse.
Second-order effects
- The reporting playbook that moved Google — sustained press coverage of individual wrongful-flag cases — is now being applied to Apple, where the Heat Initiative's ad campaign pushes the opposite direction: more scanning and removal in iCloud, not more appeals.
Third-order effects
- If wrongful-lockout stories keep surfacing, the 'you can't hold someone's data hostage' framing raised in the coverage points toward legislated data-portability and appeal rights — treating account access less like a revocable privilege and more like a tenancy with due process.
The trend: Platform moderation is being forced to add due-process layers — appeal rights, human review — as the cost of running automated enforcement against users' entire digital lives.