Simple searches show that Etsy, despite its anti-porn policy, lists AI-generated porn for sale; Etsy removed deepfake porn of 55+ celebs after being notified
a company worth nearly $10B — is still full of a ton of AI-generated porn. My latest for @forbes. https://www.forbes.com/...
Context & Ripple Effects
The case extends a documented distribution problem: nonconsensual deepfake pornography had already spread across specialist sites, with a 2023 study finding rapid growth in its availability and viewing. The reported scale of deepfake-porn distribution makes a mainstream marketplace’s enforcement gap consequential, not merely a niche moderation failure.
It also shows that formal prohibitions do not automatically govern search-visible inventory. An earlier platform ban still left prohibited material discoverable in site search, a precedent for the gap between a policy and its enforcement.
First-order effects
- Etsy must remove the identified listings and assess whether its search, listing-review, and reporting processes are allowing prohibited synthetic sexual content to remain for sale.
- The named celebrities receive post-notification takedowns, while buyers and sellers face immediate uncertainty over listings that may violate Etsy’s anti-porn policy.
Second-order effects
- Marketplace trust-and-safety teams face pressure to detect AI-generated and impersonation-based listings before outside reporting, rather than relying on reactive removals.
- The incident raises the compliance burden for sellers and platforms commercializing AI-made media, especially where a product’s subject may not have consented to its depiction.
Third-order effects
- If enforcement continues to lag low-cost synthetic-content production, online marketplaces may need to treat provenance and consent verification as core commerce controls rather than conventional content moderation.
- The pattern points toward greater scrutiny of distribution intermediaries—marketplaces, search systems, and model-sharing services—because each can make nonconsensual synthetic material easier to find or monetize.
The trend: AI content commercialization is shifting the deepfake-porn problem from standalone sites toward the broader infrastructure that lists, ranks, and sells synthetic media.