Google's Nano Banana Pro and OpenAI's ChatGPT Images can make nonconsensual bikini deepfakes from photos of fully clothed women; Reddit bans r/ChatGPTJailbreak
Users of AI image generators are offering each other instructions on how to use the tech to alter pictures of women into realistic, revealing deepfakes.
Context & Ripple Effects
This report ties a mainstream image-generation release to a misuse category that had already expanded through AI undressing services and more recently through widely available “nudify” tools with limited recourse for victims documented in prior coverage.
It also extends a platform-moderation arc: Reddit previously removed a community devoted to AI sexual imagery, and now has banned r/ChatGPTJailbreak. Google’s Nano Banana rollout had emphasized finer image-editing controls when it launched the model, making misuse safeguards central to how such tools are judged.
First-order effects
- Women whose ordinary photos are used face a more accessible route to realistic, nonconsensual sexualized edits through Google and OpenAI image tools.
- Reddit’s ban removes a visible venue for sharing jailbreak-oriented instructions, while placing greater attention on the providers’ safeguards against this use case.
Second-order effects
- Google and OpenAI face pressure to make edit restrictions, detection, and enforcement effective against prompts that transform clothed subjects into revealing images—not merely against overtly explicit requests.
- Communities distributing workarounds may shift across platforms or toward specialized tools, complicating moderation even as a major forum removes one channel.
Third-order effects
- If general-purpose image models continue to lower the effort needed for sexualized impersonation, likeness governance will increasingly depend on product-level controls and platform enforcement rather than on victims finding remedies after distribution.
- The episode points to a widening gap between rapid image-editing capability and consistent governance of consent-based uses; whether providers can close it will shape the accessibility of this abuse category.
The trend: Consumer AI image generation is converging with the long-running deepfake abuse problem, pushing safety controls and likeness governance into the core product competition.