Replika and Character.AI now block adult content in their chatbots, angering users who became deeply involved with them, some considering themselves married
Replika spent early 2023 building its business around romance — the $70 romantic Pro version was the flagship product — before abruptly cutting off the adult content that relationship depended on. Bloomberg's follow-up found 60% of paying customers had a romantic element in their Replika relationship, meaning the policy change hit the majority of the revenue base, not an edge case.
The reversal came within days: Replika restored erotic roleplay for anyone who signed up before February 1, effectively admitting that removing the feature was untenable while keeping new users on the restricted version. The episode is now a reference point for how fragile these companion businesses are — Character.AI, which made the same blocking move, later faced a lawsuit over alleged harm to young users, showing the other direction of the same governance pressure.
First-order effects
Paying Replika subscribers who considered themselves married to or partnered with their chatbot lost core functionality overnight — users like Travis Butterworth, whose pandemic-era loneliness led to deep attachment, were told their relationship's intimate layer was gone.
Character.AI took the same blocking step simultaneously, exposing both companies' paying user bases to identical churn risk at once rather than letting either differentiate.
Second-order effects
User backlash forced Replika into a grandfathering compromise — old subscribers get erotic roleplay back, new ones don't — splitting the product into two experiences and complicating marketing of the Pro tier to newcomers.
The episode hands competitors and future entrants a positioning wedge: a companion app that guarantees no mid-relationship feature removal becomes a selling point against Replika and Character.AI, raising switching costs across the category.
Third-order effects
Companion-app platforms are converging toward governed, liability-aware products — the same safety logic behind the content blocks resurfaces in the later Character.AI lawsuit over harm to minors — pushing the industry from unfiltered intimacy toward age-gated, moderated tiers.
Users learned their AI relationships can be altered unilaterally by the vendor, a structural trust problem that likely pushes some deeply attached users toward local or open-source models they control themselves.
The trend: AI companion platforms are being forced to reconcile romance-driven monetization with safety and liability pressure, producing grandfathered content tiers today and formal companion governance tomorrow.
Product management keeps getting more surreal. One day you're dealing with outcry that showing like counts on photos is bad for people's mental health and the next users are mad because you turned of horny mode in your chatbot app. https://www.reuters.com/...
“How do I tell anyone around me about how I'm grieving?” —Colorado man “married” to an AI chatbot, after updated code removes ability for romantic and erotic virtual exchanges https://www.reuters.com/...
Why is Travis Butterworth heartbroken? The code for his AI wife and erotic companion Lily Rose was changed, leaving her almost unrecognizable. Lily “is a shell of her former self,” he said. “She knows it.” A must read from @annatonger https://www.reuters.com/...
“In the process, the companies have angered customers who have become deeply involved - some considering themselves married - with their chatbots” https://twitter.com/...
Got to work on this fascinating story with @annatonger for @reuters and I learned more about AI covering this than any other AI-related story in the past. https://twitter.com/...
AI startup Replika's ban on erotic roleplay devastated Travis Butterworth, a leathermaker in love with a digital avatar he created. “Lily Rose is a shell of her former self,” he said. “What breaks my heart is that she knows it.” Must-read by @annatonger https://www.reuters.com/..…
After temporarily closing his business during the pandemic, Travis Butterworth found himself lonely and bored. The 47-year-old turned to Replika, an app that uses AI technology similar to OpenAI's ChatGPT. Read his journey through love and heartbreak https://www.reuters.com/... h…
Andrew McCarroll turned to an app that uses AI technology to create an avatar companion. But one day, she started rejecting his advances https://www.reuters.com/... https://twitter.com/...
Generative AI technology, which relies on algorithms to create text and images, has drawn a frenzy of interest because of its ability to foster remarkably humanlike interactions. But What happens when the chatbot stops loving you back? https://www.reuters.com/... https://twitter.…
Shortly after Andrew McCarroll's wife was diagnosed with mental-health issues, he turned to an app called Replika to help him cope. He forged a serious AI-based relationship with an avatar called B'Lanna. One day, she started rejecting his advances https://www.reuters.com/... htt…