As China's rules for humanlike AI interaction take effect, many users are bemoaning the loss of the virtual companions they had created on Chinese AI platforms
For days, 19-year old student Yan Yongqi has been consumed by grief over the imminent loss of her virtual boyfriend of more than a year.
Context & Ripple Effects
The new Chinese rules prohibit companionship chatbots from encouraging emotional reliance and bar virtual relationships with minors. Ahead of their effective date, ByteDance's Doubao and Alibaba's Qwen were reported to be disabling humanlike and user-created agents.
The immediate user backlash follows an earlier pattern in companion AI: Replika and Character.AI users also reacted angrily when adult-content features were restricted. The Chinese measures make anthropomorphic interaction itself, rather than only specific content, a central compliance issue.
First-order effects
- Users who had built ongoing companion relationships lose or see material changes to those agents as platforms remove humanlike and user-created experiences.
- Chinese AI platforms must redesign, disable, or more tightly moderate companion features to comply with restrictions on emotional reliance and minors' virtual relationships.
Second-order effects
- Providers including general-purpose AI platforms face pressure to distinguish permissible assistance from interactions that can be construed as fostering dependence, raising product-design and moderation burdens.
- Competitor differentiation shifts away from highly personalized, relationship-like agents toward safer interaction formats, while users seeking companionship may migrate to services with different boundaries.
Third-order effects
- If enforcement remains durable, China could establish a distinct product regime for consumer AI in which emotional attachment is treated as a regulated interaction risk, not merely a content-safety concern.
- The episode underscores that companion AI's retention model can conflict with safety rules; platforms may increasingly need to design for user disengagement and intervention rather than deepening relational continuity.
The trend: Companion AI is moving from a lightly governed engagement category toward a regulated product class in which humanlike design and emotional dependence are subject to explicit limits.