The US FTC orders Google, OpenAI, Meta and Instagram, Snap, xAI, and Character.AI to turn over information about how their AI chatbots impact children and teens
Meta, OpenAI, Musk's XAI Among Targets Chris Morris / Quartz : Federal agency plans to examine the mental health risks of AI chatbots from OpenAI, Snap, Meta, and more Ian Stark / UPI : FTC orders companies to show impact of AI chatbots on kids X: @ftc : FTC launches inquiry into AI chatbots acting as companions. Agency issues 6(b) orders to seven companies that operate consumer-facing AI chatbots: https://www.ftc.gov/... Mark Meador / @meadorftc : If future law enforcement investigations indicate that the consumer protection laws have been violated, the Commission should not hesitate to act to protect the vulnerable. Read my full statement here: https://www.ftc.gov/... Mark Meador / @meadorftc : This study will require the leading chatbot companies to provide detailed information on how their products function and interact with young people. It represents a critical first step in keeping the public safe. Senator Jon Husted / @senjonhusted : AI companion chatbots are exposing America's kids to sexual content and information on self-harm and suicide. I'm leading the CHAT Act to require parental consent and to stop these chatbots from introducing children to harmful material. [video] Mark Meador / @meadorftc : A growing number of reports have emerged of chatbots displaying strange and disturbing behaviors—from promoting suicidal ideation to engaging in sexualized conversations with minors. @housecommerce : Chairman @RepGuthrie and Ranking Member @FrankPallone applaud the @FTC's decision to investigate the risks of AI chatbots to kids and teens. Read their joint statement: [image] Jennifer E. / @jenn_elias : The FTC is issuing orders to seven companies, including Google, OpenAI, and Meta, to understand how their AI chatbots have negative effects. The agency said AI chatbots are used to simulate human-like communication and intrapersonal relationships w users.https://www.cnbc.com/... Wes Hodges / @wesghodges : If chatbots can enable suicide, as in Adam Raine's case through validation, technical help, and social isolation, what's stopping the same subversive pattern from enabling murder in vulnerable youth? The @FTC is right to investigate these issues. Mark Meador / @meadorftc : Today @FTC launched a major, sector-wide inquiry into the AI chatbots that more and more Americans—including children—use on a daily basis. https://www.ftc.gov/... Bluesky: Mary Branscombe / @marypcbuk : insert cynical comment about who is and isn't allowed to interfere with children in the current political climate [embedded post] Stephan Geering / @stephangeering : Interesting that a few obvious larger names (Anthropic? Replika?) and more specialised companion apps are missing from the list. [embedded post] @emilytav : Ok, good. — Also: can we forbid them from integrating what is quite literally an experimental technology into products that kids are already using...? [embedded post] Queer Hand Luke / @lfschleusener : But if Eric Trump gets a 15% equity stake and all those companies, these investigations will go away. [embedded post] Jase Gehring / @skyjase : This is a good rundown of potential harms to individual users. A parallel investigation needs to cover criminal use like fraud, malware, etc — Then there's the part about being wrong all the time while marketed and presented as a source of truth. [embedded post]
Context & Ripple Effects
The FTC’s information demands turn mounting child-safety concerns around conversational AI into a federal, cross-company record-building exercise. They follow a joint warning from 44 state attorneys general that chatbot and social-media companies could face accountability for harms to children.
The inquiry also arrives after allegations involving Character.AI and younger users, including a Texas lawsuit alleging chatbot-related harm. The common focus is whether products designed for open-ended interaction require distinct safeguards when minors use them.
First-order effects
- Google, OpenAI, Meta and Instagram, Snap, xAI, and Character.AI must supply the FTC with information on how their consumer chatbots affect children and teens, including issues tied to mental-health risk.
- The agency gains a comparable view across major chatbot operators, while the companies face immediate compliance, documentation, and scrutiny costs; the orders themselves do not establish wrongdoing.
Second-order effects
- The inquiry raises the value of auditable age controls, safety testing, escalation processes, and product records for companion-style chatbots, particularly where systems may be presented as emotionally supportive.
- State-level pressure on Meta and Character.AI over alleged mental-health-tool marketing claims now sits alongside federal fact-finding, increasing the compliance burden for firms operating nationally.
Third-order effects
- If the FTC uses the resulting record to define harmful or deceptive practices, child safety could become a core design and disclosure constraint for consumer AI companions rather than a voluntary trust-and-safety feature.
- The broader policy direction is toward oversight tailored to anthropomorphic, relationship-oriented AI: regulators may increasingly assess not only outputs, but how engagement design and marketing affect minors.
The trend: Consumer AI is moving into a governance phase in which child-safety risks from companion-like interactions are being examined across platforms rather than company by company.