Q&A with AI pioneer Yoshua Bengio on advocating for AI regulation, his support for California's AI safety bill, AI achieving human-level intelligence, and more
Shirin Ghaffary / Bloomberg : X: @shiringhaffary and @shiringhaffary . Forums: r/artificial X: Shirin Ghaffary / @shiringhaffary : NEW: I talked to legendary AI researcher Yoshua Bengio about why he's worried we're running out of time to regulate AI, and why he supports AI safety bill SB 1047. “It's going to create an incentive for companies to not be the worst student in the class” https://www.bloomberg.com/... Shirin Ghaffary / @shiringhaffary : Bengio told me that for years, he didn't worry too much about AI risks, because he thought we were still far away from AI reaching human intelligence. Then ChatGPT came out. “I've completely changed my mind after we ended up with machines that can talk back to us,” he said Forums: r/artificial : AI Godfather Fears Regulators Running Out of Time to Take Action
Context & Ripple Effects
Bengio’s support for California’s bill extends a long-running public position: he had already argued for AI regulation, including limits on lethal autonomous systems, in a 2019 profile of his regulatory views. His more recent reasoning centers on the speed at which conversational systems have made advanced AI feel less remote.
The interview also follows his 2023 call for governments to act quickly and debates among leading researchers over how seriously to weigh longer-term AI risks. It matters because it connects those broad warnings to a concrete state-level policy proposal and a behavioral rationale for developers.
First-order effects
- Bengio’s endorsement gives SB 1047 a prominent technical voice arguing that safety rules can create incentives for AI companies to improve their conduct rather than merely punish failures.
- The discussion puts greater emphasis on the gap between increasingly human-like interaction and the pace of governance, strengthening the public case for acting before capabilities advance further.
Second-order effects
- AI developers and their policy teams face more pressure to explain how their safety practices compare with regulatory expectations, especially when prominent researchers frame minimum standards as a competitive discipline.
- The debate shifts from whether AI risks merit oversight to how rules should shape company behavior—an operational question that can divide firms, researchers, and policymakers even where they share safety concerns.
Third-order effects
- If state-level proposals continue to attract support from influential AI researchers, AI governance may increasingly be tested through enforceable development and deployment obligations rather than voluntary safety commitments.
- The durable fault line is likely to be whether regulation can set common safety baselines without locking in a single view of which future capabilities or harms deserve intervention.
The trend: AI policy is moving from general warnings about powerful models toward concrete rules intended to make safety practices a condition of competing and operating.