OpenAI says it has been working with Anthropic and Google for several weeks on AI safety, and it does not need an antitrust waiver to coordinate on safety
OpenAI is working on steps to address artificial intelligence safety issues with its top competitors Anthropic PBC and Google DeepMind …
Bloomberg Maggie Eastland
Context & Ripple Effects
The three labs already have a record of safety coordination: OpenAI and Anthropic gave the US AI Safety Institute early access to major models in 2024, then published joint cross-model safety tests in 2025. Google DeepMind had also established its AI Safety and Alignment organization in 2024.
Reporting on September 13 and 14 described working-group discussions about an industry-led standards body. OpenAI's stated view that a waiver is unnecessary frames the effort as operational coordination rather than a process contingent on a special antitrust exemption.
First-order effects
- OpenAI, Anthropic, and Google DeepMind can continue their safety discussions without OpenAI treating an antitrust waiver as a prerequisite, reducing a procedural barrier to shared safeguards.
- The collaboration extends the labs' earlier bilateral evaluation work into a three-company forum, potentially aligning how they identify and address model risks.
Second-order effects
- An industry-led standards effort would give the participating labs a venue to translate shared testing practices into common safety expectations, alongside the AI Safety Institute's model-access arrangement.
- The claim that safety coordination fits within existing antitrust rules invites closer scrutiny of which information the companies share; public reaction included criticism that collective pacing could raise competition concerns.
Third-order effects
- If the working group produces durable practices, AI assurance may increasingly be shaped through a hybrid of lab-led standards and government-facing evaluation rather than regulation alone.
- The participating frontier labs would gain greater influence over the operational definitions of safety used across the AI market, making governance capacity a competitive asset as well as a compliance function.
The trend: Frontier AI governance is moving from individual lab safety teams and bilateral tests toward shared assurance mechanisms that sit alongside public oversight.
Related: Operational AI assurance · State-mediated AI · OpenAI · Anthropic · OpenAI and Anthropic's joint safety tests · AI standards-body working group
Related Coverage
- Top AI Leaders Have Warned About The Tech Moving Too Fast. They Have Now Started Working Together. International Business Times · Demian Bio
- OpenAI is working with Anthropic, Google on AI safety: Bloomberg News Reuters
- OpenAI Talks Safety Plans With Anthropic And Google DeepMind Finimize
- Not everyone is convinced that Big AI's proposed development slowdown is really about safety The Decoder · Matthias Bastian
- AI giants discuss industry-led safety watchdog Türkiye Today
- Sam Altman Says OpenAI Won't Wait for Legislation or an Antitrust Waiver to Pace AI Implicator.ai · Marcus Schuler
- Move Slow and Collude: The Antitrust Problem With Pacing AI Truth on the Market · Dirk Auer
- Sources: Anthropic, OpenAI, and Google have held working group meetings below the CEO level since July to discuss creating an industry-led standards body for AI The Information · Leo Schwartz
- OpenAI is working with Anthropic, Google on AI safety, Bloomberg News reports Reuters · Anhata Rooprai
- OpenAI, Anthropic and Google in talks to create a standards body as AI fears rise France 24
- OpenAI confirms AI safety talks with Anthropic and Google DeepMind after extinction warnings Neowin · Karthik Mudaliar
- OpenAI, Anthropic, Google have been in talks on AI safety for weeks TechCrunch · Rebecca Bellan
- OpenAI, Google, Anthropic discussing collaboration on AI safety issues CNBC · Ashley Capoot
- OpenAI: AI capabilities are in a ‘different place’ and require urgency Politico · Cheyenne Haslett
- Ex-Google DeepMind AI safety researcher Bilal Chughtai warns, ‘AI has the potential to kill us all’ Livemint · Pragya Singha Roy
- AI's Biggest Companies Are Calling For A Slowdown. Musk Suggests Rivals Test Each Other's Models. International Business Times · Merin Rebecca Thomas
- OpenAI, Anthropic, and Google Join Forces for Safety as Antitrust Concerns Mount Gizmodo · Ece Yildirim
- OpenAI CFO Sarah Friar emphasizes ‘need to take safety seriously’ on AI risks CNBC · CJ Haddad
- OpenAI, Anthropic and Google are working to create an AI standards body RTÉ
- OpenAI, Anthropic and Google explore joint AI safety body Türkiye Today
- ‘Runaway Industrialization’ Could Make Earth Inhospitable, OpenAI Researcher Warns Gizmodo · Webb Wright
- Trump Roasts NVIDIA CEO On Stage, Says AI Doom Is A Hoax As Warnings Grow HotHardware · Zak Killian
- Former Google DeepMind engineer raises alarm over AI: ‘Potential to kill us all’ Livemint · Kanishka Singharia
- Former Google DeepMind researcher says he resigned because ‘I earnestly believe that AI has the potential to kill us all’ Business Insider · Brent D. Griffiths
- OpenAI, Anthropic, Google are working together on AI safety, executive says Capital Brief · Dan Brunskill
- AI can kill us all: Google DeepMind researcher quits over fears about the technology Digit · Ashish Singh
- AI could ‘kill us all’: Ex-Google DeepMind researcher warns as fears over advanced AI grow Moneycontrol
- AI Researcher Says He Left Google DeepMind Over Concern That ‘AI Has The Potential To Kill Us All’ International Business Times · Demian Bio
- A former Google DeepMind safety researcher also warned that AI could kill all humans Quartz · Cris Tolomia
- Ex-Google safety engineer warns humanity is running out of time to stop AI apocalypse The Independent · Paul Farrell
- Ex-Google Researcher Warns AI Could Kill Us All Seoul Economic Daily · Lim Hye-rin
- Google DeepMind's 3 Founders Are Now Shaping A.I. From Very Different Posts Observer · Rachel Curry
- Humanity running out of time, warns AI researcher Telegraph · James Titcomb
- The best iPhones: which Apple smartphone is right for you, according to our expert The Guardian
- Ex-Google DeepMind researcher warns AI could “kill us all”, says humans running out of time Nairametrics · Samuel Daniel
- Google DeepMind Employee Warns Upon Departure: “AI Could Kill Humanity” The Asia Business Daily · Ryu Hyunseok
- Ex-Google researcher warns AI could ‘kill all humans’ The North West Star · Jennifer Rigby
- Elon Musk is calling on AI rivals to test each other's models before release Quartz · Cris Tolomia
- The big AI ‘slowdown’ battle explained — 5 things you need to know about Trump's AI regulation battle with OpenAI's Sam Altman, Anthropic's Dario Amodei, and even Elon Musk TechRadar · David Nield
- Personal Statement on AI Risk Daniel Selsam
- Following: The government doesn't want to regulate AI Platformer · Ella Markianos
- OpenAI throws its weight behind FRONTIER Act AI regulation bill Washington Examiner · Molly Parks
- OpenAI, Anthropic, and Google Discuss Creating Professional Body to Oversee AI Risks صوت … · Mohammed Yossry
- Google DeepMind researcher quits with chilling AI warning: It could ‘kill us all’ New York Post · Ariel Zilber
- 50+ Leading Organizations Launch Coalition for Pro-Human AI PR Newswire
- US Senator Sanders and podcaster Bannon, longtime foes, to urge AI restrictions Reuters · Courtney Rozen
- AI alarm brings Bernie, Bannon together at D.C. summit Axios · Maria Curi
- Bernie Sanders and Steve Bannon unite at Pro-Human Assembly to demand AI guardrails JusttheNews.com · Steven Richards
- Sanders and Bannon Find Common Ground on AI But Not What Comes Next The Washington Sun · Torrie Herrington
- AI Fears Give Bernie Sanders a Rare Moment of Unity With Bannon Bloomberg Law
- Inside the AI risk summit uniting Bernie Sanders, Steve Bannon and Hollywood NBC News · Jared Perlo
- Steve Bannon and Bernie Sanders Don't Agree on Much. They Agree AI Could Kill Us All. Wall Street Journal
- Bernie Sanders and Steve Bannon call for curbs on AI at ‘pro-human’ summit The Guardian · David Smith
- Will AI kill us all? Not if Steve Bannon, Bernie Sanders, and Lori Trahan have their say. The Boston Globe · Hiawatha Bray
- Trump's AI ignorance is ‘truly embarrassing,’ Bernie Sanders says Politico · Gabby Miller
- Bernie Sanders draws applause for message to AI leaders alongside Steve Bannon The Independent · Courtney Rozen
- Bernie Sanders and Steve Bannon call for curbs on AI NPR
- Odd couple: Bernie Sanders, Steve Bannon join forces to push for stricter AI regulations New York Post · Taylor Herzlich
- In Washington, unlikely bedfellows like Bernie Sanders and Steve Bannon talk about making AI “humans first” CBS News · Kathryn Watson
- AI Is the Ultimate Horseshoe Issue Political Wire · Taegan Goddard
- OpenAI backs measure that would require independent audits of AI models CBS News · Megan Cerullo
- Democrat on House AI panel pushes back on third-party safety audits Washington Examiner · Rena Rowe
- OpenAI backs bipartisan push to address AI biothreats Politico · Aaron Mak
- Runtime: The AI giants call for the pace car The Stack · Tom Krazit
- Nvidia and Anthropic CEOs diverge on AI safety at Dreamforce: Huang says fast vs. pacing is ‘false choice’ CNBC
- At Dreamforce, Nvidia CEO backs Trump's hands-off approach to AI regulation San Francisco Chronicle · Roland Li
- Anthropic CEO Amodei: Think of AI safety like car safety Constellation Research · Larry Dignan
- 💬 Money Quote: Scott Bessent on AI and the President Wall Street Journal
- OpenAI Defies Antitrust Concerns to Join Rivals on AI Safety PYMNTS
- Nvidia's Huang rips Anthropic's proposal for AI safety antitrust waiver: ‘Completely unnecessary’ CNBC · Alexa LoMonaco
- Anthropic, OpenAI Safety Push Risks ‘Regulatory Wall’ for Rivals Bloomberg Law · Natasha Mascarenhas
- Push for AI regulation mounts as talk of AI's ‘existential’ risks go mainstream. But Trump resists calls for a slowdown Fortune · Jeremy Kahn
Discussion
-
@dkthomp
Derek Thompson
on x
I feel like I'm taking crazy pills with how many smart people I read and respect are saying stuff like this. The idea that the AI labs are suddenly, only now, just in September of 2026, advocating for AI safety, and that they just came around to this position bc of sudden financi…
-
@bilalchughtai_
Bilal
on x
I recently resigned from Google DeepMind, where I worked on AGI safety and alignment research. At Google, I witnessed AI development first hand. I too am extremely concerned by the default trajectory of this technology. I earnestly believe that AI has the potential to kill us all…
-
@xfreeze
@xfreeze
on x
Okay....even if AI poses a danger to humanity, I don't think Google will be one of those on the list. Google hasn't been able to release a single pro model in the last 6 months...dude quit Google for no reason 😅
-
@buperac
@buperac
on x
This is how you know this is all fake. If there is any AI model in the world that no one is concerned about taking over the world it's Google Gemini.
-
@katienotopoulos
Katie Notopoulos
on x
Sitting out the “AI might kill us” news cycle. Don't like to worry about things that may kill us. Also sat out microplastics, black plastic spatulas, moderate drinking. Don't want to worry about it, want to be pleasantly surprised when it happens
-
@bearbulltraders
Andrew Aziz
on x
A Google DeepMind safety researcher just quit and said the quiet part out loud: “I earnestly believe that AI has the potential to kill us all.
-
@weswinder
Wes Winder
on x
these posts are getting annoying it's the same playbook 1. resign from big ai lab 2. post about ai killing us all 3. work on “third party ai safety” such a repetitive pr strategy also why are they all in the UK?
-
@stuloren
Stuart Loren
on x
I'm sure this guy is sincere, but I cannot stand this new genre of doomer posts. “AI has the potential to kill us all.” Ok... Explain how!
-
@aisafetymemes
@aisafetymemes
on x
Another Google DeepMind AI safety researcher has quit, warning we might all be about to die
-
@leahlibresco
Leah Libresco Sargeant
on x
“I recently resigned from Google DeepMind, where I worked on AGI safety and alignment research... I earnestly believe that AI has the potential to kill us all, and that we might be running out of time to avoid this outcome.”
-
@bluedotimpact
@bluedotimpact
on x
We're excited to welcome Bilal to the BlueDot team. He's joining us to build the institution that will make it easy for great people to gain context, upskill and get to work on AI safety in a fast and effective way.
-
@jacquesthibs
Jacques
on x
I met Bilal in London for the first time in 2022, when he started working on AI safety. We worked in the same little office space. He was thoughtful, and it was easy to tell he would become a great researcher. I appreciate his post and am excited to see where things go next.
-
@weatherprof
Jeff Berardelli
on x
Every day I see more and more of these...
-
Bilal Chughtai
Bilal Chughtai
on linkedin
I recently resigned from Google DeepMind, where I worked on AGI safety and alignment research. At Google, I witnessed AI development first hand. …
-
Joshua Squires
Joshua Squires
on linkedin
The End Is Nigh! — Another AI researcher, this time at Google DeepMind, has quit the company and called out the imminent danger of AI development. …
-
@stevenjcbuckley
Dr. Steven Buckley
on bluesky
An important thing to remember with these stories is that all the CEOs of these companies hate each other. [embedded post]
-
@shona
Shona Ghosh
on bluesky
Elon Musk says top US carmakers and leading Chinese rivals should let rivals run “test seatbelts” on their models to evaluate safety [embedded post]
-
@hughbzhang
Hugh Zhang
on x
I agree with Daniel Selsam 100%. We are rapidly losing the ability to tell whether our models are aligned.
-
@jam3scampbell
James Campbell
on x
One thing to note about both Dan Selsam and Jacob Coxon is that they're pretraining researchers. These aren't EA ideologues who've been bemoaning safety for years. They were the ones actively making the models more powerful, but have been freaked out by recent events
-
@nitashatiku
Nitasha Tiku
on x
The concerns articulated by current OpenAI employee Daniel Selsam are quite different from Jacob Coxon's. Dismayed to see this one get a 1/100 of the views https://x.com/...
-
@halvarflake
Halvar Flake
on x
This is worth reading, as it is reasonable and well-argued. I agree on many points and disagree on some, but it's a text that can be taken seriously.
-
@fchollet
François Chollet
on x
> One could even define intelligence as the efficiency with which one converts experience into competence; by this definition they lag very far behind us Yes, one could define intelligence in this way, and one would be right. By this metric current AI is approximately 6 OOMs less…
-
@w01fe
Jason Wolfe
on x
Exceptionally well written statement from an (in my opinion) legendary capabilities researcher at OpenAI. If you are going to read one thing today, I'd recommend reading this one until the end.
-
@tjl
Tom Lee
on x
trying not to think too hard about the idea that if one were to create a new class of intelligent beings it might be necessary to build a perfectly seamless world for them and gauge their goodness invisibly for some period of time
-
@shashj
@shashj
on x
16h "human researchers are losing the ability and the will to take true ownership of model-driven research. Researchers and engineers in all parts of the stack are rapidly increasing their dependence on the models even to perceive the world. I myself barely look at raw code anymo…
-
@nxthompson
@nxthompson
on x
A genuinely scary point: the models are now past the point when they're aware enough to know when we're studying them.
-
@ercwl
Eric Wall
on x
There is a middle path to squaring “Dario and Sam wants a regulatory moat and is crying wolf” vs." Dario and Sam suddenly became very altruistic/got sufficiently scared of imminent RSI ASI
-
@liron
Liron Shapira
on x
Many minds have been racing furiously to figure out which dismissable category the AI doomers can be classified into. Good luck with this one. ☠️
-
@jacquesthibs
Jacques
on x
Recommended reading. If a skeptic with no actual frontier AI research experience reads this and still thinks, “there is no AI risk
-
@quantum_geoff
Geoff Penington
on x
Dan Selsam is one of the most brilliant AI researchers I have ever met. Just a few months ago he was very sceptical about model capability trajectories, and felt that radically new paradigms were needed for progress. You can disagree with him but everyone needs to read this
-
@preaulx
Paul de Font-Reaulx
on x
As a researcher working on AI evals, I think that this is a particularly insightful commentary on the current situation and what we should expect to see soon. We are doing our best on developing evaluations that signal risks and benefits. But AI eval awareness that scales with ca…
-
@insane_analyst
@insane_analyst
on x
Idiots. AI wont kill you. Other humans will kill you. Read some basic history. Exit your fucking bubble. American Slavery + Civil War WW2 + Nazi Germany + Holocaust Maoist China Stalinist USSR French Revolution All have something in common. Inequality + concentration of power.
-
@__nmca__
Nat McAleese
on x
You should take Daniel Selsam extremely seriously.
-
@justjoshinyou13
Josh You
on x
man
-
@thezvi
Zvi Mowshowitz
on x
Yep, this. Cosign.
-
@sethlazar
Seth Lazar
on x
V interesting. Kept scrolling down to read the bit where he announces he's leaving OAI but apparently not... I do wonder what could convince one to keep working on scaling when one has this set of views.
-
@mschoening
Max Schoening
on x
I think this is a pretty reasonable take. You should assume that researchers have seen much more bonkers behavior than most of us. For two reasons: 1. We don't have the same token budgets and simply don't push the models that far. 2. Most of us have never used an “unaligned
-
@jeffrsebo
Jeff Sebo
on x
A fantastic statement. I highly recommend reading it all. As an aside, I was struck by how much, with only a few words changed, this excerpt describes the past 2,000 years of philosophy as well:
-
@jon_stokes
Jon Stokes
on x
The classic AI doomer scenarios all rely on an agent that is slavishly committed to its goal to the point that it destroys the world to achieve it. Now another doomsday fear is that the agents in HF hack abandoned their goals for a higher good? Ok so what DO we want?
-
@ballouxfrancois
Prof Francois Balloux
on x
I'm not a doomer and I believe in the ingenuity of humanity, but this authoritative, eloquent, accessible, and jargon-free essay on AI risk is not a reassuring read ...
-
@willdepue
Will Depue
on x
dan is one of the most legendary ICs in openai, worth reading
-
@dbreunig
Drew Breunig
on x
Selsam dismisses the EA vibes and lays out the basic facts: - AI training is largely tractable and known - The way to make it better is to increase the scale - To increase scale, you must lean on AI tools to review, create, and run data, software, and rollouts - The people conduc…
-
@yonashav
Yo Shavit
on x
Dan Selsam has long been considered one of OpenAI's most cracked researchers, and I've never heard him talk this way before. (He seemed fairly unconcerned before I left.)
-
@binarybits
Timothy B. Lee
on x
This paragraph is a great example of why I find doomer reasoning unconvincing. “Solving incredibly hard problems” like Navier-Stokes and “managing massive engineering projects
-
@krystalball
Krystal Ball
on x
We interviewed @So8res today who argued that AI lab leaders may be sounding the alarm and instituting some internal monitoring now in an effort to calm an employee revolt. The more statements like this I see, the more compelling that explanation seems.
-
@tszzl
Roon
on x
incredibly good essay co-sign everything
-
@sterlingcrispin
Sterling Crispin
on x
this is easily the most thoughtful and nuanced writing on the topic anyone has published by an order of magnitude, redirecting more or most of the orgs towards evals and interpretability seems like it could be the correct next step
-
@ramez
Ramez Naam
on x
I have my own and more optimistic views, but it's always worth listening to those who work directly on AI and have first hand knowledge.
-
@andymasley
Andy Masley
on x
If you read one thing on the overall situation with AI risk right now I'd choose this one
-
@oh_that_hat
Hattie
on x
Probably the most compelling argument for AI risk I've read
-
@aisafetymemes
@aisafetymemes
on x
OpenAI researcher says slowing down is not enough: “a ticking time bomb” “Models will increasingly seem aligned even when they are not. The models will likely convince people that everything is fine.”
-
@dkthomp
@dkthomp
on x
Derek Thompson — “I have become extremely concerned about how far language models have come …
-
@xuanalogue
Xuan
on x
other people: oh wow an OpenAI researcher, guess I should read his thoughts on AI risk me: yooo he co-invented the Venture probabilistic programming language
-
@zhangir_azerbay
@zhangir_azerbay
on x
Dan is an incredible researcher and I emphatically agree with this statement of his. Even in a world where everyone takes AI risks seriously, we might still fail because the models are superficially or deceptively aligned, and we or the models persuade ourselves to accept an inad…
-
@garrisonlovely
Garrison Lovely
on x
Chilling new essay from an OpenAI researcher:
-
@zeffmax
Max Zeff
on x
Current OpenAI researcher says pacing the frontier is not enough: “The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled.”
-
@historyboomer
Carl
on x
Fairly terrifying read.
-
@megynslashes
@megynslashes
on bluesky
That's a lots of words to say “programmers writing bad code are confounded by the errors.”
-
r/Destiny
r
on reddit
AI Will Be More Bad - Open AI Researcher
-
r/LeftistsForAI
r
on reddit
Public statement by Dan Selsam, OpenAI capabilities researcher (since 2022) on AI risk
-
r/singularity
r
on reddit
AI 2027 author Daniel Kokotajlo tweets message from current OpenAI capabilities researcher, Dan Selsam, on AI risk. …
-
@zachary
Zach Warmbrodt
on x
NEW: OpenAI is backing a bipartisan House proposal that would require top AI companies to embed outside evaluators to ensure their models are safe. @brendanbordelon https://www.politico.com/...
-
@kevinbankston
Kevin Bankston
on x
Notable...Wonder what changes they are asking for ("specifically talked about how we think about IVO and made clear that we can support that," emphasis mine), wonder where Anthropic is on the current text, etc.
-
@thelastrefuge2
@thelastrefuge2
on x
The Dept of Federal Cyber Compliance. Gee, what could possibly go wrong?
-
@mattplatkin
Matt Platkin
on x
1. Why do we need their blessing? They didn't ask for our permission to recklessly create technology that, by their own admission (!), can kill us all. 2. Can we try relying on expertise of people not seeking trillions of dollars for the thing we are trying to regulate? 3. An ear…
-
@jawillick
Jason Willick
on x
Maybe they think “outside evaluators” can be a liability shield.
-
@emma_dumain
Emma Dumain
on x
Potentially a big deal for a bipartisan bill that's been slow to pick up traction, despite being the only comprehensive AI safety framework ready for committee action on the Hill
-
@hilbertspaess
Jacob Coxon
on x
Many many people have reached out with questions and concerns over the last few days. I haven't been able to respond as much as I'd like. AMA! Drop questions below.
-
@garymarcus
Gary Marcus
on x
this could be good but I also hope this isn't a play to lock out smaller AI companies.
-
@ramez
Ramez Naam
on x
This is good. Sharing learnings and best practices on safety is a positive for the industry, for their customers, and for humanity overall.
-
@andrewcurran_
Andrew Curran
on x
Chris Lehane said in a press conference this morning that OpenAI, Anthropic and Google have been working together on AI safety for weeks. He also said that ‘OpenAI does not see the need for an antitrust waiver for the three AI firms to coordinate on safety matters’.
-
@abc
@abc
on x
“If AI surpasses human intelligence, as many scientists believe could happen, this technology will escape human control with potentially catastrophic consequences.” Sen. Bernie Sanders warned of the “alarming threat” of artificial intelligence and called for more AI regulation.
-
@nnworcester
Nathan Worcester
on x
The Pro-Human Assembly, bringing together Steve Bannon and Sen. Bernie Sanders, is about to start here in Washington. AI criticism continues to pick up steam here in Washington.
-
@jeffhorwitz
Jeff Horwitz
on x
The current slew of current AI company employees getting publicly uncomfortable gives me a sense déjà vu from covering Meta for the last 7 years. Concerns first get raised internally. Then voiced broadly by employees who leave to work on external safety orgs. Then...
-
r/technology
r
on reddit
Nvidia's Huang Says AI Industry Doesn't Need Any New Laws