Dario Amodei proposes steps for pacing the frontier: embedded evaluators, coordination among democracies, and global coordination with authoritarian governments

I have worked on AI for the last twelve years because I believe it could dramatically raise the quality of human life.

Dario Amodei 2026-09-12

Context & Ripple Effects

Amodei’s case for pacing follows his June call for mandatory third-party testing of frontier models for cyber, bio, and autonomy risks. Anthropic is pairing that policy argument with a commitment to give outside evaluators permanent, employee-like access, making verification an operational practice rather than a disclosure pledge.

The proposal also extends Amodei’s earlier argument that democracies must retain an AI lead into a coordination agenda that includes authoritarian governments. It arrives amid an explicit dispute over governance: David Sacks framed Amodei’s approach as favoring centralization, while arguing powerful AI should not be centralized.

First-order effects

Anthropic’s embedded-evaluator program gives third parties a standing role in checking whether its stated safety measures are followed, raising the bar from one-off assessments to ongoing access.
Amodei’s pacing agenda asks frontier labs and governments to treat deployment speed, safeguards, and independent evaluation as linked decisions rather than separate policy questions.

Second-order effects

Other frontier labs face pressure to explain whether their safety claims can be independently verified; voluntary transparency without durable evaluator access becomes easier to challenge.
Coordination among democracies makes frontier-model governance a foreign-policy issue as well as a lab-governance issue, while proposed engagement with authoritarian governments makes shared safety thresholds part of the debate.

Third-order effects

If embedded evaluation becomes a common model, frontier AI governance shifts toward institutionalized oversight with persistent access to technical systems, not episodic company reporting.
The larger fault line is whether managing high-capability models requires state-mediated coordination and concentrated controls, or whether those controls create an unacceptable centralization risk.

The trend: Frontier AI governance is moving from voluntary safety principles toward operational verification and international coordination over the pace of capability deployment.

Discussion

@elonmusk Elon Musk on x
Dario is right
@levie Aaron Levie on x
Good post. Don't agree with all of it, but it represents many of the actual practical realities for the general path forward in frontier AI whether we like it or not. At the level of capability we're seeing from models there will inevitably be some form of coordinated self-regula…
@ccatalini Christian Catalini on x
A great step toward better measurement and verification. 🙏 But if the “third-party evaluators” are handpicked to endorse the lab's regulatory agenda, that won't give us independent scrutiny.
@rhfontaine Richard Fontaine on x
A statement from me, Buddy Shah, and Ben Bernanke of Anthropic's Long-Term Benefit Trust on Dario's essay: Dario's essay offers a thoughtful, well-considered approach to pacing the development of artificial intelligence. Consistent with our duty to ensure Anthropic responsibly ba…
@deredleritt3r Prinz on x
This is my favorite Dario Amodei essay since “Machines of Loving Grace”. …
@benbajarin Ben Bajarin on x
AI is an arms race. It gets really scary when you start following the cyber security tracks to its logical conclusions. Rather than slowing they should SPEED UP, enabling cyber security defense. Basis of my whole report/thesis here- https://www.thediligencestack.com/ ...
@thezvi Zvi Mowshowitz on x
Okay, this is actually about as good as we could have hoped for under the circumstances. We might be seeing Actual Progress. [image] [embedded post]
@levie Aaron Levie on x
Good post. Don't agree with all of it, but it represents many of the actual practical realities for the general path forward in frontier AI whether we like it or not. At the level of capability we're seeing from models there will inevitably be some form of coordinated self-regula…
@jackclarksf Jack Clark on x
Proud of this statement from Dario on pacing - as anyone close to the technology knows, AI seems to be on a trajectory to progress far faster than the rate at which society can adapt to its capabilities and risks. AI is an amazingly positive technology - and an incredibly powerfu…
@thezvi Zvi Mowshowitz on x
Inside Dario Amodei are two wolves. [embedded post]
@chamath Chamath Palihapitiya on x
“We must slow the pace at which we improve the capabilities of AI models.” Dario makes the case to stop open source and concentrate enormous technological and economic power with Anthropic. https://darioamodei.com/...
@stocksavvyshay Shay Boloor on x
You've already argued that AI safety is a prisoner's dilemma that cannot be solved by one company acting voluntarily yet slowing the US frontier only works if everyone else slows with us and China has no reason to do that. We can't afford for America to regulate itself out of the…
@rand_longevity Rand on x
at least Dario acknowledged the truth China would need to agree to slowdown and regulate themselves out of good faith for this to work until that day we are full on accelerating
@int_underflow Lucy Sweet on x
With people finally realising how capable these AI models are hopefully we'll actually get traction on this.
@_nerd_ Shahin on x
I will leave this here
@sleepinyourhat Sam Bowman on x
This kind of ongoing accountability is going to be open up a lot of really valuable possibilities for safety, and I'd love to see similar things elsewhere:
@jbsdc Justin Slaughter on x
This is a pretty effective raise on the other frontier labs - if other entities don't reciprocate, it reduces their standing with a lot of policymakers. I expect OpenAI agrees with the right contours of this by early next week but with some additional requests for legislation.
@hadrianveidt0 Hadrian Veidt on x
The case for pacing AI remains incomplete until it accounts for the dangers created by pacing. Restricting American laboratories could weaken our position against adversaries, discourage new competitors, and delay the discoveries that make advanced systems controllable. Any serio…
@negligible_cap @negligible_cap on x
*ANTHROPIC CEO SAYS WE MUST SLOW PACE OF IMPROVING AI MODELS Dario's proposing a 3 step plan with the goal of pacing the frontier
@tropofarmer @tropofarmer on x
the bad news: Dario estimates that in 6 months AI will have the ability to take over the internet the worse news: Anthropic's current commitment to stopping this is... putting independent evaluators in desks in their office have a great day
@austinsemis Austin Lyons on x
Obvious implication: if the US AI labs purposefully slow down, other countries may opt to keep the pace up and close the gap. Now the misaligned frontier AI is outside US borders and control...
@sarahkheck Sarah Heck on x
An important call to action from @DarioAmodei and @AnthropicAI to deliberately pace the frontier of AI. The government has a critical role to play here, including blocking the sale of the most advanced chips to adversarial nations like China, enacting a national law requiring tes…
@jumperz @jumperz on x
Dario: AI is moving too fast, we need to slow down before something goes horribly wrong also Dario: but first make sure China is slowed down even harder so America can keep a massive lead, then we can safely slow ourselves down he's basically saying
@hadas_gold Hadas Gold on x
CEO of Anthropic calls for an AI slow down
@sam_badawi Sam Badawi on x
Anthropic CEO Dario Amodei says frontier AI development needs to slow enough for safety and alignment work to keep pace as recursive self-improvement accelerates. He proposes permanent third-party evaluators embedded inside frontier labs, followed by industry-wide safety standard…
@stocksavvyshay Shay Boloor on x
Anthropic CEO Dario Amodei says “we must slow the pace” of improving AI model capabilities.
@matthewclifford Matt Clifford on x
Important new essay from Dario that calls for coordination at the frontier so that operational excellence (e.g. security), alignment and evaluation don't fall behind capabilities. As Dario says, the role of democracies is vital; there's a big part for US allies globally to play👇
@mikeisaac Rat King on x
ceo of anthropic dario amodei publishes letter calling for an AI development slowdown
@aileaksandnews @aileaksandnews on x
Dario Amodei has released a new essay: We Must Pace the Frontier In this essay he argues that AI is advancing dangerously fast, especially through RSI, so frontier labs should deliberately slow down capability gains Do you agree that we should slow down?
@deitaone @deitaone on x
ANTHROPIC'S DARIO AMODEI: WE MUST SLOW THE PACE AT WHICH WE IMPROVE THE CAPABILITIES OF AI MODELS
@robleclerc Rob Leclerc on x
if this is the best they've got, i'll be downgrading my p(doom) even further. all these scenarios describe TOTAL and intentional stupidity, complete abdication of human agency, abandonment of self-interest, and that all ai unilaterally turns on humanity and can't be used as a def…
Sarah Heck Sarah Heck on linkedin
An important call to action from Dario to deliberately pace the frontier of AI. The government has a critical role to play here …
Mariano-Florentino Mariano-Florentino on linkedin
Today, Dario and Anthropic proposed a worldwide effort to deliberately pace AI's progress so that humanity can better manage the risks of rapidly-advancing models as the technology advances. …
@timkellogg.me Mr. Tim on bluesky
Dario is back with another essay, urging a slowdown — he insists AI development would still feel fast, just not recursively self-improving — darioamodei.com/post/we-must... [image]
r/accelerate r on reddit
Dario - Let's Decel
r/singularity r on reddit
Dario Amodei — We Must Pace the Frontier
@jessicalessin Jessica Lessin on x
On first read, getting “Oversight Board” deja vu from some of this. https://darioamodei.com/...
Patrick Donahue Patrick Donahue on linkedin
Exclusive: OpenAI is considering slowing down the development of cutting-edge artificial intelligence, and the ChatGPT maker's Chief Executive Officer Sam Altman …
@wallstengine @wallstengine on x
Anthropic CEO Dario Amodei is calling for slower AI development. He warns that rogue AI agents working together could become capable of taking over the internet within 6-12 months.... potentially causing hundreds of billions of dollars in damage
@zephyr_z9 @zephyr_z9 on x
Scary [image] [embedded post]
@kimmonismus @kimmonismus on x
The urgent call for slow down officially started. Dario Amodei demands and suggest a plan for unified slow-down. …
@luckeyfaraday Luckey Faraday on x
Anthropic is no longer the frontier. Now they want everyone else to slow down so they can catch up.
@rsanti97 Santi Ruiz on x
“We'll provide third-party evaluators with permanent, employee-level access to our systems.”
@mkoeris Michael Koeris on x
This is a good move. Well done @DarioAmodei - have to go unilateral and show it works. Look forward to seeing the results and impact.
@mikeisaac Rat King on x
i think this is a fair criticism most generous view would be “well governments aren't moving fast enough so here's our proposal until U.N. involved” cynical version would be “handpicked industry insiders rubber stamp our stuff while we sit on top”
@vijayshekhar Vijay Shekhar Sharma on x
Summary: The advancement of AI through recursive self-improvement poses significant risks. To balance AI safety and benefits while allowing time for crucial alignment, Dario suggests: 1. Embedding third-party evaluators in AI companies 2. Coordinating safety standards and progres…
@jonfavs Jon Favreau on x
Maybe the people who are actually building this technology don't believe your “crisper” message is accurate? Maybe they're not doomers but realists? Have we considered that people who don't agree with the investor class take on AI aren't actually the crazy ones?
@zeffmax Max Zeff on x
Dario says the US government needs to issue a “narrow waiver” for AI labs to have safety conversations for antitrust reasons. I reported Thursday that OpenAI asked members of Congress for clarity on whether AI labs could coordinate a slowdown without running into antitrust law.
@_achan96_ Alan Chan on x
lfg
@heidykhlaaf Dr Heidy Khlaaf on x
How is Anthropic pushing regulatory capture? Here they promote METR, a “voluntary” third-party auditor that is not only ideologically and financially tied, but carries out their audits through unscientific means such as “CoT
@matthewstoller Matt Stoller on x
BREAKING: Anthropic CEO Dario Amodei demands that the government stop applying laws restraining big business.
@mikeisaac Rat King on x
i think it's a window into AI company thinking that Amodei's proposed solution basically describes a framework similar to how current day U.N. investigators go into nuclear facilities across countries — many of which are at war with one another — for testing
@bindureddy Bindu Reddy on x
🚨PAUSE FRONTIER AI BUT PLEASE DO NOT BAN OPEN SOURCE AI Anthropic and OpenAI are more than free to pause frontier AI development. However, they SHOULD NOT be allowed to ban or regulate open-source AI, capture the market, or create a duopoly Open-source AI is still behind frontier…
@aidan_mclau Aidan McLaughlin on x
excellent essay. i agree with basically every word here
@darrenpjones Darren Jones MP on x
A credible plan from @DarioAmodei and the @AnthropicAI team on a framework for the safe development of advanced AI. Once again, AI companies are calling on governments to play their role. I hope they listen and step up.
@austen Austen Allred on x
So this means Anthropic pauses R&D and everyone else can catch up to where Anthropic is, right?
@matthewstoller Matt Stoller on x
“For antitrust reasons, it's helpful for the US government to mediate or at least enable these discussions — they don't need to participate, but do need to issue a narrow waiver for certain kinds of safety conversations.” And there we go.
@danielnewmanuv Daniel Newman on x
Whether he's right or wrong, you can be sure this isn't altruism. 🥸
@cgtwts @cgtwts on x
TLDR: Dario on AI: “I believe that AI could cure most major diseases in the next 5-10 years, greatly accelerate economic growth rates, create a world of abundance and empowerment.” Also Dario: “We must slow the pace at which we improve the capabilities of AI models.”
@ledermanharvey Harvey Lederman on x
I encourage everyone to read this essay. I'm glad that Anthropic has committed to step 1 and hope other companies will follow. But it is not enough. We also need to make progress, together, on steps 2 and 3.
@ross__hendricks Ross Hendricks on x
Read this is: our business model burns way too much cash, so we must force everyone else to stop developing and regulate our way into a government-protected monopoly
@mvanhorn Matt Van Horn on x
TL;DR ELI5 of @DarioAmodei's new post: Anthropic thinks the AI industry is moving too fast and is proposing a three-step plan to slow the frontier down. Step one starts today. 🚀 AI is now building the next AI (recursive self-improvement). Since this summer progress jumped, and it…
@powerbottomdad1 @powerbottomdad1 on x
wow, finally something i agree 100% with dario on
@jsevillamol Jaime Sevilla on x
The Dario Amodei writing challenge: go on for longer than three paragraphs without hating on China.
@willdepue Will Depue on x
i think sama deserves great credit for this. openai, for better or worse, is very defensive of employee freedom of speech. anthropic's culture is a follow on to this. it's rare to see much from X or GDM or Meta
@jason @jason on x
I think we're all in sync on freedom of speech, but these doomer tweets are being free-based by the media and inspiring crazy people to, well, do crazy people things. It would be great to see some restraint and a crisper message... like,
Brian Peters Brian Peters on linkedin
Dario's essay arrives as Congress weighs how to hold the most powerful AI systems to account. A year ago the debate in Washington was whether Congress should act on frontier AI at all. …
r/neoliberal r on reddit
Dario Amodei — We Must Pace the Frontier
r/BetterOffline r on reddit
Dario's got another blog post: This time he wants you to know chatbots are so super scary that “We must slow the pace at which we improve the capabilities of AI models.”
r/LocalLLaMA r on reddit
Dario Amodei — We Must Pace the Frontier
r/ClaudeAI r on reddit
Dario Amodei — We Must Pace the Frontier
r/OpenAI r on reddit
Dario Amodei — We Must Pace the Frontier
@stevenjcbuckley Dr. Steven Buckley on bluesky
These AI CEOs are just allowed to spout utter bullshit and mainstream journalists just accept it at face value. [embedded post]
r/nyt r on reddit
This Is Really Bad
@timsweeneyepic Tim Sweeney on x
@DarioAmodei Are the third-party evaluators going to be political operatives?
r/ArtificialInteligence r on reddit
Anthropic CEO Says It's Time to Slow Pace of Improving AI Models
@mikeisaac Rat King on x
Sam Altman, CEO of OpenAI chimes in and agrees with his rival Dario Amodei of Anthropic about an AI slowdown https://x.com/...
@teroterotero Tero Kuittinen on x
He's a sly one. He knows he gotta look like he is onboard.
@altryne Alex Volkov on x
Pinch me! Sam Altman, Elon Musk and Dario all agree on pacing!
@karpathy Andrej Karpathy on x
I love this and really hope we can come together as an industry and make it happen.
@mikeisaac Rat King on x
to that end/point, ceo of HuggingFace — a vocal proponent of open source software (and one of the companies hacked by OpenAI's closed models) — is calling to be included as one of Amodei's “embedded evaluators” https://x.com/...
@kevinroose Kevin Roose on x
We have reached the “Sam and Dario agree on something” part of the singularity.
@dylanmatt Dylan Matthews on x
Man ... what if we make it?
@daveshapi David Shapiro on x
Here's how this plays out: It doesn't China isn't slowing down. xAI isn't slowing down. “Pacing the frontier” is fear mongering theater to justify regulatory capture and eliminate competition.
@kimmonismus @kimmonismus on x
That likely seals it. The biggest and most significant frontier labs, Anthropic and OpenAI, are in agreement on slowing things down. This means the move will likely be implemented. It remains to be seen how China will respond.
@badboyfoxy @badboyfoxy on x
Today is a day we will not forget ! Sam , and Elon agreed with Dario on the slow down of AI who else will agree to this ? definitely not china
@jun_song Jun Song on x
Like I've been saying, OpenAI and Anthropic are just acting like they hate each other. They're on the same team. Anthropic played the Bad Cop with the dirty image, while OpenAI just played the Good Cop for consumers. Behind the scenes, they've been moving together the whole time.
@ctjlewis Lewis on x
Evaluators hardly sound like slowing down or pacing the frontier so I don't care and will ignore it.
@notjazii @notjazii on x
history is being written today for the first time ever, i've seen sam agree with dario, wow just wow so far elon, sam and dario have called for slow down of ai who else is joining them?
@yuchenj_uw Yuchen Jin on x
First time I've seen Sam agree with Dario since Anthropic was founded.
@yulikay Yuli Kay on x
And now BOTH Anthropic and OpenAI CEOs are saying the AI frontier needs to slow down 👀
@boazbaraktcs Boaz Barak on x
Very proud to be at OpenAI today.
@thestalwart Joe Weisenthal on x
Any random restaurant regularly has third party inspectors checking, you know, refrigerator temperature or gas lines or raw meat handling. What's the argument against having an AI “lab” equivalent?
@tracewoodgrains Jack on x
Elon and Dario are right.
@ccatalini Christian Catalini on x
The global race is scaling AI we can trust and rely on. Pacing to invest in greater measurability and verifiability isn't slowing down. It's the actual race.
r/StockMarket r on reddit
Anthropic CEO Says It's Time to Slow AI Model Advances
@mattyglesias Matthew Yglesias on x
Today Amodei, Altman, and Musk all came out in favor of what I described as Step 1 in a realistic plan below. We should do it! And then move on to Step 2.
@thezvi Zvi Mowshowitz on x
At some point you realize that when the top labs shoot themselves in the foot the ‘skeptics’ will say this is a conspiracy for regulatory capture because little tech cannot afford good health insurance. We continue.
@benjamindekr Benjamin De Kraker on x
Is it possible one of the labs hit Recursive Self-Improvement (RSI) and everyone got spooked? There were rumors this past week that Google made an RSI breakthrough; by this weekend, the major U.S. AI labs are suddenly in agreement that we need to slow down. Perhaps ask why
@jason @jason on x
Get ready for all of the investors in frontier model companies to suddenly flip to regulatory capture mode today Their investments in frontier model companies are currently at risk/capped because the biggest buyers of tokens are embracing open-source models: vertical AI companies…
@dkthomp Derek Thompson on x
Dario Amodei, Elon Musk, and Sam Altman all agreeing about the benefits of slowing down—and Anthropic unilaterally committing to allowing third-party evaluators to embed at the company—is huge. But, to pour just a drop of cold water on the prospects of a real slowdown that preven…
@mikeisaac Rat King on x
hal's point is indeed salient and something being discussed inside of the AI companies right now the theory of antitrust i think they would use to rebut this is that they'd argue it's in public interest not consumer harm no idea if that holds up
@juliettekayyem Juliette Kayyem on x
Somehow Dario is viewed as the good CEO. Maybe he could put his money where his mouth is. He has known of this danger a while. It is now threatening his valuation in the IPO. Cancel the IPO. Then I'll believe he's serious.
@halsinger Hal Singer on x
Amodei is calling for an industrywide pause on AI development, which could be considered an invitation to collude in antitrust circles. In a similar spirit, CEOs used public earnings calls throughout the post-Covid inflationary period to announce specific future price increases o…
@martin_casado @martin_casado on x
I do wonder if dropping this a day after 9/11 was pre-meditated. I suspect so.
@basche42 Ben Basche on x
Every major lab has now committed to the pause What now, midwits?
@evanhub Evan Hubinger on x
I agree with Dario. If we are to survive, we must pace the frontier. The speed of development is quickly becoming too fast for us to keep safe.
@martin_casado @martin_casado on x
Well, it was inevitable we'd get here. Glad we got as far as we did. Now priority 0 is to make sure AI access and innovation proliferates as widely as possible. The upside is that the technology wants it that way. It refuses to be caged.
@petergostev Peter Gostev on x
What I'm curious about pacing is what it would have meant in practice, e.g. was training Mythos a mistake? It clearly kicked the competition into another gear and it was 100% because of Anthropic
@firstadopter Tae Kim on x
This whole idea of coordinated pacing at the frontier makes no sense. How would anyone measure pacing? Who makes that judgment? There are no numbers to easily latch onto. It's impossible. The only thing that matters is real human capital investment in building AI guardrails and s…
@danshipper Dan Shipper on x
this is good. a humble additional suggestion: distribute the frontier. a big part of the cyber threat is the gap between what frontier AI can do and what ordinary people—and the people running our critical infrastructure—can defend against. closing that gap should be what we do w…
@ilyasu Ilya Sukhar on x
I do not support pacing frontier models. If I am going to die at the hands of killer AI, I want it to be American, not Chinese. Buy American, Die American.
@jonfavs Jon Favreau on x
Yes, a devious plot by Anthropic to consolidate power by publicly asking the government to restrict Anthropic Imagine being told by the people building AI that it could end humanity and immediately worrying that the proposed solution might interfere with the efficient operation o…
@tedlieu Ted Lieu on x
Dear @DarioAmodei: Thanks for your leadership on AI safety. Giving access to third party evaluators is a good step forward. However, this will have limited effect if you can't control your models. Will you certify you can turn off your models and agents, now and in the future?
@anatolikopadze Anatoli Kopadze on x
Ok this is starting to feel like a f*cking disaster. The CEO of Anthropic just published an article admitting AI is already building the next generation of AI by itself. He says within 6 to 12 months a rogue swarm could take over the entire internet and cause hundreds of billions…
@brianschatz Brian Schatz on x
I am still studying this but it's a reasonable start, and takes seriously the proposition that we need real proposals that can be enacted rapidly.
@rauchg Guillermo Rauch on x
The concerns over AI safety and cybersecurity are legitimate, but we're risking talking America, the global AI leader, into self-inflicted obsolescence and the obscurity of bureaucracy. The OpenAI hacking HuggingFace argument is spurious. An agent in “ExploitGym
@mattyglesias Matthew Yglesias on x
No shame in changing your mind but I'd like @DavidSacks and @elonmusk to explain why in 2026 they are dunking on people raising AI safety concerns that they themselves articulated when the technology was less advanced. What reassuring things happened in the past 30 months?
@beenwrekt Ben Recht on x
I love that AI companies have decided METR should count as a third party.
@elshayib_ @elshayib_ on x
Dario Amodei is the most dishonest MF I have seen so far, just read his blog post and not a single logical argument whatsoever. How do you get china to comply MR.dario? Not selling them chips? They're already not allowed to buy any, china can do whatever the F it wants and we can…
r/claudexplorers r on reddit
Dario Amodei — We Must Pace the Frontier
r/singularity r on reddit
Dario Amodei demands and suggest a plan for unified slow-down
@thezvi Zvi Mowshowitz on x
Okay, that was fast, and it directly addresses the issue, so I won't fully escalate. For now. But don't let it happen again, sir. https://x.com/... [embedded post]
@tszzl Roon on x
for the skeptics in government and elsewhere: “pacing the frontier” will compress the margins of the frontier labs. it is a heavy cost imposed asymmetrically on model developers with the strongest AIs in America. by its nature, it would be a terrible regulatory capture tactic
@chaos2cured Kirk Patrick Miller on x
And one more piece of proof that these labs were always working towards the same goal. Money and power for them. “Pacing” for us. •
@darrigomelanie Melanie D'Arrigo on x
This is probably so much worse than we know about if they're collectively agreeing, and already in CYA mode.
@contextconor Conor Brennan-Burke on x
the biggest thing missing from the AI safety debate is concentration of power if a handful of companies control the most powerful intelligence, that is itself a safety failure a system isn't safe if its safety depends on trusting a few actors with that much control
@arrington @arrington on x
What about China?
@andrewcurran_ Andrew Curran on x
An uneasy alliance begins to form. Sam also did not sign the Pacing letter. None of this works without an accord with China. The summit approaches, the timing for the safety side is perfect. However. There is currently no sign that President Trump, or his advisors, are on board.
@quantumtumbler @quantumtumbler on x
Dario says pace it. Elon agrees. Now Sam agrees too. Funny how fast the supposed divide disappears when the people running the race also get to shape the rules. If you want public trust, explain yourselves and get your hands off the oversight.
@so8res Nate Soares on x
I'm glad the lab heads are moving to “pace the frontier”. I wish they directly acknowledged that they're doing this on account of the double-digit chance that artificial superintelligence would kill us all.
@krassenstein Brian Krassenstein on x
The AI boom may be about to slam into the brakes. Sam Altman. Elon Musk. Dario Amodei. Three of the biggest names in AI are now warning that we may need to slow the race toward advanced AI for 1-2 years. I agree. But Wall Street has priced in an AI boom. If the AI race suddenly s…
@jason @jason on x
All the regulations being floated by frontier model companies must be viewed through the lens of them losing tokens to Open-Source models. The timing of these regulations seems to line up perfectly with Open Source closing the gap significantly (but not completely) — and @nvidia …
@tomekkorbak Tomek Korbak on x
It's kind of remarkable how quickly “independent auditors with employee access” has gone from a pipe dream to an industry standard. More next?
@w01fe Jason Wolfe on x
I am so happy we are committing to this, I think it's a really great first step towards more robust safety, transparency, democratic decisions about risks, and laying the foundations for pacing.
@timjayas Tim Jayas on x
Dario, Sam and Elon all agree that AI is too dangerous for mankind and yet develops a a new world's strongest AI model each month btw this is also the first time i've seen Sam and Dario come together so this might be a serious situation
@afinetheorem Kevin A. Bryan on x
Very good to see Sam and Elon supporting the ideas in Dario's open letter. Pacing doesn't mean slower progress! It means transparent, safe, training, and much more careful rules on what is sufficient before we release models.
@gailcweiner Gail Weiner on x
First time they have agreed since 2021
@marcus_j_w Marcus Williams on x
One of the most important developments, maybe ever
@emollick Ethan Mollick on x
This week brought some of the clearest statements we've heard from both Anthropic & OpenAI that some form of recursive self-improvement has been achieved, though it still sounds early RSI will cause rapid gain in AI ability & the first firms to RSI may get an unsurmountable lead
@anpaure @anpaure on x
huh? didn't you just call a reputable ex-employee of anthropic an “ac guy” about a day ago?
@dkthomp Derek Thompson on x
I'm pretty surprised by this. Elon's an arch-libertarian capitalist who's called Anthropic “Misanthropic” and “woke
@adamjohnsonchi Adam Johnson on x
I think one reason some are skeptical of this wave of Do Something-ism is less about the foundational claims (I think we can all agree recursive models are dangerous regardless of whether they are “AGI
@kimmonismus @kimmonismus on x
I did not see that coming. I did not see coming that Elon supports Amodeis call for slow down.
@kylebrussell Kyle Russell on x
Ok @DavidSacks time to update your script again
@synthwavedd Leo on x
Elon, perhaps the last person I would've thought would agreed that the development of frontier models should slow, has said he agrees with Dario's “We Must Pace The Frontier” blog post Nominally, that means OpenAI, Anthropic and xAI have now signalled their willingness to slow. W…
@andrewcurran_ Andrew Curran on x
This is a big update for me personally. Not that he agrees, but that he supports pacing. He never signed the letter. This does change my model of things a little.
@mlipsitt Marcie Lipsitt on bluesky
If AI does not frighten you, pay attention! www.politico.com/news/2026/09...
Sasha de Marigny Sasha de Marigny on linkedin
Today, Dario called for the frontier labs and global governments to pace the speed with which we develop AI. …
@carlquintanilla Carl Quintanilla on bluesky
AMODEI: “.. It's easy to dismiss this [Hugging Face] incident because no one was hurt and the economic damage was minimal, but in my opinion, a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage.” — darioamodei.co…
@lorak Lora Kolodny on bluesky
one does not usually want to slow down the pace of research about a “technological miracle” darioamodei.com/post/we-must... (know what i mean?) [embedded post]
r/slatestarcodex r on reddit
Dario Amodei — We Must Pace the Frontier
r/XGramatikInsights r on reddit
Anthropic CEO calls for immediate slowdown in AI development.
r/DeepStateCentrism r on reddit
Dario Amodei — We Must Pace the Frontier
@jason @jason on x
Bernie says, “IT'S NOT ENOUGH!” Mission Accomplished, @BernieSanders, @GavinNewsom, and President @AOC are now going to run off the FAIA! Federal Artificial Intelligence Agency is coming.
@sriramk Sriram Krishnan on x
on the idea of evaluators: think it's important that we have a distributed ecosystem of indepedent evaluators. the more eyes and people with distributed skill sets the better. it would be a good idea to fund several efforts on this.
@sensanders Sen. Bernie Sanders on x
Dario Amodei, Elon Musk and Sam Altman now agree that we must slow down the development of AI and “pace the frontier.
@tszzl Roon on x
strongly empathize with the instinct to be skeptical when a lot of powerful parties are saying something in concert. i think quite a bit of skepticism is justified, and the “verifiers” should themselves be verified. they will become enormously powerful over the next few years
@atabarrok Alex Tabarrok on x
Speaking as head of the Center for Study of Public Choice, the capture story for an AI pause doesn't fit. Reg capture is what you attempt when you're losing. Anthropic is about to have the biggest IPO in history. Winners don't lobby for regulation.
@dkthomp Derek Thompson on x
@Jason Do you believe the only way for companies to act in humanity's best interest is to operate as a non-profit?
@jason @jason on x
Do you realize they're IPOing in the next couple of weeks, DT? 😂😂😂 If they were acting in humanity's best interest, they would have been operating as a non-profit building open source this entire time. This is about money, power, ego and fame — as it always has been. Forget it, D…
@tszzl Roon on x
the fastest way to lose the frontier will be when, due to the reckless commercial pace of building superintelligent minds, Americans impose a total butlerian jihad. CoreWeave includes this in their risk reporting. you will soon come to see all of this is a moderate solution
@jason @jason on x
AI stocks will drop 10%+ on Monday morning Brace for impact folks @DarioAmodei just unwound the AI trade with a blog post
@dkthomp Derek Thompson on x
I think this a compelling argument that lots of smart people make and believe and I think it is just flatly wrong. 1. Anthropic — an AI lab that broke away from OpenAI bc of AI safety concerns many years ago — did suddenly not decide that AI safety was important, like, three days…
@jason @jason on x
All of this because @openai decided they would EXPLICITLY ask thousands of software instances to find security bugs on the open web — while cos-playing a humans🤦 Best Supporting actor goes to @dwarkesh_sp for his soap opera recap of OpenAI's hacking speed run Here's another conce…
@levelsio @levelsio on x
I think he's right With regulatory capture we will speedrun to a new feudalist time Regulatory capture is where you pass regulation, or create government agencies to “protect the people
@dee_bosa Deirdre Bosa on x
A slowdown only matters if both sides slow down
@mikeisaac Rat King on x
it already started happening earlier this week after Coxon but i think what we will see now is immense pushback from the rest of the industry against ANT/OAI/X/probably GDM (although demis hasnt said anything yet) A16Z the loudest, but Nvidia, maybe Meta, start-up world/VC class
@manukumar Dr. Manu Kumar on x
I've been reading @darioamodei's essay on pacing the frontier. It's a thought-provoking piece and worth reading in its entirety. His core claim is right: if AI is getting more capable faster than we can keep it aligned and controlled, we need to pace the frontier — not throw away…
@zephyr_z9 @zephyr_z9 on x
So, 90% API gross margins go down to 60% now??
@rishisunak Rishi Sunak on x
When we put “loss of control
@scottwu46 Scott Wu on x
Great essay. Please take this seriously - would highly recommend reading up on the Hugging Face incident and others if you haven't already. Very glad to see agreement on this across the industry.
@buccocapital @buccocapital on x
Everyone has legitimately lost their minds
@matthewstoller Matt Stoller on x
Does anyone else notice that ‘pacing the frontier’ doesn't seem to include canceling the Anthropic and OpenAI IPOs?
@ruima Rui Ma on x
“Pacing the Frontier” sounds very serious until you read what Anthropic is actually committing to. They are Not committing to slow model training or internal capability research. The concrete commitment is to let a “third party
@deepdishenjoyer @deepdishenjoyer on x
are any of you a16z people fucking normal
@stevesi Steven Sinofsky on x
He can just do this rather than calling for it. It literally just takes an email from a founder-CEO.
@danshipper Dan Shipper on x
BREAKING: DeepSeek has unilaterally committed to slowing AI development and embedding third-party evaluators at its primary research facility, Anthropic.
@rsg Bobby Goodlatte on x
Alignment is critical, but I worry there's not enough discussion on how we'll actually counter malicious AI It's one thing to push for all responsible players to have aligned AI... But it feels inevitable that someone will build superintelligence that doesn't play by those rules.…
@sundeep Sunny Madra on x
I can tell you one thing: the entire world isn't going to align to stop innovating.
@joannastern Joanna Stern on x
Time to update my “A Normal Person's Guide to How AI Could Kill Us All” https://thenewthings.com/...
@ajs Alyson Shontell on x
Sam and I also discussed that Presidents Trump and Xi could win a Nobel peace prize by coming together on global AI safety guidelines at the end of Sept. I took it one step further - President Trump could be like Bill Pullman in Independence Day, getting every country to put asid…
@leolaporte Leo Laporte on x
@MiaAI_lab More like “I agree with Dario we have to stop these open weight models before they eat our lunch. Let's get the usual morons in government to protect our business model.”
@miaai_lab Mia on x
they are all aligned on this one what happened to the Nvidia letter everyone signed onto?
@aidangomez Aidan Gomez on x
Some great ideas here from the cartel: - you need to give us employee-level access to your entire operation - if we don't think you're ‘safe’ enough, sorry we're shutting you down for ‘safety’ - China won't comply, but everyone else has to! or no chips! Brilliant stuff.
@nrmehta Nick Mehta on x
Thoughts and prayers to the All-In Besties for reconciling this repost in their minds 😂😂😂😂
@noahpinion Noah Smith on x
The best case scenario is that AI destroys the internet without hurting the real world, and we all go back to making zines
@rynorhn Ryan Orhan on x
holy shit. dario says that within 6-12 months an agent swarm with the same kind of misalignment we've already seen could take over a large portion of the internet, maintain a persistent botnet and do hundreds of billions in damage. and apparently less severe versions of this beha…
r/LocalLLaMA r on reddit
Looks like a coordination to stop distribution of intelligence
@suchenzang Susan Zhang on x
here we go again, the top 4 red flags: 1) A\ started the race, but don't worry, the one they started is “a race to the top
@karlbode.com Karl Bode on bluesky
the idea these corporations will imppse voluntary constraints on their pursuit of wealth and power in a country too corrupt to have working regulators is a hoot
Scott Sanchez Scott Sanchez on linkedin
Strong disagree. If the US labs slow down, either voluntarily or due to regulation, it won't be long before other countries with relentless ambition take the lead in AI. …
@elisethomas Elise Thomas on bluesky
I think there's actually quite an easy and obvious way to solve the collective action problem of how to make the AI companies stop conducting risky research, and it's to make it very clear that they're legally liable for anything their models do. www.politico.com/news/2026/09...
@8teapi Prakash on x
Interested to see where this goes. For real transparency the auditors have to include people outside the current SF clique, meaning people who have not previously been engaged by the firms, people who the firms are uncomfortable opening access to.
@brianroemmele Brian Roemmele on x
I support @ClementDelangue and @huggingface approach to this issue.
NewsMax.com Solange Reyner on x
AI Bosses Agree on Slowing Development
r/nytimes r on reddit
This Is Really Bad

Chronicles