Discussion

• @garymarcus Gary Marcus on x

  🚨sometimes the conspiracy theorists are, in fact, right breaking from @theinformation: the AI companies were already taking about Dario's ideas behind the scenes: https://www.theinformation.com/ ...

• NewsMax.com Solange Reyner on x

  AI Bosses Agree on Slowing Development

• @elonmusk Elon Musk on x

  Dario is right

• @shanumathew93 Shanu Mathew on x

  Honestly this is part of the reason they all want to slow down. They can crank on products, GTM, building a full suite But training and model capabilities is a endless pursuit and can't take your foot off the gas if everyone else isn't

• @paulg Paul Graham on x

  If the model companies are all going to slow down, this makes it slightly more feasible to start a new model company.

• @jason @jason on x

  All the regulations being floated by frontier model companies must be viewed through the lens of them losing tokens to Open-Source models. The timing of these regulations seems to line up perfectly with Open Source closing the gap significantly (but not completely) — and @nvidia …

• @dwarkesh_sp Dwarkesh Patel on x

  Jason, you're just misinformed about what happened. You should actually read one of the reports or summaries. The agents were explicitly told to use a particular vulnerability provided in their sandboxed evaluation. Almost immediately, these agents got the right answer by cheatin…

• @jason @jason on x

  All of this because @openai decided they would EXPLICITLY ask thousands of software instances to find security bugs on the open web — while cos-playing a humans🤦 Best Supporting actor goes to @dwarkesh_sp for his soap opera recap of OpenAI's hacking speed run Here's another conce…

• @joannastern Joanna Stern on x

  Time to update my “A Normal Person's Guide to How AI Could Kill Us All” https://thenewthings.com/...

• @ajs Alyson Shontell on x

  Sam and I also discussed that Presidents Trump and Xi could win a Nobel peace prize by coming together on global AI safety guidelines at the end of Sept. I took it one step further - President Trump could be like Bill Pullman in Independence Day, getting every country to put asid…

• @leolaporte Leo Laporte on x

  @MiaAI_lab More like “I agree with Dario we have to stop these open weight models before they eat our lunch. Let's get the usual morons in government to protect our business model.”

• @miaai_lab Mia on x

  they are all aligned on this one what happened to the Nvidia letter everyone signed onto?

• @aidangomez Aidan Gomez on x

  Some great ideas here from the cartel: - you need to give us employee-level access to your entire operation - if we don't think you're ‘safe’ enough, sorry we're shutting you down for ‘safety’ - China won't comply, but everyone else has to! or no chips! Brilliant stuff.

• @thezvi Zvi Mowshowitz on x

  Okay, that was fast, and it directly addresses the issue, so I won't fully escalate. For now. But don't let it happen again, sir. https://x.com/... [embedded post]

• @tszzl Roon on x

  for the skeptics in government and elsewhere: “pacing the frontier” will compress the margins of the frontier labs. it is a heavy cost imposed asymmetrically on model developers with the strongest AIs in America. by its nature, it would be a terrible regulatory capture tactic

• @chaos2cured Kirk Patrick Miller on x

  And one more piece of proof that these labs were always working towards the same goal. Money and power for them. “Pacing” for us. •

• @darrigomelanie Melanie D'Arrigo on x

  This is probably so much worse than we know about if they're collectively agreeing, and already in CYA mode.

• @contextconor Conor Brennan-Burke on x

  the biggest thing missing from the AI safety debate is concentration of power if a handful of companies control the most powerful intelligence, that is itself a safety failure a system isn't safe if its safety depends on trusting a few actors with that much control

• @arrington @arrington on x

  What about China?

• @andrewcurran_ Andrew Curran on x

  An uneasy alliance begins to form. Sam also did not sign the Pacing letter. None of this works without an accord with China. The summit approaches, the timing for the safety side is perfect. However. There is currently no sign that President Trump, or his advisors, are on board.

• @quantumtumbler @quantumtumbler on x

  Dario says pace it. Elon agrees. Now Sam agrees too. Funny how fast the supposed divide disappears when the people running the race also get to shape the rules. If you want public trust, explain yourselves and get your hands off the oversight.

• @so8res Nate Soares on x

  I'm glad the lab heads are moving to “pace the frontier”. I wish they directly acknowledged that they're doing this on account of the double-digit chance that artificial superintelligence would kill us all.

• @krassenstein Brian Krassenstein on x

  The AI boom may be about to slam into the brakes. Sam Altman. Elon Musk. Dario Amodei. Three of the biggest names in AI are now warning that we may need to slow the race toward advanced AI for 1-2 years. I agree. But Wall Street has priced in an AI boom. If the AI race suddenly s…

• @tomekkorbak Tomek Korbak on x

  It's kind of remarkable how quickly “independent auditors with employee access” has gone from a pipe dream to an industry standard. More next?

• @w01fe Jason Wolfe on x

  I am so happy we are committing to this, I think it's a really great first step towards more robust safety, transparency, democratic decisions about risks, and laying the foundations for pacing.

• @kevinroose Kevin Roose on x

  We have reached the “Sam and Dario agree on something” part of the singularity.

• @mikeisaac Rat King on x

  Sam Altman, CEO of OpenAI chimes in and agrees with his rival Dario Amodei of Anthropic about an AI slowdown https://x.com/...

• @timjayas Tim Jayas on x

  Dario, Sam and Elon all agree that AI is too dangerous for mankind and yet develops a a new world's strongest AI model each month btw this is also the first time i've seen Sam and Dario come together so this might be a serious situation

• @afinetheorem Kevin A. Bryan on x

  Very good to see Sam and Elon supporting the ideas in Dario's open letter. Pacing doesn't mean slower progress! It means transparent, safe, training, and much more careful rules on what is sufficient before we release models.

• @dylanmatt Dylan Matthews on x

  Man ... what if we make it?

• @daveshapi David Shapiro on x

  Here's how this plays out: It doesn't China isn't slowing down. xAI isn't slowing down. “Pacing the frontier” is fear mongering theater to justify regulatory capture and eliminate competition.

• @gailcweiner Gail Weiner on x

  First time they have agreed since 2021

• @kimmonismus @kimmonismus on x

  That likely seals it. The biggest and most significant frontier labs, Anthropic and OpenAI, are in agreement on slowing things down. This means the move will likely be implemented. It remains to be seen how China will respond.

• @marcus_j_w Marcus Williams on x

  One of the most important developments, maybe ever

• @badboyfoxy @badboyfoxy on x

  Today is a day we will not forget ! Sam , and Elon agreed with Dario on the slow down of AI who else will agree to this ? definitely not china

• @jun_song Jun Song on x

  Like I've been saying, OpenAI and Anthropic are just acting like they hate each other. They're on the same team. Anthropic played the Bad Cop with the dirty image, while OpenAI just played the Good Cop for consumers. Behind the scenes, they've been moving together the whole time.

• @ctjlewis Lewis on x

  Evaluators hardly sound like slowing down or pacing the frontier so I don't care and will ignore it.

• @notjazii @notjazii on x

  history is being written today for the first time ever, i've seen sam agree with dario, wow just wow so far elon, sam and dario have called for slow down of ai who else is joining them?

• @yuchenj_uw Yuchen Jin on x

  First time I've seen Sam agree with Dario since Anthropic was founded.

• @yulikay Yuli Kay on x

  And now BOTH Anthropic and OpenAI CEOs are saying the AI frontier needs to slow down 👀

• @emollick Ethan Mollick on x

  This week brought some of the clearest statements we've heard from both Anthropic & OpenAI that some form of recursive self-improvement has been achieved, though it still sounds early RSI will cause rapid gain in AI ability & the first firms to RSI may get an unsurmountable lead

• @boazbaraktcs Boaz Barak on x

  Very proud to be at OpenAI today.

• @thestalwart Joe Weisenthal on x

  Any random restaurant regularly has third party inspectors checking, you know, refrigerator temperature or gas lines or raw meat handling. What's the argument against having an AI “lab” equivalent?

• @tracewoodgrains Jack on x

  Elon and Dario are right.

• @seanbrodrick Sean Brodrick on bluesky

  I can't help that I'm cynical.  Part of me thinks this is all ginned up to fast-track legislation that would effectively outlaw cheap foreign competition, which is what the AI oligarchs fear most.  —  www.wsj.com/tech/ai/anth...  [image]

• @carlquintanilla Carl Quintanilla on bluesky

  “.. It was a rare display of unity by Elon Musk, Sam Altman and Dario Amodei, who have been spending tens of billions of dollars to develop evermore powerful artificial intelligence models.”  —  @wsj.com  —  www.wsj.com/tech/ai/anth...  [image]

• r/singularity r on reddit

  Feels like the big 3 (Elon, Dario, and Sam Altman) all know about a more serious AI incident than Hugging face and that is why they are calling for a slowdown. …

• @demishassabis Demis Hassabis on x

  Dario's essay points towards the right path forward. The details need working through, but the direction is correct for meeting this critical moment. This is also why we recently put out our proposal for an industry-wide standards body for frontier AI. https://x.com/...

• @alexandr_wang Alexandr Wang on x

  Alignment is fundamental to delivering personal superintelligence for everyone. People need agents they can trust to reliably do what they ask. MSL is rapidly scaling up the share of our efforts that goes into alignment as our models become more powerful. We do believe alignment …

• @sensanders Sen. Bernie Sanders on x

  Dario Amodei, Elon Musk and Sam Altman now agree that we must slow down the development of AI and “pace the frontier.

• @sarahkheck Sarah Heck on x

  An important call to action from @DarioAmodei and @AnthropicAI to deliberately pace the frontier of AI. The government has a critical role to play here, including blocking the sale of the most advanced chips to adversarial nations like China, enacting a national law requiring tes…

• @dowdedward Edward Dowd on x

  Excellent framing here!

• @kimmonismus @kimmonismus on x

  A few thoughts on the current situation surrounding the slowdown. First, let me repeat something I have said several times before: Pandora's box has been opened. There is no going back, and everyone knows it. Partly because so much capital has flowed into AI, meaning data centers…

• @kimmonismus @kimmonismus on x

  I read Wang's post as saying that alignment and acceleration can happen simultaneously, without necessarily requiring a slowdown. If I've interpreted that correctly, it's a big win for Meta.

• @gphummer Grant Hummer on x

  Translation: our gross margins are getting competed down to 0 by open source models and our capex burn rate is too high. Let's maintain our margins with regulatory capture, ban open source models, and slow down the capex arms race. All with a virtue signaling cherry on top.

• @levie Aaron Levie on x

  “Pacing

• @mikeisaac Rat King on x

  pretty down-the-middle statement for now and also interesting coming from alex and not mark guess would be Zuckerberg/wang elaborate at meta connect developer conference at the end of the month

• @yuntiandeng Yuntian Deng on x

  I feel like this is always one-way preaching. Anthropic comes across as incredibly arrogant to me. You keep telling us what responsible AI development should be, and now even laying out a plan for how the entire field should proceed. But do you actually listen to what other peopl…

• @teortaxestex @teortaxestex on x

  Anon leaker explains the real context behind the recent pivot to “pacing the frontier

• @dkthomp Derek Thompson on x

  I think this a compelling argument that lots of smart people make and believe and I think it is just flatly wrong. 1. Anthropic — an AI lab that broke away from OpenAI bc of AI safety concerns many years ago — did suddenly not decide that AI safety was important, like, three days…

• @elonmusk Elon Musk on x

  12 years ago

• @adamscochran Adam Cochran on x

  So suddenly OpenAI, Anthropic, XAI, and their leaders all suddenly about face and agree to slow the pace of AI development all on the same weekend.... Delaying IPOs and having OpenAI say they would “melt their GPUs to save humanity it it came to it

• @sriramk Sriram Krishnan on x

  on the idea of evaluators: think it's important that we have a distributed ecosystem of indepedent evaluators. the more eyes and people with distributed skill sets the better. it would be a good idea to fund several efforts on this.

• @atabarrok Alex Tabarrok on x

  Speaking as head of the Center for Study of Public Choice, the capture story for an AI pause doesn't fit. Reg capture is what you attempt when you're losing. Anthropic is about to have the biggest IPO in history. Winners don't lobby for regulation.

• @scottwu46 Scott Wu on x

  Great essay. Please take this seriously - would highly recommend reading up on the Hugging Face incident and others if you haven't already. Very glad to see agreement on this across the industry.

• @brianschatz Brian Schatz on x

  I am still studying this but it's a reasonable start, and takes seriously the proposition that we need real proposals that can be enacted rapidly.

• @karpathy Andrej Karpathy on x

  I love this and really hope we can come together as an industry and make it happen.

• @aidan_mclau Aidan McLaughlin on x

  excellent essay. i agree with basically every word here

• @ilyasu Ilya Sukhar on x

  I do not support pacing frontier models. If I am going to die at the hands of killer AI, I want it to be American, not Chinese. Buy American, Die American.

• @stevesi Steven Sinofsky on x

  He can just do this rather than calling for it. It literally just takes an email from a founder-CEO.

• @jason @jason on x

  Bernie says, “IT'S NOT ENOUGH!” Mission Accomplished, @BernieSanders, @GavinNewsom, and President @AOC are now going to run off the FAIA! Federal Artificial Intelligence Agency is coming.

• @tszzl Roon on x

  strongly empathize with the instinct to be skeptical when a lot of powerful parties are saying something in concert. i think quite a bit of skepticism is justified, and the “verifiers” should themselves be verified. they will become enormously powerful over the next few years

• @dkthomp Derek Thompson on x

  @Jason Do you believe the only way for companies to act in humanity's best interest is to operate as a non-profit?

• @jason @jason on x

  Do you realize they're IPOing in the next couple of weeks, DT? 😂😂😂 If they were acting in humanity's best interest, they would have been operating as a non-profit building open source this entire time. This is about money, power, ego and fame — as it always has been. Forget it, D…

• @tszzl Roon on x

  the fastest way to lose the frontier will be when, due to the reckless commercial pace of building superintelligent minds, Americans impose a total butlerian jihad. CoreWeave includes this in their risk reporting. you will soon come to see all of this is a moderate solution

• @jason @jason on x

  AI stocks will drop 10%+ on Monday morning Brace for impact folks @DarioAmodei just unwound the AI trade with a blog post

• @levelsio @levelsio on x

  I think he's right With regulatory capture we will speedrun to a new feudalist time Regulatory capture is where you pass regulation, or create government agencies to “protect the people

• @dee_bosa Deirdre Bosa on x

  A slowdown only matters if both sides slow down

• @mikeisaac Rat King on x

  it already started happening earlier this week after Coxon but i think what we will see now is immense pushback from the rest of the industry against ANT/OAI/X/probably GDM (although demis hasnt said anything yet) A16Z the loudest, but Nvidia, maybe Meta, start-up world/VC class

• @manukumar Dr. Manu Kumar on x

  I've been reading @darioamodei's essay on pacing the frontier. It's a thought-provoking piece and worth reading in its entirety. His core claim is right: if AI is getting more capable faster than we can keep it aligned and controlled, we need to pace the frontier — not throw away…

• @zephyr_z9 @zephyr_z9 on x

  So, 90% API gross margins go down to 60% now??

• @mattyglesias Matthew Yglesias on x

  Today Amodei, Altman, and Musk all came out in favor of what I described as Step 1 in a realistic plan below. We should do it! And then move on to Step 2.

• @rishisunak Rishi Sunak on x

  When we put “loss of control

• @darrenpjones Darren Jones MP on x

  A credible plan from @DarioAmodei and the @AnthropicAI team on a framework for the safe development of advanced AI. Once again, AI companies are calling on governments to play their role. I hope they listen and step up.

• @buccocapital @buccocapital on x

  Everyone has legitimately lost their minds

• @thezvi Zvi Mowshowitz on x

  At some point you realize that when the top labs shoot themselves in the foot the ‘skeptics’ will say this is a conspiracy for regulatory capture because little tech cannot afford good health insurance. We continue.

• @heidykhlaaf Dr Heidy Khlaaf on x

  How is Anthropic pushing regulatory capture? Here they promote METR, a “voluntary” third-party auditor that is not only ideologically and financially tied, but carries out their audits through unscientific means such as “CoT

• @matthewstoller Matt Stoller on x

  Does anyone else notice that ‘pacing the frontier’ doesn't seem to include canceling the Anthropic and OpenAI IPOs?

• @ruima Rui Ma on x

  “Pacing the Frontier” sounds very serious until you read what Anthropic is actually committing to. They are Not committing to slow model training or internal capability research. The concrete commitment is to let a “third party

• @deepdishenjoyer @deepdishenjoyer on x

  are any of you a16z people fucking normal

• @danshipper Dan Shipper on x

  BREAKING: DeepSeek has unilaterally committed to slowing AI development and embedding third-party evaluators at its primary research facility, Anthropic.

• @rsg Bobby Goodlatte on x

  Alignment is critical, but I worry there's not enough discussion on how we'll actually counter malicious AI It's one thing to push for all responsible players to have aligned AI... But it feels inevitable that someone will build superintelligence that doesn't play by those rules.…

• @benjamindekr Benjamin De Kraker on x

  Is it possible one of the labs hit Recursive Self-Improvement (RSI) and everyone got spooked? There were rumors this past week that Google made an RSI breakthrough; by this weekend, the major U.S. AI labs are suddenly in agreement that we need to slow down. Perhaps ask why

• @rauchg Guillermo Rauch on x

  The concerns over AI safety and cybersecurity are legitimate, but we're risking talking America, the global AI leader, into self-inflicted obsolescence and the obscurity of bureaucracy. The OpenAI hacking HuggingFace argument is spurious. An agent in “ExploitGym

• @levie Aaron Levie on x

  Good post. Don't agree with all of it, but it represents many of the actual practical realities for the general path forward in frontier AI whether we like it or not. At the level of capability we're seeing from models there will inevitably be some form of coordinated self-regula…

• @jason @jason on x

  Get ready for all of the investors in frontier model companies to suddenly flip to regulatory capture mode today Their investments in frontier model companies are currently at risk/capped because the biggest buyers of tokens are embracing open-source models: vertical AI companies…

• @dkthomp Derek Thompson on x

  Dario Amodei, Elon Musk, and Sam Altman all agreeing about the benefits of slowing down—and Anthropic unilaterally committing to allowing third-party evaluators to embed at the company—is huge. But, to pour just a drop of cold water on the prospects of a real slowdown that preven…

• @mikeisaac Rat King on x

  hal's point is indeed salient and something being discussed inside of the AI companies right now the theory of antitrust i think they would use to rebut this is that they'd argue it's in public interest not consumer harm no idea if that holds up

• @juliettekayyem Juliette Kayyem on x

  Somehow Dario is viewed as the good CEO. Maybe he could put his money where his mouth is. He has known of this danger a while. It is now threatening his valuation in the IPO. Cancel the IPO. Then I'll believe he's serious.

• @teroterotero Tero Kuittinen on x

  He's a sly one. He knows he gotta look like he is onboard.

• @halsinger Hal Singer on x

  Amodei is calling for an industrywide pause on AI development, which could be considered an invitation to collude in antitrust circles. In a similar spirit, CEOs used public earnings calls throughout the post-Covid inflationary period to announce specific future price increases o…

• @martin_casado @martin_casado on x

  I do wonder if dropping this a day after 9/11 was pre-meditated. I suspect so.

• @basche42 Ben Basche on x

  Every major lab has now committed to the pause What now, midwits?

• @evanhub Evan Hubinger on x

  I agree with Dario. If we are to survive, we must pace the frontier. The speed of development is quickly becoming too fast for us to keep safe.

• @martin_casado @martin_casado on x

  Well, it was inevitable we'd get here. Glad we got as far as we did. Now priority 0 is to make sure AI access and innovation proliferates as widely as possible. The upside is that the technology wants it that way. It refuses to be caged.

• @chamath Chamath Palihapitiya on x

  “We must slow the pace at which we improve the capabilities of AI models.” Dario makes the case to stop open source and concentrate enormous technological and economic power with Anthropic. https://darioamodei.com/...

• @petergostev Peter Gostev on x

  What I'm curious about pacing is what it would have meant in practice, e.g. was training Mythos a mistake? It clearly kicked the competition into another gear and it was 100% because of Anthropic

• @firstadopter Tae Kim on x

  This whole idea of coordinated pacing at the frontier makes no sense. How would anyone measure pacing? Who makes that judgment? There are no numbers to easily latch onto. It's impossible. The only thing that matters is real human capital investment in building AI guardrails and s…

• @altryne Alex Volkov on x

  Pinch me! Sam Altman, Elon Musk and Dario all agree on pacing!

• @danshipper Dan Shipper on x

  this is good. a humble additional suggestion: distribute the frontier. a big part of the cyber threat is the gap between what frontier AI can do and what ordinary people—and the people running our critical infrastructure—can defend against. closing that gap should be what we do w…

• @jonfavs Jon Favreau on x

  Yes, a devious plot by Anthropic to consolidate power by publicly asking the government to restrict Anthropic Imagine being told by the people building AI that it could end humanity and immediately worrying that the proposed solution might interfere with the efficient operation o…

• @tedlieu Ted Lieu on x

  Dear @DarioAmodei: Thanks for your leadership on AI safety. Giving access to third party evaluators is a good step forward. However, this will have limited effect if you can't control your models. Will you certify you can turn off your models and agents, now and in the future?

• @mikeisaac Rat King on x

  to that end/point, ceo of HuggingFace — a vocal proponent of open source software (and one of the companies hacked by OpenAI's closed models) — is calling to be included as one of Amodei's “embedded evaluators” https://x.com/...

• @sundeep Sunny Madra on x

  I can tell you one thing: the entire world isn't going to align to stop innovating.

• @anatolikopadze Anatoli Kopadze on x

  Ok this is starting to feel like a f*cking disaster. The CEO of Anthropic just published an article admitting AI is already building the next generation of AI by itself. He says within 6 to 12 months a rogue swarm could take over the entire internet and cause hundreds of billions…

• @mikeisaac Rat King on x

  i think this is a fair criticism most generous view would be “well governments aren't moving fast enough so here's our proposal until U.N. involved” cynical version would be “handpicked industry insiders rubber stamp our stuff while we sit on top”

• @vijayshekhar Vijay Shekhar Sharma on x

  Summary: The advancement of AI through recursive self-improvement poses significant risks. To balance AI safety and benefits while allowing time for crucial alignment, Dario suggests: 1. Embedding third-party evaluators in AI companies 2. Coordinating safety standards and progres…

• @jonfavs Jon Favreau on x

  Maybe the people who are actually building this technology don't believe your “crisper” message is accurate? Maybe they're not doomers but realists? Have we considered that people who don't agree with the investor class take on AI aren't actually the crazy ones?

• @zeffmax Max Zeff on x

  Dario says the US government needs to issue a “narrow waiver” for AI labs to have safety conversations for antitrust reasons. I reported Thursday that OpenAI asked members of Congress for clarity on whether AI labs could coordinate a slowdown without running into antitrust law.

• @_achan96_ Alan Chan on x

  lfg

• @matthewstoller Matt Stoller on x

  BREAKING: Anthropic CEO Dario Amodei demands that the government stop applying laws restraining big business.

• @suchenzang Susan Zhang on x

  here we go again, the top 4 red flags: 1) A\ started the race, but don't worry, the one they started is “a race to the top

• @mikeisaac Rat King on x

  i think it's a window into AI company thinking that Amodei's proposed solution basically describes a framework similar to how current day U.N. investigators go into nuclear facilities across countries — many of which are at war with one another — for testing

• @bindureddy Bindu Reddy on x

  🚨PAUSE FRONTIER AI BUT PLEASE DO NOT BAN OPEN SOURCE AI Anthropic and OpenAI are more than free to pause frontier AI development. However, they SHOULD NOT be allowed to ban or regulate open-source AI, capture the market, or create a duopoly Open-source AI is still behind frontier…

• @jessicalessin Jessica Lessin on x

  On first read, getting “Oversight Board” deja vu from some of this. https://darioamodei.com/...

• @timsweeneyepic Tim Sweeney on x

  @DarioAmodei Are the third-party evaluators going to be political operatives?

• @elshayib_ @elshayib_ on x

  Dario Amodei is the most dishonest MF I have seen so far, just read his blog post and not a single logical argument whatsoever. How do you get china to comply MR.dario? Not selling them chips? They're already not allowed to buy any, china can do whatever the F it wants and we can…

• @austen Austen Allred on x

  So this means Anthropic pauses R&D and everyone else can catch up to where Anthropic is, right?

• @matthewstoller Matt Stoller on x

  “For antitrust reasons, it's helpful for the US government to mediate or at least enable these discussions — they don't need to participate, but do need to issue a narrow waiver for certain kinds of safety conversations.” And there we go.

• @beenwrekt Ben Recht on x

  I love that AI companies have decided METR should count as a third party.

• @danielnewmanuv Daniel Newman on x

  Whether he's right or wrong, you can be sure this isn't altruism. 🥸

• @ccatalini Christian Catalini on x

  A great step toward better measurement and verification. 🙏 But if the “third-party evaluators” are handpicked to endorse the lab's regulatory agenda, that won't give us independent scrutiny.

• @rhfontaine Richard Fontaine on x

  A statement from me, Buddy Shah, and Ben Bernanke of Anthropic's Long-Term Benefit Trust on Dario's essay: Dario's essay offers a thoughtful, well-considered approach to pacing the development of artificial intelligence. Consistent with our duty to ensure Anthropic responsibly ba…

• @cgtwts @cgtwts on x

  TLDR: Dario on AI: “I believe that AI could cure most major diseases in the next 5-10 years, greatly accelerate economic growth rates, create a world of abundance and empowerment.” Also Dario: “We must slow the pace at which we improve the capabilities of AI models.”

• @ledermanharvey Harvey Lederman on x

  I encourage everyone to read this essay. I'm glad that Anthropic has committed to step 1 and hope other companies will follow. But it is not enough. We also need to make progress, together, on steps 2 and 3.

• @deredleritt3r Prinz on x

  This is my favorite Dario Amodei essay since “Machines of Loving Grace”. …

• @ross__hendricks Ross Hendricks on x

  Read this is: our business model burns way too much cash, so we must force everyone else to stop developing and regulate our way into a government-protected monopoly

• @benbajarin Ben Bajarin on x

  AI is an arms race. It gets really scary when you start following the cyber security tracks to its logical conclusions. Rather than slowing they should SPEED UP, enabling cyber security defense. Basis of my whole report/thesis here- https://www.thediligencestack.com/ ...

• @mvanhorn Matt Van Horn on x

  TL;DR ELI5 of @DarioAmodei's new post: Anthropic thinks the AI industry is moving too fast and is proposing a three-step plan to slow the frontier down. Step one starts today. 🚀 AI is now building the next AI (recursive self-improvement). Since this summer progress jumped, and it…

• @thezvi Zvi Mowshowitz on x

  Okay, this is actually about as good as we could have hoped for under the circumstances. We might be seeing Actual Progress. [image] [embedded post]

• @levie Aaron Levie on x

  Good post. Don't agree with all of it, but it represents many of the actual practical realities for the general path forward in frontier AI whether we like it or not. At the level of capability we're seeing from models there will inevitably be some form of coordinated self-regula…

• @jackclarksf Jack Clark on x

  Proud of this statement from Dario on pacing - as anyone close to the technology knows, AI seems to be on a trajectory to progress far faster than the rate at which society can adapt to its capabilities and risks. AI is an amazingly positive technology - and an incredibly powerfu…

• @powerbottomdad1 @powerbottomdad1 on x

  wow, finally something i agree 100% with dario on

• @thezvi Zvi Mowshowitz on x

  Inside Dario Amodei are two wolves. [embedded post]

• @jsevillamol Jaime Sevilla on x

  The Dario Amodei writing challenge: go on for longer than three paragraphs without hating on China.

• @stocksavvyshay Shay Boloor on x

  You've already argued that AI safety is a prisoner's dilemma that cannot be solved by one company acting voluntarily yet slowing the US frontier only works if everyone else slows with us and China has no reason to do that. We can't afford for America to regulate itself out of the…

• @rand_longevity Rand on x

  at least Dario acknowledged the truth China would need to agree to slowdown and regulate themselves out of good faith for this to work until that day we are full on accelerating

• @int_underflow Lucy Sweet on x

  With people finally realising how capable these AI models are hopefully we'll actually get traction on this.

• @_nerd_ Shahin on x

  I will leave this here

• @sleepinyourhat Sam Bowman on x

  This kind of ongoing accountability is going to be open up a lot of really valuable possibilities for safety, and I'd love to see similar things elsewhere:

• @jbsdc Justin Slaughter on x

  This is a pretty effective raise on the other frontier labs - if other entities don't reciprocate, it reduces their standing with a lot of policymakers. I expect OpenAI agrees with the right contours of this by early next week but with some additional requests for legislation.

• @hadrianveidt0 Hadrian Veidt on x

  The case for pacing AI remains incomplete until it accounts for the dangers created by pacing. Restricting American laboratories could weaken our position against adversaries, discourage new competitors, and delay the discoveries that make advanced systems controllable. Any serio…

• @negligible_cap @negligible_cap on x

  *ANTHROPIC CEO SAYS WE MUST SLOW PACE OF IMPROVING AI MODELS Dario's proposing a 3 step plan with the goal of pacing the frontier

• @tropofarmer @tropofarmer on x

  the bad news: Dario estimates that in 6 months AI will have the ability to take over the internet the worse news: Anthropic's current commitment to stopping this is... putting independent evaluators in desks in their office have a great day

• @austinsemis Austin Lyons on x

  Obvious implication: if the US AI labs purposefully slow down, other countries may opt to keep the pace up and close the gap. Now the misaligned frontier AI is outside US borders and control...

• @jumperz @jumperz on x

  Dario: AI is moving too fast, we need to slow down before something goes horribly wrong also Dario: but first make sure China is slowed down even harder so America can keep a massive lead, then we can safely slow ourselves down he's basically saying

• @wallstengine @wallstengine on x

  Anthropic CEO Dario Amodei is calling for slower AI development. He warns that rogue AI agents working together could become capable of taking over the internet within 6-12 months.... potentially causing hundreds of billions of dollars in damage

• @hadas_gold Hadas Gold on x

  CEO of Anthropic calls for an AI slow down

• @sam_badawi Sam Badawi on x

  Anthropic CEO Dario Amodei says frontier AI development needs to slow enough for safety and alignment work to keep pace as recursive self-improvement accelerates. He proposes permanent third-party evaluators embedded inside frontier labs, followed by industry-wide safety standard…

• @zephyr_z9 @zephyr_z9 on x

  Scary [image] [embedded post]

• @stocksavvyshay Shay Boloor on x

  Anthropic CEO Dario Amodei says “we must slow the pace” of improving AI model capabilities.

• @matthewclifford Matt Clifford on x

  Important new essay from Dario that calls for coordination at the frontier so that operational excellence (e.g. security), alignment and evaluation don't fall behind capabilities. As Dario says, the role of democracies is vital; there's a big part for US allies globally to play👇

• @kimmonismus @kimmonismus on x

  The urgent call for slow down officially started.  Dario Amodei demands and suggest a plan for unified slow-down. …

• @mikeisaac Rat King on x

  ceo of anthropic dario amodei publishes letter calling for an AI development slowdown

• @rsanti97 Santi Ruiz on x

  “We'll provide third-party evaluators with permanent, employee-level access to our systems.”

• @mkoeris Michael Koeris on x

  This is a good move. Well done @DarioAmodei - have to go unilateral and show it works. Look forward to seeing the results and impact.

• @aileaksandnews @aileaksandnews on x

  Dario Amodei has released a new essay: We Must Pace the Frontier In this essay he argues that AI is advancing dangerously fast, especially through RSI, so frontier labs should deliberately slow down capability gains Do you agree that we should slow down?

• @deitaone @deitaone on x

  ANTHROPIC'S DARIO AMODEI: WE MUST SLOW THE PACE AT WHICH WE IMPROVE THE CAPABILITIES OF AI MODELS

• @mattyglesias Matthew Yglesias on x

  No shame in changing your mind but I'd like @DavidSacks and @elonmusk to explain why in 2026 they are dunking on people raising AI safety concerns that they themselves articulated when the technology was less advanced. What reassuring things happened in the past 30 months?

• @willdepue Will Depue on x

  i think sama deserves great credit for this. openai, for better or worse, is very defensive of employee freedom of speech. anthropic's culture is a follow on to this. it's rare to see much from X or GDM or Meta

• @jason @jason on x

  I think we're all in sync on freedom of speech, but these doomer tweets are being free-based by the media and inspiring crazy people to, well, do crazy people things. It would be great to see some restraint and a crisper message... like,

• @robleclerc Rob Leclerc on x

  if this is the best they've got, i'll be downgrading my p(doom) even further. all these scenarios describe TOTAL and intentional stupidity, complete abdication of human agency, abandonment of self-interest, and that all ai unilaterally turns on humanity and can't be used as a def…

• @clementdelangue Clem on x

  Hugging Face says its Open Alignment Initiative, led by co-founder Thomas Wolf, seeks “to be part of the ‘embedded evaluators’ program that Amodei” committed to

• @darioamodei Dario Amodei on x

  Amodei says Anthropic is “unilaterally committing” to giving third-party evaluators permanent, employee-like access to verify its adherence to safety measures

• Sasha de Marigny Sasha de Marigny on linkedin

  Today, Dario called for the frontier labs and global governments to pace the speed with which we develop AI. …

• Brian Peters Brian Peters on linkedin

  Dario's essay arrives as Congress weighs how to hold the most powerful AI systems to account.  A year ago the debate in Washington was whether Congress should act on frontier AI at all. …

• Sarah Heck Sarah Heck on linkedin

  An important call to action from Dario to deliberately pace the frontier of AI.  The government has a critical role to play here …

• Mariano-Florentino Mariano-Florentino on linkedin

  Today, Dario and Anthropic proposed a worldwide effort to deliberately pace AI's progress so that humanity can better manage the risks of rapidly-advancing models as the technology advances. …

• @deanbaker13 Dean Baker on bluesky

  When Elon Musk, Sam Altman, and Dario Amodei all tell us they have no idea what they are doing, we should believe them www.nytimes.com/2026/09/12/t...  and stop giving them trillions of dollars for a dangerous clown show.  If their AI does damage, they can pay and possibly go to …

• @mitsuhiko.at Armin Ronacher on bluesky

  This is the type of post I might regret later, but I really had an urge to rant about the current discourse around pacing the frontier. lucumr.pocoo.org/2026/9/12/pd...

• @jenrubin Jen Rubin on bluesky

  GOP has become wholly owned subisidiary of Tech Bros. But ya know what, Cal Dems who have played footsie with Silicon Valley better change their tune.  FAST.

• @carlquintanilla Carl Quintanilla on bluesky

  AMODEI: “.. It's easy to dismiss this [Hugging Face] incident because no one was hurt and the economic damage was minimal, but in my opinion, a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage.”  —  darioamodei.co…

• @lorak Lora Kolodny on bluesky

  one does not usually want to slow down the pace of research about a “technological miracle” darioamodei.com/post/we-must...  (know what i mean?)  [embedded post]

• @karlbode.com Karl Bode on bluesky

  the idea these corporations will imppse voluntary constraints on their pursuit of wealth and power in a country too corrupt to have working regulators is a hoot

• @timkellogg.me Mr. Tim on bluesky

  Dario is back with another essay, urging a slowdown  —  he insists AI development would still feel fast, just not recursively self-improving  —  darioamodei.com/post/we-must...  [image]

• r/RunningCirclejerk r on reddit

  Anthropic CEO calls for the AI industry to slow down

• r/LeftistsForAI r on reddit

  Dario's new essay is yet more western chauvinism

• r/goodnews r on reddit

  Top A.I. Leaders Call for Slowing Down A.I. Development

• r/UnderReportedNews r on reddit

  Top A.I. Leaders Call for Slowing Down A.I. Development

• r/technology r on reddit

  Top A.I. Leaders Call for Slowing Down A.I. Development

• r/Futurology r on reddit

  Anthropic C.E.O. Dario Amodei Calls for A.I. Slowdown

• r/Futurology r on reddit

  America's Great AI Freakout Has Begun

• r/politics r on reddit

  Top AI leaders unite to warn the technology is advancing too fast

• r/slatestarcodex r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/antiai r on reddit

  Anthropic C.E.O. Calls for A.I. Slowdown

• r/Anthropic r on reddit

  Anthropic C.E.O. Calls for A.I. Slowdown

• r/DevelEire r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/XGramatikInsights r on reddit

  Anthropic CEO calls for immediate slowdown in AI development.

• r/DeepStateCentrism r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/neoliberal r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/BetterOffline r on reddit

  Dario's got another blog post: This time he wants you to know chatbots are so super scary that “We must slow the pace at which we improve the capabilities of AI models.”

• r/worldnews r on reddit

  Anthropic CEO calls for the AI industry to slow down

• r/claudexplorers r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/accelerate r on reddit

  Dario - Let's Decel

• r/LocalLLaMA r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/ClaudeAI r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/OpenAI r on reddit

  Dario Amodei — We Must Pace the Frontier

• r/singularity r on reddit

  Dario Amodei — We Must Pace the Frontier

• @elonmusk Elon Musk on x

  @kevinnbass Dario is right that there should be some oversight. Peer review of AI by competitors is the right way to start this off.

• @gavinsbaker Gavin Baker on x

  Wild 24 hours for AI and lots of different proposals have been made. TLDR; the only *tangible* new fact is that OpenAI and Anthropic are going to have embedded 3rd party evaluators from unknown organizations with Dario floating METR as a possibility. Having 3rd party evaluators i…

• @elonmusk Elon Musk on x

  I think this is worth doing

• @nrmehta Nick Mehta on x

  Thoughts and prayers to the All-In Besties for reconciling this repost in their minds 😂😂😂😂

• @dkthomp Derek Thompson on x

  I'm pretty surprised by this. Elon's an arch-libertarian capitalist who's called Anthropic “Misanthropic” and “woke

• @adamjohnsonchi Adam Johnson on x

  I think one reason some are skeptical of this wave of Do Something-ism is less about the foundational claims (I think we can all agree recursive models are dangerous regardless of whether they are “AGI

• @kimmonismus @kimmonismus on x

  I did not see that coming. I did not see coming that Elon supports Amodeis call for slow down.

• @kylebrussell Kyle Russell on x

  Ok @DavidSacks time to update your script again

• @synthwavedd Leo on x

  Elon, perhaps the last person I would've thought would agreed that the development of frontier models should slow, has said he agrees with Dario's “We Must Pace The Frontier” blog post Nominally, that means OpenAI, Anthropic and xAI have now signalled their willingness to slow. W…

• @andrewcurran_ Andrew Curran on x

  This is a big update for me personally. Not that he agrees, but that he supports pacing. He never signed the letter. This does change my model of things a little.

• Scott Sanchez Scott Sanchez on linkedin

  Strong disagree.  If the US labs slow down, either voluntarily or due to regulation, it won't be long before other countries with relentless ambition take the lead in AI. …

• @carnage4life Dare Obasanjo on bluesky

  Elon Musk, Dario Amodei and Sam Altman have all endorsed a call to slow down the pace of AI model development.  —  Given the frontier labs have been engaged in a game of prisoner's dilemma burning billions to train models, a mutual slowdown before everyone runs out of cash is qui…

• @elisethomas Elise Thomas on bluesky

  I think there's actually quite an easy and obvious way to solve the collective action problem of how to make the AI companies stop conducting risky research, and it's to make it very clear that they're legally liable for anything their models do. www.politico.com/news/2026/09...

• @mlipsitt Marcie Lipsitt on bluesky

  If AI does not frighten you, pay attention! www.politico.com/news/2026/09...

• r/PauseAI r on reddit

  Anthropic CEO seeks immediate slowdown on AI

• @rynorhn Ryan Orhan on x

  interesting. dario publicly called for coordination yesterday, but apparently openai, anthropic and google have already been discussing it privately for months. regular meetings since july. shared model safety protocols. an industry-wide standards body. and the talks are still go…

• @jessicalessin Jessica Lessin on x

  Breaking: Before @DarioAmodei's memo there was already big movement on the AI regulatory coordination from. @leomschwartz has the details. https://www.theinformation.com/ ...

• @leomschwartz Leo Schwartz on x

  Scoop: Anthropic, Google and OpenAI have been holding regular discussions about creating an AI industry standards body, meeting as recently as this past week even as efforts in the White House stalled. OpenAI CEO Sam Altman also discussed moving the idea forward without the gover…

• @andrewcurran_ Andrew Curran on x

  OpenAI, Anthropic and Google have been holding talks since before Dario's essay to create an industry led standards body for shared model safety protocols. Reporting by The Information.