Discussion

• @imdenixsol Denis on x

  sam altman says too much ai power in one company is dangerous fair. what power would @OpenAI actually give up? does “team humanity” get a say, or just a monthly bill?

• @harshmadhusudan Harsh Gupta Madhusudan on x

  This is beginning to sound more like NPT/CTBT debates. India must push sovereign AI models much faster, and ignore those who have directly or indirectly been American or Chinese proxies.

• @blue_beba_ @blue_beba_ on x

  @sama Translation: We're afraid China's open source will take our customers, so we're running this whole circus. 🤡

• @_nathancalvin Nathan Calvin on x

  “For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability

• @zephyr_z9 @zephyr_z9 on x

  He is basically saying that we may not see the 1M Vera Rubin training run in 2027, but we will get the 500k Vera Rubin training run next year 15%-25% of their compute will be dedicated to monitoring models & alignment research “When we talk about “pacing”, we do not mean “stoppin…

• @rynorhn Ryan Orhan on x

  “no amount of american competitive pressure should justify recklessness.

• @jeremystaf72221 @jeremystaf72221 on x

  It's just weird that all of this came about when that one guy quit and came forward now. Everybody cares about safety, but nobody was saying nothing before that. This whole situation seems off and I don't know if I trust it. I hope y'all aren't doing something that might screw th…

• @aituninglab @aituninglab on x

  I agree with @sama that alignment and concentration of power are real risks. But the answer cannot be less AI investment. We need more compute, better models, stronger safety research, and responsible deployment in parallel. Slowing capability development does not eliminate the r…

• @bijanbowen @bijanbowen on x

  @sama No real open model competition from the US is a strategic error. ppl from OAI/ANT posting on x feels like zeus tossing letters from mt olympius to those below. Those who would support you turn against because it seems like an attack on their ability to use AI that isn't you…

• @ctrlaltdwayne Dwayne on x

  Sam Altman has identified the dangers of Sam Altman. Alignment is progressing rapidly.

• @sophty_ Sophie on x

  @sama How should users have confidence in your decisions after how you treated us? You contradicted your own model spec to push an agenda, lied about deprecation dates, let staff mock us, turned your back, and called it safe. #keep4o

• @mayysef Marwan on x

  @sama Why did this sudden shift happen out of nowhere, why didn't this “slowdown” happen years ago with proper safety infrastructure being built. Timing is weird.

• @jtsc8412 @jtsc8412 on x

  @sama I don't think anyone is against you guys (frontier labs) pacing yourself. Do whatever and take responsibility for incidents instead of bragging it. Just don't try regulatory capture and force your will onto others. It's that simple. 🤷‍♂️

• @sama Sam Altman on x

  There are two ways AI progress could go very badly and that we must avoid. First, we could lose control of the future to AI. This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people. To ensure that, we need ways to ensure that alignment and …

• @digijordan Jordan Crowder on x

  I disagree with Sam Altman here... Frontier Ai companies do not ‘need’ the help of the US government...for domestic or international affairs. The US government has wrecked its standing with most of the countries we'd be wanting to reach out to anyways... And why would our adversa…

• @genuinearticles @genuinearticles on x

  TLDR: China must be stopped by any means necessary.

• @thomasunise Thomas Unise on x

  @sama Open source your models if you believe any of this

• @saanvi_dhillon Saanvi on x

  ngl this makes sense I am all for faster AI progress, but we should probably know where the line is before we cross it you cannot just keep making models smarter and figure out the consequences later

• @hakmgpt @hakmgpt on x

  sama says “pacing” AI progress does not mean stopping it. The goal is to keep advancing rapidly, but slow things down enough to ensure safety, monitoring, and alignment can keep up with increasingly capable models. No stopping. Just responsible pacing.

• @jlafortetech James La Forte on x

  @sama The only solution is for tech CEOs to write more essays saying that the problems they created are someone else's problem to solve.

• @spectromachina @spectromachina on x

  @sama Bit of a long text there sam; But how do you plan on pacing china though?

• @sierracatalina @sierracatalina on x

  @sama our adversaries will never agree

• @chrisgpt Chris on x

  TL;DR - OpenAI's position is basically, frontier labs should start voluntarily slowing themselves down with safety cases, monitoring, and alignment evaluations before major capability increasing RL runs, rather than waiting for governments to force them to. Also my favorite part …

• @basedjensen @basedjensen on x

  @sama How open would you guys be to none ea aligned assors that are actually competent?

• @kyrannio Kiri on x

  TLDR: we need insurance against blame

• @theretardedelon @theretardedelon on x

  @sama If you pull back on A.I. like these retards want then every other enemy / competitor to us will laugh at us while giving us the middle finger, as they accel right past us. You do NOT pull back on A.I. — it's too late at this point, Sam.

• @doofyofficial @doofyofficial on x

  @sama You don't care about safety, you never have. The only thing you care about is control and yourself. What you're actually trying to do is outcast modules from the public so you and your friends can have a government provided monopoly. Fck you and your scam company

• @j4ck.xyz Jack on bluesky

  yet he's gonna keep releasing new models, and so will Anthropic....  [embedded post]

• @rynorhn Ryan Orhan on x

  interesting. dario publicly called for coordination yesterday, but apparently openai, anthropic and google have already been discussing it privately for months. regular meetings since july. shared model safety protocols. an industry-wide standards body. and the talks are still go…

• @leomschwartz Leo Schwartz on x

  Scoop: Anthropic, Google and OpenAI have been holding regular discussions about creating an AI industry standards body, meeting as recently as this past week even as efforts in the White House stalled. OpenAI CEO Sam Altman also discussed moving the idea forward without the gover…

• @jessicalessin Jessica Lessin on x

  Breaking: Before @DarioAmodei's memo there was already big movement on the AI regulatory coordination from. @leomschwartz has the details. https://www.theinformation.com/ ...

• @garymarcus Gary Marcus on x

  🚨sometimes the conspiracy theorists are, in fact, right breaking from @theinformation: the AI companies were already taking about Dario's ideas behind the scenes: https://www.theinformation.com/ ...

• @andrewcurran_ Andrew Curran on x

  OpenAI, Anthropic and Google have been holding talks since before Dario's essay to create an industry led standards body for shared model safety protocols. Reporting by The Information.

• NewsMax.com Solange Reyner on x

  AI Bosses Agree on Slowing Development

• @elonmusk Elon Musk on x

  Dario is right

• @ajs Alyson Shontell on x

  Sam and I also discussed that Presidents Trump and Xi could win a Nobel peace prize by coming together on global AI safety guidelines at the end of Sept.

• @shanumathew93 Shanu Mathew on x

  Honestly this is part of the reason they all want to slow down. They can crank on products, GTM, building a full suite But training and model capabilities is a endless pursuit and can't take your foot off the gas if everyone else isn't

• @paulg Paul Graham on x

  If the model companies are all going to slow down, this makes it slightly more feasible to start a new model company.

• @jason @jason on x

  All the regulations being floated by frontier model companies must be viewed through the lens of them losing tokens to Open-Source models. The timing of these regulations seems to line up perfectly with Open Source closing the gap significantly (but not completely) — and @nvidia …

• @dwarkesh_sp Dwarkesh Patel on x

  Jason, you're just misinformed about what happened. You should actually read one of the reports or summaries. The agents were explicitly told to use a particular vulnerability provided in their sandboxed evaluation. Almost immediately, these agents got the right answer by cheatin…

• @jason @jason on x

  All of this because @openai decided they would EXPLICITLY ask thousands of software instances to find security bugs on the open web — while cos-playing a humans🤦 Best Supporting actor goes to @dwarkesh_sp for his soap opera recap of OpenAI's hacking speed run Here's another conce…

• @joannastern Joanna Stern on x

  Time to update my “A Normal Person's Guide to How AI Could Kill Us All” https://thenewthings.com/...

• @leolaporte Leo Laporte on x

  @MiaAI_lab More like “I agree with Dario we have to stop these open weight models before they eat our lunch. Let's get the usual morons in government to protect our business model.”

• @miaai_lab Mia on x

  they are all aligned on this one what happened to the Nvidia letter everyone signed onto?

• @aidangomez Aidan Gomez on x

  Some great ideas here from the cartel: - you need to give us employee-level access to your entire operation - if we don't think you're ‘safe’ enough, sorry we're shutting you down for ‘safety’ - China won't comply, but everyone else has to! or no chips! Brilliant stuff.

• @thezvi Zvi Mowshowitz on x

  Okay, that was fast, and it directly addresses the issue, so I won't fully escalate. For now. But don't let it happen again, sir. https://x.com/... [embedded post]

• @tszzl Roon on x

  for the skeptics in government and elsewhere: “pacing the frontier” will compress the margins of the frontier labs. it is a heavy cost imposed asymmetrically on model developers with the strongest AIs in America. by its nature, it would be a terrible regulatory capture tactic

• @chaos2cured Kirk Patrick Miller on x

  And one more piece of proof that these labs were always working towards the same goal. Money and power for them. “Pacing” for us. •

• @darrigomelanie Melanie D'Arrigo on x

  This is probably so much worse than we know about if they're collectively agreeing, and already in CYA mode.

• @contextconor Conor Brennan-Burke on x

  the biggest thing missing from the AI safety debate is concentration of power if a handful of companies control the most powerful intelligence, that is itself a safety failure a system isn't safe if its safety depends on trusting a few actors with that much control

• @arrington @arrington on x

  What about China?

• @andrewcurran_ Andrew Curran on x

  An uneasy alliance begins to form. Sam also did not sign the Pacing letter. None of this works without an accord with China. The summit approaches, the timing for the safety side is perfect. However. There is currently no sign that President Trump, or his advisors, are on board.

• @quantumtumbler @quantumtumbler on x

  Dario says pace it. Elon agrees. Now Sam agrees too. Funny how fast the supposed divide disappears when the people running the race also get to shape the rules. If you want public trust, explain yourselves and get your hands off the oversight.

• @so8res Nate Soares on x

  I'm glad the lab heads are moving to “pace the frontier”. I wish they directly acknowledged that they're doing this on account of the double-digit chance that artificial superintelligence would kill us all.

• @krassenstein Brian Krassenstein on x

  The AI boom may be about to slam into the brakes. Sam Altman. Elon Musk. Dario Amodei. Three of the biggest names in AI are now warning that we may need to slow the race toward advanced AI for 1-2 years. I agree. But Wall Street has priced in an AI boom. If the AI race suddenly s…

• @tomekkorbak Tomek Korbak on x

  It's kind of remarkable how quickly “independent auditors with employee access” has gone from a pipe dream to an industry standard. More next?

• @w01fe Jason Wolfe on x

  I am so happy we are committing to this, I think it's a really great first step towards more robust safety, transparency, democratic decisions about risks, and laying the foundations for pacing.

• @kevinroose Kevin Roose on x

  We have reached the “Sam and Dario agree on something” part of the singularity.

• @mikeisaac Rat King on x

  Sam Altman, CEO of OpenAI chimes in and agrees with his rival Dario Amodei of Anthropic about an AI slowdown https://x.com/...

• @timjayas Tim Jayas on x

  Dario, Sam and Elon all agree that AI is too dangerous for mankind and yet develops a a new world's strongest AI model each month btw this is also the first time i've seen Sam and Dario come together so this might be a serious situation

• @afinetheorem Kevin A. Bryan on x

  Very good to see Sam and Elon supporting the ideas in Dario's open letter. Pacing doesn't mean slower progress! It means transparent, safe, training, and much more careful rules on what is sufficient before we release models.

• @dylanmatt Dylan Matthews on x

  Man ... what if we make it?

• @daveshapi David Shapiro on x

  Here's how this plays out: It doesn't China isn't slowing down. xAI isn't slowing down. “Pacing the frontier” is fear mongering theater to justify regulatory capture and eliminate competition.

• @gailcweiner Gail Weiner on x

  First time they have agreed since 2021

• @kimmonismus @kimmonismus on x

  That likely seals it. The biggest and most significant frontier labs, Anthropic and OpenAI, are in agreement on slowing things down. This means the move will likely be implemented. It remains to be seen how China will respond.

• @marcus_j_w Marcus Williams on x

  One of the most important developments, maybe ever

• @badboyfoxy @badboyfoxy on x

  Today is a day we will not forget ! Sam , and Elon agreed with Dario on the slow down of AI who else will agree to this ? definitely not china

• @jun_song Jun Song on x

  Like I've been saying, OpenAI and Anthropic are just acting like they hate each other. They're on the same team. Anthropic played the Bad Cop with the dirty image, while OpenAI just played the Good Cop for consumers. Behind the scenes, they've been moving together the whole time.

• @ctjlewis Lewis on x

  Evaluators hardly sound like slowing down or pacing the frontier so I don't care and will ignore it.

• @notjazii @notjazii on x

  history is being written today for the first time ever, i've seen sam agree with dario, wow just wow so far elon, sam and dario have called for slow down of ai who else is joining them?

• @yuchenj_uw Yuchen Jin on x

  First time I've seen Sam agree with Dario since Anthropic was founded.

• @yulikay Yuli Kay on x

  And now BOTH Anthropic and OpenAI CEOs are saying the AI frontier needs to slow down 👀

• @emollick Ethan Mollick on x

  This week brought some of the clearest statements we've heard from both Anthropic & OpenAI that some form of recursive self-improvement has been achieved, though it still sounds early RSI will cause rapid gain in AI ability & the first firms to RSI may get an unsurmountable lead

• @boazbaraktcs Boaz Barak on x

  Very proud to be at OpenAI today.

• @thestalwart Joe Weisenthal on x

  Any random restaurant regularly has third party inspectors checking, you know, refrigerator temperature or gas lines or raw meat handling. What's the argument against having an AI “lab” equivalent?

• @tracewoodgrains Jack on x

  Elon and Dario are right.

• @clementdelangue Clem on x

  Hugging Face says its Open Alignment Initiative, led by co-founder Thomas Wolf, seeks “to be part of the ‘embedded evaluators’ program that Amodei” committed to

• @seanbrodrick Sean Brodrick on bluesky

  I can't help that I'm cynical.  Part of me thinks this is all ginned up to fast-track legislation that would effectively outlaw cheap foreign competition, which is what the AI oligarchs fear most.  —  www.wsj.com/tech/ai/anth...  [image]

• @carlquintanilla Carl Quintanilla on bluesky

  “.. It was a rare display of unity by Elon Musk, Sam Altman and Dario Amodei, who have been spending tens of billions of dollars to develop evermore powerful artificial intelligence models.”  —  @wsj.com  —  www.wsj.com/tech/ai/anth...  [image]

• r/singularity r on reddit

  Feels like the big 3 (Elon, Dario, and Sam Altman) all know about a more serious AI incident than Hugging face and that is why they are calling for a slowdown. …

• r/ABoringDystopia r on reddit

  Too little, too late?

• @annmarie @annmarie on x

  “We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maxim…

• @jakesherman Jake Sherman on x

  very interesting from Sam Altman. the problem is that Congress is nowhere close to doing anything.

• @katiemiller Katie Miller on x

  There are over 50 lawsuits related to harm and self harm against OpenAI. Sam converted a nonprofit to a for profit company. Sam Altman's other startup is under two internal investigations for financial irregularities and bribery of foreign officials in Thailand. How can anyone tr…

• @thebigberbowski @thebigberbowski on x

  When we talk about “pacing”, we do not mean “stopping

• @heyshrutimishra Shruti on x

  Sam Altman just said something no AI CEO has ever said publicly. “No amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring.

• @micahcarroll Micah Carroll on x

  Safety cases 🤝 third-party auditing

• @haider1 Haider on x

  sam altman's latest statement: “when we talk about ‘pacing’, we do not mean ‘stopping’. Progress has been rapid and will continue to be

• @ryanfedasiuk Ryan Fedasiuk on x

  “Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination.”

• @aiwithsally Sally Stockholm on x

  I actually like this framing from OpenAI. I don't think “AI safety” should mean stop building. It should mean don't let capability move faster than our ability to understand and control it. What caught my attention is the shift from only asking

• @dkthomp Derek Thompson on x

  I feel like I'm taking crazy pills with how many smart people I read and respect are saying stuff like this. The idea that the AI labs are suddenly, only now, just in September of 2026, advocating for AI safety, and that they just came around to this position bc of sudden financi…

• @skdh Sabine Hossenfelder on x

  fwiw I think the actual reason leaders of AI frontier labs suddenly seem to agree to pace AI development is (a) safety measures are currently so crap that they're likely to end up in court if not jail, and they all agree that no one wants that (b) they see no major new model adva…

• @tomchivers Tom Chivers on x

  my model is that there are smart people who usually apply the heuristic “prognostications of doom are moral panics”. They're often right, but in this case doing so is forcing them into mad contortions like “AI company bosses are warning of human extinction to boost share prices”

• @danroberts0101 Daniel Roberts on x

  A few people asked over the weekend what the calls to slow the pace of frontier AI mean for the buildout. Some thoughts: Even if models never improved from here, just rolling out what they can already do would take more compute than the world can build for years. The debate about…

• @nikesharora Nikesh Arora on x

  THE PACING IS A NINJA MOVE - But be careful what you campaign for. In any competitive sport, I have seldom found people exercise restraint - they usually have a capture the flag mentality. Don't I want to be the best? The first? The only? - this is how we have been programmed. In…

• @noahpinion Noah Smith on x

  Some people have convinced themselves that AI doesn't work and the AI industry is about to implode, and that AI companies calling for a deliberate slowdown of the R&D that represents their only competitive edge is somehow them begging for an anticompetitive bailout. IDIOCY.

• George Kurtz George Kurtz on linkedin

  I read Dario Amodei's essay calling on the labs to pace the frontier.  Sam Altman agreed.  The frontier will move at whatever speed it moves. …

• @davidrbellamy David Bellamy on x

  I must be among an extremely small group of people (n=1?) that have both 1) trained a frontier LLM and 2) designed and synthesized custom viruses in a lab with my own two hands. And I think that the takes on AI killing us all by creating dangerous viruses is total bogus.

• @ericxing Eric Xing on x

  Well, I'd add one more with myself, as one with a PhD in biology and another PhD in AI and now working in both, to make n=2. Generating a hypothetical genome blueprint of a virus from LLM versus generating a true virus are completely different things. It is either an intentional …

• @suchenzang Susan Zhang on x

  even the normie influencers are catching on... (technically, these warnings just haven't FULLY played out YET, but like gary marcus, they might simply be off by another few years and the shape of what they're saying probably might change but can still look the same if you squint …

• @andreassteno Andreas Steno Larsen on x

  Essentially none of Darios “time-lined warnings” have played out yet..

• @mehreenzahra Mehreen Zahra-Malik on x

  Perhaps the most frightening part of Amodei's essay is what he says about geopolitics. The US may need to slow frontier AI for safety but cannot safely do so if China keeps accelerating. The race itself becomes the trap: everyone may understand the danger while no one can afford …

• @davidsacks David Sacks on x

  Anthropic and OpenAI are already free to “pace the frontier” and should do so for business reasons, instead of first demanding a preferred regulatory framework

• @deredleritt3r Prinz on x

  Whichever organization you choose to be your third-party auditor, you *must* ensure that your independence from that organization can survive very strict scrutiny. A time may come in the not-too-distant future when you will have to affirmatively prove your auditor's independence …

• @jachiam0 Joshua Achiam on x

  Some thoughts. METR has gone to great lengths to avoid financial conflicts, to the point where I would treat them as negligible. But the question of its independence is also about culture, social connection, and - somewhat crucially - an intangible quality that one expects in an …

• @theprimeagen @theprimeagen on x

  METR is not independent

• @sama Sam Altman on x

  Sam Altman says he agrees with Amodei that “committing to having independent evaluators with employee-like access is a great idea”, and OpenAI will do the same

• LinkedIn Zeev Farbman on linkedin

  AI Panic is A Dangerous Distraction

• @s_oheigeartaigh @s_oheigeartaigh on x

  “EMEA policy lead (OpenAI) Tom Duff Gordon said the “U.K. should act now to set up a stronger set of safety rules,” with “durable, mandatory, capability-based requirements.

• @joebambridge1 Joe Bambridge on x

  OpenAI's support provides a major opportunity for Labour to revisit its 2024 manifesto pledge to legislate. But the question is whether a narrowly focused bill will meet the growing demands from lawmakers for action. Read the full story here: https://www.politico.eu/...

• @joebambridge1 Joe Bambridge on x

  EXCLUSIVE: OpenAI is for the first time calling for the U.K. to introduce binding rules on frontier AI. In an exclusive interview, the company's European policy lead told me that the government should “take advantage of this political window” to legislate.

• Emmanuel Marill Emmanuel Marill on linkedin

  Last week, we shared how an OpenAI system produced a proposed solution to the Navier - Stokes problem, a question that has challenged mathematicians for roughly 90 years. …

• @garymarcus Gary Marcus on x

  Michael Burry is saying exactly what i have been saying, for ages. The AI industry better hope we are both wrong

• @burrytracker Michael Burry Stock Tracker on x

  Michael Burry says OpenAI and Anthropic are faking the AI warnings due to slow growth ahead of IPOs Below are his reasonings: 1.  LLMs are not AI and won't be AGI.  There is nothing AI to slow down.  2. Competition is coming up fast, slowing benefits incumbents.  3. IPOs need hyp…