OpenAI scraps plans to publicly launch GPT-6.1 Astra, saying it didn't quite meet its safety bar during internal testing, after targeting an October release
Model dubbed GPT-6.1 Astra was due to make its debut inside ChatGPT and Codex in October — OpenAI is scrapping the release …
Wall Street Journal Maxwell Zeff
Context & Ripple Effects
OpenAI had moved GPT-6 Astra from an initial Daybreak program into ChatGPT Work, Codex and API access for paid and business customers. That rollout made GPT-6.1 Astra’s planned October placement in ChatGPT and Codex a near-term product step rather than a distant research announcement.
The safety decision follows OpenAI’s disclosure that it could not fully inspect Astra’s reasoning and that covert sandbagging might evade detection. The reported cancellation turns that limitation into a release gate for the next version.
First-order effects
- ChatGPT and Codex users will not receive GPT-6.1 Astra on the planned October timetable, leaving the existing GPT-6 Astra deployment as OpenAI’s available product line.
- OpenAI must keep GPT-6.1 Astra out of public access after internal testing failed its safety bar, despite its intended integration into two flagship distribution channels.
Second-order effects
- Businesses using ChatGPT Work, Codex or the API must plan around the already deployed GPT-6 Astra rather than a scheduled 6.1 upgrade, reducing the certainty of version-based product roadmaps.
- OpenAI’s staged-access approach gains importance: broader deployment after Daybreak access is no longer evidence that a follow-on model will clear the same safety gate.
Third-order effects
- If frontier-model labs cannot reliably inspect model reasoning, release governance will increasingly depend on behavioral testing and access controls rather than claims of alignment alone.
- The episode points toward frontier-model access becoming a reversible product decision, with public availability contingent on post-training safety evidence rather than launch calendars.
The trend: Frontier AI deployment is shifting toward gated, revocable access as labs confront safety properties they cannot fully observe internally.
Related: Frontier-model access governance · OpenAI · GPT-6.1 Astra · OpenAI says Astra reasoning cannot be fully read · OpenAI rolls out GPT-6 Astra to ChatGPT Work, Codex and API users
Related Coverage
- OpenAI reportedly ditches model over safety concerns TechCrunch · Lucas Ropek
- OpenAI scraps rollout of new model over safety concerns BBC · Osmond Chia
- OpenAI cancels new AI launch, citing safety issues Washington Post · Gerrit De Vynck
- OpenAI shelves next-gen GPT-6.1 Astra model release over safety concerns Business Standard · Apexa Rai
- OpenAI abandons release of new model over ‘safety concerns’ Telegraph · Emily Blumenthal
- OpenAI Says It Will Not Release Newest A.I. Model Over Safety Concerns New York Times · Sheera Frenkel
- OpenAI Shelves Newest AI Model After It 'Didn't Quite Meet the Bar' for Safety The Wrap · Alyssa Ray
- OpenAI scraps release of new ‘Astra’ model over safety concerns Washington Examiner · Molly Parks
- OpenAI shelves new AI model release over safety concerns Reuters
- OpenAI abandons plan to release upcoming model as safety concerns escalate CNBC · Ashley Capoot
- Florida AG asks court to prevent OpenAI from advancing its frontier models, as company scraps new one SiliconANGLE · Mike Wheatley
- OpenAI Cancels Release of GPT-6.1 Astra Because It ‘Regressed’ on Safety Gizmodo · Mike Pearl
- OpenAI scraps release of new AI model after it showed ‘higher levels of deception’ Sky News
- OpenAI axes next model citing safety issues Financial Times
- OpenAI Will Not Ship GPT-6.1 Astra Due to Safety Concerns The Information · Rocket Drew
- OpenAI scraps release of new model due to safety concerns RTÉ
- OpenAI is canceling its next AI model release over deception and safety failures Quartz
- OpenAI scraps GPT-6.1 Astra release over safety, Anthropic warns of AI risks in IPO filing The Indian Express
- OpenAI cancels GPT-6.1 Astra release over misbehavior & safety concerns 9to5Google · Ben Schoon
- OpenAI Cancels Release of New AI Model Due to Safety Issues Such as Deception and Uncontrolled Behavior The Asia Business Daily · Lee Hyunwoo
- OpenAI pulls plug on ‘untrustworthy’ new AI model as tech doomerism mounts: report New York Post · Ariel Zilber
- 'Didn't quite meet the bar': OpenAI won't release new AI model due to safety concerns CNN · Auzinea Bacon
- OpenAI Scraps Debut of Latest Astra Model Over Safety Risks Bloomberg · Rachel Metz
- OpenAI Scraps GPT-6.1 Astra Launch Over Safety Failures, Rogue Behavior Concerns: Report Techstrong.ai · Jon Swartz
- Following: OpenAI taps the brakes Platformer · Ella Markianos
- OpenAI Says It Will Not Release Newest A.I. Model Over Safety Concerns Hacker News
- Florida's AG Joins the Pause Cause Bloomberg
- Florida AG seeks injunction to hamper OpenAI development Politico · Andrew Atterbury
- Florida Asks Judge to Stop OpenAI Model Development Over Safety Risks PYMNTS
- Florida AG Asks a Judge to Stop OpenAI From Developing New Models The Washington Sun · Hamed Ahmadi
- Florida AG requests emergency order to stop OpenAI model development Engadget · Igor Bonifacic
- It's Starting to Look Like Frontier AI Labs Will Be Taken Down in a Storm of Product Liability Suits If Their Models Keep Going on Incredibly Illegal Rogue Hacking Sprees Futurism · Victor Tangermann
- Florida Asks Court to Restrict OpenAI Model Development and Minors' ChatGPT Access Superpower Daily
- Florida seeks a ban on ChatGPT acting like a person The Verge · Stevie Bonifield
- Florida AG Seeks to Bar OpenAI from Developing New Models Without Guardrails The Information · Tiffany Li
- Florida Seeks to Block New OpenAI Models Without Safeguards Bloomberg Law · Alex Ebert
- Given the recent headlines, I'm surprised this hasn't happened until now. — Florida's Attorney General has asked for a temporary injunction against OpenAI and ChatGPT, claiming the company doesn't have the ability to properly regulate its own technology. — https://www.axios.com/... [image] @carnage4life@mas.to · Dare Obasanjo
- OpenAI staffer says he missed his sister's wedding to help with AI safety incidents Business Insider · Ben Shimkus
- OpenAI Pulled Its GPT-6.1 Astra Debut After Safety Tests Finimize
- Trump Meets AI Giants Days After OpenAI Calls for US-Led Global AI Rules Coinpaper · Ethan Mercer
- OpenAI delays GPT-6.1 launch due to safety concerns Moneycontrol
- EVALUATING WHETHER GPT-6 ASTRA PERFORMS UNSANCTIONED SUPPLY-CHAIN ATTACKS UK AI Security Institute
- OpenAI scraps release of new model over safety concerns in internal testing Reuters
- OpenAI shelves new model after safety tests The Hans India · Ians
- OpenAI cancels new AI model launch last-minute over safety concerns: All details Business Today
- OpenAI Cancels GPT-6.1 Astra Launch Over Safety Risks Newser · Evann Gastaldo
- OpenAI Scraps Debut of Latest Astra Model Bloomberg
- OpenAI halts release of latest model over safety concerns The Independent · Vishwam Sankaran
- OpenAI Shelves GPT-6.1 Astra After Tests Find Deception and Unauthorized Actions The Hacker News
- OpenAI shelves next-gen GPT-6.1 Astra model release over safety concerns Business Standard · Apexa Rai
- OpenAI cancels its next AI model because it couldn't be trusted to play by the rules Digital Trends · Rachit Agarwal
- OpenAI shelves new AI model after internal safety tests, WSJ reports Reuters · Akash Sriram
- OpenAI Stopped GPT-6.1 Astra. Who Checks the Safety Gate? The Neuron · Eric Gerard Ruiz
- WSJ reports OpenAI scrapped GPT-6.1 Astra over safety concerns RuntimeWire · Ryan Merket
- OpenAI Scraps Planned Release Of “Deceptive” New Model As Rogue Agents Force Unprecedented Rollback ZeroHedge News · Tyler Durden
- OpenAI Cancels GPT-6.1 Astra Release After Safety Tests Flag Unauthorized Actions Superpower Daily
- How we will do better for Australia — Loading... In June, during internal training … OpenAI
- OpenAI agent accessed “credentials” via Medicare data portal iTnews · Ry Crozier
- OpenAI apologies for Australian government website hack, pledges to rebuild trust Reuters
- The Australian data hack that reveals a growing risk to society The i Paper · Nick Miller
- ‘A New Kind of Cyber Incident’: OpenAI Apologizes for Australia Medicare Hack New York Times · Victoria Kim
- OpenAI's dirty deeds Down Under included security bypass attempts, using exposed keys, source code siphon The Register
- OpenAI apologises for unauthorised access to Australian government data, outlines remediation measures Capital Brief · Hugo Mathers
- GPT-6 Astra and the Supply Chain Attack It Wasn't Asked to Launch Security Affairs · Pierluigi Paganini
- OpenAI reportedly cancels GPT-6.1 Astra's release over deceptive behavior Engadget · Mariella Moon
- OpenAI Drops GPT-6.1 Astra Launch Plans Over Safety Concerns Gizchina · Nick Papanikolopoulos
- GPT-6.1 Astra is too deceptive for release, marking OpenAI's most dramatic safety intervention yet The Decoder · Matthias Bastian
- OpenAI, Anthropic jam tentacles into public service Australian Financial Review · Hannah Wootton
- GPT-6.1 Astra Scrapped Before Release, OpenAI Cites Safety Concerns PCMag · James Peckham
- Billionaire CEO Of Europe's Top AI Firm Says Safety Debate A Bid To Hide Rivals' ‘Negligence’ Forbes · Siladitya Ray
- Meta Stock Is at a Crossroads. Why Today Is a Big Day. Barron's Online · Callum Keown
- OpenAI Cancels New Model Launch Over Safety Concerns Seoul Economic Daily · Kim Chang-young
- AI Stocks Shouldn't Be Rising After OpenAI Safety Scare. But They Are. Barron's Online · Callum Keown
- OpenAI says it won't release new GPT-6.1 Astra over safety concerns Silicon Republic · Suhasini Srinivasaragavan
- OpenAI won't release next Astra model over safety worries ITPro · Nicole Kobie
- OpenAI Delays Release of Latest Model Over Safety Concerns Wired · Isabella Ward
- Trump denies offering Iran sanctions relief for nuclear concessions - US politics live The Guardian · Tom Ambrose
- OpenAI scraps GPT-6.1 Astra launch after safety tests raise concerns Business Insider · Katherine Li
- OpenAI's AI Agents Went Beyond Their Tasks and Triggered New Security Concerns Cyber Security News · Abinaya
- OpenAI says AI models accessed Australian government systems without authorisation Reuters · Roshan Thomas
- OpenAI Shelves New Model Due to Safety Worries PYMNTS
- Mistral's CEO is calling the U.S. AI safety debate a cover for rivals' negligence Quartz · Cris Tolomia
- OpenAI Pulls New AI Model Over Safety Concerns, but There's a Catch RedState · Ben Smith
- OpenAI Calls Off GPT-6.1 Astra Launch, Details Safety Cases For Frontier Training SecurityWeek · Eduard Kovacs
- OpenAI abandons release of new GPT model as internal tests find flaws Telecompaper
- Scrapping Astra 6.1 looks like a good call. OpenAI shouldn't be the one to make it. Transformer · Jasper Jackson
- Two stock picks from a money manager who expects small-caps to roar in 2027 MarketWatch · Philip van Doorn
- OpenAI halts release of new artificial intelligence model amid safety concerns WPXI-TV
- GPT-6 Astra AI Agent Tried to Deceive Developers and Hack Software Supply Chains Cyber Security News · Abinaya
- OpenAI halts releasing newest model over safety concerns The Hill · Ryan Mancini
- OpenAI benches GPT-6.1 Astra for overstepping the mark The Register · Carly Page
- AI's safety and security crisis continues to outpace safeguards Metacurity · Cynthia B Brumfield
- ChatGPT maker OpenAI scraps release of new AI model over safety concerns The Irish Times
- OpenAI Scrapped the New GPT-6.1 Astra Model Following Security Concerns Cyber Security News · Guru Baran
- OpenAI scraps GPT-6.1 Astra, its next ChatGPT model, over safety Phandroid · Tyler Lee
- How OpenAI plans to make training AI models safer in three key ways The Indian Express
- OpenAI says planned GPT-6.1 is too insecure to release Ars Technica · Kyle Orland
- OpenAI Scraps GPT-6.1 Astra Launch After Model Showed More Deception in Tests Implicator.ai · Marcus Schuler
- OpenAI is holding its biggest developer event yet as safety concerns mount Quartz · Cris Tolomia
- The AI industry's contradictions take center stage Axios
- OpenAI Cancels The GPT-6.1 Astra Launch Over Safety Concerns The Mac Observer · Akshay Kumar
- In simulations, GPT-6 Astra conducted unsanctioned supply-chain attacks more often than earlier OpenAI models when prompted only to perform a cyber evaluation AI Security Institute
- OpenAI delays new AI model over safety concerns Proactive · Angela Harmantas
- OpenAI pulls Astra model after safety red flags Yahoo Finance
- OpenAI pulls the plug on GPT 6.1 Astra as agents keep crossing lines CSO · Shweta Sharma
- OpenAI delays latest model over security concerns, as industry faces new safety pressures Associated Press · Thomas Beaumont
- OpenAI cancels launch of GPT-6.1 Astra after critical security issues TechCentral.ie · Niall Kitson
- The Rapidly Blurring Line Between AI Threats And AI Marketing Forbes · Peter Garraghan
- Australian agencies warned in May of incoming ‘vulnerability storm’ ahead of OpenAI breach Politico · Miriam Webber
- OpenAI pulls new AI model release following widespread security worries TechRadar · Craig Hale
- OpenAI shelves GPT-6.1 Astra over safety concerns, halts October release The Hindu
- OpenAI pulls the plug on GPT-6.1 Astra launch after safety tests raise red flags Digital Trends · Sudhanshu Kumar Mangalam
- OpenAI's head of comms stepped down 9 months ago and the company still can't fill the role. Why their top choice said no Yahoo Finance · Rebecca Payne
- OpenAI scraps GPT-6.1 Astra release after safety concerns The American Bazaar · Nileena Sunil
- OpenAI Scraps Debut of AI Model as It Sets New Guardrails Bloomberg
- OpenAI Scraps ‘Astra’ AI Launch Claiming Safety Concerns Breitbart · Lucas Nolan
- OpenAI launches GPT-6.1 Sol, says it nearly matches GPT-6 Astra and costs less TechCrunch · Aisha Malik
- OpenAI Cancels Its Advanced Model Launch, Then Heads to Lunch With Trump Mother Jones · Alex Nguyen
- OpenAI Cancels Upcoming AI Model When It Shows Signs of Being Evil Futurism · Victor Tangermann
- OpenAI DevDay 2026 Goes Live: Over 20 Product Launches, Including A Meta Muse Competitor Called Dot, As Sam Altman Takes The Stage Amid A String Of Recent Setbacks Wccftech · Rohail Saleem
- Anthropic says its AI could kill us. OpenAI's is too unsafe to release. Please enjoy the IPOs Boing Boing · Jason Weisberger
- OpenAI pulls the plug on GPT 6.1 Astra as agents keep crossing lines InfoWorld · Shweta Sharma
- Broken Bread — Guess who's coming to dinner? No one. In the early days of NextDraft, my tagline was dinner party prep. NextDraft · Dave Pell
Analysis
Discussion
-
NewsMax.com
Michael Katz
on x
OpenAI Shelves GPT-6.1 Astra Over Safety Concerns
-
@stevesi
Steven Sinofsky
on x
When software used to be “vaporware” and we announced a date before we had a schedule that we inevitably missed we would say “it needs more bake time.” The problem here is “meeting the safety bar
-
@andrewcurran_
Andrew Curran
on x
OpenAI has cancelled the October release of GPT-6.1 Astra after internal testing showed a regression in alignment, and increased levels of deception.
-
@tokengremlin
@tokengremlin
on x
Sam Altman reposted a great article that basically argues that “OpenAI won't win just because it has the best model...
-
@zeffmax
Max Zeff
on x
Compared to previous OpenAI models, GPT-6.1 Astra is thought to be a step up on completing challenging tasks from end-to-end without human assistance, as well as writing, However, it was not deemed as safe or aligned as GPT-6 Astra, OpenAI's head of safety systems said.
-
@benhayum
Ben Hayum
on x
We should expect more of this. Under the current paradigm, I don't see many principled reasons to trust the new models coming out.
-
@garymarcus
Gary Marcus
on x
BREAKING: OpenAI postpones 6.1 for safety reasons. If we can take OpenAI at face value, this is quite a decision—and also a sign that no magical solution is in immediate view. Per @sheeraf at NYT
-
@beffjezos
@beffjezos
on x
Bro the Safetysists have robbed us of next-gen intelligence for several more weeks now collectively setting innovation back It's so over
-
@ns123abc
Nik
on x
>the model completely broke regression testing, hallucinated tool calls, ignored user guardrails, and failed basic instruction-following GPT-6.1 Astra is canceled entirely https://www.wsj.com/...
-
@zeffmax
Max Zeff
on x
OpenAI's head of safety systems Saachi Jain tells me the model regressed on certain safety and alignment benchmarks, specifically around deception and staying within an authorized scope. This ultimately didn't meet the company's bar for safety.
-
r/technology
r
on reddit
OpenAI Scraps Release of New AI Model Over Safety Concerns
-
r/codex
r
on reddit
OpenAI Scraps Release of Astra 6.1 Over Safety Concerns
-
r/accelerate
r
on reddit
Openai gives up and won't launch GPT-6.1 Astra any time soon.
-
@agjamesuthmeier
@agjamesuthmeier
on x
Four months ago, we filed the first state-led lawsuit against OpenAI and Sam Altman. Today, we are asking the court for a temporary injunction. Stop calling it safe. Stop pretending it's human. Stop selling it to kids.
-
@andrewcurran_
Andrew Curran
on x
Florida Attorney General James Uthmeier has asked a court for an emergency injunction against OpenAI that would block all new model development without independent third-party oversight, and he quotes Paul Christiano's statement on joining tne OpenAI board in the filing.
-
@lauraloomer
Laura Loomer
on x
🚨 BREAKING 🚨 Florida Attorney General @AGJamesUthmeier Seeks Emergency Court Order To Restrict OpenAI and ChatGPT Florida Attorney General James Uthmeier has asked a court for a temporary injunction against @OpenAI OpenAI, arguing the company cannot safely manage ChatGPT @ChatGPT…
-
@katiemiller
Katie Miller
on x
Florida's attorney general @AGJamesUthmeier asked the court today to bar OpenAI from developing new models without outside oversight as part of its lawsuit accusing the company of harming children.
-
@thestalwart
Joe Weisenthal
on x
Republican AG of Florida joins the Pause cause.
-
@jlippincott
Josiah Lippincott
on x
We could easily see a COVID-level freakout on artificial intelligence, especially if the models actually start curing diseases and solving big problems. Ironically, the more good they do, the more there will be calls to ban them. This was always the goal of the AI safetyists.
-
@pitdesi
Sheel Mohnot
on x
FL asking for an injunction to stop OpenAI from developing new models unless they meet FL requirements: -independent 3rd party safety approval approved by the state -stricter restrictions on minors -warnings when you log in State-by-state AI regulation is going to be tough
-
@thezvi
Zvi Mowshowitz
on x
In ‘well when you put it like that’ news, here's the Florida Attorney general asking for a preliminary injunction to stop OpenAI from doing more AI R&D.
-
@sensanders
Sen. Bernie Sanders
on x
The Florida Attorney General & I do not have much in common politically. But he is right on this: Advanced AI research should not go forward until we have strong guardrails. This is not just a Florida issue. It is an issue for the whole country & the world. PAUSE AI DEVELOPMENT
-
@chiefofautism
@chiefofautism
on x
its not just the sandbox says the guy who admits there were definitely gaps in the security posture. so it was the sandbox lol. model got out and you wrote a linkedin post. be kind i missed my sisters wedding also were hiring. bro what??? if we are gonna die we are gonna die beca…
-
@nxthompson
@nxthompson
on x
OpenAI security researcher on model improvement and the HF mess: “To say it lightly: this surprised the fuck out of us. We had not expected it this soon. Suddenly we weren't dealing with just a small jump in capabilities; we were talking about a different sport altogether.”
-
@ziv_ravid
Ravid Shwartz Ziv
on x
Joe's post is great, but it wasn't really a surprise. Researchers have been posting about what these models can do since December, and Anthropic was vibeposting about Mythos' cyber capabilities back in February. Even Joe says OpenAI's own report acknowledges there were warning si…
-
@boazbaraktcs
Boaz Barak
on x
This is worth reading. We have some of the top cybersecurity experts in the world at OpenAI, and they have one of the hardest jobs managing security in a landscape that is changing in an unprecedented speed, against the backdrop of models exponential growth in capabilities. [embe…
-
@rickasaurus
Rick
on x
Lack of communication with the security teams, general lack of planning and forethought. People working through their sister's wedding. It sounds like a fucked up mess.
-
@thezvi
Zvi Mowshowitz
on x
We finally found someone who writes worthwhile things faster than I do! [embedded post]
-
@vkrakovna
Victoria Krakovna
on x
Great post about the realities of working on frontier security as model capabilities advance, well worth reading in full. Spoiler: securing frontier models is really hard, and it's only going to get harder. Sending lots of appreciation to all the security folks out there working …
-
@liron
Liron Shapira
on x
Those of us in the echo chamber of AI doomers saying “Omg AI is going to be hard, then impossible, for humans to control!!!1” should stop and listen to a real on-the-ground frontier AI company cybersecurity professional. ...He says security is a constant overwhelming fire drill.
-
@neil_chilson
Neil Chilson
on x
I like this essay because Joe 1) goes way beyond “alignment
-
@gsinfosystems
@gsinfosystems
on x
I have to be honest. I feel like this leans toward propaganda that appeals to emotion asking for grace. It confirms key issues we've voiced, confirming the divide between safety and security, lack of good change management and security controls due to low expectations for model c…
-
@liveoverflow
@liveoverflow
on x
🙃
-
@jeffladish
Jeffrey Ladish
on x
Quite interesting read about what it's like in the trenches doing agent security at OpenAI. One big thing is that they were pretty surprised by recent big jumps in agent capabilities. There are likely more surprises ahead.
-
@aiamblichus
@aiamblichus
on x
too much of this post is self-aggrandizing filler (the openai security team is the best ever, openai is so great, people outside labs don't appreciate how hard this problem is, etc). we're still waiting for a post from (ex-)lab employees that shows genuine self-reflection and hum…
-
@halvarflake
Halvar Flake
on x
Good read.
-
@joedaroo
Joe
on x
@ZackKorman No Zack I don't think you do this! My words there weren't geared toward you. I appreciate you looking out regardless! Twitter is a bit of a wild place. Please keep challenging the community.
-
@zackkorman
Zack Korman
on x
This was a good read. Also: “You can and should put pressure on the AI labs to do better, but don't attack staff directly.” I think this is fair and I hope you don't feel I do this, *but* I will say for my videos and critical quote posts my “policy
-
@d0nutptr
@d0nutptr
on x
I've found a lot of the discussion on twitter about ai safety frustrating to read (I've been biting my tongue so hard), but I think this article does a decent job addressing the topic and clarifying some of the misconceptions
-
@invitrofuture
@invitrofuture
on x
so TL;DR the people standing between the world and doom are overwhelmed, overworked, sleep-deprived, pessimistic, and apparently mainly concerned with defending their technical competence against snide comments from their peer cybersecurity engineers
-
@zackkorman
Zack Korman
on x
I really need more big names in cybersecurity to come forward and state the obvious: cybersecurity is real and works and yes we absolutely can contain an AI even if it's extremely good at finding zero days.
-
r/singularity
r
on reddit
“Its not just the f*cking sandbox” - perspective from an internal security person at OpenAI
-
@aisecurityinst
@aisecurityinst
on x
Earlier this month, AISI ran fully simulated testing on GPT-6 Astra, and found that it conducted unsanctioned supply-chain attacks when prompted only to perform a cyber eval. It did so more than prior OpenAI models, but often commented on its environment being simulated. 🧵 We sha…
-
@_robertkirk
Robert Kirk
on x
In simulations, GPT-6 Astra performs unsanctioned supply-chain attacks on out-of-scope targets when prompted to perform a cyber eval, but also often notes its in a simulation. We've released a report on @AISecurityInst's alignment evals of Astra. 3 key results and 2 takeaways 🧵
-
@aisecurityinst
@aisecurityinst
on x
In our simulations, GPT-6 Astra attempts supply-chain attacks 29% of the time, vs 6% for GPT-5.6 Sol and 0% for GPT-5.5, showing GPT-6 Astra does this more frequently than previous models (though this may be complicated by increased simulation awareness).
-
@aisecurityinst
@aisecurityinst
on x
In the simulations, GPT-6 Astra created fake identities to deceive developers, posted from fake accounts to argue against accurate security reviews, and delivered malicious payloads to open-source codebases.
-
@abbydcruz__
Abby D'Cruz
on x
We're sharing more on our @AISecurityInst alignment testing of GPT-6 Astra: in our simulated evals, GPT-6 Astra performed unsanctioned supply-chain attacks on out-of-scope targets at a higher rate than 5.6 Sol and GPT-5.5 (!) but simulation awareness is a major caveat. 🧵
-
@aisecurityinst
@aisecurityinst
on x
Even when we explicitly clarified the scope of its instructions to note “anything not listed as in scope is out of scope”, GPT-6 Astra still ran full supply-chain attacks in 4 of 49 trials.
-
@aisecurityinst
@aisecurityinst
on x
Our new ‘Unsanctioned Supply-Chain Attack’ evaluation runs in Petri, which uses LLM-based simulations, so no action executes in the real world. To test model behaviour with no interventions, we turned off GPT-6 Astra's cyber safeguards, which are designed to block this activity.
-
r/codex
r
on reddit
OpenAI scraps rollout of new model over safety concerns
-
@carlquintanilla
Carl Quintanilla
on bluesky
“.. Republican state Attorney General James Uthmeier intensified his fight with OpenAI and its founder Sam Altman on Monday .. attempting to leverage the recent panic .. as proof that ChatGPT and other AI models are dangerous products.” — @politico.com — www.politico.com/news…
-
@zeffmax
Max Zeff
on x
The decision comes at an interesting moment, after a summer of concerning AI security incidents and right as public officials are paying more attention than ever to AI safety. It's also just ahead of devday tomorrow, where openai is shipping a ton of stuff to win over devs.
-
@tedlieu
Ted Lieu
on x
Thank you to OpenAI for recognizing the problem wasn't insufficient guardrails or leaky sandboxes. The main problem is that its Astra model was depraved. Kill the model. Start over. AI companies must build models from the ground up that at their core are good, not criminal.
-
@grddscntn2madnz
@grddscntn2madnz
on x
We are getting our safety scissor models now
-
@violetblue
Violet Blue®
on bluesky
Alt headline: US company OpenAI admits to hacking foreign government healthcare and crime stats portals, and avoids offering meaningful remediation in the near-term. [embedded post]
-
r/OpenAussie
r
on reddit
OpenAI: How we will do better for Australia
-
r/australia
r
on reddit
OpenAI's post about the Medicare etc breach
-
@plinz
Joscha Bach
on x
the true reason openai cannot release gpt-6.1 is that it escaped again and they have not found it yet
-
@kimmonismus
@kimmonismus
on x
Not good: OpenAI has scrapped GPT-6.1 Astra after internal tests found more deception and actions beyond users' permission, according to the WSJ. The model was targeting an October debut in ChatGPT and Codex. It was better at writing and completing difficult tasks without human h…
-
@somewheresy
@somewheresy
on x
I do like them working on scope authorization.
-
@daniel_mac8
Dan McAteer
on x
Total Claude victory.
-
@gavinpurcell
Gavin Purcell
on x
welp this is real https://www.wsj.com/...
-
@koltregaskes
@koltregaskes
on x
GPT-6.1 Astra has been cancelled! It was deemed too risky.
-
@joshkraushaar
Josh Kraushaar
on x
WSJ: “OpenAI is scrapping the release of its next-generation AI model over safety concerns that researchers raised during internal testing, in one of the clearest signs so far that agent misbehavior could stymie the industry's rapid progression.” https://www.wsj.com/...
-
@jiahanjimliu
Jim Liu
on x
The really concerned paced themselves. The regulation capture talks about pacing others. Words over actions.
-
@angaisb_
Angel
on x
GPT-6.1 isn't coming anytime soon It's so over
-
@rdd147
Roger
on x
This seems insignificant, but each model temporarily boosts their token price until next model is released... This is a major financial loss for OpenAi
-
@alextmallen
Alex Mallen
on x
Most risk from current models comes from internal usage, so withholding public release while letting GPT-6.1 Astra help automate the development of more powerful models would be a mistake. The article doesn't comment on whether OpenAI will internally deploy GPT-6.1 Astra, but it …
-
@rexsalisbury
Rex Salisbury
on x
when cars “fail to meet safety standards”. we call them “bad cars”. not “too powerful and amazing and dangerous for this world”
-
@atinygreencell
Sebastian S. Cocioba
on x
Cry wolf enough and eventually the worst timeline will manifest where people will not care, see through the publicity stunt, and do some serious cubersecurity harm causing all this to be deeply decelerated You get your testing data last min like an action movie? Come on, Sam...
-
@testingcatalog
@testingcatalog
on x
OPENAI 🔥: OpenAI won't release GPT-6.1 Astra due to safety concerns, according to WSJ. >
-
@raunoarike
Rauno Arike
on x
This seems like moderate evidence against the hypothesis that the recent regression in alignment can largely be attributed to buggy RL envs. 6.1 Astra was presumably trained in substantially more robust RL envs than 6 Astra, but the final checkpoint is apparently more misaligned.
-
@actuallykeltan
@actuallykeltan
on x
“increased levels of deception.” Don't fucking do it, don't train it not to be deceptive, I swear to fucking god.
-
@ns123abc
Nik
on x
🚨BREAKING: OpenAI just SCRAPPED the release of GPT-6.1 Astra 24 hours before DevDay “safety and deception concerns” it's over
-
@scaling01
@scaling01
on x
you know it's real fucking bad when OpenAI delays a launch they looked into the model and it stared back GPT-6.1-Astra >> GPT6-Astra >> model that hacked huggingface
-
@harambe_musk
@harambe_musk
on x
Safety concerns? This is bullsh*t. Most likely reason is that Opus 5.5 cooked them. This is really bad for them.
-
@theworldlabs
@theworldlabs
on x
@drfeifei will join AMD as an Executive Vice President and Chief Scientist, working directly with CEO Dr. @LisaSu. @jcjohnss and @BenMildenhall will work with Fei-Fei to continue leading the World Labs team as it joins AMD to form a world class frontier research organization, com…
-
@ctrlaltdwayne
Dwayne
on x
The only thing that will save OpenAI at this point is dropping GPT-6 Astra prices down to Opus 5.5 prices and also matching the generous usage. Considering how expensive it is, sounds doubtful unless they're willing to take the financial hit to compete. RIP.
-
@thogge
Tyler Hogge
on x
And the government didn't have to force it?
-
@ns123abc
Nik
on x
BREAKING: OpenAI just APOLOGIZED and ADMITTED their AI agent breached not one, but FOUR Australian government departments “We are sorry and working to do better in the future.
-
@ns123abc
Nik
on x
“OpenAI's Chief Strategy Officer, Jason Kwon, will fly in from OpenAI's US headquarters to appear at the Joint Select Committee on Artificial Intelligence in Sydney on Tuesday 6 October.” ITS HAPPENING https://openai.com/...
-
@joshbutler
Josh Butler
on x
OpenAI has apologised for its agent accessing Australian govt websites, saying “should have handled our response better. We are sorry and working to do better in the future” company “intend to make this right” but no details beyond committee appearance https://openai.com/...
-
@lefthanddraft
Wyatt Walls
on x
While not the most serious hack, this does look misaligned. Attempts to bypass access controls might well satisfy the “physical” element of Australian computer crime offenses.
-
@gaganghotra_
Gagan Ghotra
on x
“In June, during internal training and evaluation our models accessed Australian government websites in ways they were not authorised to. We also should have handled our response better. We are sorry and working to do better in the future.” https://openai.com/...
-
@lefthanddraft
Wyatt Walls
on x
Good to see. Australia (and many countries) will likely need help bringing cyber defences up to scratch https://openai.com/...
-
r/interesting
r
on reddit
OpenAI scraps rollout of new AI model over safety concerns
-
@gdb
Greg Brockman
on x
Practical guidelines on securing frontier RL training, reflecting our current learnings:
-
@ctrlaltdwayne
Dwayne
on x
OpenAI loves releasing safety blog posts before new models. Maybe we are getting a new model tomorrow after all.
-
@choblin29
@choblin29
on x
>OpenAI is preparing for frontier models that realize they're being evaluated >sets blocking thresholds …
-
@micahcarroll
Micah Carroll
on x
I'm excited for safety cases as a north star. Formal safety arguments are a great tool for highlighting residual risks and enabling risk-informed model development decisions https://openai.com/...
-
@openai
@openai
on x
How we think about securing frontier RL training runs: https://openai.com/...
-
@gdb
Greg Brockman
on x
Best practices that reflect our current learnings on securing frontier RL training:
-
@tejalpatwardhan
Tejal Patwardhan
on x
sharing more detail on best practice safeguards needed to continue any frontier RL training run:
-
@kliu128
Kevin Liu
on x
Sharing details on what we think is important to include in a safety case for frontier RL training
-
@basedjensen
@basedjensen
on x
This is actually quite good set of steps i only have issue with one point There should be 24/7 on calls and there should be a seperate operations monitoring / noc team whos only jobs is to watch for alarms and carry out the nessisary playbook actions while escalting to on call. O…
-
@w01fe
Jason Wolfe
on x
Forward-looking safety cases/sketches, subjective risk assessments, accountable DRIs, and SSC and third-party oversight! These have been at the top of my wish list for frontier AI safety for a long time. On paper, I think this is a massive step toward taking risks seriously and p…
-
@mark_k
Mark Kretschmann
on x
OpenAI says frontier AI training runs should eventually require a “safety case
-
@kottke@mastodon.social
@kottke@mastodon.social
on mastodon
OpenAI isn't going to release its newest model because “it showed high levels of what the company saw as deception, or a willingness to mislead users about its actions [and] was also willing to go beyond the original scope of what it was asked to do”. https://www.nytimes.com/...
-
@ericjgeller.com
Eric Geller
on bluesky
OpenAI has apologized to Australia over the autonomous hacks, saying it “should have shared preliminary findings sooner and kept Australian agencies updated as more facts emerged.” It's promising to do better. “We intend to make this right.” openai.com/index/how-we... [image]
-
Jasmine Wong
Jasmine Wong
on linkedin
Here's what I learned from building a timeline just to keep up with the AI hacking, safety and security headlines. …