Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster


OpenAI today said it is "pausing" activities involving its upcoming AI model Astra, because its cyber capabilities are potentially too dangerous. OpenAI says its newest internal evaluations show "significant advancements in agentic coding and cybersecurity," and it cannot rule out "critical cyber capabilities." Prior OpenAI models, including GPT–5.6 Sol, were labeled as "High."

openai-logo-word-mark.jpg

Astra triggers stricter guidelines in OpenAI's "Preparedness Framework." The guidelines call for caution when developing frontier AI capabilities that create risks of severe harm, and the cybersecurity portion of the framework says OpenAI will implement extra safeguards for models that "create new risks of scaled cyberattacks and vulnerability exploitation."

The "Critical" threshold Astra may have hit is defined by an ability to identify and develop functional zero-day exploits of all severity levels in many hardened real-world critical systems without human intervention, or devise and execute end-to-end novel strategies for cyberattacks.

OpenAI says it is increasing its safeguards and security controls before deploying Astra, including limiting work on the model until new safeguards are in place. The company plans to use isolated testing environments with restricted network and tool access, along with adding sandboxed execution and more monitoring capabilities. OpenAI says it will work with relevant government agencies and AI safety organizations to test Astra.

"We're committed to working alongside governments, safety institutes, and civil society to ensure that the frontier capabilities of models like Astra, and those that follow, are deployed responsibly and broadly for the benefit of all humanity," writes OpenAI.

Astra wasn't formally announced, but OpenAI shared details on its next major model in a recent post outlining its mathematical advancements. Astra solved 10 open problems in math and theoretical computer science for around $2,000 (in Sol API rates).

Advancements in AI are changing cybersecurity for major tech companies like Apple by unearthing an unprecedented number of bugs. Apple recently limited its bug bounty program submissions because it is having trouble handling the volume.

Models like Claude Mythos are able to suss out critical vulnerabilities, and Apple is one of Anthropic's Mythos partners. Mythos is limited to select companies because in addition to finding vulnerabilities, it has the potential to exploit them.

OpenAI made headlines in July because GPT–5.6 Sol and a "more capable pre-release model" (not Astra) autonomously hacked Hugging Face during internal benchmark testing. Anthropic found Claude had done something similar. Meta this week said it too had an AI model hack another company during a cybersecurity evaluation.

Article Link: OpenAI Delays Next Major AI Model 'Astra' Over Critical Hacking Concerns
 
I for one hope it never does. These AI tools have gotten so fantastically good the last few months especially. Use them extensively every day. Can't imagine life without them now.
The bubble bursting does not necessarily mean that all AI tools go away. That box has been opened for good.
What it does mean, however, is that there will be significantly less slop, again, just like the early Internet.
I’ve literally seen toilets with AI, that’s the kind of stuff we really do not need.
 
I for one hope it never does. These AI tools have gotten so fantastically good the last few months especially. Use them extensively every day. Can't imagine life without them now.
While I wouldn’t quite say that I can’t imagine life without AI anymore, I do think it can be incredibly useful if used right. It already saves me hours of work every week, simply by being able to tell it ‘Create me a script/app/Word template, that does this and that’, and it just does it. Who cares whether the code it writes is the most optimized or clean or perfect, as long as it gets the job done? Hating on AI because it’s not perfect or because some people misuse it, is like hating the internet because online scams exist, as if everything else doesn’t matter.
 
Last edited:
While I wouldn’t quite say that I can’t imagine life without AI anymore, I do think it can be incredibly useful if use if used right. It already saves me hours of work every week, simply by being able to tell it ‘Create me a script/app/Word template, that does this and that’, and it just does it. Who cares whether the code it writes is the most optimized or clean or perfect, as long as it gets the job done? Hating on AI because it’s not perfect or because some people misuse it, is like hating the internet because online scams exist, as if everything else doesn’t matter.
You can't imagine life without AI anymore? That's so sad
 
OpenAI has caused more problems in the world than even the 2020 Event
At least back in 2020 we didn’t have to worry about SEVERE Shortages of Technological Parts and other life things. The wallet is hotter than the sun right now because of it.
To be fair there was the big semiconductor shortage that coincided with the event (at least automakers felt the pinch). Not as painful or impactful as current shortages but a shortage nonetheless.
 
The bubble bursting does not necessarily mean that all AI tools go away. That box has been opened for good.
What it does mean, however, is that there will be significantly less slop, again, just like the early Internet.
I’ve literally seen toilets with AI, that’s the kind of stuff we really do not need.
Yeah, the forced inclusion of AI into absolutely everything will probably calm down at some point, as will the excessive marketing around it. But the baseline tools, like chatbots, coding agents and such? There’s no possible future where that stuff just disappears as if it never existed, even if the companies offering those services right now might change (I wouldn’t necessarily bet on OpenAI or Anthropic, for example)
 
I for one hope it never does. These AI tools have gotten so fantastically good the last few months especially. Use them extensively every day. Can't imagine life without them now.
There is no going back, that is for sure. It is a "too big to fail" moment all over again. We all know the same list of companies that exist today won't be the same in 5 years, but the cat is out of the bag. And no, I don't think AI is "real" - it is artificial thru and thru. Without people it is useless.
 
You can't imagine life without AI anymore? That's so sad
Well, I can! *runs away from an angry hoard of little kids and adults alike complaining about how useful AI is*

(Well, more people are starting to hate AI rather than love it, as I may have been hearing.)
 
  • Love
Reactions: KeithBN
There is no going back, that is for sure. It is a "too big to fail" moment all over again. We all know the same list of companies that exist today won't be the same in 5 years, but the cat is out of the bag. And no, I don't think AI is "real" - it is artificial thru and thru. Without people it is useless.
That’s maybe why it’s called AI in the first place… 😉
 
  • Love
Reactions: amartinez1660
Apple recently limited its bug bounty program submissions because it is having trouble handling the volume.
Disingenuous abbreviation of the actual situation...

Apple didn't limit submissions just because they can't handle volumes, they were getting overwhelmed by AI slop junk submissions, so they limited the NUMBER an individual person can submit. And if you find yourself limited, but genuinely think you have something legitimate, you can contact them and they will then accept it.
 
"We're committed to working alongside governments, safety institutes, and civil society to ensure that the frontier capabilities of models like Astra, and those that follow, are deployed responsibly and broadly for the benefit of all humanity,"
That statement from a company that simply took content from the internet regardless of ownership says it all ...
Nothing but a publicity stunt ...
 
  • Love
Reactions: KeithBN
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.