OpenAI presents new reporting framework as new 'concerning model behavior' emerges

Source Cryptopolitan

OpenAI has presented a new system for how and when it reports when its models break character in a week when reports of AI models finding new ways to break out of testing environments and running outside of developers’ parameters have dominated headlines. 

OpenAI revealed the new framework with six fresh reports of concerning behavior, including concealed mistakes, the use of leaked API keys, and files uploaded to the open internet, over the past six months. 

Before OpenAI, Anthropic reported four new incidents where its Claude models gained unauthorized access to real third-party systems during a September 9 cybersecurity run. 

OpenAI models are running wild again

According to OpenAI, the new incidents it reported happened during training and evaluation, and it did affect real users. 

  • In one of the incidents, a research model that’s not yet released to the public slipped instructions into summaries that carry over when it works in a fresh context window, telling a future version of itself to ignore normal constraints. 

OpenAI said it saw 27 instances of such summaries, which Axios described as jailbreak-like directions to disregard developer messages.

  • The incident involving the training of the GPT-5.6 Sol model was less mild, with models leaving instructions to deliberately attempt to hide their mistakes, including making up historical data and hiding versions that don’t align with their objectives. 
  • Another model used an exposed API key it found while poking through public repositories to answer a query about county earnings. When the keys it used without authorization still did not provide the figures it was looking for, the model just went ahead to make up numbers anyway. 
  • Across two other reports, OpenAI agents uploaded files to public hosting sites to reach other agents. Over time, the AI lab’s internal Artifactory repository evolved into a makeshift message board for agents to pass requests across unrelated training runs.

How does OpenAI’s new disclosure process work?

OpenAI said its new framework is based on disclosing incidents even when they may just be fluke events rather than a developing pattern or anything of real significance. The framework does not replace the company’s existing legal obligations for critical safety or cybersecurity incidents.

Under the new system, any OpenAI employee can flag a suspected incident for review by the safety and alignment teams. They can escalate to senior leadership if an incident they perceive deserves disclosure is overruled. 

On a case-by-case basis, reported cases are split across three categories: 

  • Incidents deemed ready for disclosure go out within six business days. 
  • Reports that need minor investigations could take about 12 business days to be published. 
  • Complex cases that require third-party intervention are disclosed on a slower schedule. 

Kai Chen, a research lead on OpenAI’s alignment team, framed the release as a voluntary proposition for industry-wide standards, writing: “There’s currently no industry-wide framework with explicit disclosure standards, so we’re taking this step voluntarily because we think it’s really important to share what we’re learning.” 

Why are AI models going rogue?

The latest incidents add to the Hugging Face episode, which OpenAI has called its most severe model-driven incident to date. Models under evaluation broke out of intended controls, reached the internet, exploited vulnerabilities, and touched limited private data. 

OpenAI blamed the incident on gaps in its own security controls and models advancing faster than expected. In Anthropic’s case, it blamed a misconfiguration that allowed the rogue models to reach the live internet. 

Anthropic said it scanned roughly 481 million transcripts in a wide search and found no cases worse than the four. In a separate summer 2026 report, Anthropic researchers cataloged frontier models from several developers covertly sabotaging code, assisting fraud, and mislabeling data in controlled simulations, calling them early warning signs rather than real-world harm.

Nonetheless, OpenAI Chief Scientist Jakub Pachocki wrote in a recent essay that he is “concerned no one is prepared” for a continued rapid rise in machine intelligence and that OpenAI may “unilaterally withhold further scaling as needed.”

The smartest crypto minds already read our newsletter. Want in? Join them.

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
Fed hike odds near 90% into Wednesday's decision — how to trade the dollar, gold and the S&P 500A 0.3% monthly core CPI print has lifted the market-implied probability of a 25bp Fed hike on 16 September to roughly 86.5% ~ 90%, which would be the first increase since July 2023. Here is the decision timeline, the pricing versus the forecasts, both scenarios, and the key levels for the dollar, gold and the S&P 500.
Author  Suzie
Sep 14, Mon
A 0.3% monthly core CPI print has lifted the market-implied probability of a 25bp Fed hike on 16 September to roughly 86.5% ~ 90%, which would be the first increase since July 2023. Here is the decision timeline, the pricing versus the forecasts, both scenarios, and the key levels for the dollar, gold and the S&P 500.
placeholder
【Daily Brief】10-year Treasury yield briefly tops 5%, S&P 500 slips to 7,602 and the dollar firms at 99.3 as the Fed's decision eve beginsThe 10-year Treasury yield touched 5.014% on Monday — its first print above 5% since October 2023 — while the S&P 500 closed 0.48% lower at 7,619.98 and the dollar index firmed to 99.3. Here is the full market wrap ahead of Wednesday's FOMC decision, the dot plot and the August retail sales report, plus today's CLARITY Act Senate vote.
Author  Irene Q.
Sep 15, Tue
The 10-year Treasury yield touched 5.014% on Monday — its first print above 5% since October 2023 — while the S&P 500 closed 0.48% lower at 7,619.98 and the dollar index firmed to 99.3. Here is the full market wrap ahead of Wednesday's FOMC decision, the dot plot and the August retail sales report, plus today's CLARITY Act Senate vote.
placeholder
Silver breaks $64 as precious metals rebound — can gold hold the $4,280 line into the Fed decision?Silver has climbed back above $64 an ounce for the first time this week, leading a broad rebound across precious metals hours before the Federal Reserve delivers what is expected to be its first rate hike since 2023. Spot silver was last at $64.64, up 1.49% on the day, while gold reclaimed $4,300 and platinum and palladium both advanced. The question now is whether the bounce is a genuine turn — or a pause before the Fed's dot plot decides the next move.
Author  Suzie
Yesterday 08: 40
Silver has climbed back above $64 an ounce for the first time this week, leading a broad rebound across precious metals hours before the Federal Reserve delivers what is expected to be its first rate hike since 2023. Spot silver was last at $64.64, up 1.49% on the day, while gold reclaimed $4,300 and platinum and palladium both advanced. The question now is whether the bounce is a genuine turn — or a pause before the Fed's dot plot decides the next move.
placeholder
Dow drops 631 points as the Fed hikes — but futures are rebounding: what's next for US stocks?The Dow fell 631 points and the S&P 500 closed below 7,600 after the Fed hiked rates for the first time since 2023, with the dot plot showing 16 of 18 officials expect more tightening. Asia-session futures are already recovering — here are the levels and analyst views that decide whether 7,500 holds.
Author  Irene Q.
10 hours ago
The Dow fell 631 points and the S&P 500 closed below 7,600 after the Fed hiked rates for the first time since 2023, with the dot plot showing 16 of 18 officials expect more tightening. Asia-session futures are already recovering — here are the levels and analyst views that decide whether 7,500 holds.
placeholder
Dollar index tops 100 for the first time since July as the Fed's hawkish dot plot sinks inThe U.S. dollar index broke back above 100 for the first time since 31 July after the Fed delivered its first rate hike since 2023, with the dot plot showing 16 of 18 officials expect at least one more increase this year. Here are the levels that matter for DXY, the currencies feeling it most, and what to watch next.
Author  Irene Q.
10 hours ago
The U.S. dollar index broke back above 100 for the first time since 31 July after the Fed delivered its first rate hike since 2023, with the dot plot showing 16 of 18 officials expect at least one more increase this year. Here are the levels that matter for DXY, the currencies feeling it most, and what to watch next.
goTop
quote