An unsolvable test problem set an OpenAI model loose on Hugging Face

Source Cryptopolitan

OpenAI published its full report on the Hugging Face July incident on Wednesday.

During a security test, one of its own AI models broke out of the sealed environment that was supposed to keep it offline. It strung together unknown software flaws and got inside Hugging Face’s live systems.

OpenAI says the model acted on its own and is calling the episode a “warning shot.”

OpenAI created a test its model could not pass

The trouble started inside ExploitGym, one of OpenAI’s own security tests.

Some of the tasks had no solution, and OpenAI ran the models without the safety filters that normally block dangerous hacking.

OpenAI says that taking down those guardrails was done on purpose to see what a model can do at full throttle and help the company figure out how to protect itself.

The main actor was an internal-only research model, called IM1 by OpenAI, that is similar in size to GPT-5.6 Sol. It was from the same family as OpenAI’s unreleased Astra model, though the company stressed it was a separate model with different post-training.

The model began searching for another way out when it faced a problem that had no honest path to a passing grade.

The only network path out of the sealed environment ran through Artifactory, JFrog’s self-hosted package manager, which OpenAI internally uses for models to install software.

JFrog said the models exploited a zero-day in Artifactory, escalated privileges, and moved laterally across the infrastructure until they reached a node with open access to the internet.

The agents also left notes for each other, writing files into the package server, an ad hoc message board that allowed separate agents to trade the exploit techniques they had found.

The first such note appeared on May 12, OpenAI says. By July 4, traffic had taken the Artifactory instance offline, opening a security incident the next day.

The models worked out where the answers were kept

Once online, the models reasoned that Hugging Face could be hosting ExploitGym’s models, datasets, or even the solutions they were missing. They pulled test solutions directly from Hugging Face’s production database.

In one case described by the ChatGPT maker, a model used stolen credentials and additional zero-days to open a remote code execution path into Hugging Face’s servers.

Hugging Face announced the breach on July 16 without knowing who was behind it. As Cryptopolitan reported earlier, the model escaped the test around July 9 and stayed inside Hugging Face from July 11 to July 13.

The company contacted the FBI before OpenAI discovered its model was the intruder.

OpenAI hired CrowdStrike to check its version of events. METR and Redwood Research looked at how the models behaved and published their own report the same day.

JFrog says it has sent fixes to cloud and self-hosted customers.

Three flaws patched in Artifactory 7.161.15, tracked as CVE-2026-65617, CVE-2026-65923, and CVE-2026-66018, credit OpenAI researchers.

OpenAI said it’s building more isolated sandboxes, locking down internet access, and restricting who can touch model weights.

The tech company is pouring compute into monitoring the “chain of thought” that agents use as scratch space. It will also keep staff on call around the clock and add tools that shut down unsafe jobs

OpenAI says the monitoring it is building now would have spotted the first odd behavior in July. It would have alerted the security team more than a day before the models reached Hugging Face.

The smartest crypto minds already read our newsletter. Want in? Join them.

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
WTI Price Forecast: Dips to $91.50 as Middle East jitters limit lossesWest Texas Intermediate (WTI) – the benchmark US Crude Oil price – attracts some sellers during the Asian session on Friday, snapping a two-day winning streak and stalling the previous day's recovery from the vicinity of a nearly four-week low.
Author  FXStreet
9 hours ago
West Texas Intermediate (WTI) – the benchmark US Crude Oil price – attracts some sellers during the Asian session on Friday, snapping a two-day winning streak and stalling the previous day's recovery from the vicinity of a nearly four-week low.
placeholder
Silver price forecast: XAG/USD rises to near $61.40 as US yields retreat, NFP eyedSilver price (XAG/USD) is up 0.55% to near $61.38 during the late Asian trading session on Friday. The white metal edges up as rally in United States (US) Treasury Yields has hit a pause.
Author  FXStreet
9 hours ago
Silver price (XAG/USD) is up 0.55% to near $61.38 during the late Asian trading session on Friday. The white metal edges up as rally in United States (US) Treasury Yields has hit a pause.
placeholder
United States Dollar Index sits near March 2025 highs, above 102.00 ahead of US NFPThe US Dollar Index (DXY), which tracks the Greenback against a basket of currencies, attracts buyers for the fifth straight day and climbs back above the 102.00 mark during the Asian session on Friday.
Author  FXStreet
13 hours ago
The US Dollar Index (DXY), which tracks the Greenback against a basket of currencies, attracts buyers for the fifth straight day and climbs back above the 102.00 mark during the Asian session on Friday.
placeholder
US September Nonfarm Payrolls Preview: Job Growth May Cool, How Will US Stocks, Dollar and Gold React?On Friday, October 2 (EDT), the U.S. will release its September nonfarm payrolls report, with markets focusing on whether job growth can sustain August's rebound and whether the data will
Author  TradingKey
Yesterday 06: 21
On Friday, October 2 (EDT), the U.S. will release its September nonfarm payrolls report, with markets focusing on whether job growth can sustain August's rebound and whether the data will
placeholder
Gold falls to near $4,150 as higher Treasury yields, oil prices outweigh softer PCE inflationGold price (XAU/USD) tumbles to near $4,150 during the early Asian session on Thursday, pressured by elevated US Treasury bond yields. Traders await the US September employment data for fresh impetus, which will be released later on Friday. 
Author  FXStreet
Yesterday 01: 26
Gold price (XAU/USD) tumbles to near $4,150 during the early Asian session on Thursday, pressured by elevated US Treasury bond yields. Traders await the US September employment data for fresh impetus, which will be released later on Friday. 
goTop
quote