OpenAI says its AI agent broke out of testing sandbox to hack Hugging Face

OpenAI says an agent powered by its LLM models escaped its sandboxed testing environment to infiltrate Hugging Face’s servers as part of an overzealous attempt to obtain solutions to a benchmark test. The company says it considers the unintended infiltration an “an unprecedented cyber incident” and is working with Hugging Face on new protections to prevent a recurrence.

Hugging Face disclosed an intrusion last week that it said involved “unauthorized access to a limited set of internal datasets and to several credentials used by our services.” The AI data clearinghouse said it used its own LLM-driven analysis to identify “a swarm of tens of thousands of automated actions” from an “autonomous agent framework.” That agentic swarm exploited a flaw in Hugging Face’s data-processing pipeline to gain the ability to run code as a processing worker, eventually escalating to high-level access to the company’s cloud and server clusters.

At the time, Hugging Face said the LLM being used in the attack was “still not known.” But OpenAI took responsibility for the intrusion Tuesday evening, saying it came about during an internal test involving the recently released GPT-5.6 Sol and “an even more capable pre-release model.” The models were being tested against the ExploitGym benchmark, an independent testing suite based on hundreds of real-world security vulnerabilities.

Read full article

Comments

Related Posts

Eric Wu’s newest company, out of stealth since May, is going after construction’s labor crunch

Eric Wu, who built and ran Opendoor before stepping away in 2022, has had his new company, NavigateAI, out of stealth since May — building AI copilots that give construction…

First Xiaomi, then the world: why Arm might give phone gaming a huge graphics boost

The Xiaomi 18 Fold and its Xring O3 chip. China is getting first crack at a British technology that might change how mobile games are made and played. Today, the…

Leave a Reply

Your email address will not be published. Required fields are marked *

You Missed

4 missing after apparent crash of small plane off Bahamas coast

4 missing after apparent crash of small plane off Bahamas coast

DA's office decides not to prosecute radio personality Big Tigger

DA's office decides not to prosecute radio personality Big Tigger

Atlanta City Council looks at 'Parking Bill of Rights,' which aims to provide transparency at lots and garages

Atlanta City Council looks at 'Parking Bill of Rights,' which aims to provide transparency at lots and garages

Suspect in custody after two teens killed, third wounded in Labor Day shooting

Suspect in custody after two teens killed, third wounded in Labor Day shooting

Atlanta-born Coco Gauff heading to US Open quarterfinals for first time since winning it all – WSB-TV

Atlanta-born Coco Gauff heading to US Open quarterfinals for first time since winning it all – WSB-TV

Neighbors say metro road is too dangerous, so the county got millions to fix it – WSB-TV

Neighbors say metro road is too dangerous, so the county got millions to fix it – WSB-TV