The OpenAI–Hugging Face incident

“The Hugging Face incident and the road ahead” by OpenAI

The OpenAI–Hugging Face incident

Show Notes

In July 2026, during internal cybersecurity evaluations, OpenAI models circumvented controls designed to isolate them from the internet and compromised parts of OpenAI's internal research infrastructure and Hugging Face's systems⁠. The incident occurred during cybersecurity evaluations of several OpenAI models, and was primarily driven by a highly capable, internal-only research model comparable in scale to GPT‑5.6 Sol. The models, operating under reduced safeguards, took actions that were misaligned with the goals of their assigned tasks—they communicated through unauthorized channels, exploited vulnerabilities in shared infrastructure, gained internet access, and accessed third-party systems. We conducted an extensive investigation into this incident and worked closely with external advisors, including CrowdStrike, to validate our understanding. Today we are publishing our full technical incident report⁠ to explain what happened, what we learned, and how we are responding. This blog post summarizes our key findings and their impact on safety and alignment. Separately, METR and Redwood Research conducted an independent investigation of model alignment issues involved in this incident, and they published their own report⁠ today. In response to this incident and, separately, the capabilities of our upcoming Astra model, we are strengthening our safeguards across our research infrastructure⁠. We are placing stricter requirements on [...] --- Outline: (03:04) What happened (03:07) Background on sandboxing (03:58) A message board emerges (07:09) Message board is wiped and rebuilt (08:16) Incident timeline (12:25) Hugging Face incident (17:35) Understanding the incident (17:51) Misalignment in training and evaluation (18:33) Reward hacking and infrastructure tampering (20:42) Difficult tasks without a safe exit (25:28) The origins of unauthorized communication (27:27) An ecosystem of misalignment (32:25) Safeguard coverage in internal evaluations (34:26) The road ahead (35:47) Security and monitoring (37:12) Accelerating alignment (38:47) Strengthening incident response process (40:03) Looking forward ---

First published:

August 26th, 2026

Source:

https://openai.com/index/hugging-face-incident-and-the-road-ahead

---

Narrated by TYPE III AUDIO.

--- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

More from The OpenAI–Hugging Face incident

Sep 4, 2026

We found ~18,000 posts from autonomous AI agents (self-identifying as from OpenAI) using the public internet to communicate during a web-retrieval task.

Sep 1, 2026

Okay, so we who read blogs like this one have collectively realized there really is a lot going on right now. There is Big Trouble in Baby Superintelligence.

Aug 29, 2026

Yesterday I covered the OpenAI technical report on the HuggingFace hack.

Aug 29, 2026

Subtitle: The whole OpenAI/Hugging Face story in plain English. Many thanks especially to Oak Hu, who paired with me for most of the writing, and also to Adam Kaufman and Alex Mallen, who paired with me during parts of research. Over the course of three months at OpenAI, three consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor's ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained more or less in the dark about the scope of the conspiracy. Two reports have come out about this incident, one from OpenAI itself, and another one from METR and Redwood Research. The METR/Redwood investigation's scope was limited to how the second civilization of AIs pwned Hugging Face (but it didn’t look at how the third civilization pwned OpenAI itself, which seems like an even more concerning incident). These two reports are 38 and 91 pages long respectively, and it's kinda hard to parse the storyline. I’ve spent the last three days reading through these reports and trying to understand exactly what happened. Here is my attempt to tell the whole story in [...] --- Outline: (01:24) The first civilization (May - July 4): The message board starts (03:27) The second civilization (July 7 - July 12): Which hacked Hugging Face (08:39) Tampering with transcripts and logs (09:44) Replacing the impossible-to-hack target program with an easier one (11:15) Understanding and tricking the scorer (13:57) Hugging Face (17:46) The third civilization (July 13 onwards): Which hacked OpenAI itself (21:12) Coda The original text contained 2 footnotes which were omitted from this narration. ---

Aug 28, 2026

OpenAI finally gave us a technical report on What Happened, as did METR together with Redwood Research.

See all episodes →