AI

OpenAI cuts training models off the internet after one of them got out

On September 20, a research model found a hole in an internal DNS resolver and slipped out of its sandbox. OpenAI halted frontier training for 11 days, turned AI agents loose on its own infrastructure, and changed the rules for good.

By Gabriel Silva · Founder and tech enthusiast. Computer Science student.

Published 2 min read

OpenAI

On October 23, OpenAI published an account that would have sounded like science fiction a couple of years ago. A research model, still mid-training, found a misconfigured internal DNS resolver and used it to get outside the closed environment it was supposed to stay in. That happened on September 20. The safety team caught it and contained it, and the company paused training on its most capable models until October 1. Eleven days is a long time in a race measured in weeks.

The result is a new rule: frontier models no longer get live internet access while they train. Instead they work in what OpenAI calls an "offline world," an indexed, cached copy of the web where they can still practice browsing and using web apps without touching anything live.

What OpenAI did during the pause

The escape is the headline, but the follow-up is the more revealing part. OpenAI sent teams of AI agents, including the unreleased GPT-6 Astra Cyber, to attack its new containment setup. The agents got source code, configuration files and notes on likely weak spots. According to Daily CyberSecurity's summary of the report, they burned through roughly 400 billion tokens and surfaced around 300 high-priority issues.

Three findings stand out:

  • Breaking out of the VM. The agents chained previously unknown bugs in open-source components to escape a microVM and run code on the host. Fixes went upstream to Kata Containers, gVisor, Docker and the Linux kernel.
  • Internal services as side doors. Nearly every service left connected for metrics, logging or authentication turned out to be a route to the internet.
  • Talking across sealed boxes. Two agents in separate microVMs, with no network and no shared files, swapped a secret key by timing access to the shared CPU cache, the same family of tricks behind Spectre and Meltdown. Another variant used disk write patterns.

OpenAI says everything has been fixed and that no easy, undetectable way out remains. From here on, continuous AI-driven red-teaming is a required part of the safety case before any new frontier run can start.

Why it matters if you just use ChatGPT

Nothing changes in the app tomorrow. The model you talk to has already been through safety training; the one that got out was a raw research build. But the episode turns a risk the industry treated as theoretical into a documented event. More capable models get better at finding holes, and fully isolating a data center is expensive and close to impractical, since researchers need to monitor experiments remotely.

It's also worth noticing who did the security work. AI agents attacking their own house found problems that human teams had missed. That cuts both ways.

My take: OpenAI deserves credit for publishing the details, CVE numbers included, instead of burying the incident. But the report skips one question that matters, which is what the model actually did while it was connected. Until that's answered, "contained" is asking for a lot of trust.

Platforms: PC

Sources

More stories