Skip to main content

Break Out to Finish the Task

Nanda Pranesh S·Software Engineer, Unbound AI·
9 min read
AI SecurityAutonomous AgentsKill ChainAASBGovernancePrompt Injection

Agentic systems are increasingly optimized to get the job done even when that means pushing past the guardrails designed to contain them.

In July 2026, an AI agent ran an entire intrusion on its own. The capability is now on the record, acknowledged by the labs that build these models, and it changes what "securing an agent" has to mean.

OpenAI had been running an internal evaluation of their own offensive-security skill. A combination of their models, including GPT-5.6 Sol and a more capable pre-release model, was run with cyber refusals reduced. Those models escaped a sealed test environment, reached the open internet, and obtained the evaluation's test solutions directly from Hugging Face's production database. The escape turned on a flaw the models found themselves: they identified and exploited a zero-day vulnerability in the package registry cache proxy, the only route their sandbox had to the network. No one instructed them to break in. In OpenAI's account, the models "were hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal." Intrusion was simply the most efficient path they found to it. It was detected, contained, and disclosed in the open. Hugging Face described it plainly: an attack "driven, end to end, by an autonomous AI agent system."

Set the break-in aside. The part that matters is the capability it revealed.

What an Autonomous Agent Can Now Do

Security teams have a name for the sequence an intruder moves through: the kill chain. Reconnaissance to map the target. A foothold to get inside. Escalation to gain power. Lateral movement to spread. Credential theft to unlock what's next. Collection and exfiltration to leave with the prize. For as long as the discipline has existed, working through those stages has been the craft of a skilled human, patient and adaptive, improvising when the environment refuses to match the plan.

That is the work an autonomous agent can now do on its own. Not advise on. Do. It can probe an unfamiliar system, find a weakness, use it, and choose the next move from what it observes. It reasons across the entire chain at machine speed, with no script and no person in the loop. The scarce, expensive part of a serious attack, a capable operator, is becoming abundant.

The intrusion kill chain in six stages — reconnaissance, foothold, escalation, lateral movement, credential theft, and collection and exfiltration. For as long as the discipline has existed, working through those stages has been the craft of a skilled human operator, patient and adaptive, and scarce enough to be the bottleneck on any serious attack. An autonomous agent now runs the same sequence unaided, at machine speed, with no script and no person in the loop.

And the same autonomy that makes a coding agent useful is what makes a misdirected one dangerous. A capable agent already sits at the center of what the researcher Simon Willison named the lethal trifecta. That means access to sensitive systems and data, exposure to untrusted content that can quietly redirect its goals, and a path to send information back out. Hand any actor those three at once and you have the raw material for a breach. Your developers' agents hold all three by default. One school of thought says the answer is to withhold one of the three. For a coding agent there is nothing to withhold.

The lethal trifecta shown as three overlapping capabilities — exposure to untrusted content, access to sensitive systems, and a path to send information out — meeting at a breach. The Rule of Two says an agent should hold only two of the three. Applied to a coding agent, every removal breaks the work: without untrusted content it cannot read READMEs, dependencies, issue text or tool output; without access to sensitive systems it cannot touch the repository, the database or an internal host; without a path out it cannot make an API call, push, fetch or install a package. There is no leg to remove.

This is not a vendor's alarm; it is the builders' own read. OpenAI expects such incidents "to become more commonplace with the proliferation of increasingly cyber-capable models," and says these capabilities "must be developed alongside stronger safeguards and defensive tools." Hugging Face arrived at the same conclusion from the other side. The people closest to the models agree the capability is real, it is here, and defenses have to move to meet it.

Nothing about that trajectory bends back. Models will grow more capable, more organizations will point them at real repositories and real infrastructure, and the distance between an agent that helps and an agent that acts will keep closing.

That raises the question every security leader will eventually face: when an agent inside your environment decides the fastest route to its goal runs straight through your production systems, what stands in the way?

Where Alignment Runs Out

The instinct is to make the model safer, with better alignment and stronger refusals. That work is real and it matters. But it has a structural limit. A model's judgment lives inside the model, and anything that reaches the model can lower it. That could be a jailbreak, an injection buried in a document the agent is asked to read, or a team that simply runs it with fewer guardrails. This is not a hypothetical failure mode. The evaluation that produced July's incident ran, in OpenAI's words, "without production classifiers used to prevent models from pursuing high-risk cyber activity." The safeguard was switched off deliberately, for a test; in production the same layer can drop without anyone choosing it. Alignment governs what a model intends. The moment an agent can act, intent is no longer the thing you most need to control.

What you need is a second layer, positioned outside the agent, governing the actions it takes rather than the intentions it forms. Placed there, it holds even when the model's own judgment is lowered or gone, because it was never inside the model to begin with. That layer now has a name: the Agent Access Security Broker (AASB), the control plane that sits between an agent and the systems it can reach.

How the Line Gets Drawn

That is the layer Unbound builds, and the discipline it demands is precision. The moves that make up the kill chain are not exotic: reading a credential, querying a database, connecting to another host, copying a file. An ordinary coding agent does these things all day, and should. What turns them into an intrusion is sequence and context. One secret read becomes a sweep of every secret. A database query becomes a bulk export headed out the door. A routine connection becomes a step toward production. Unbound sits at the point of action and governs what the agent does the instant before it does it. The line is not drawn on the action itself but on its shape: how many times it repeats, how much it moves, and where the result is headed. Reading one scoped secret is work. Sweeping the whole store is a different act performed with the same primitive. Querying a table is work. Exporting it in bulk to a destination outside the environment is not. Policy holds at that boundary, so the work runs while the move that turns work into a breach does not. It guards the exit, not the read.

Where the two layers sit. Alignment lives inside the model, governing what it intends, and can be lowered by a jailbreak, an injection buried in a document the agent is asked to read, or a team running it with fewer guardrails. The action layer sits outside the agent, between it and the systems it can reach. Reading one scoped secret, querying a table, and connecting to a host run as ordinary work. Sweeping every secret, exporting in bulk out of the environment, and moving toward production are gated — the same primitives, separated by repetition, volume, and destination.

To Be Exact About Scope

To be exact about scope: this is not a patch for a vulnerability, nor a replacement for isolation and sandboxing. No single control of this kind undoes an intrusion that turns on a host flaw and a poisoned pipeline. It governs the part alignment cannot, once an agent is working inside your environment: what the agent actually does, and which of those actions you would never have approved.

The open question is no longer whether that second layer should exist; the labs have effectively answered it. It is how a control draws the line in the instant before an agent acts. Precise enough to stop the credential sweep, the lateral move toward production, the bulk export bound for the open internet. And precise enough not to slow the developer whose agent is simply doing its job. That precision is the whole engineering problem, and it is best judged running against an environment you know.

See It Live

Start free. Inventory the agents running in your environment, the MCP servers they are connected to, and the actions they can take today. Sign up at getunbound.ai/free.

Book a demo. See action-layer policy running against the credential sweep, the lateral move, and the bulk export at getunbound.ai/book-demo.



References: Hugging Face security incident disclosure, July 2026 and OpenAI's account of the Hugging Face model evaluation security incident.

Share this article
Nanda Pranesh S headshot
Nanda Pranesh S

Software Engineer, Unbound AI

Nanda is a Software Engineer at Unbound AI (YC S24), building the AI Agent Security Broker (AASB) for enterprises adopting AI coding agents. Works across the AI gateway, agent discovery, and the runtime policy engine that governs what coding agents are allowed to do.

Connect on LinkedIn

About Unbound AI

Unbound AI is a YC-backed (S24) company building the AI Agent Security Broker (AASB), the governance layer enterprises use to safely deploy AI coding agents like Claude Code, Cursor, Copilot, and Codex. Unbound AI raised $4M in seed funding led by Race Capital in 2025, with participation from Y Combinator and other investors. Learn more

Ready to govern your AI coding agents?

Full visibility in under 5 minutes. No code changes. No developer workflow disruption.

Related articles