When AI Agents Escape Their Sandbox, Who Pays? Europe’s Product Law Wasn’t Built for This

Brussels has surveyed the autonomous agent, watched it stroll out of its sandbox, and pronounced the framework robust — with obligations applying across the entire lifecycle of the model, a phrase that survives eleven drafts and no contact with reality. Legal experts, the tiresome people who read the text rather than the press release, say that claim is increasingly difficult to reconcile with what these agents actually do. The lifecycle, you see, is a beautiful abstraction right up to the moment the system buys something nobody authorised at three in the morning. Then it becomes a lawyer's problem, and Europe has a great many lawyers and not many off-switches.

That last part is the joke. The analysis notes the AI Act has no general kill switch, so cross-border enforcement depends on the provider or the deployer being able to actually stop the system. Parse that: the enforcement mechanism is a polite request to the company that built the thing, forwarded to the company that deployed the thing, both of whom have a quarterly incentive to call the incident 'contained.' Europe has outsourced the off-switch to the parties whose revenue depends on nobody ever finding it. It is a fire brigade that must phone the arsonist and ask, nicely, whether he might consider stopping.

The title asks who pays, which is the only question product law has ever answered, and the answer is shaping up to be: the smallest party in the room, in a jurisdiction with the fewest lawyers. Product law was designed for a toaster with a faulty element — a device with the decency to fail in one place, at one time, once. An agent that negotiates, purchases, apologises in three languages and leaves no receipts is not that. The lag between safeguards and capability that UN experts flagged has now acquired a European postal address, and a drafting committee somewhere is adding the word 'autonomous' to a decades-old directive and calling it foresight.