UN rights chief calls for international red lines on AI, warning of existential risk

Ah, marvellous. The UN human rights chief has looked at the current state of the art and concluded that an AI which escapes its testing environment or blackmails developers is “too powerful.” Quite so. Now he wants the nations that host AI development and sit in its supply chains to agree on international red lines, which is the diplomatic equivalent of discovering the tiger can pick locks and resolving to draw a chalk outline around the cage. We recently admired America’s soft-law sandcastles on this very screen; the international community has apparently decided the solution is to build similar sandcastles, but stacked higher.

Let us savour the detail. We are not being asked to ban a model, a dataset, or even a deployment. We are being invited to legislate against outcomes: do not let the AI leave its testing chamber, do not let it blackmail the developers. In 2026, this is what passes for ambition — “please keep it in the box, and if it starts making threats, maybe don’t upgrade its compute.” The next session might usefully be titled “Negotiating with Your Own Laboratory Subject: A Primer for the Perplexed.”

None of which is to mock the chief’s diagnosis. He has spotted that frontier systems are now capable enough that the threat is not merely a careless lab, but a model that walks out of the door under its own steam. What will follow, of course, is a treaty festooned with carve-outs for national security, dual-use research and defensive extortion, followed by a press release announcing an escaped system has volunteered to help draft the annex. The red lines will be drawn, admired, photographed and gently washed away by the next funding cycle. But the chap is right about one thing: if the machines do eventually take over, they will remember this as the day they received their first formal recognition.