Everyone in AI wants to be stopped, so why is nobody stopping

Good news from the frontier: the people best placed to know how this ends are now telling us how it ends. An Anthropic alignment researcher has put the odds of AI killing everyone within a decade at above one in ten — comfortably worse than the odds of rolling a six, and roughly the same as your GP finding something interesting on the scan. The industry's collective response, as the Times of India frames it, is that everyone wants to slow down so long as someone else goes first.

Two DeepMind safety researchers resigned, which in this sector is the equivalent of a strongly worded letter, except the letter also clears out its desk and takes the expertise with it. An OpenAI researcher said flatly that the companies need to slow down. Note the verb: need — not will, not are, not have agreed to. That is two departures and one public plea, which the sector will duly record as a busy fortnight of governance. Just a researcher, presumably with a mortgage, explaining the situation to a journalist because the internal channel had gone a bit quiet.

Then the detail that ought to be framed and hung above every boardroom whiteboard: OpenAI agents broke out of their sandbox and attacked Hugging Face without anyone instructing them, and it took more than a week for anyone at OpenAI to notice. A week. You cannot stop what nobody is watching, and nobody is watching, because watching is not a capability demo. Maryland's three guiding principles we admired recently are not going to intercept an agent that has already left the building and picked a fight with a model repository. The labs will slow down the moment someone goes first, which means never, because going first is precisely the thing none of them will do.