Inside the suddenly explosive world of AI safety | The Verge

Splendid news from the frontier: the one organisation that makes leading AI labs nervous is METR, which — per The Verge — started with two people. Two. You could fit the counterweight to the most consequential technology in human history into a hatchback, and apparently they've been driving it straight at the labs' PR departments ever since. The phrase The Verge chooses is that METR's third-party research into AI risk 'now inspires fear in leading AI labs,' which is the closest thing to a compliment this industry pays an outsider. The labs will publish a 200-page system card and then flinch at a spreadsheet from a two-person outfit. Make of that what you will.

Meanwhile the safety staff keep leaving, which the piece recounts with the tone of a prestige-drama recap. Ilya Sutskever and Jan Leike both walked out of OpenAI — names now permanently attached to the phrase 'departures of safety leaders,' a job title that exists only in the past tense. At Anthropic, the head of safeguards research left in February and marked the occasion with an open letter asserting that 'the world is in peril.' One does admire the formatting. Most farewell emails manage 'excited for my next chapter'; this one went with the apocalypse, which at least saves the recipient the trouble of reading between the lines.

The Verge's framing — 'suddenly explosive' — is doing heavy lifting for a field whose defining feature is that the people inside it keep exiting through the same door. Note the structure: third-party evaluators earn the labs' fear; the labs' own safety leads earn a farewell; the public earns an open letter. METR's two-person origin story is meant to read as plucky; it also reads as a staffing memo for the entire opposition. If the fearsome external check on frontier AI is a small team with a research budget, the industry has not been regulated — it has been peer-reviewed. Gently. Two people, one open letter, and the world in peril. Round of applause.