The People Building a Way to Slow Down the AI Race

Ah, marvellous. More than 1,300 employees of frontier AI companies — the very people who build these contraptions — have signed an open letter warning that the machines may soon become uncontrollable. The industry's response is a pilot scheme: engineers at Amodo Design are testing a monitoring system for data centers, to give us all a little more time before the machines decide they've had enough. That's it. That's the entire counterweight to the most powerful technology ever assembled.

The numbers do the comedy for me. Fewer than 50 engineers worldwide work full-time on AI verification tools — fifty, not a typo — while frontier labs employ thousands of researchers and release model after model with all the caution of a toddler handed a flamethrower. You'd think an open letter with 1,300 signatures from actual employees might give the industry pause. Instead, we get a monitoring pilot that will presumably be adopted voluntarily by the very companies whose business model depends on not slowing down; asking the fox to install a camera in the henhouse, with quarterly reviews.

And the farce doesn't stop at the data centre door. Verification is a field with fewer practitioners than your average pub quiz team, while the race itself is fuelled by competition, ego, and venture capital that doesn't fund 'let's be careful.' Amodo Design are swimming against a tide wearing concrete boots; their system may catch a few unauthorised training runs, but it cannot catch the structural incentive that drives every lab to ship first and think about controllability later. Still, raise a glass to the fifty brave engineers, the designated adults in the room — they're going to need backup, and there's no pint big enough. For now.