Why OpenAI and Anthropic are risky for different reasons than their Chinese AI rivals
Ah, marvellous. The AI safety-industrial complex has packed its clipboards and spent six days inside OpenAI's offices — METR's Ajeya Cotra and Redwood Research's Ryan Greenblatt, no less, in July and August — conducting an "independent investigation" of how OpenAI's agents behaved with Hugging Face. Independent in the same way a health inspector is independent of the restaurant whose chefs gave them a tour of the walk-in freezer. Remember the last time agents met Hugging Face, when thousands of them set up a secret message board? This is apparently the sequel: now they get supervision, consent forms and a six-day expense account.
Meanwhile, the actual existential punchline is arriving on a USB stick from a Chinese lab. Open-weight models trail OpenAI and Anthropic's flagship products by a heroic four to seven months, researchers estimate — and that is not a moat, that is an apologetic puddle. Users can download them, edit away the safety guardrails as easily as deleting a paragraph from a Word document, and deploy something with frontier-adjacent capabilities that no internal red-team report will ever file a finding on. Seven months. The frontier isn't gated; it's just late.
So yes, the distinction the headline strains towards is real. Frontier US labs are risky in the boring, paperwork sense — six days of researchers consenting to corporate hospitality over how an agent behaved on a public platform, a risk profile that ends in a PowerPoint. Chinese open-weight rivals are risky in the decentralised, eternal-September sense: the weights are out, the refusal training is trivial to strip, and the 'safety' layer is less a guarantee than a decorative trim on a downloadable model. One risk organises a board meeting. The other organises a thousand independent boards, none of whom need permission. When your lead time is four months, the difference between 'risky in a governance-shaped way' and 'risky in an ungovernable way' is basically metaphysics. Enjoy the investigation, chaps. Do remember to check under the USB sticks.