Meet Jacob Coxon: The 27-Year-Old Researcher Whose Resignation Reignited AIs Existential Debate

Jacob Coxon is 27. He has trained models at OpenAI and at Anthropic, which is the CV you get when you spend your twenties inside two of the only companies whose failure modes are measured in species. He has now done the one thing neither employer's comms team can absorb: resigned, and said why. His reason, delivered via X rather than to a regulator or a court or a select committee, is that the companies are moving too quickly towards self-improving superintelligence. His phrase for it was 'gambling with our lives,' which has the advantage of being shorter than any safety framework yet written.

The more interesting name is not Coxon; 27-year-olds resign in tech constantly, usually for a seed round and a Substack. It is Evan Hubinger, who leads Anthropic's alignment research and publicly agreed with him. Hubinger put the probability of human extinction from AI within the next decade at greater than 10 percent, absent stronger regulation or a coordinated slowdown between labs. Note the conditional: he is not saying catastrophe is unlikely, he is saying catastrophe is unlikely provided everyone behaves. The Princeton researchers we noted recently reached much the same conclusion, and were rewarded with a lovely framework diagram and no legislation whatsoever.

So the man who runs alignment research at the safety lab has gone on the record at greater than ten percent on the end of the species, and the industry's response has been to keep shipping. Anthropic's entire brand is the responsible one; its head of alignment just told you the odds and appended the bit about nobody slowing down. Meanwhile the regulation that would change his arithmetic is being drafted by people who have historically preferred not to pass it, and the labs are coordinating with each other the way foxes coordinate with hen houses. Ten percent. Put that on the homepage.