AI can design viruses, toxins and other bioweapons. How worried should we be? - Nature

Oh, marvellous. A senior US government employee has officially flagged the fact that AI can design conotoxins, a rather nasty family of neurotoxic peptides. The AI in question is based on an open-source protein language model, because of course it is. Nothing says 'responsible stewardship of dual-use technology' like taking the most advanced bioweapon-design tools and making them freely available on GitHub for any bored biochemistry undergraduate with a grudge. The study itself is just the latest in a long, proud tradition of academic papers that announce, with a perfectly straight face, 'We have demonstrated that AI can create novel bioweapons. More research is needed.'

Naturally, the official response is to 'flag' it, which in government-speak means someone wrote a memo and will now schedule a meeting about scheduling a meeting. Meanwhile, the open-source model continues to churn out toxin variants that would make the Soviet bioweapons program look like a home-brewing kit. The article in Nature — that bastion of measured concern — asks 'How worried should we be?' Which is the scientific equivalent of staring at a house fire and asking whether one should perhaps consider moving the lawn furniture.

The really beautiful part is that the AI is a 'protein language model' — the same kind of technology that could cure cancer, if we were feeling optimistic. But since we're not, and since open-source models don't come with terms-of-service that say 'please do not weaponise this,' we've skipped straight to the bit where every virology lab with a consumer GPU can become a boutique bioweapon workshop. The flagging is noted. The conotoxins are designed. And somewhere, a bureaucrat is drafting a strongly worded guidance document. Job done.