Exclusive: US military had close call after using AI for false intelligence report, sources say
An analyst, per CNN, used AI to fuse open-source intelligence with the government's secret signals intelligence, reached a false conclusion about what a ship was carrying, then used AI a second time to write it up in the standard format military officials have been trained to trust. It was disseminated. US Special Operations Command Pacific and the Pentagon have not commented. The machine did the analysis, the machine did the persuasive writing, and the human's contribution was pressing enter on a document that reads exactly like the ones people act on.
Here is the bit that should bother you. Not that the model was wrong — analysts have been wrong since before there were analysts, and they get corrected. It's that a second pass of the same technology took a guess and gave it the typography, the register and the unearned confidence of a product that gets believed. CNN's sources call the episode a close call. In the Pacific, a close call means somebody was briefly one signature away from something that doesn't get retracted, which is a lovely euphemism for luck.
And consider what the AI was actually being asked to do. Fusing open-source material with secret signals intelligence means pouring open-web noise and the crown jewels into the same blender, with no rulebook, no audit trail and no legislation anywhere that says who signs off when the blend is wrong. The classification system exists to keep those two streams apart; the fusion is now the selling point. The Pentagon and Special Operations Command Pacific did not respond to a request for comment, which is the institutional equivalent of studying the ceiling — and the takeaway from the whole exercise will be that the AI needs a better prompt.