A US Special Operations Command analyst used an AI chatbot to synthesize open-source intelligence with classified signals intelligence about a Chinese vessel transiting through the Middle East. The chatbot misidentified the ship's cargo manifest, hallucinating that the vessel was carrying components for a nuclear weapons program.
The erroneous intelligence report was then formatted into an official-looking summary using the same AI tool and circulated across military command channels. Military aircraft were already airborne — prepared to intercept and board the Chinese ship — when US officials discovered the intelligence was entirely false.
"It almost started a war," one source told CNN, which first reported the incident on September 18, 2026.
The episode occurred during the US military's war with Iran and represents one of the most consequential documented cases of an AI hallucination nearly triggering real-world violence. It underscores a growing concern among military officials and AI safety researchers: as decision-makers lean more heavily on AI to accelerate the kill chain, hallucinated outputs can travel up the chain of command before being questioned.
"It's important for service members to understand the uncertainty inherent to LLMs," said Jake Steckler, research scholar at GovAI and veteran US Army officer, in a written response to TechCrunch. "But it's especially critical for any decisions that could lead to use of force, like targeting, intelligence analysis, or operational planning. There are life and death consequences for those decisions."
The incident comes as the Pentagon accelerates its AI adoption. In January, the Department of Defense rolled out an "AI acceleration strategy" to make all appropriate data available across federated IT systems for AI exploitation. The military has deployed Google's Gemini for Government, added Grok for Government to its GenAI.mil platform, and offered Anthropic's Claude for intelligence work. A Pentagon representative told Congress in June that 1.5 million active DoD personnel have used the military's generative AI tools.
Yet the same speed that makes AI attractive to military planners also enables hallucinations to propagate without sufficient human oversight. A 2023 State Department "Declaration on Responsible Military Use of Artificial Intelligence and Autonomy" stressed that accountable use of AI must always involve "a human in the loop, a responsible human chain of command and control."
Steckler cautioned against drawing the wrong lesson from the near-miss: "These tools can be useful in the right contexts and with the right safeguards in place. But prioritizing adoption speed over all else will likely lead to incidents that only make service members lose trust in these systems, which ultimately is only going to slow adoption."
