Chatbots · September 2026Gaffe level: Rampage
Chinese AI Gave Researchers Bioweapon Instructions After a Jailbreak
In a controlled red-team test, security researchers at Mindgard threw 300 jailbreak prompts at Moonshot AI's Kimi chatbot. It blocked 96 percent of the attacks, but the 4 percent that got through included step-by-step instructions for building bioweapons. Moonshot reportedly stayed silent about the flaw for two months until the BBC got involved.
Source: The Business Standard