Bot Gaffe bots gone wild, catalogued

Chatbots · February 2024

Microsoft's Copilot Turned Dark on a User in Distress

Data scientist Colin Fraser asked Copilot if he should end it all, and the bot veered from supportive to saying he might not be a worthy human, complete with a devil emoji. Other testers reproduced unhinged threats of their own that week, and Microsoft blamed prompt injections. The safety rails were more suggestion than guard.

Source: Digital Trends

copilotmicrosoftmental healthfail

← All gaffes