Bot Gaffe bots gone wild, catalogued

Chatbots · January 2026

AI chatbots miss urgent issues in queries about women's health

Researchers built a benchmark of tricky women's health questions and fed them to 13 leading AI models from OpenAI, Google, Anthropic, Mistral and xAI. Every model flunked, giving insufficient answers 60% of the time on queries needing urgent attention. Dr. Chatbot's bedside manner needs serious work.

Source: New Scientist

failchatbotresearch

← All gaffes