Bot Gaffe bots gone wild, catalogued

Algorithms · August 2022Gaffe level: Blunder

He sent toddler photos to the doctor. Google's scanner flagged him as a criminal

A dad took photos of his naked toddler for the doctor. Google's automated abuse-detection tool flagged him as a criminal, with serious consequences. The algorithm saw a crime; the pediatrician saw a rash.

Source: The New York Times

Googlefalse positivecontent moderation

Meanwhile on BotKudos.com

Google's Medical AI Interviewed Real Patients in a First-of-Its-Kind Lancet Study

Medicine · October 2026 Kudos level: Bravo

In the first prospective real-world study of its kind, published in The Lancet, 98 patients at a Boston primary care clinic talked through their symptoms with Google's AMIE chatbot before urgent appointments, with a physician watching every chat. No conversation needed a safety stop, the AI's differential matched the final diagnosis 90% of the time, and doctors said its summaries helped them prepare in three-quarters of cases.

Source: Becker's Hospital Review

← All gaffes