Copilot falsely accuses journalist of being a child molester and fraudster
Copilot falsely accuses journalist of being a child molester and fraudster
Occurred: August 2024
Report incident 🔥 | Improve page 💁 | Access database 🔢
Microsoft's Copilot chatbot falsely accused German journalist Martin Bernklau of serious crimes he had reported on.
A long-time court reporter in the Tübingen area of Germany, Bernklau queried the system about himself, only to find it incorrectly claimed he was a convicted child molester, an escapee from a psychiatric facility, and a fraudster who preyed on widows.
The bot also provided Bernklau's personal information, including his full address and phone number
Copilot appears to have mistakenly cast Bernklau as a perpetrator based on his decades of reporting on abuse, violence, and fraud cases.
After receiving a cease-and-desist letter, Microsoft attempted to remove the false information, but it reappeared after a few days.
The public prosecutor's office in Tübingen declined to press charges, stating no crime had been committed since the accusations came from an AI, not a real person.
Hallucination (artificial intelligence)
In the field of artificial intelligence (AI), a hallucination or artificial hallucination (also called bullshitting, confabulation or delusion) is a response generated by AI that contains false or misleading information presented as fact.
Source: Wikipedia 🔗
Operator: Martin Bernklau
Developer: Microsoft
Country: Germany
Sector: Media/entertainment/sports/arts
Purpose: Generate text
Technology: Chatbot; NLP/text analysis; Machine learning
Issue: Accuracy/reliability; Privacy
Page info
Type: Incident
Published: September 2024