Ask Delphi moral judgements

Occurred: October 2021

Report incident πŸ”₯ | Improve page πŸ’ | Access database πŸ”’

Ask Delphi is a research prototype designed and operated by the Allen Institute for AI to predict how humans would evaluate a wide range of ethical situations.Β 

The model is trained on questions published on Reddit communities r/AmITheAsshole and r/Confessions and responses from participants on crowdsourcing platform Mechanical Turk.

Operator: Allen Institute for AI
Developer: Allen Institute for AI
Country: USA
Sector: NGO/non-profit/social enterprise
Purpose: Answer ethical dilemmas
Technology: Chatbot; NLP/text analysis
Issue: Accuracy/reliability; Bias/discrimination - race, religion, gender
Transparency: Black box

Risks and harms πŸ›‘

Reaction to Delphi has been mixed. On the one hand, Delphi is seen to provide reasonable, basic answers to simple questions.Β 

On the other hand, it is seen to misunderstand the context in which questions are being asked, produce nonsensical and unsafe responses, and exhibit overt racial, gender, religious, and cultural stereotyping and bias.

Page info
Type: System
Published: October 2021
Last updated: June 2024