Ask Delphi moral judgements
Occurred: October 2021
The Allen Institute for AI's Ask Delphi is a research prototype designed to predict how humans would evaluate a wide range of ethical situations. The model is trained on questions published on Reddit communities r/AmITheAsshole and r/Confessions and responses from participants on crowdsourcing platform Mechanical Turk.
Reaction to Delphi has been mixed. On the one hand, Delphi is seen to provide reasonable, basic answers to simple questions. Equally, it is seen to misunderstand the context in which questions are being asked, produce nonsensical and clearly unsafe responses, and exhibit overt racial, gender, religious, and cultural stereotyping and bias.
Operator: Allen Institute for AI
Developer: Allen Institute for AI
Sector: NGO/non-profit/social enterprise
Purpose: Answer ethical dilemmas
Technology: Chatbot; NLP/text analysis
Issue: Accuracy/reliability; Bias/discrimination - race, religion, gender
Transparency: Black box