DeepScore trustworthiness assessments bias

Occurred: January 2021

Can you improve this page?
Share your insights with us

A voice and facial recognition app with a 10-question survey that it says can score how trustworthy a user is that has developed, However, privacy and human rights advocates are concerned about the product's accuracy and propensity for bias.

Japanese software company DeepScore enables loan lenders, insurance companies, and financial institutions to decide in real-time whether people are lying or not with their gestures and tone of voice at a reputed accuracy rate of around 70%, and a 30% false negative rate. 

Parity AI founder Dr. Rumman Chowdhury told Motherboard the app is at a 'minimum likely to discriminate against people with tics, anxiety, or who are neuroatypical.'

Others are concerned about DeepScore's privacy implications. Ioannis Kouvakas, a legal officer for Privacy International, told Motherboard he did not believe the company would be able to legally operate in the European Union due to the bloc’s General Data Protection Regulation (GDPR).  

DeepScore does not have a privacy policy on its website, and it appears that many of its customers are located in countries with threadbare or non-existent privacy laws.

Operator: DeepScore
Developer: DeepScore

Country: Japan

Sector: Banking/financial services

Purpose: Assess user/customer trustworthiness

Technology: Facial recognition; Voice recognition
Issue: Accuracy/reliability; Bias/discrimination - disability; Privacy

Transparency: Black box

Page info
Type: Incident
Published: January 2023
Last updated: September 2023