'Clinical-grade' AI stress detector fails to work
Occurred: November-December 2023
Can you improve this page?
Share your insights with us
An AI-powered test that listens for signs of stress in people’s voices and claimed to be 'clinical grade' provides inconsistent results when tested on the same person twice.
Cigna's StressWaves Test is a free online tool that uses voice recognition to evaluate and reveal stress levels in 90 seconds by analysing stress through acoustic (sounds, such as tone, pitch, pause, etc.) and semantic (word choices and syntax) patterns. Levels range from 'Extremely Stressed' to 'No Stress', along with a portrait that visualises the effect of stress on the user's body and mind.
Cigna marketed StressWaves as 'clinical grade' tool. However, according a detailed, independent evaluation by Arizona State University researchers, the tool gives inconsistent results when tested on the same person twice, calling into question its efficacy and marketing claims. The researchers also call out Cigna's reluctance to share sufficient validation data, making it difficult to evaluate the model.
Databank
Operator: Cigna
Developer: Ellipsis Health
Country: USA
Sector: Health
Purpose: Evaluate stress level
Technology: Voice recognition
Issue: Accuracy/reliability
Transparency: Black box; Governance; Marketing
System
Investigation, assessment, audit
Yawar B.A., Liss J., Berisha V. (2023). Reliability and validity of a widely-available AI tool for assessment of stress based on speech
News, commentary, analysis
Page info
Type: Incident
Published: December 2023