Occurred: April 2022
Report incident 🔥 | Improve page 💁 | Access database 🔢
An Intel AI-based software system that aims to detect the emotional states of students during digital classes sparked controversy.
The solution, integrated with Zoom via the “Class” software product, analyses students’ body language and facial expressions to infer mental states such as boredom, distraction, or confusion and is intended to aid teachers in adapting their teaching techniques.
Some teachers who tested Intel's system in a physical classroom said the system was useful.
However, critics of affective computing argued emotion recognition is notoriously inaccurate and often mistakes facial expresssions for real, underlying feelings. The technology is also known to struggle across different cultures and scenarios.
Others are concerned about the intrusive nature of using cameras in an educational context, and in their potential for continual surveillance and misuse.
Classroom Technologies co-founder and CEO Michael Chasen told Protocol he hopes to partner with one of the colleges his company works with to evaluate Intel's system.
Operator:
Developer: Intel; Classroom Technologies
Country: USA
Sector: Education
Purpose: Improve student engagement
Technology: Emotion recognition; Facial analysis
Issue: Accuracy/reliability; Privacy; Surveillance
Stanford HAI (2023). 2023 AI Index Report - 3.2 AI Incidents (pdf)
https://www.protocol.com/enterprise/emotion-ai-school-intel-edutech
https://www.techradar.com/news/intel-under-fire-over-its-face-reading-ai
https://gizmodo.com/remote-learning-spyware-tracks-student-emotions-1848806568
https://www.biometricupdate.com/202204/affective-computing-draws-intels-attention-prompts-debate
https://www.extremetech.com/extreme/334259-intel-tests-controversial-new-student-monitoring-software
https://hothardware.com/news/intel-sparks-ai-ethics-uproar-over-tech-that-deciphers-body-language
https://www.techzine.eu/news/applications/77387/intel-develops-ai-to-detect-students-emotions/
https://www.tomshardware.com/uk/news/intel-students-ai-controversy
Page info
Type: Incident
Published: April 2022