Facebook labels black men 'primates'

Occurred: September 2021

Facebook's AI-powered recommendation system asked users watching a Daily Mail video featuring Black men whether they like to '[k]eep seeing videos about 'Primates', prompting significant controversy.

The video was published by the Daily Mail on its Facebook page and depicted white people, including police officers, confronting Black men. No primates were shown. 

The discovery led to accusations of racism, condemnation of Facebook's apparent inability to manage inappropriate content on its platform, including its over-reliance on technology to detect and manage unsafe content. 

The company apologised for its 'unacceptable error', said it had disabled its topic recommendation feature responsible for the message, and would look to ensure it does not happen again.

System 🤖

Operator: Meta/Facebook
Developer: Meta/Facebook
Country: USA
Sector: Technology
Purpose: Recommend topics
Technology: Topic recommendation system
Issue: Bias/discrimination - race; Safety
Transparency: Governance; Black box

Page info
Type: Incident
Published: September 2021
Last updated: June 2024