Occurred: April 2015
Report incident 🔥 | Improve page 💁 | Access database 🔢
YouTube Kids is full of 'disturbing' and 'harmful' content, leading to accusations of poor algorithmic design, inadequate oversight and systemic corporate irresponsibility.
The Campaign for a Commercial-Free Childhood (CCFC), a coalition of children’s and consumers advocacy groups, alleged in a legal complaint that YouTube's content recommendation algorithm quickly exposed children to offensive and explicit sexual language, graphic adult discussions, jokes about paedophilia and drug use, the modelling of unsafe behaviours such as lighting matches, amongst other things.
The suit also stated that kids were being exposed to alcohol product advertising.
YouTube responded to the CCFC's complaint by saying 'We use a combination of machine learning, algorithms and community flagging to determine content in the YouTube Kids app. The YouTube team is made up of parents who care deeply about this, and are committed to making the app better every day.'
At its launch, product manager Shimrit Ben-Yair had claimed YouTube Kids was the 'first step toward reimagining YouTube for families.'
➕ March 2017. A BBC investigation found that inappropriate knock-offs of Peppa Pig, Nickelodeon's PAW Patrol and other kids' TV shows were bypassing YouTube's safety filters.
YouTube Kids content recommendation system 🔗
Operator: Alphabet/Google/YouTube
Developer: Alphabet/Google/YouTube
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Engage children
Technology: Content recommendation system; Advertising management system; Machine learning
Issue: Accuracy/reliability; Safety; Transparency
Campaign for a Commercial-Free Childhood (2015). Request for Investigation into Google’s Unfair and Deceptive Practices in Connection with its YouTube Kids App (pdf)
Page info
Type: Incident
Published: August 2023