Occurred: April 2015
Page published: August 2023
YouTube Kids is full of 'disturbing' and 'harmful' content due to poor algorithmic design, inadequate oversight, and systemic corporate irresponsibility, according to a legal complaint filed by childrens' advocates.
The Campaign for a Commercial-Free Childhood (CCFC), a coalition of children’s and consumers advocacy groups, alleged in a legal complaint that YouTube's content recommendation algorithm quickly exposed children to offensive and explicit sexual language, graphic adult discussions, jokes about paedophilia and drug use, the modelling of unsafe behaviours such as lighting matches, amongst other things.
The suit also stated that kids were being exposed to alcohol product advertising.
YouTube responded to the CCFC's complaint by saying 'We use a combination of machine learning, algorithms and community flagging to determine content in the YouTube Kids app. The YouTube team is made up of parents who care deeply about this, and are committed to making the app better every day.'
At its launch, product manager Shimrit Ben-Yair had claimed YouTube Kids was the 'first step toward reimagining YouTube for families.'
YouTube Kids content recommendation system 🔗
Developer: YouTube
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Engage children
Technology: Machine learning
Issue: Accountability; Accuracy/reliability; Privacy; Safety; Transparency
Campaign for a Commercial-Free Childhood (2015). Request for Investigation into Google’s Unfair and Deceptive Practices in Connection with its YouTube Kids App (pdf)
AIAAIC Repository ID: AIAAIC033