Grok generates hyperrealistic racist images of football players
Grok generates hyperrealistic racist images of football players
Occurred: January 2025
Report incident 🔥 | Improve page 💁 | Access database 🔢
Elon Musk's AI chatbot, Grok, has been discovered to be generating photo realistic racist images of football players, raising concerns about its safety and potential online abuse and misinformation.
Signify, an organisation that works with prominent groups and clubs in sports to track and report online hate, said it has seen a sharp increase in reports of abuse since Grok strengthened its image generation capabilities in December 2024.
Examples include an image depicting a Black player picking cotton; another shows the same player eating a banana surrounded by monkeys in a forest.
Other images depict a number of players and managers meeting and conversing with controversial historical figures such as Adolf Hitler, Saddam Hussein and Osama bin Laden.
England's Premier League is reportedly aware of the situation. It has established measures to report and combat racist abuse, which reportedly exceeded 1,500 reports in 2024.
The emergence of Grok-generated racist images can be attributed to several factors, notably the lack of effective safeguards.
Unlike other AI tools that have stricter guidelines, Grok's system has many time sbeen shown to be easily manipulated or "jailbroken" by users to generate inappropriate images.
Athletes targeted by these images face not only personal harm but also broader implications for their mental health and public perception.
The incident also highlights concerns that the normalisation of this kinds of imagery can contribute to a toxic environment in sports and beyond.
Signify said it believes the introduction of photorealistic AI will make these kinds of outputs much more regular and visible.
However, whether and how Elon Musk improves the safety of Grok remains unclear.
Operator:
Developer: xAI
Country: UK
Sector: Media/entertainment/sports/arts
Purpose: Generate images
Technology: Generative AI; Machine learning
Issue: Bias/discrimination; Mis/disinformation
https://www.theguardian.com/technology/2025/jan/13/just-the-start-xs-new-ai-software-driving-online-racist-abuse-experts-warn
Page info
Type: Incident
Published: January 2025