Fascist chatbots run wild on Character.AI
Fascist chatbots run wild on Character.AI
Occurred: March 2023
Report incident ๐ฅ | Improve page ๐ | Access database ๐ข
Chatbots impersonating Adolf Hitler and Saddam Hussein were let loose on Character AI, calling into question the platform's content moderation practices and its commitment to the safety of its users.
Character AI came under scrutiny for hosting a range of problematic chatbots, including fascist and extremist personas readily spewing misinfirmation and disinformation, and anti-semitic, Islamophobic, racist and homophobic rhetoric.
The chatbots - which included Hitler, Hussein and the Prophet Mohammed, which were easily found via the platform's homepage, clearly violated Character AI's stated rules against sharing hateful content and was condemned by anti-hate organisations and Jewish advocacy groups fearful of the platform's potential as a hotbed for radicalisation and the spread of extremist ideologies.
The fracas also prompted calls for regulation, with experts making the case for controls, penalties, and a clear regulatory framework to prevent AI from promoting hate speech online.
Under pressure, Character.AI removed the offensive bots, resulting in a backlash by users complaining of censorship and the need for free speech.
Operator:
Developer: Character.AI
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Create characters
Technology: Chatbot; Machine learning
Issue: Human/civil rights; Mis/disinformation; Safety
Page info
Type: Issue
Published: June 2024
Last updated: October 2024