A hack of AI chatbot platform Muah.ai revealed individuals attempting to simulate child abuse scenarios, raising concerns about the platform's safety and security policies and actions.

The hacker, who discovered vulnerabilities in the site's system, shared explicit prompts found in the stolen data, including requests for role-playing as children and other forms of sexual abuse involving minors. Muah.ai presents itself as an "uncensored" platform but says it is commited to banning underage content. 

The hack exposed a large volume of user data, including explicit messages and prompts related to child sexual abuse. Although it remains unclear if the platform's AI generated the requested content, the findings underscore a troubling trend in the use of AI for illicit purposes. The site's administrator claimed that they actively moderate and remove child-related chatbots.

In addition to highlighting highly questionable security and safety practices at the company, the breach raises broader questions about the regulation and ethical use of AI technologies, particularly as they become more accessible and easier to manipulate.