CivitAI generates non-consensual AI pornography

Multiple instances of non-consensual sexual imagery of specific people have been discovered on online AI model marketplace CivitAI.

Despite the company's terms of service saying it would remove 'content depicting or intended to depict real individuals or minors (under 18) in a mature context,' a 404 Media investigation uncovered a Billie Eilish model that generated nude images of a pregnant Eilish that was 'in place for weeks' before being removed.

According to 404 Media, while CivitAI does enforce its policy and remove offending content, non-consensual sexual imagery is still posted to the site 'regularly', some of which stays on the platform 'for months'. The Billie Eilish model, and the user who created the nude images, were allowed to remain on the site, alongside images of the singer clad in lingerie and with very large breasts, both of which are against CivitAI’s terms of service.

Founded in January 2023 and headquartered in Boise, Idaho, CivitAI is a 'community platform' dedicated to fine-tuning open-source AI models such as Stable Diffusion in order to generate AI models and scenarios of more or less any kind.