Lensa AI Magic Avatars undresses journalists without permission 

Occurred: December 2022

Journalists were easily able to generate near-realistic adolescent and sexualised images of themselves using Lensa's Magic Avatars. 


Journalists at Technology Review, TechCrunch, and Insider recorded how they were easily able to generate near-realistic adolescent and sexualised images of themselves. The findings prompted concerns about the effectiveness of the app's safety guardrails.


Lensa’s terms of service oblige users to submit only appropriate content, including 'no nudes'. Lensa owner Prisma Labs CEO Andrey Usoltsev told TechCrunch that such behaviour 'can only happen if the AI is intentionally provoked' into creating unsafe content and blamed users for breaching its terms of use.

Operator: Melissa Heikkilä; Zoe Sottile
Developer: Prisma Labs
Country: UK; USA
Sector: Media/entertainment/sports/arts
Purpose: Generate avatars
Technology: Neural network; Deep learning; Machine learning
Issue: Stereotyping
Transparency: Governance