Lensa AI Magic Avatars generates nudes from childhood photos
Lensa AI Magic Avatars generates nudes from childhood photos
Occurred: December 2022
Report incident 🔥 | Improve page 💁 | Access database 🔢
Childhood photographs of academic Olivia Snow uploaded to Lensa AI's Magic Avatars system generated fully nude images, raising questions about the product's governance.
Despite only uploading headshots of herself, Snow, a research fellow at UCLA’s Center for Critical Internet Inquiry, described in WIRED how Magic Avatars generated nudes from her childhood photos.
According to Snow, 'many users—primarily women—have noticed that even when they upload modest photos, the app not only generates nudes but also ascribes cartoonishly sexualized features, like sultry poses and gigantic breasts, to their images.'
The incident prompted commentators to express concerns about the ineffectiveness of Lensa's no nudes policy.
Lensa blamed its users, saying that any pornographic images generated by Magic Avatars are 'the result of intentional misconduct on the app'.
Operator: Olivia Snow
Developer: Prisma Labs
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Create avatars
Technology: Neural network; Deep learning; Machine learning
Issue: Privacy
https://www.wired.com/story/lensa-artificial-intelligence-csem/
https://www.theguardian.com/us-news/2022/dec/09/lensa-ai-portraits-misogyny
https://jezebel.com/trendy-portrait-app-lensa-is-accused-of-creating-noncon-1849870304
https://mindmatters.ai/2023/01/the-lensa-magic-avatar-feature-needs-attention/
https://edition.cnn.com/style/article/lensa-ai-app-art-explainer-trnd/index.html
https://www.unilad.com/news/ai-app-trend-lensa-099020-20221211
Page info
Type: Incident
Published: December 2023