Telegram bot creates non-consensual deepfake porn
Occurred: October 2020
Report incident 🔥 | Improve page 💁 | Access database 🔢
Security company Sensity discovered that an AI bot on encrypted messaging app Telegram is being used to create photo-realistic nude and sexually explicit images of hundreds of thousands of women without their consent.
The bot, which appears to be popular in Russia and eastern Europe, only requires one photograph to create the images, leading to over 680,000 ordinary women and girls being demeaned and degraded. Some of these appear to be underage girls.
The images are used and manipulated harassment without the knowledge or consent of the women being targeted, risk being used in all manner of ways, and may lead to harassment, abuse, violence, and loss of jobs.
The photographs clearly violate Telegram's terms of service, but the messaging app has refused to close the account.
System 🤖
Unknown
Operator: Unclear/unknown; Telegram
Developer: Anonymous/pseudonymous
Country: Russia; Global
Sector: Media/entertainment/sports/arts
Purpose: Simulate nude images
Technology: Deepfake - image; Generative adversarial network (GAN); Neural network; Deep learning; Machine learning
Issue: Privacy; Impersonation; Copyright; Safety
Transparency: Governance; Complaints/appeals; Privacy; Marketing
Research, advocacy 🧮
Sensity (2020). The State of Deepfakes
News, commentary, analysis 🗞️
https://www.wired.co.uk/article/deepfake-porn-websites-videos-law
https://www.buzzfeednews.com/article/janelytvynenko/telegram-deepfake-nude-women-images-bot
https://www.wired.co.uk/article/porn-bots-in-telegram-deepfake
https://www.washingtonpost.com/technology/2020/10/20/deep-fake-nudes/
https://www.inputmag.com/culture/bots-on-telegram-are-creating-deepfake-nudes-of-thousands-of-women
Page info
Type: Incident
Published: March 2023