Telegram bot creates non-consensual deepfake porn
Occurred: October 2020
Report incident ๐ฅ | Improve page ๐ | Access database ๐ข
Security company Sensity discovered that an AI bot on encrypted messaging app Telegram is being used to create photo-realistic nude and sexually explicit images of hundreds of thousands of women without their consent.ย
The bot, which appears to be popular in Russia and eastern Europe, only requires one photograph to create the images, leading to over 680,000 ordinary women and girls being demeaned and degraded. Some of these appear to be underage girls.
The images are used and manipulated harassment without the knowledge or consent of the women being targeted, risk being used in all manner of ways, and may lead to harassment, abuse, violence, and loss of jobs.
The photographs clearly violate Telegram's terms of service but the messaging app refused to close the account.
Deepfake pornography
Deepfake pornography, or simply fake pornography, is a type of synthetic pornography that is created via altering already-existing photographs or video by applying deepfake technology to the images of the participants.
Source: Wikipedia ๐
System ๐ค
Unknown
Operator: Unclear/unknown; Telegram
Developer: Anonymous/pseudonymous
Country: Russia; Global
Sector: Media/entertainment/sports/arts
Purpose: Simulate nude images
Technology: Deepfake - image; Machine learning
Issue: Ethics/values; Privacy; Impersonation; Copyright; Safety
Research, advocacy ๐งฎ
Sensity (2020). The State of Deepfakes
News, commentary, analysis ๐๏ธ
https://www.wired.co.uk/article/deepfake-porn-websites-videos-law
https://www.buzzfeednews.com/article/janelytvynenko/telegram-deepfake-nude-women-images-bot
https://www.wired.co.uk/article/porn-bots-in-telegram-deepfake
https://www.washingtonpost.com/technology/2020/10/20/deep-fake-nudes/
https://www.inputmag.com/culture/bots-on-telegram-are-creating-deepfake-nudes-of-thousands-of-women
Page info
Type: Incident
Published: March 2023