Telegram bot creates non-consensual deepfake porn

Occurred: October 2020

Can you improve this page?
Share your insights with us

Security company Sensity has discovered that an AI bot on encrypted messaging app Telegram is being used to create photo-realistic nude and sexually explicit images of hundreds of thousands of women without their consent. 

The bot, which appears to be popular in Russia and eastern Europe, only requires one photograph to create the images, leading to over 680,000 ordinary women and girls being demeaned and degraded. Some of these appear to be underage girls.

The images are used and manipulated harassment without the knowledge or consent of the women being targeted, risk being used in all manner of ways, and may lead to harassment, abuse, violence, and loss of jobs.

The photographs clearly violate Telegram's terms of service, but the messaging app has refused to close the account.

Operator: Unclear/unknown; Telegram
Developer: Anonymous/pseudonymous

Country: Russia; Global

Sector: Media/entertainment/sports/arts

Purpose: Simulate nude images

Technology: Deepfake - image; Generative adversarial network (GAN); Neural network; Deep learning; Machine learning
Issue: Privacy; Impersonation; Copyright; Safety

Transparency: Governance; Complaints/appeals; Privacy; Marketing

Page info
Type: Incident
Published: March 2023