Westfield High School students hit by non-consensual nude deepfakes

Occurred: October 2023

Report incident πŸ”₯ | Improve page πŸ’ | Access database πŸ”’

Girls at Westfield High School in New Jersey, USA, were subjected to fake nude images of them being shared among other students, sparking uproar and prompting a police investigation.

Male classmates reputedly used girls' photos found online to concoct and circulate AI-generated pornographic images of female students as young as 14 years old in group chats. One victim told the Wall Street Journal, 'We're aware that there are creepy guys out there but you'd never think one of your classmates would violate you like this.'Β Β 

It had taken four days before the school found out that the boys had been using the Clothoff AI tool to create and share fake the nude images, though school officials said they 'believed' the images had since been deleted and were no longer in circulation.

The Wall Street Journal reported that families of four of the victims had filed police reports, and a New Jersey senator had asked county prosecutors to investigate.

βž• June 2024. 14-year-old Westfield deepfake porn victim Francesca Mani appeared before US Senate hearing on revenge pornography

βž• July 2024. Francesca Mani launched AI Heeelp!, a website that offers resources to other victims of deepfake pornography.

System πŸ€–

Operator: Westfield High School students
Developer: Alaiksandr Babichau, Alexander German, Dasha Babicheva, Yevhen Bondarenko
Country: USA
Sector: Education
Purpose: Entertain
Technology: Deepfake - image; Generative adversarial network (GAN); Neural network; Deep learning; Machine learning
Issue: Ethics/values; Safety; Privacy
Transparency: Governance; Marketing

Page info
Type: Incident
Published: November 2023
Last updated: August 2024