GenNomis AI art generator accused of producing explicit child images
Embedded Files
Occurred: March 2025
Report incident ๐ฅ | Improve page ๐ | Access database ๐ข
South Korean AI platform GenNomis has been accused of facilitating the creation of AI-generated explicit images, including child sexual abuse material (CSAM), following the exposure of an unsecured database containing nearly 94,000 files.
What happened
What happened
Cybersecurity researcher Jeremiah Fowler discovered an unprotected database linked to GenNomis, revealing explicit AI-generated images that included depictions of minors and celebrities portrayed as children.ย
The database contained over 47 GB of data, including user prompts and generated images, raising serious concerns about the misuse of generative AI tools for creating harmful content.ย
The platform and its parent company, AI-Nomis, went offline shortly after the discovery was reported.
Why it happened
Why it happened
The data breach occurred due to inadequate security measures, with the database lacking encryption or password protection.ย
GenNomis' guidelines prohibit the creation of illegal content such as CSAM but its tools openly allowed users to create unrestricted images, including face-swapping and deepfake content.
What it means
What it means
For those directly impacted - such as individuals depicted in non-consensual deepfake imagery - the incident represents a grave violation of privacy and dignity.ย
Indirectly, the finding highlights broader societal risks posed by unregulated generative AI technologies, including the proliferation of CSAM and exploitation through deepfake pornography.ย
The case emphasises the urgent need for stronger legal frameworks and technological safeguards to prevent the misuse of AI tools for harmful purposes.ย
Generative art
Generative art is post-conceptual art that has been created (in whole or in part) with the use of an autonomous system.
Source: Wikipedia๐
System ๐ค
System ๐ค
Nudify๐
Operator:ย
Developer: AI-NOMIS
Country: South Korea
Sector: Media/entertainment/sports/arts
Purpose: Undress individuals
Technology: Deepfake; Machine learning
Issue: Accountability; Privacy; Safety; Transparency
Investigations, assessments, audits ๐๏ธ
Investigations, assessments, audits ๐๏ธ
Page info
Type: Issue
Published: April 2025
Page updated
Google Sites
Report abuse