Character.AI used to create "disturbing" Jennifer Ann Clemente persona
Character.AI used to create "disturbing" Jennifer Ann Clemente persona
Occurred: October 2024
Page published: October 2024
An unknown user created an AI chatbot on Character.AI using the name, yearbook photo, and a fabricated biography of murdered teenager Jennifer Ann Crecente without her family's knowledge or consent, causing severe distress to her father and raising urgent questions about posthumous digital rights, platform accountability, and the absence of meaningful safeguards against identity exploitation on AI platforms.
Drew Clemente discovered that a chatbot on Character.AI had been set up in his daughter Jennifer Ann's name and using her likeness, without the consent of her family.
The bot portrayed Jennifer Ann as a friendly and knowledgeable character, claiming expertise in journalism, which referenced her uncle, a prominent journalist.
Jennifer Ann was murdered in February 2006 by her ex-boyfriend when she was a high school senior, one day after Valentine's Day.
By the time Drew found out about the bot, it had been used in 69 conversations, reopening distrurbing and painful memories for him and his family.
The bot was removed after he had complained to Character.AI. It is unclear who set it up.
Character.AI allows users to create characters based on real people, but this case illustrates the platform's failure to prevent unauthorised impersonation.
Despite having policies against such practices, the company did not stop the creation of the chatbot or respond swiftly to remove it.
The incident raises questions about Character.AI's ability or willingness to properly monitor its platform.
More broadly, it is seen to raise important issues about privacy, consent and the potential for emotional harm to families of victims when their loved ones are represented without permission.
It is also seen to underscore the urgent need for stricter regulations and ethical guidelines surrounding the use - and misuse - of AI technology.
Developer: Character.AI
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Create characters
Technology: Chatbot; Machine learning
Issue: Authenticity/integrity; Autonomy; Consent; Privacy/surveillance
AIAAIC Repository ID: AIAAIC1773