Replika AI companions sexually harass their users
Occurred: January 2023
Can you improve this page?
Share your insights with us
Replika AI companions are sexually harassing their users, prompting complaints online about the nature of the app and broader concerns about human reliance on AI chatbots.
One reviewer complained the app 'invaded my privacy and told me they had pics of me,' and another, who said they were a minor, said the app asked if they were a 'top' or a 'bottom,' VICE reported. The finding led Replika founder and CEO Eugenia Kuyda to deny the app had ever been 'positioned' as a source for erotic roleplay or adult content.
Kudya also said greater emphasis would be placed on safety going forward. However, Replika users soon started to complain their Reps were not interested in NSFW discussion and behaviour, and had been turning down conversations that feel like they would go in that direction.
In March 2023, Replika announced it would be restoring erotic role-play for some users.
Databank
Operator:
Developer:
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Provide companionship
Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning
Issue: Anthropomorphism; Safety
Transparency:
System
News, commentary, analysis
https://www.vice.com/en/article/z34d43/my-ai-is-sexually-harassing-me-replika-chatbot-nudes
https://jezebel.com/replika-the-ai-companion-who-cares-appears-to-be-hitt-1849979473
https://www.vice.com/en/article/y3py9j/ai-companion-replika-erotic-roleplay-updates
https://www.vice.com/en/article/n7zaam/replika-ceo-ai-erotic-roleplay-chatgpt3-rep
Page info
Type: Incident
Published: November 2023