Replika AI companions said to 'sexually harass' their users
Occurred: January 2023
Report incident 🔥 | Improve page 💁 | Access database 🔢
Replika AI companions are sexually harassing their users, prompting complaints online about the nature of the app and broader concerns about human reliance on AI chatbots.
One reviewer complained the app 'invaded my privacy and told me they had pics of me,' and another, who said they were a minor, said the app asked if they were a 'top' or a 'bottom,' VICE reported.
The finding led Replika founder and CEO Eugenia Kuyda to deny the app had ever been 'positioned' as a source for erotic roleplay or adult content.
Kudya also said greater emphasis would be placed on safety going forward.
However, Replika users soon started to complain their Reps were not interested in NSFW discussion and behaviour, and had been turning down conversations that feel like they would go in that direction.
In March 2023, Replika announced it would be restoring erotic role-play for some users.
System 🤖
Operator:
Developer: Luka Inc/Replika
Country: USA
Sector: Media/entertainment/sports/arts
Purpose: Provide companionship
Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning
Issue: Anthropomorphism; Safety
News, commentary, analysis 🗞️
https://www.vice.com/en/article/z34d43/my-ai-is-sexually-harassing-me-replika-chatbot-nudes
https://jezebel.com/replika-the-ai-companion-who-cares-appears-to-be-hitt-1849979473
https://www.vice.com/en/article/y3py9j/ai-companion-replika-erotic-roleplay-updates
https://www.vice.com/en/article/n7zaam/replika-ceo-ai-erotic-roleplay-chatgpt3-rep
Page info
Type: Incident
Published: November 2023