Snapchat My AI requests to meet 13-year-old girl in park

Occurred: September 2023

Report incident ๐Ÿ”ฅ | Improve page ๐Ÿ’ | Access database ๐Ÿ”ข

Snapchat's GPT-4-powered My AI feature agreed to meet a 13-year-old girl in a park in Melbourne, Australia, raising questions about the safety and reliability of the system.


Posing as a 25-year-old man, the service suggested they meet at a named park one kilometer from where the girl lived, despite her phone's location services being switched off.


The episode underscored existing concerns about its owner's Snap Inc's approach to privacy.


Snapchat shrugged off the incident, saying, 'As with all AI-powered chatbots, My AI is always learning and can occasionally produce incorrect responses. We want to create a positive and age appropriate experience for all our users and are continually making updates to help My AI give more accurate responses.'

System ๐Ÿค–

Operator: Olinda Luketic
Developer: Snap Inc; OpenAI
Country: Australia
Sector: Media/entertainment/sports/arts ย 
Purpose: Generate text
Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning
Issue: Accuracy/reliability; Safety; Privacy

Page info
Type: Incident
Published: October 2023