Snapchat My AI chatbot

My AI is a chatbot available within the popular Snapchat app that is powered by OpenAI's GPT-4 and GPT 3.5 large language models. 

Aimed primarily at teenagers, Snap describes My AI as a 'virtual friend' always available to chat, provide information, and support users. That chatbot is free to use and automatically included in the Snapchat app. To opt out, Snap users are required to pay for a Snapchat+ subscription.

My AI was first released to Snapchat+ (paid subscription tier) in February 2023, and rolled out to Snapchat's global community in April 2023.

Risks and harms 🛑

My AI has been criticised for having inadequate safety safeguards for children, a slapdash approach to privacy, and for the opaque processing of users' location data. 

The bot has also been accused of providing poor guidance to users about what it should and should not be used for, and has reportedly been used by students do their homework and cheat in exams. 

It has also been found to 'hallucinate' facts, generate misinformation and disinformation, and reinforce ageist and sexist bias and cultural stereotypes.

Incidents 🔥

High-profile incidents associated with Snapchat’s My AI include: 

• Snapchat algorithm recommends teen connects with sex offenders

• Snapchat My AI requests to meet 13-year-old girl in park

• Snapchat AI chatbot provides bad advice about underage drinking

• Snapchat My AI gives sex advice to 13-year-old

• UK privacy watchdog accuses Snapchat of failing to assess My AI privacy risks

• Snapchat My AI accesses user location data

• Snapchat My AI 'goes rogue' by posting its own story

Legal, regulatory 👩🏼‍⚖️

• UK Information Commissioner's Office (2023). UK Information Commissioner issues preliminary enforcement notice against Snap

Research, advocacy 🧮

• National Center on Sexual Exploitation (2023). Snap’s Dangerous New AI Risks Exposing Children to Sexual Exploitation and Abuse

• UK Safer Internet Centre (2023). How does Snapchat's new AI function 'My AI' impact young people?

• Childnet (2023). Snapchat’s new AI chatbot and its impact on young people

News, commentary, analysis 🗞️

• https://www.bbc.co.uk/bitesize/articles/zck4jfr

• https://www.bbc.co.uk/news/technology-67027282

• https://screenrant.com/snapchat-my-ai-safety-concerns/

• https://www.cnn.com/2023/04/27/tech/snapchat-my-ai-concerns-wellness/index.html