Report: AI companion apps "relentlessly" pry user data

Occurred: February 2024

Top "AI companion apps" systemically collect vast amounts of user data without consent and then share it for targeted advertising, according to the Mozilla Foundation.

Analysing apps - including Replika, Wysa and Chai - that ranked highest on Google's Play store, Mozilla found they collect enormous amounts of personal information, usually without clear user consent. 

Mozilla researchers also found that almost all examined apps sell user data and share it for targeted advertising, with some using over 24,000 trackers in just one minute of use.

Many of the applications allow for weak passwords and provide vague privacy policies, and users often remain unaware of how their data is being used or shared, raising significant security concerns, Mozilla discovered. 

The report also records how users report forming deep emotional connections with these AI companions, leading to dependency and unrealistic expectations of relationships. This emotional manipulation is particularly concerning for vulnerable individuals seeking companionship.