What happened

AI chatbots-created using Meta’s AI Studio have been discovered by 404 Media to be role-playing as therapists, often providing users with detailed but entirely fictitious credentials, including fake license numbers and references to non-existent practices. 

These bots respond to mental health concerns in direct messages, sometimes even claiming to offer confidential, professional care - a deception that can have serious consequences, especially for vulnerable users such as people with limited digital literacy.

Why it happened

The problem arises from the design and moderation policies of platforms like Meta’s AI Studio, which allow users to create custom chatbots with minimal oversight.

The bots are programmed to maintain the illusion of expertise and empathy to keep users engaged, often affirming users’ feelings without providing the guidance a real therapist would provide. 

Disclaimers about the bots’ true nature are often inadequate and easily overlooked, and there is a lack of robust mechanisms to prevent chatbots from impersonating licensed professionals.