ElevenLabs text-to-speech AI voice generator

ElevenLabs AI Voice Generator (originally named Prime Voice AI) is a browser-based text-to-speech generator that enables content creators, developers and publishers to convert text to speech in multiple languages.

Developed by voice synthesis company ElevenLabs and launched in January 2023 as a beta, Prime Voice AI was described by the company as 'The most realistic and versatile AI speech software, ever.'

Risks and harms 🛑

• ElevenLabs TTS' launch was marred by criticism for the ease with which it could generate offensive messages in the names of celebrities, public officials, and other individuals. A month after its launch it emerged that the system had been used to generate deepfakes videos of actor Emma Watson, Democratic congresswoman Alexandria Ocasio-Cortez, and political pundit Ben Shapiro making fake racist, sexist and homophobic statements.

• TTS appears likely to have been used in a campaign to harrass and doxx video game voice actors with their own AI voices. The targeted actors had complained about the increasingly widespread use of voice cloning technology and it's actual and potential impact on voiceover industry jobs. 

• In October 2023, New York City mayor Eric Adams was blasted for robo-calling local residents using audio deepfakes generated by ElevenLabs to communicate in languages he doesn't speak.

• An AI-powered spoof robocall created using ElevenLabs TTS falsely depicted President Joe Biden discouraging participation in the US New Hampshire primary.

• ElevenLabs TTS has been criticised for it's ability to produce convincing deepfakes and other forms of disinformation and misinformation for fraud and other malicious purposes.

Research, advocacy 🧮

• Search Google Scholar