Deep Cam Live AI impersonator prompts misuse fears

Deep Cam Live, a new AI product that enables anyone to replicate someone's else's voice, raised concerns about potential misuse and impersonation scams. 

Deep Cam Live is able to produce real-time synthetic voices, faces and video appearances, including deepfakes, with only a single image. The product is supposedly intended for video production, animation, and other creative projects. Its creators claim they are "committed to evolving the project within legal and ethical frameworks, implementing measures like watermarking outputs when necessary to prevent abuse."

However, critics point out that the free, open-source technology can easily be misused, for example by enabling criminals to pose as loved ones in distress, requesting financial assistance. Other forms of misuse could take the form of revenge porn and child exploitation, harassment and bullying, disinformation, electoral interference, and identify theft and fraud.

In one of the most popular videos circulating online, X user Joao transformed himself into Republican Vice Presidential candidate J.D. Vance, Meta CEO Mark Zuckerberg, and actors Hugh Grant and George Clooney.

Deep Cam Live is seen to raise a panoply of legal and ethical issues, including the liability and responsibility for AI-generated content and its potential misuse.