Stable Diffusion

Transparency and accountability 🙈

Risks and harms 🛑

Stable Diffusion has been accused of perpetuating stereotypes, violating copyright, spreading misinformation and disinformation, and generating violent, offensive, highly realistic Child Sexual Abuse Material (CSAM) and non-consensual explicit content.

Bias/discrimination

Stable Diffusion was primarily trained on images with English descriptions, resulting in images that tend to reinforce western stereotypes and biases. A Bloomberg test discovered that the tool produces content that is full of gender and racial stereotypes when it renders people in 'high-paying' and 'low-paying jobs.'

Copyright

Stable Diffusion draws on copyrighted works of artists, without the owner’s consent or any form of attribution, prompting concerns about plagiarism and the misuse, abuse and loss of IP. Furthermore, users are given full rights to images they create on Stable Diffusion, and is free to use them commercially, resulting in questions about fair use. Responding to pressure, Stability AI gave artists the ability to opt out of having their artworks included in data training and stopped users being able to emulate the style of specific artists, including Greg Rutkowski, leading users to complain the model had been 'nerfed'.

In January 2023, a group of lawyers filed a US class-action lawsuit against Sta­bil­ity AI, DeviantArt, and Mid­jour­ney on the basis that their use of Sta­ble Dif­fu­sion illegally remixes the copy­righted works of mil­lions of artists whose work was used as train­ing data. Stability AI was also accused in UK and US filed by Getty Images of infringing the copyright protections of over 12 million photographs from its stock image collection when training Stable Diffusion.

Furthermore, Google researchers have shown that Stable Diffusion is able to memorise and recreate specific copyrighted images.

Dual/multi-use

The relative accessibility of the model, including the release of its model weights, together with its relative paucity of filters, means Stable Diffusion can be used for more or less any purpose, including nefarious ones such as spreading spam, propaganda, deepfakes, misinformation and disinformation.

Employment

Artists' loss of copyright and the ability of users to create images in their unique style has prompted increasing concern that artists, photographers, illustrators, cinematographers and others stand to lose their commercial viability and careers.

A French game developer's release of a Stable Diffusion-based tool to generate images in the style of late Korean artist Kim Jung Gi with a simple text prompt sparked a furious response from artists who saw the tool as theft, and accused the developer of cultural appropriation.

Safety

TechCrunch noted that Stability AI bans lewd or sexual material, hateful or violent imagery, prompts containing copyrighted or trademarked material, and personal information such as phone numbers and Social Security numbers. But this has not stopped users generating abusive, violent, sexual and pornographic images.

Legal, regulatory 👩🏼‍⚖️

• Andersen et al v. Stability AI Ltd. et al (pdf)

• Congresswoman Eshoo letter to National Security Advisor (NSA) and the Office of Science and Technology Policy (OSTP)

Research, advocacy 🧮

• Carlini N., Hayes J., Nasr M., Jagielski M., Sehwag V., Tramèr F., Balle B., Ippolito D., Wallace E. (2023). Extracting Training Data from Diffusion Models

• Luccioni A.S., Akiki C., Mitchell M., Jernite Y. (2023). Stable Bias: Analyzing Societal Representations in Diffusion Models

• Somepalli G., Singla V., Goldblum M., Geiping J., Goldstein T. (2022). Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models

News, commentary, analysis 🗞️

• https://www.technologyreview.com/2022/09/16/1059598/this-artist-is-dominating-ai-generated-art-and-hes-not-happy-about-it/

• https://techcrunch.com/2022/08/12/a-startup-wants-to-democratize-the-tech-behind-dall-e-2-consequences-be-damned/

• https://www.theverge.com/2022/9/15/23340673/ai-image-generation-stable-diffusion-explained-ethics-copyright-data

• https://www.artificialconversation.com/p/stable-diffusion-draws-controversy

• https://thealgorithmicbridge.substack.com/p/stable-diffusion-2-is-not-what-users

• https://techcrunch.com/2022/08/24/deepfakes-for-all-uncensored-ai-art-model-prompts-ethics-questions/

• https://mailchi.mp/jack-clark/import-ai-304-reality-collapse-thanks-to-facebook-open-source-speech-rec-ai-culture-wars

• https://www.nytimes.com/2022/10/21/technology/generative-ai.html

• https://www.thehindu.com/sci-tech/technology/digital-art-why-art-created-by-ai-artificial-intelligence-stable-diffusion-deep-learning-controversial/article65995849.ece

• https://waxy.org/2022/08/exploring-12-million-of-the-images-used-to-train-stable-diffusions-image-generator/

• https://www.technologyreview.com/2022/09/20/1059792/the-algorithm-ai-generated-art-raises-tricky-questions-about-ethics-copyright-and-security/

• https://www.technologyreview.com/2022/09/16/1059598/this-artist-is-dominating-ai-generated-art-and-hes-not-happy-about-it/

• https://arstechnica.com/information-technology/2022/09/flooded-with-ai-generated-images-some-art-communities-ban-them-completely/

• https://newsletters.theatlantic.com/galaxy-brain/6317de90bcbd490021b246bf/ai-art-dalle-midjourney-stable-diffusion/

• https://restofworld.org/2022/ai-backlash-anime-artists/

• https://news.artnet.com/art-world/a-i-should-exclude-living-artists-from-its-database-says-one-painter-whose-works-were-used-to-fuel-image-generators-2178352

• https://www.artnews.com/art-news/news/kim-jung-gi-death-stable-diffusion-artificial-intelligence-1234649787

• https://www.businessinsider.com/ai-image-generators-artists-copying-style-thousands-images-2022-10

• https://arstechnica.com/information-technology/2022/12/thanks-to-ai-its-probably-time-to-take-your-photos-off-the-internet/