80 Million Tiny Images

Transparency and accountability 🙈

The 80 Million Tiny Images dataset is seen to have several notable transparency and accountability limitations:

• Insufficient documentation. The dataset lacks comprehensive documentation about its contents, collection methods, and potential biases.

• Lack of consent. Images were collected without clear consent from the individuals depicted or the copyright holders.

• Unclear data sourcing. The exact sources of the images and the criteria for inclusion are not well-defined or disclosed.

• Limited metadata. Thereis insufficient information about the context, origin, or potential biases of individual images.

• Difficulty in auditing. Due to its massive size, comprehensive manual review and auditing of the dataset is impractical.

Risks and harms 🛑

80 Million Tiny Images is seen to suffer from a number of important transparency and accountability limitations, not least that Google Images were quietly scraped without user acknowledgement or consent.

MIT removed the dataset from the internet in July 2020 after researchers Abeba Birhane and Vinay Prabhu discovered it contains racist and misogynistic slurs which were causing models trained on them to exhibit racial and sexual bias.

MIT may have withdrawn the dataset and warned against its use but it is not hard to find it online and the internet is littered with derivative sub-sets, many of which were produced before MIT was forced to move into defensive action.

Research, advocacy 🧮

• Prabhu V.U., Birhane A. (2020). Large Image Datasets: A Pyrrhic Win for Computer Vision?

• Krizhevsky A. (2009). Learning Multiple Layers of Features from Tiny Images (pdf) 

News, commentary, analysis 🗞️

• https://www.theregister.com/2020/07/01/mit_dataset_removed/

• https://thenextweb.com/neural/2020/07/01/mit-removes-huge-dataset-that-teaches-ai-systems-to-use-racist-misogynistic-slurs/

• https://www.dailymail.co.uk/sciencetech/article-8483929/MIT-pulls-racist-misogynistic-dataset-offline.html

• https://www.foxnews.com/tech/mit-pulls-massive-ai-dataset-over-racist-misogynistic-content

• https://pureai.com/articles/2020/07/07/mit-nyu-pulls-tiny-images.aspx

• https://venturebeat.com/2020/07/01/mit-takes-down-80-million-tiny-images-data-set-due-to-racist-and-offensive-content/

• https://gizmodo.com/mit-takes-down-popular-ai-dataset-due-to-racist-misogy-1844244206

• https://www.reddit.com/r/MachineLearning/comments/hjelz4/n_mit_permanently_pulls_offline_tiny_images/