Scale AI shares sensitive Roomba robot vacuum training photos

Sensitive photographs used to train iRobot vacuum cleaners, including of a young woman sitting on the toilet, were shared on Facebook, triggering privacy advocates to question the effectiveness of iRobot data protection practices.

According to Technology Review, images of development versions of iRobot’s Roomba J7 series robot vacuum were posted online by Venezuelan contractors to San Francisco-based Scale AI, a start-up that uses low-cost gig workers to annotate audio, photo, and video data used to train artificial intelligence systems.

According to iRobot, the photos came from 'special development robots with hardware and software modifications that are not and never were present on iRobot consumer products for purchase.' The images, the company says, were 'shared in violation of a written non-disclosure agreement between iRobot and an image annotation service provider.'

iRobot declined to share the consent agreements with Technology Review, nor make any of its paid collectors or employees available to discuss their understanding of the terms. However, a follow-up article cited beta testers saying iRobot had 'failed spectacularly' to mention that personal images of their homes and children will be seen and analysed by other humans.

iRobot CEO Colin Angle later confirmed the company terminated its relationship with Scale AI as a result of the incident.