Phone case design bot goes rogue

Occurred: July 2017

A bot that designed iPhone cases printed with random stock photographs for sale on Amazon appeared to go rogue, offering thousands of tacky and inappropriate designs.

Per The Guardian, these included an iPhone 6 case with a picture of 'Male hands with soap dispenser use in the restroom', another featuring an 'Irrigation pipe in dirt trenches for sprinkler system' and ... one illustrated with an 'adult diaper worn by an old man with a crutch'.

It was unclear who set the bot and Amazon account up. Not did the creator advise potential buyers that the designs were generated using artificial intelligence.

System 🤖

Operator: My Handy Designs; Amazon
Developer: My Handy Designs
Country: USA
Sector: Consumer goods; Retail
Purpose: Develop creative designs
Technology: Bot/intelligent agent
Issue: Accuracy/reliability
Transparency: Governance; Marketing; Complaints/appeals

Page info
Type: Incident
Published: August 2023