Amazon Q hallucinates, leaks data

Occurred: December 2023

Amazon's Q generative AI service suffers from inaccuracy, privacy, and security issues, according to company internal documents. 

Amazon employees expressed concerns about a variety of issues regarding Q, including that it has been 'experiencing severe hallucinations and leaking confidential data,' including the location of AWS data centers, internal discount programs, according to The Platformer, citing leaked Amazon documents. 

Amazon hit back by disputing claims that Q had released confidential data, and said it continued to fine-tune the system 'as it transitions from being a product in preview to being generally available.'

Industry analysts questioned whether Q was ready for companies to use. Amazon has been seen criticised by some as being late to generative AI. 

Operator: Casey Newton; Zoe Schiffler
Developer: Amazon
Country: USA
Sector: Business/professional services
Purpose: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning
Technology: Generate text
Issue: Accuracy/reliability; Confidentiality; Privacy
Transparency: Governance