Cruise self-driving cars struggle to recognise children
Occurred: November 2023
Report incident ๐ฅ | Improve page ๐ | Access database ๐ข
Cruise knew that its self-driving cars had been struggling to recognise children, but kept its vehicles on the road anyway.
According to internal safety assessment documents obtained by The Intercept, Cruise was concerned that its vehicles might drive too fast at crosswalks or near a child moving abruptly into the street. The materials also indicate Cruise lacks data around scenarios such as kids suddenly separating from their accompanying adult, falling down, riding bicycles, or wearing costumes.ย
The materials also revealed that Cruise lacked high-precision machine learning software that would automatically detect child-shaped objects around the car and manoeuvre accordingly, and was relying on human beings to manually identify children encountered by AVs where its software could not do so automatically.ย
Cruise responded that its vehicles have had 'no on-road collisions with children'.
System ๐ค
Operator: General Motors/Cruise LLC
Developer: General Motors/Cruise LLC
Country: USA
Sector: Automotive
Purpose: Automate steering, acceleration, braking
Technology: Self-driving system; Computer vision; Machine learning
Issue: Safety
Transparency: Governance; Safety
Investigations, assessments, audits ๐ง
News, commentary, analysis ๐๏ธ
https://theintercept.com/2023/11/06/cruise-self-driving-cars-children/
https://www.forbes.com/sites/cyrusfarivar/2023/11/06/under-fire-over-robotaxi-safety-gm-halts-production-of-cruise-driverless-van/
https://boingboing.net/2023/11/09/cruise-knew-its-driverless-cars-endangered-children.html
https://futurism.com/the-byte/cruise-robotaxis-children
https://www.thestreet.com/automotive/exclusive-general-motors-cruise-allegations-robotaxi
Page info
Type: Issue
Published: November 2023