Cruise self-driving cars struggle to recognise children
Occurred: November 2023
Can you improve this page?
Share your insights with us
Cruise knew that its self-driving cars had been struggling to recognise children, but kept its vehicles on the road anyway.
According to internal safety assessment documents obtained by The Intercept, Cruise was concerned that its vehicles might drive too fast at crosswalks or near a child moving abruptly into the street. The materials also indicate Cruise lacks data around scenarios such as kids suddenly separating from their accompanying adult, falling down, riding bicycles, or wearing costumes.
The materials also revealed that Cruise lacked high-precision machine learning software that would automatically detect child-shaped objects around the car and manoeuvre accordingly, and was relying on human beings to manually identify children encountered by AVs where its software could not do so automatically.
Cruise responded that its vehicles have had 'no on-road collisions with children'.
Databank
Operator: General Motors/Cruise LLC
Developer: General Motors/Cruise LLC
Country: USA
Sector: Automotive
Purpose: Automate steering, acceleration, braking
Technology: Self-driving system; Computer vision; Machine learning
Issue: Safety
Transparency: Governance; Safety
System
Investigations, assessments, audits
The Intercept (2023). CRUISE KNEW ITS SELF-DRIVING CARS HAD PROBLEMS RECOGNIZING CHILDREN — AND KEPT THEM ON THE STREETS
News, commentary, analysis
https://theintercept.com/2023/11/06/cruise-self-driving-cars-children/
https://www.forbes.com/sites/cyrusfarivar/2023/11/06/under-fire-over-robotaxi-safety-gm-halts-production-of-cruise-driverless-van/
https://boingboing.net/2023/11/09/cruise-knew-its-driverless-cars-endangered-children.html
https://futurism.com/the-byte/cruise-robotaxis-children
https://www.thestreet.com/automotive/exclusive-general-motors-cruise-allegations-robotaxi
Page info
Type: Incident
Published: November 2023