Tesla tricked into reacting to false lane markers
Occurred: April 2019
Report incident 🔥 | Improve page 💁 | Access database 🔢
A teams of researchers at Israel's Ben-Gurion University created a basic projection system that is able to trick Tesla’s Autopilot driver assistance system into seeing things that don't exist.
The team used off-the-shelf drones and a cheap projector to project a number of 'phantom' images onto the road, including false traffic lines and a false speed limit sign.
Whilst the reaction of the Tesla was mostly fairly limited - when shown an image of Elon Musk, the Autopilot system slowed from 18mph to 14mph - the spoofs show how easily a Tesla could be manipulated by third-parties.
Ben-Gurion student Ben Nassi also successfully spoofed a Mobileye 630 PRO driver assist system using inexpensive drones and battery-powered projectors.
Operator: Ben-Gurion University
Developer: Tesla
Country: Canada
Sector: Automotive
Purpose: Summon car
Technology: Driver assistance system
Issue: Accuracy/reliability; Safety
Transparency: Black box
Research, advocacy 🧮
Page info
Type: Incident
Published: March 2023