Tesla Autopilot, Full-Self Driving

Transparency and accountability 🙈

Tesla's Autopilot and Full-Self Driving systems are seen to exhibit multiple transparency and accountability limitations:

• Algorithmic black box There is limited public information on how Autopilot and FSD function, leaving users uncertain about the underlying mechanisms and making it difficult for users to understand how decisions are made

• Privacy. While Tesla claims to protect privacy, the extent of data collection and usage, particularly regarding camera recordings and vehicle data, remains unclear.

• Public release of crash data. Tesla actively seeks to block or limit the release of detailed crash data related to its Autopilot system, including information on hardware/software versions, road conditions, and driver engagement at the time. This restricts regulators, researchers and the public from assessing real-world system performance and failure patterns.

• Liability. Recent court verdicts where Tesla was found partially liable for crashes involving Autopilot highlight accountability issues. These cases often rely on data exposed only through legal or unauthorised channels, not voluntarily shared by Tesla.

• Third-party audits. Tesla actively resists third-party audits or independent validation of Autopilot's performance and safety standards.

• Regulatory oversight. Tesla has significant autonomy in determining software updates, potentially prioritising customer satisfaction over safety restrictions. The National Highway Traffic Safety Administration (NHTSA) has had to request detailed information about software updates and their impacts, indicating a lack of proactive disclosure.

• Marketing. Tesla promotes Autopilot and FSD features as advanced, often leading to driver and public misconceptions about their true capabilities and autonomy levels. This contrast between rhetoric and technical reality hampers informed user understanding, leading to crashes and other incidents, and creates accountability gaps.

Risks and harms 🛑

Tesla Autopilot and FSD have been criticised for being inaccurate and unsafe, causing property damage, bodily injury and loss of life. 

The systems have also been called out for violating the privacy of its customers and the general public.