French court rules City of Orleans use of AI is illegal

Occurred: July 2024

A French court ruled that the City of Orleans' use of AI-powered audio surveillance is disproportionate and illegal, raising doubts about the legality of other similar systems in the country.

Intended to detect "unusual situations", the system consisted of microphones installed in public spaces linked to local CCTV cameras. 

The court rejected (pdf) the city's argument that no personal data was being processed, stating that the microphones linked to cameras collect information that could identify individuals.

The court ruled that even if the system was useful for policing, it "cannot be considered necessary for the exercise of these powers," emphasising that usefulness does not equate to legality or proportionality.

The ruling is considered the first victory in France against this kind of AI-powered audio surveillance. The court also ruled that public contracts for such surveillance systems can be challenged in court by organizations like La Quadrature du Net, which brought this case.

The decision is seen as a warning to other cities considering similar surveillance technologies, and highlights the need for greater transparency, public consultation, and adherence to fundamental rights when implementing surveillance systems.

System 🤖

Operator:
Developer: Sensivic
Country: France
Sector: Govt - municipal
Purpose: Detect abnormal situations
Technology: Machine learning
Issue: Human/civil rights; Privacy