Gladsaxe vulnerable children detection

Transparency and accountability 🙈

The Gladsaxe system raised concerns regarding transparency and accountability.

• Decision-making process. The system's algorithms and decision-making processes were not fully transparent, making it difficult to understand how risk scores are calculated and which factors contribute to a child being flagged as vulnerable.

• Black box. The Gladsaxe system was proprietary and its inner workings not publicly accessible - a lack of transparency that hindered external scrutiny and made it challenging to identify potential biases or errors.

• User communication. The system's outputs, such as risk scores and alerts, are not always shared with parents or guardians, which can lead to a lack of understanding and potential mistrust.

• Inadequate oversight. There is limited external oversight and monitoring of the system's performance, leading to a lack of accountability for errors or biases.

• Complaints and appeals. There were limited opportunities for individuals to appeal or contest the system's decisions.

Risks and harms 🛑

The Gladsaxe model algorithm is seen to have posed risks of privacy invasion, misidentification and potential bias, leading to unwarranted interventions and stigmatisation. 

Research, advocacy 🧮

• Jørgensen R.F. (2021). Data and rights in the digital welfare state: the case of Denmark

News, commentary, analysis 🗞️

• https://politiken.dk/viden/Tech/art7202917/Algoritmer-skal-udpege-langtidsledige

• https://politiken.dk/indland/art7023935/Gladsaxe-indstiller-arbejdet-med-omstridt-overv%C3%A5gning-af-b%C3%B8rnefamilier

• https://eticasfoundation.org/ghetto-plan-in-denmark-tracing-children-with-special-needs/

• https://www.businessinsider.in/denmark-is-using-algorithms-to-dole-out-welfare-benefits-and-undermining-its-own-democracy-in-the-process/articleshow/67279722.cms

• https://automatingsociety.algorithmwatch.org/report2020/denmark/

• https://foreignpolicy.com/2018/12/25/the-welfare-state-is-committing-suicide-by-artificial-intelligence/

• https://privacyinternational.org/examples/3146/danish-central-agency-expands-algorithmic-administration

• https://damijan.org/2018/12/26/umetna-inteligenca-in-spodkopavanje-telmeljev-demokracije/