GoGuardian Beacon student suicide prevention software raises privacy, bias concerns

Occurred: October 2021

Baltimore City Schools monitored the laptops of local school students for indications of self-harm and suicide during the COVID-19 pandemic, raising questions about privacy and equity.

Using GoGuardian’s Beacon suicide prevention software, the school system identified nine students as having a severe mental health crisis

However, reports suggested the software was also being used for disciplinary purposes and could result in LGBTQ students being unintentionally outed, or student expression hampered. In addition, it appeared less wealthy students may be tracked more regularly since school-owned laptops may be their only devices. 

Other reports state school police monitor GoGuardian software after school hours, including on weekends and holidays, raising concerns about students enduring more or less constant surveillance.

While some people saw this as a necessary safeguard, others worried about the potential invasion of privacy and the implications of having school police involved in mental health checks. 

Operator: Baltimore City Public Schools; Pekin Community High School  
Developer: Liminex Inc/GoGuardian
Country: USA
Sector: Education
Purpose: Detect & categorise at-risk behaviour
Technology: Suicide prevention algorithm
Issue: Privacy; Surveillance; Bias/discrimination - economic
Transparency: Black box

Page info
Type: Issue
Published: October 2021
Last updated: June 2024