Concerns were raised about potential discrimination against families with disabilities caused by a child abuse and neglect screening tool used by Allegheny County, Pennsylvania.

The US Department of Justice is reportedly examining the tool over concerns that it may violate the Americans with Disabilities Act by discriminating against families with disabilities, including those with mental health issues.

The algorithm incorporates data points tied to disabilities in children, parents, and other household members. This includes information from Supplemental Security Income (SSI) and diagnoses for mental, behavioural and neurodevelopmental disorders.

Critics worry that including disability-related data could automate discrimination against families based on disabilities or other external characteristics, and lead to a higher likelihood of investigations for families with disabilities.

Allegheny County officials maintained that the tool helps predict outcomes and that parents with disabilities may need additional support. They also state that the algorithm has been updated several times, sometimes removing disability-related data points.

The debate highlighted a broader discussion about the use of algorithms in child welfare decisions, with supporters arguing for their efficiency and critics warning about potential biases and discrimination.