NarxCare drug addition risk assessment
WIRED reports that NarxCare, a software system that uses patient data, drug use data, and metadata to determine the risk of drug addiction is denying users opioids on the basis it thinks they are at risk of addiction.
Patients complain that the system, developed by Appriss, can be inaccurate and unfair. It is believed to reinforce existing racial and gender biases.
Appriss has failed to disclose how the NarxCare system works, and does not provide access to its data, model or code. The company has also made a number of contradictory claims about the algorithm's data sources and other inputs.
Operator: US Department of Justice; Rite Aid; Walmart; Sam's Club
Purpose: Assess & predict drug abuse
Technology: Risk algorithm
Issue: Fairness; Accuracy/reliability
Opacity: Governance; Black box; Marketing