NarxCare drug addiction assessment system accused of wrongly denying patients opioids
NarxCare drug addiction assessment system accused of wrongly denying patients opioids
Occurred: August 2021
Page published: September 2021 | Page last updated: June 2024
A software system used to determine the risk of drug addiction was accused of denying users opioids on the basis it wrongly reckoned they were at risk of addiction.
Developed by Bamboo Health (formerly named Appriss), NarxCare is used across several US states to track prescriptions for drugs such as opioids and purports to identify and flag patients with ‘drug-shopping’ behaviours - people who might be lying to doctors about the pain they’re in in order to get opioids.
While marketed as a "decision support tool," in some cases the system recommended denying painkillers to people who suffer from severe pain and have no history of drug abuse, according to WIRED.
Patients denied legal prescriptions have reported severe physical suffering, mental health crises, and, in some cases, being forced toward the illicit drug market to manage "unbearable" pain.
The system was also accused of reinforcing existing racial and gender biases.
Bamboo Health considers the NarxCare algorithm a trade secret. Because the formula is not public, neither doctors nor patients can verify how a score is calculated or challenge inaccuracies.
Developer: Appriss
Country: USA
Sector: Health
Purpose: Assess & predict drug abuse
Technology: Risk assessment algorithm
Issue: Accountability; Accuracy/reliability; Fairness; Transparency
AIAAIC Repository ID: AIAAIC0758