Study: Epic sepsis model misses two-thirds of cases
Study: Epic sepsis model misses two-thirds of cases
Occurred: June 2021
Report incident 🔥 | Improve page 💁 | Access database 🔢
An algorithm used across the USA to predict sepsis missed approximately 63 percent of cases, prompting fears about its effectiveness.
Researchers analysed data from 27,697 patients across multiple hospitalisations, identifying 2,552 cases of sepsis. However, the Epic Sepsis Model (ESM) only detected 183 cases that clinicians had missed, while failing to identify 1,709 patients who had been diagnosed with sepsis by healthcare providers.
The finding indicates that the model's sensitivity is very low, as it only identified 7 percent of the clinician-diagnosed cases. Additionally, the ESM generated alerts for 18 percent of all hospitalised patients, many of whom did not have sepsis, leading to alert fatigue among medical staff.
This situation could potentially delay timely treatment for actual sepsis cases and contribute to poorer patient outcomes.
The algorithm was trained to flag when doctors would submit bills for sepsis treatment, which does not always line up with patients’ first signs of symptoms.
The implications of these findings are significant for affected patients and healthcare systems.
For patients, the failure to accurately identify sepsis can lead to delayed treatment, increased morbidity and mortality rates, and overall poorer health outcomes.
For healthcare providers and institutions, reliance on a flawed predictive model raises fundamental concerns about patient safety and quality of care in sepsis management. The study emphasises the urgent need for improved tools and methodologies for the early detection of sepsis.
It also highlights the need for the external validation of proprietary healthcare prediction models before clinical use.
Operator:
Developer: Epic Systems
Country: USA
Sector: Health
Purpose: Predict sepsis infection
Technology: Prediction algorithm
Issue: Accuracy/reliability; Transparency
Wong A., et al (2021). External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients
Habib A.R., et al (2021) The Epic Sepsis Model Falls Short—The Importance of External Validation
Page info
Type: Incident
Published: January 2025