Regulator raises doubts about Babylon Health triage system
Regulator raises doubts about Babylon Health triage system
Occurred: March 2021
Report incident π₯ | Improve page π | Access database π’
The UK's medical device regulatory body, MHRA, admitted it had concerns about Babylon Health's symptom checker, prompting wider questions about the service.Β
In a letter to Dr. David Watkins, an NHS consultant oncologist who had been raising alarms about the robustness of the technology, Dr. Duncan McPherson, clinical director for devices at MHRA, stated: "Your concerns are all valid and ones that we share."
The MHRA's concerns focused on safety issues, including potential errors in diagnosing serious conditions like heart attacks. There were also concerns about the unclear purpose of the chatbot, with confusing disclaimers that appeared to contradict its actual use.
The regulator's response suggested worries about the lack of transparency and proper oversight of the technology. While it was limited in what it could publicly disclose about any specific investigations due to confidentiality constraints, the MHRA indicated that the issues raised highlighted the need to develop a new regulatory framework for medical devices in the UK.Β
Babylon Health maintained that it complied with the highest safety and regulatory standards and was in the process of applying for European certification for the symptom checker.
β February 2020. Babylon Health dismissed (pdf) Dr Watkins as a 'troll' and claimed he had 'targeted members of our staff, partners, clients, regulators and journalists and tweeted defamatory content about us' after he had gone public with its concerns about the Sympton Checker's safety.
Babylon Health. Babylon results published after 2400 Twitter troll tests (pdf)
Operator: Babylon Health
Developer: Babylon Health
Country: UK
Sector: Health
Purpose: Provide health information
Technology: Chatbot; NLP/text analysis; Deep learning; Neural network; Machine learning
Issue: Accountability; Accuracy/reliability; Robustness; Safety; Transparency
Page info
Type: Issue
Published: August 2024