Perth doctors warned for using ChatGPT to write patient medical records

Occurred: May 2023

Doctors in Australia using ChatGPT to write medical notes, which were then uploaded to patient record systems, were ordered to stop by their CEO.

An email shared with ABC showed that doctors at Perth's South Metropolitan Health Service (SMHS) had been using software such as ChatGPT to write medical notes which were then being uploaded to patient record systems, thereby potentially compromising patient confidentiality and privacy.

The incident resulted in the hospital group's CEO ordering staff across the health service's five hospitals not to use AI chatbots. "Crucially, at this stage, there is no assurance of patient confidentiality when using AI bot technology, such as ChatGPT, nor do we fully understand the security risks,' warned SMHS chief executive, Paul Forden.

It also led the Australian Medical Association to call for national regulation on AI in healthcare.

System 🤖

Operator: South Metropolitan Health Service
Developer: OpenAI
Country: Australia
Sector: Health
Purpose: Write medical records
Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning
Issue: Confidentiality; Privacy
Transparency: Governance

Page info
Type: Incident
Published: November 2023