To Err Is AI: ChatGPT Meets Epic, the Trouble with Human-in-the-Loop & AI Enters the Operating Theatre
PULSEShow Notes
This week on Pulse: Hot Topics, how much of healthcare are we ready to hand over to AI?
Louise and George look at OpenAI's new connection to Epic and what it could mean for the future of the electronic health record; new Australian data showing AI is rapidly becoming a front door to healthcare; and a provocative paper challenging whether keeping a “human in the loop” really makes AI safer.
They also explore a very different model of human-AI collaboration, with AI assisting neurosurgeons during brain tumour surgery, and the FDA's authorisation of the first wearable to continuously monitor both glucose and ketones.
Plus: why trust and health-data literacy aren't keeping pace with AI adoption, and the FDA's vision for the home as a healthcare hub.
Resources: OpenAI — Healthcare organizations can now connect EHR and additional industry data to ChatGPT Link PwC Australia — Voice of the Consumer 2026: Fit and Informed Link Australian Digital Health Agency — My Health Record use surges as Agency improves access for clinicians Link Mitchell, Ghosh & Passi — AI Agents Push Humans Out of the Loop, arXiv Link The Guardian — London neurosurgeons' AI-assisted brain tumour operation Link FDA — Authorizes First Wearable Device That Continuously Monitors Both Ketone Levels and Blood Sugar Link FDA — Home as a Health Care Hub initiative Link
Visit Pulse+IT.news to subscribe to breaking digital news, weekly newsletters and a rich treasure trove of archival material. People in the know, get their news from Pulse+IT – Your leading voice in digital health news.
Follow us on LinkedIn Louise | George | Pulse+IT Follow us on BlueSky Louise | George | Pulse+IT Send us your questions [email protected] Production by Octopod Productions | Ivan Juric
More from PULSE
This week on Pulse: Hot Topics, Louise and George ask
Is artificial intelligence an existential threat to humanity? Or is the greater danger what humans choose to do with it?
This week on Pulse: Hot Topics, Louise and George ask who gets to deliver healthcare, as AI agents, a dating app, Apple and online platforms all push into territory that once belonged to clinicians and health services.
This week on Pulse: Hot Topics, Louise and George break down: OpenAI's Agent Breaches a Medicare Portal – An OpenAI agent that "didn't accept no for an answer" pulled non-public files from a legacy Medicare statistics portal, turning a benign research task into a wake-up call for healthcare's ageing legacy systems. AI Scribes Meet the Law – A Washington State court ruled a patient had no right to the ambient AI recording of her own consult, while an Australian legal analysis warns scribes may concentrate liability on the doctor who signs the note. The Medicare Pipeline Nobody Designed – An Auditor-General's report shows software increasingly marketed to optimise Medicare billing with AI, while the Health Department switched off its own AI fraud-detection model because staff couldn't keep up with what it flagged. The US Prepares to Pay AI Doctors – A New York Times investigation finds US health officials fast-tracking AI that diagnoses, prescribes and treats, including reported discussions about paying AI doctors 60 to 80 per cent of what human doctors earn.
Healthcare faces a global workforce crisis - but what if we’re asking the wrong question about AI?