From Health 201AI Med Risk

documented ai-in-healthcare failures — what went wrong, why, and what might have helped, synthesised from public sources


Digital Rights Watch: Australian AI medical scribes run with no regulatory oversight, patients denied care for refusing them

What happenedDigital Rights Watch published 'Off the Record: AI Scribes in Australian Healthcare' on July 28, 2026 (covered by Medical Xpress and regional Australian outlets August 2026), after reviewing privacy policies from 60 clinics and contacting seven AI scribe vendors. Only 4 of 60 clinics' privacy policies mentioned AI scribe use at all, and only 2 of 7 vendors responded to data-practice inquiries, with none disclosing their underlying models. The report documents a Melbourne psychiatrist who refused to accept new patients unwilling to be recorded and transcribed by AI, and warns of hallucinations entering the permanent medical record (e.g. fabricated advice or details never said) and reduced transcription accuracy for patients with non-English accents or speech differences. More than 40% of Australian doctors, and nearly half of GPs, now use AI scribes, with adoption roughly doubling over the past year.

Failure modeAI scribe adoption in clinical practice outpaced any regulatory registration, consent standard, or vendor transparency requirement, so hallucinated or biased transcription can enter the permanent medical record unchecked, and patients who decline recording can be denied care rather than offered a non-AI alternative.

What might have helpedTreating AI scribes as medical devices subject to registration before clinical use could have established a baseline for safety. Mandatory clinic disclosure and patient consent, paired with a guaranteed non-AI-recorded care pathway for those who refuse, might have preserved patient autonomy. Vendor transparency requirements regarding underlying models and accuracy across accents and speech patterns could have provided necessary insight into system limitations.

Partly mitigated Since thenAustralia's TGA moved to compliance action in August 2026 against scribes that perform medical-device functions, such as suggesting diagnoses or treatment, without registration.

Still openScribes that only transcribe remain outside device regulation, so review, consent and a non-AI option still rest on professional guidance rather than law.

LessonRegulators are acting on scribes that make clinical suggestions, but plain transcription scribes stay unregulated. Consent and a non-AI path therefore depend on each clinic's own policy.

Sources: insightnews.com.au · dermatologyrepublic.com.au

← Back to the incident library

Not medical or legal advice. This site documents how AI systems have failed; it is not a source of care or advice. For a health problem, seek medical attention or talk to a health professional; in an emergency, call 911 or your local emergency number. For legal questions, consult a lawyer.

If you are in crisis: in the US, call or text 988 (Suicide & Crisis Lifeline). Elsewhere, see findahelpline.com.

To report harm from an AI tool, contact the relevant authority: see where to report a problem. AI Med Risk does not take complaints or act on individual cases.