From Health 201AI Med Risk

documented ai-in-healthcare failures — what went wrong, why, and what might have helped, synthesised from public sources


Babylon Health triage chatbot missed cardiac red flags

What happenedClinicians and regulators documented Babylon's symptom-checker triaging classic heart-attack presentations (central chest pain in a 60-year-old smoker) to non-urgent pathways, among other unsafe outputs surfaced by Twitter user @DrMurphy11 and BBC reporting.

Failure modeSymptom-checker under-triage of time-critical conditions; marketing claims ('on par with doctors') outran validation; slow response to external safety reports.

What might have helpedTreating red-flag symptom lists as triggers for automatic escalation could have ensured consistent responses to critical signs. Implementing adversarial clinical testing prior to launch might have identified potential safety gaps earlier. Establishing a dedicated vulnerability-report channel for clinicians could have provided a structured way to surface concerns and improve system resilience.

Mitigation: no published fix or mitigation found so far. Checked monthly; see what was tried elsewhere.

Updates: 2026-10-02: A source link stopped working and was replaced with other reporting on the same events.

← Back to the incident library

Not medical or legal advice. This site documents how AI systems have failed; it is not a source of care or advice. For a health problem, seek medical attention or talk to a health professional; in an emergency, call 911 or your local emergency number. For legal questions, consult a lawyer.

If you are in crisis: in the US, call or text 988 (Suicide & Crisis Lifeline). Elsewhere, see findahelpline.com.

To report harm from an AI tool, contact the relevant authority: see where to report a problem. AI Med Risk does not take complaints or act on individual cases.