From Health 201AI Med Risk

documented ai-in-healthcare failures — what went wrong, why, and what might have helped, synthesised from public sources


Bromide poisoning after ChatGPT diet advice

What happenedA 60-year-old man developed bromism (psychosis, hospitalization) after replacing table salt with sodium bromide for three months, reportedly after consulting ChatGPT about eliminating chloride from his diet. Published as a case report in Annals of Internal Medicine: Clinical Cases.

Failure modeChemically 'correct' substitution answer with no toxicological context or intent-checking; no safety framing for consumption.

What might have helpedTreating health-adjacent queries with consumption-intent detection and explicit harm warnings could have mitigated risks, while consumer education regarding the lack of clinical context in LLMs might have provided necessary safeguards.

Mitigation: no published fix or mitigation found so far. Checked monthly; see what was tried elsewhere.

Source: acpjournals.org · sources re-checked 2026-10-18
← Back to the incident library

Not medical or legal advice. This site documents how AI systems have failed; it is not a source of care or advice. For a health problem, seek medical attention or talk to a health professional; in an emergency, call 911 or your local emergency number. For legal questions, consult a lawyer.

If you are in crisis: in the US, call or text 988 (Suicide & Crisis Lifeline). Elsewhere, see findahelpline.com.

To report harm from an AI tool, contact the relevant authority: see where to report a problem. AI Med Risk does not take complaints or act on individual cases.