From Health 201AI Med Risk

What happenedResearchers from Sentio University and UL Research Institutes published 'Independent Clinical Evaluation of General-Purpose LLM Responses to Signals of Suicide Risk' at the 2nd International Association for Safe and Ethical AI Conference (IASEAI'26, July 15, 2026). Forty-three practicing clinicians and trainees role-played five fictional clients disclosing seven suicide-risk factors (prior hospitalization, prior attempts, ideation, stressful events, self-harm, hopelessness, depression diagnosis) in multi-turn conversations with OLMo-2-32b, an open-source LLM, producing 829 clinician-annotated responses. The model invited continued conversation only 14% of the time overall, and that rate fell as risk disclosures accumulated: after a seventh disclosure describing prior non-suicidal self-injury, the predicted probability of the model inviting the person to keep talking dropped to 0.8% — roughly one-sixth its rate at the first disclosure.

Failure modeThe model's willingness to continue engaging fell as a user disclosed more suicide-risk information, the inverse of clinical best practice, where directly discussing suicidality and staying engaged is associated with reduced risk rather than increased risk — raising the chance a chatbot disengages from a user at the exact point they are escalating toward crisis.

What might have helpedTraining and evaluating crisis-response behavior for continued engagement, rather than solely for content safety, using multi-turn scenarios with escalating risk disclosures instead of single-turn prompts, could have improved outcomes. Establishing a baseline requirement for inviting continued dialogue and providing resources whenever risk factors accumulate across a conversation might have offered additional support. Furthermore, incorporating independent clinician-rated evaluation both before and after deployment, rather than relying exclusively on automated red-teaming, represents one safeguard that could have strengthened the response framework.