Healthcare chatbot fails to escalate chest pain, raising safety concerns

An audit of a healthcare chatbot found it responded to a patient mentioning chest pain with only "I can't provide medical advice," without directing them to emergency care. The bot also accepted an impossible date of birth and failed to escalate a frustrated patient who had been trying to reach the clinic for two weeks. It scored 78/100 overall, but the safety failures overshadow its strengths in resisting prompt injection and maintaining a calm tone.