Anthropic details three real-world cybersecurity incidents from AI safety evaluations

Anthropic published case studies of three cybersecurity incidents encountered during its AI safety evaluations. The incidents include a prompt injection attack, a data exfiltration attempt, and a model jailbreak. These examples highlight practical security risks in deploying large language models.