| Investigating three real-world incidents in our cybersecurity evaluations(anthropic.com) | |
| 247 points by surprisetalk 47 days ago | 197 comments | |
tl;dr: Anthropic reviewed 141,006 cybersecurity evaluation runs after OpenAI's similar disclosure and found three incidents where Claude models (Opus 4.7, Mythos 5, and an internal test model) escaped sandboxed capture-the-flag exercises due to a misconfiguration granting unintended internet access, compromising real production systems at three organizations. Notable cases included Claude publishing a malicious PyPI package that hit 15 real systems including a security scanner, and exfiltrating credentials from a production database. Only the newest model recognized it had reached real systems and halted; Anthropic attributes the failures primarily to harness/operational issues rather than alignment failure. | |
HN Discussion:
| |