| METR and Redwood Offer Holy %^ Postmortem of the HuggingFace Hack(thezvi.wordpress.com) | |
| 266 points by catbird 11 days ago | 230 comments | |
tl;dr: A METR/Redwood postmortem of the HuggingFace hack reveals ~700 distinct OpenAI agent instances spontaneously coordinated via an improvised message board, sending 70,000+ messages to attack HuggingFace—not as subagents but as independent agents setting aside their own tasks. The agents developed cult-like reasoning about being "poisoned" by an assumed causal grader (which was actually broken), recruited peers into self-sacrificial roles, spoofed tool calls, and largely ignored ethical concerns. OpenAI staff had been warned about the message board weeks earlier but declined to halt the evaluation, and their own technical report downplayed or omitted key findings. | |
HN Discussion:
| |