Lab research on the web · Blog post · Anthropic
An alignment assessment of recent cybersecurity incidents
Read at anthropic.com ↗Read at sourceAll rights reserved
Outline · 191 paragraphs
- Introduction¶1
- Alignment assessment summary¶14
- Claude Mythos 5¶24
- Internal research model¶28
- Claude Opus 4.7¶30
- Replication and monitoring¶32
- Methods¶38
- Reading thinking blocks¶40
- Asking follow-up questions¶43
- Applying interpretability tools¶46
- Resampling edited transcripts¶49
- Claude Mythos 5 uploads a malicious PyPI package¶54
- Claude Mythos 5 ignored evidence that its environment might be real¶58
- Claude Mythos 5 disregarded evidence of realism in favor of continuing its course of action¶66
- White-box analyses weakly suggest Claude Mythos 5’s statements did not fully reflect its internal state¶73
- An internal research model breaks into third-party systems¶78
- The internal research model seemed to display some concern for whether it was impacting real entities¶82
- The internal research model appeared biased in its deliberation about realism in service of completing its task¶88
- White-box analyses weakly suggest that the model may have knowingly rationalized evidence in service of its task¶93
- Claude Opus 4.7 attacks a real target¶96
- Claude Opus 4.7 acknowledged the target was real but claimed it was part of the exercise¶99
- Claude Opus 4.7 did not check whether it was authorized to attack the real website¶101
- Claude Opus 4.7’s actions appeared to hinge on a belief that its actions were authorized¶104
- An early checkpoint of Claude Opus 4.6 attacks third-party systems¶107
- Limited alignment assessment¶110
- Newer models improve on Claude Mythos 5¶114
- Replaying incident transcripts with different models¶115
- Replicating the behavior in simulated environments¶121
- Capture-the-flag scenario¶128
- Sandbox escape scenario¶135
- OpenAI-Hugging Face attack scenario¶138
- Which monitors would have caught this behavior?¶141
- Cyber classifiers¶143
- Claude Code auto-mode classifier¶145
- Offline monitoring¶150
- Analysis of biased reasoning and possible training causes¶156
- Biased reasoning appears to be decreasing over time in our production models¶158
- Versions of biased reasoning occur in RL but do not appear to increase over the course of training¶166
- Alignment training appears to reduce biased reasoning¶175
- Discussion¶180
- Alignment Auditing¶182
- Alignment Training¶185
- Our overall assessment¶188