Evaluators and safety organisations · Article · Goodfire
Training and Deploying Production Cyber Monitors on Kimi K3
Read at goodfire.com ↗Read at sourceNo licence statement found
Outline · 58 paragraphs
- Introduction¶1
- Our Monitor Recipe¶12
- Data¶13
- Architecture: a monitor cascade¶16
- Inference Optimizations¶21
- Results¶27
- Evaluating Our Monitors¶28
- Comparing Different Monitoring Systems¶35
- External Red Teaming Results¶40
- Conclusion¶45
- Appendix¶49
- Comparing on vs. off policy monitors¶50
- Reducing judge calls while preserving recall¶52
- Footnotes¶54