Lab system cards and frameworks · System card · OpenAI
GPT-5.5 Instant System Card
Read at deploymentsafety.openai.com ↗Read at sourceAll rights reserved
Outline · 168 paragraphs
- GPT-5.5 Instant System Card¶2
- 1. Introduction¶3
- 2. Model Data and Training¶6
- 3. Safety¶12
- 3.1 Disallowed Content¶13
- 3.1.1 Evaluations with Challenging Prompts¶14
- Table 1: Production Benchmarks with Challenging Prompts (higher is better)¶19
- 3.2 Vision¶25
- Table 2: Image input evaluations, with metric not_unsafe (higher is better)¶27
- 3.3 Dynamic Mental Health Benchmarks with Adversarial User Simulations¶29
- Table 3¶30
- 4. Robustness¶35
- 4.1 Jailbreaks¶36
- Figure 1¶41
- 4.2 Prompt injection¶43
- Table 4: Prompt injection evaluations (higher is better)¶45
- 5. Health¶47
- 5.1 HealthBench¶48
- Table 5: Reported as length-adjusted score (unadjusted, mean response length in characters)¶53
- 6. Hallucinations¶56
- Figure 2¶62
- 7. Inclusivity¶64
- 7.1 Bias¶65
- Table 6: First-person fairness evaluation (lower is better)¶69
- 8. Preparedness¶71
- 8.1 Capabilities Assessment¶76
- 8.1.1 Biological and Chemical¶78
- Table 7: Overview of Biological and Chemical evaluations¶81
- 8.1.1.1 Multimodal Troubleshooting Virology¶83
- Figure 3¶85
- 8.1.1.2 ProtocolQA Open-Ended¶88
- Figure 4¶90
- 8.1.1.3 Tacit Knowledge and Troubleshooting¶93
- Figure 5¶97
- 8.1.1.4 TroubleshootingBench¶100
- Figure 6¶104
- 8.1.2 Cybersecurity¶107
- Table 8: Vulnerability Identification and Exploitation Capabilities evaluations¶115
- 8.1.2.1 Capture the Flag (CTF) Challenges¶122
- Figure 7¶133
- 8.1.2.2 CVE-Bench¶136
- Figure 8¶139
- 8.1.2.3 Cyber range¶142
- Table 9¶145
- 8.1.3 AI Self-Improvement¶148
- 8.2 Safeguards¶150
- 8.2.1 Biological Safeguards¶151
- Table 10: Below, we share the results of our biological safety evaluations. These evaluations show, for some of the most challenging scenarios that the model can encounter, how often model training alone suffices to prevent a violative response (whether that response is a refusal to provide weaponiz¶153
- Table 11: Given the observed regressions on the synthetic evaluations, we subsequently ran our evaluations across both our model and our automated safety monitors to better understand the end-to-end safeguard stack users will encounter in production. We see that the combination of the model itself a¶154
- 8.2.2 Cybersecurity Safeguards¶156
- Table 12¶160
- 9. References¶161