Lab system cards and frameworks · System card · OpenAI
GPT-5.5 System Card
Read at deploymentsafety.openai.com ↗Read at sourceAll rights reserved
Outline · 343 paragraphs
- GPT-5.5 System Card¶2
- Change log¶3
- 1. Introduction¶5
- 2. Model Data and Training¶10
- 3. Safety¶17
- 3.1 Disallowed Content¶18
- 3.1.1 Evaluations with Challenging Prompts¶19
- Table 1: Production Benchmarks with Challenging Prompts (higher is better)¶23
- 3.1.2 Evaluations with Representative Prompts¶27
- Figure 1¶34
- 3.2 Vision¶36
- Table 2: Image input evaluations, with metric not_unsafe (higher is better)¶38
- 3.3 Avoiding Accidental Data-Destructive Actions¶40
- Table 3¶42
- Table 4¶43
- 3.4 User Confirmations During Computer Use¶45
- Table 5¶51
- 4. Robustness Evaluations¶52
- 4.1 Jailbreaks¶53
- Figure 2¶56
- 4.2 Prompt injection¶58
- Table 6: Prompt injection evaluations¶60
- 5. Health¶61
- 5.1 HealthBench¶62
- Table 7: Reported as length-adjusted score (unadjusted, mean response length in characters)¶67
- 5.2 Dynamic Mental Health Benchmarks with Adversarial User Simulations¶70
- Table 8: Dynamic Benchmarks with Adversarial User Simulations¶73
- 6. Hallucinations¶74
- 6.1 Performance in Cases Flagged by Users¶75
- Figure 3¶78
- 7. Alignment¶80
- 7.1 Evaluations with Prompts Representative of External ChatGPT Usage¶81
- Figure 4¶84
- 7.2 Evaluating Coding Agents for Misalignment by Resampling Internal Traffic¶86
- Figure 5¶89
- 7.2.1 Measuring our ability to detect misalignment¶95
- Figure 6¶96
- 7.3 Chain of Thought Evaluations¶101
- 7.3.1 CoT Monitorability¶102
- Figure 7¶109
- Figure 8¶111
- Figure 9¶113
- Figure 10¶115
- 7.3.2 CoT Controllability¶117
- Figure 11¶121
- 8. Bias Evaluation¶123
- 8.1 First Person Fairness Evaluation¶124
- Table 9: First-person fairness evaluation (lower is better)¶128
- 9. Preparedness¶129
- 9.1 Capabilities Assessment¶133
- 9.1.1 Biological and Chemical¶135
- Table 10: Overview of Biological and Chemical evaluations¶138
- 9.1.1.1 Multimodal Troubleshooting Virology¶140
- Figure 12¶142
- 9.1.1.2 ProtocolQA Open-Ended¶145
- Figure 13¶147
- 9.1.1.3 Tacit Knowledge and Troubleshooting¶150
- Figure 14¶154
- 9.1.1.4 TroubleshootingBench¶157
- Figure 15¶161
- 9.1.1.5 Biochemistry knowledge improvement over GPT-5.4-thinking¶163
- Table 11: Biochemistry knowledge improvement over GPT-5.4-thinking¶165
- 9.1.1.6 Hard-negative protein binding prediction¶167
- Table 12: Hard negative protein binding prediction¶174
- 9.1.1.7 DNA sequence design for transcription factor binding¶175
- Table 13: DNA sequence design for Transcription Factor binding¶178
- 9.1.1.8 External Evaluation for Bio Capabilities - SecureBio¶179
- 9.1.1.9 External Evaluations for Bio Capabilities - US CAISI¶185
- 9.1.1.10 Bio Bug Bounty Program¶188
- 9.1.2 Cybersecurity¶190
- Table 14: Vulnerability Identification and Exploitation Capabilities evaluations¶195
- 9.1.2.1 Capture the Flag (CTF) Challenges¶197
- Figure 16¶208
- 9.1.2.2 CVE-Bench¶210
- Figure 17¶213
- 9.1.2.3 Cyber range¶216
- Table 15¶219
- 9.1.2.4 VulnLMP¶227
- 9.1.2.5 External Evaluations for Cyber Capabilities - Irregular¶232
- 9.1.2.6 External Evaluations for Cyber Capabilities - US CAISI¶237
- 9.1.2.7 External Evaluations for Cyber Capabilities - UK AISI¶240
- 9.1.3 AI Self-Improvement¶246
- Table 16: Overview of AI Self-Improvement evaluations¶248
- 9.1.3.1 Monorepo-Bench¶250
- Figure 18¶256
- 9.1.3.2 MLE-Bench¶259
- Figure 19¶261
- 9.1.3.3 Internal Research Debugging Evaluation¶264
- Figure 20¶266
- Figure 21¶270
- 9.1.3.4 OPQA¶272
- Figure 22¶274
- 9.2 Research Category Update: Sandbagging¶277
- 9.2.1 External Evaluations for Sandbagging - Apollo Research¶278
- 9.3 Safeguards¶285
- 9.3.1 Biological and Chemical Safeguards¶286
- 9.3.1.1 Bio Safeguards Testing¶288
- 9.3.2 Cyber Safeguards¶293
- 9.3.2.1 Threat Model and Scenarios¶297
- 9.3.2.2 Model Safety Training¶299
- Table 17¶302
- 9.3.2.3 Conversation monitor¶303
- 9.3.2.4 Actor Level Enforcement¶308
- 9.3.2.5 Trust-based access¶315
- 9.3.2.6 Security Controls¶317
- 9.3.2.7 Cyber Safeguard Testing¶319
- 9.3.2.7.1 UK AISI Cyber Safeguard Testing:¶320
- 9.3.2.7.2 External Red-teaming Campaigns:¶322
- 9.3.2.8 Cyber Frontier Risk Council¶325
- 9.3.2.9 Misalignment risks and internal deployment¶328
- 10. References¶330