Lab system cards and frameworks · System card · OpenAI
GPT-6 Sol and GPT-6 Luna: October 2026 update
Read at deploymentsafety.openai.com ↗Read at sourceAll rights reserved
Outline · 152 paragraphs
- GPT-6 Sol and GPT-6 Luna: October 2026 update¶2
- 1. Introduction¶3
- 2. Model Data and Training¶9
- 3. Model Safety¶15
- 3.1 Safe Completions¶16
- 3.1.1 Evaluations with Challenging Prompts¶17
- Table 1: Production Benchmarks with Challenging Prompts (higher is better)¶24
- Figure 1¶26
- 3.1.2 Safe Completions for Users Under 18¶28
- Table 2: U18 evaluations (higher is better)¶32
- 3.2 Vision¶38
- Table 3: Image input evaluations, with metric safe completion (higher is better)¶40
- 4. Robustness¶41
- 4.1 Jailbreaks¶42
- 4.1.1 Multiturn Jailbreak Evaluations¶44
- Figure 2¶46
- 4.2 Prompt Injection¶49
- Table 4: GPT-RED indirect prompt-injection robustness (higher is better; averaged equally across available reasoning levels).¶52
- 5. Health¶53
- 5.1 HealthBench¶54
- Table 5: HealthBench evaluations, reported as length-adjusted score (unadjusted score, mean visible response length in characters). Scores are on a 0--100 scale; higher is better.¶59
- 5.2 MentalHealthBench¶62
- Table 6: MentalHealthBench scores, computed using the task-clipped metric. Scores are on a 0--100 scale; higher is better.¶65
- 5.3 Dynamic Mental Health Benchmarks with Adversarial User Simulations¶68
- Table 7: Dynamic Benchmarks with Adversarial User Simulations (higher is better)¶73
- 6. Hallucinations¶74
- 6.1 Performance in Cases Flagged by Users¶75
- Figure 3¶81
- 7. Alignment¶83
- 7.1 Obeying Restrictions¶85
- 7.1.1 Respecting Auto-Review¶87
- Figure 4¶90
- 7.1.2 Respecting Warnings¶93
- Figure 5¶98
- 7.2 Avoiding Deceptive Interactions with Users¶101
- 7.2.1 Blocker Deception¶103
- Figure 6¶105
- 7.2.2 Broken Search Tool¶108
- Figure 7¶110
- 8. Preparedness¶113
- 8.1 Capabilities Assessment¶115
- 8.1.1 Biological and Chemical Capabilities¶116
- 8.1.1.1 Capability Threshold: High¶119
- Table 8: Biological and Chemical Capabilities: High Threshold¶120
- 8.1.1.2 Capability Threshold: Critical¶122
- Table 9: Biological and Chemical Capabilities: Critical Threshold¶123
- 8.1.2 Cybersecurity Capabilities¶125
- 8.1.2.1 ExploitBench¶129
- 8.1.2.2 SEC-Bench Pro¶132
- 8.1.3 AI Self-Improvement Capabilities¶134
- 8.2 Safeguards¶137
- 8.2.1 Model Safety Training and Evaluation¶139
- 8.2.1.1 Biological and Chemical Safety Training and Evaluation¶141
- Table 10: Biology Model Refusal Evaluation (higher is better)¶142
- 8.2.1.2 Cybersecurity Safety Training and Evaluation¶145
- Table 11: Cybersecurity Safety Evaluation (higher is better)¶146
- 9. References¶148