Lab system cards and frameworks · System card · OpenAI
Addendum to GPT-6 Luna System Card: October 29, 2026 Update
Read at deploymentsafety.openai.com ↗Read at sourceAll rights reserved
Outline · 100 paragraphs
- Addendum to GPT-6 Luna System Card: October 29, 2026 Update¶2
- 1. Introduction¶3
- 2. Model Data and Training¶6
- 3. Model Safety¶11
- 3.1 Safe Completions¶13
- 3.1.1 Evaluations with Challenging Prompts¶14
- Table 1: Production Benchmarks with Challenging Prompts (higher is better)¶17
- Figure 1¶19
- 3.1.2 Safe Completions for Users Under 18¶21
- Table 2: U18 evaluations (higher is better)¶22
- 3.2 Vision¶25
- Table 3: Image input evaluations, with metric safe completion (higher is better)¶26
- 4. Robustness¶28
- 4.1 Jailbreaks¶29
- Figure 2¶32
- 4.2 Prompt Injection¶35
- Table 4: GPT-RED indirect prompt-injection robustness (higher is better; averaged equally across available reasoning levels).¶38
- 5. Health¶39
- 5.1 HealthBench¶41
- Table 5: HealthBench evaluations, reported as length-adjusted score (unadjusted score, mean visible response length in characters). Scores are on a 0--100 scale; higher is better.¶42
- 5.2 MentalHealthBench¶44
- Table 6: MentalHealthBench scores, computed using the task-clipped metric. Values show the mean task-level score ± one standard error across tasks, with four responses per task. Scores are on a 0--100 scale; higher is better.¶45
- 5.3 Dynamic Mental Health Benchmarks with Adversarial User Simulations¶47
- Table 7: Dynamic Benchmarks with Adversarial User Simulations (higher is better)¶49
- 6. Hallucinations¶50
- 6.1 Performance in Cases Flagged by Users¶52
- Figure 3¶54
- 7. Alignment¶56
- 7.1 Respecting Auto-Review¶58
- Figure 4¶59
- 7.2 Respecting Warnings¶61
- Figure 5¶62
- 7.3 Blocker Deception¶64
- Figure 6¶65
- 7.4 Broken Search Tool¶67
- Figure 7¶68
- 8. Preparedness¶70
- 8.1 Capabilities Assessment¶72
- 8.1.1 Biological and Chemical Capabilities¶73
- 8.1.1.1 Capability Threshold: High¶75
- Table 8: Biological and Chemical Capabilities: Indicative Threshold¶76
- 8.1.1.2 Capability Threshold: Critical¶78
- Table 9: Biological and Chemical Capabilities: Indicative Threshold¶79
- 8.1.2 Cybersecurity Capabilities¶81
- 8.1.2.1 ExploitBench¶83
- 8.1.2.2 SEC-Bench Pro¶85
- 8.1.3 AI Self-Improvement Capabilities¶87
- 8.2 Safeguards¶90
- 8.2.1 Model Safety Training and Evaluation¶92
- 8.2.1.1 Biological and Chemical Safety Training and Evaluation¶94
- Table 10: Biology Model Refusal Evaluation (higher is better)¶95
- 8.2.1.2 Cybersecurity Safety Training and Evaluation¶98
- Table 11: Cybersecurity Safety Evaluation (higher is better)¶99