GPT-6 Sol scores 62.8 on the Respan Index (#8), ahead of DeepSeek V4.1 Flash at 50.9 (#20). GPT-6 Sol leads on 11 of the 16 benchmarks both report. DeepSeek V4.1 Flash is 7.6x cheaper per token at list price. GPT-6 Sol has the larger context window (1.1M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| LiveBench Instruction Following (LiveBench) |
| 70% |
| 68.6% |
| LiveBench Language (LiveBench) | 81.2% | 85.3% |
| LiveBench Mathematics (LiveBench) | 93.3% | 96.4% |
| LiveBench Reasoning (LiveBench) | 86.7% | 88.7% |
| SAGE (Vals AI) | 47.9% | 44.8% |
| Terminal-Bench 4.0 (Vals AI) | 19.7% | 44.4% |
| LMArena Agent (LMArena) | 0.0402 | 0.0971 |
| LMArena Elo | 1474 | 1457 |
| LMArena WebDev (LMArena) | 1620 | 1689 |
| SimpleBench (SimpleBench) | 66.7% | 73.1% |
| DeepSWE v1.1 | 74.2% | 68.8% |
| GPQA Diamond | 90.9% | 94.3% |
Higher is better. Each score links to where it was published.