GPT-6 Astra scores 70.5 on the Respan Index (#2), ahead of DeepSeek V4.1 Flash at 50.9 (#20). GPT-6 Astra leads on 13 of the 15 benchmarks both report. DeepSeek V4.1 Flash is 38x cheaper per token at list price. GPT-6 Astra has the larger context window (1.1M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| LiveBench Instruction Following (LiveBench) |
| 70% |
| 75.6% |
| LiveBench Language (LiveBench) | 81.2% | 89.4% |
| LiveBench Mathematics (LiveBench) | 93.3% | 96.8% |
| LiveBench Reasoning (LiveBench) | 86.7% | 92.7% |
| SAGE (Vals AI) | 47.9% | 46.4% |
| Terminal-Bench 4.0 (Vals AI) | 19.7% | 59.6% |
| LMArena Agent (LMArena) | 0.0402 | 0.1227 |
| LMArena Elo | 1474 | 1477 |
| LMArena WebDev (LMArena) | 1620 | 1788 |
| SimpleBench (SimpleBench) | 66.7% | 86.5% |
| GPQA Diamond | 90.9% | 96% |
Higher is better. Each score links to where it was published.