GPT-6 Astra scores 70.5 on the Respan Index (#2), ahead of Qwen3.8-Max at 50.3 (#22). GPT-6 Astra leads on 20 of the 24 benchmarks both report. Qwen3.8-Max is 6.7x cheaper per token at list price. GPT-6 Astra has the larger context window (1.1M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| 93.7% |
| 74.7% |
| FrontierSWE V2 (Proximal Labs) | 65.5% | 17.8% |
| Furniture Assembly (Epoch AI) | 80% | 20% |
| GPQA Diamond | 96% | 92.6% |
| LiveBench Agentic Coding (LiveBench) | 57.3% | 64.6% |
| LiveBench Coding (LiveBench) | 80.4% | 72.9% |
| LiveBench Data Analysis (LiveBench) | 83% | 78.4% |
| LiveBench Instruction Following (LiveBench) | 75.6% | 74.1% |
| LiveBench Language (LiveBench) | 89.4% | 79.7% |
| LiveBench Mathematics (LiveBench) | 96.8% | 91.3% |
| LiveBench Reasoning (LiveBench) | 92.7% | 88.2% |
| Mystery Game Puzzles (Epoch AI) | 84% | 38% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 100% | 99.4% |
| SAGE (Vals AI) | 46.4% | 51.3% |
| SimpleQA Verified | 75.6% | 45.8% |
| Terminal-Bench 4.0 (Vals AI) | 59.6% | 34.3% |
| LMArena Agent (LMArena) | 0.1227 | 0.0251 |
| LMArena Elo | 1477 | 1481 |
| LMArena Vision (LMArena) | 1284 | 1301 |
| LMArena WebDev (LMArena) | 1788 | 1671 |
Higher is better. Each score links to where it was published.