GPT-6 Sol scores 62.8 on the Respan Index (#8), ahead of Grok 4.7 at 49.8 (#23). GPT-6 Sol leads on 18 of the 22 benchmarks both report. Grok 4.7 is 1.3x cheaper per token at list price. GPT-6 Sol has the larger context window (1.1M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| GPQA Diamond |
| 94.3% |
| 92.7% |
| LiveBench Agentic Coding (LiveBench) | 52.9% | 54% |
| LiveBench Coding (LiveBench) | 81.8% | 77.2% |
| LiveBench Data Analysis (LiveBench) | 81.2% | 76.9% |
| LiveBench Instruction Following (LiveBench) | 68.6% | 75.3% |
| LiveBench Language (LiveBench) | 85.3% | 80.1% |
| LiveBench Mathematics (LiveBench) | 96.4% | 95.7% |
| LiveBench Reasoning (LiveBench) | 88.7% | 82.7% |
| Mystery Game Puzzles (Epoch AI) | 56% | 29% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 100% | 98.1% |
| SAGE (Vals AI) | 44.8% | 40.8% |
| SimpleQA Verified | 60.7% | 56% |
| Terminal-Bench 4.0 (Vals AI) | 44.4% | 28.8% |
| Vending-Bench 2 (Andon Labs) | 14427.85 | 10536.83 |
| LMArena Agent (LMArena) | 0.0971 | 0.0404 |
| LMArena Elo | 1457 | 1443 |
| LMArena WebDev (LMArena) | 1689 | 1638 |
| DeepSWE v1.1 | 68.8% | 71% |
Higher is better. Each score links to where it was published.