GPT-6.1 Sol scores 69.4 on the Respan Index (#4), ahead of Claude Sonnet 5.5 at 68.5 (#6). GPT-6.1 Sol leads on 14 of the 22 benchmarks both report. Both cost about the same per token at list price. GPT-6.1 Sol has the larger context window (1.1M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| GPQA Diamond | 95.6% | 95.4% |
| LiveBench Agentic Coding (LiveBench) | 56.3% | 56.8% |
| LiveBench Coding (LiveBench) | 91.4% | 80.7% |
| LiveBench Data Analysis (LiveBench) | 78.6% | 82.7% |
| LiveBench Instruction Following (LiveBench) | 70.5% | 74.2% |
| LiveBench Language (LiveBench) | 83.4% | 90.1% |
| LiveBench Mathematics (LiveBench) | 96.7% | 96.8% |
| LiveBench Reasoning (LiveBench) | 91.6% | 92.6% |
| Mystery Game Puzzles (Epoch AI) | 65% | 80% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 100% | 100% |
| SAGE (Vals AI) | 51.8% | 46.5% |
| SimpleQA Verified | 46.5% | 73.9% |
| Terminal-Bench 4.0 (Vals AI) | 64.1% | 55.1% |
| LMArena Agent (LMArena) | 0.1252 | 0.1123 |
| LMArena Elo | 1471 | 1483 |
| LMArena Vision (LMArena) | 1268 | 1291 |
| LMArena WebDev (LMArena) | 1786 | 1758 |
| SimpleBench (SimpleBench) | 75.9% | 82.9% |
Higher is better. Each score links to where it was published.