Grok 4.7 scores 49.8 on the Respan Index (#23), ahead of Gemini 3.7 Flash at 48.6 (#26). Gemini 3.7 Flash leads on 15 of the 23 benchmarks both report. Gemini 3.7 Flash is 2.0x cheaper per token at list price. Gemini 3.7 Flash has the larger context window (1.0M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| FrontierSWE V2 (Proximal Labs) |
| 20.3% |
| 29.5% |
| Furniture Assembly (Epoch AI) | 26.7% | 20.8% |
| GPQA Diamond | 94.8% | 92.7% |
| LiveBench Agentic Coding (LiveBench) | 58.3% | 54% |
| LiveBench Coding (LiveBench) | 78.9% | 77.2% |
| LiveBench Data Analysis (LiveBench) | 68% | 76.9% |
| LiveBench Instruction Following (LiveBench) | 79.9% | 75.3% |
| LiveBench Language (LiveBench) | 85.5% | 80.1% |
| LiveBench Mathematics (LiveBench) | 93.5% | 95.7% |
| LiveBench Reasoning (LiveBench) | 87.8% | 82.7% |
| Mystery Game Puzzles (Epoch AI) | 37% | 29% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 97.2% | 98.1% |
| SAGE (Vals AI) | 49.2% | 40.8% |
| SimpleQA Verified | 69.2% | 56% |
| Terminal-Bench 4.0 (Vals AI) | 12.1% | 28.8% |
| LMArena Agent (LMArena) | -0.0149 | 0.0404 |
| LMArena Elo | 1488 | 1443 |
| LMArena WebDev (LMArena) | 1592 | 1638 |
| DeepSWE v1.1 | 65.3% | 71% |
Higher is better. Each score links to where it was published.