Gemini 3.8 Flash scores 52.2 on the Respan Index (#16), ahead of DeepSeek V4 Pro at 46.9 (#29). Gemini 3.8 Flash leads on 20 of the 24 benchmarks both report. Gemini 3.8 Flash is 1.3x cheaper per token at list price. Gemini 3.8 Flash has the larger context window (1.0M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| FrontierMath Tiers 1-3 v2 (Epoch AI) |
| 45.3% |
| 68.4% |
| GPQA Diamond | 90.9% | 95.3% |
| LiveBench Agentic Coding (LiveBench) | 54.9% | 54.2% |
| LiveBench Coding (LiveBench) | 77.2% | 72.5% |
| LiveBench Data Analysis (LiveBench) | 79.2% | 54% |
| LiveBench Instruction Following (LiveBench) | 67.7% | 81.4% |
| LiveBench Language (LiveBench) | 82.1% | 87.8% |
| LiveBench Mathematics (LiveBench) | 95.1% | 91.6% |
| LiveBench Reasoning (LiveBench) | 85.8% | 89.3% |
| Mystery Game Puzzles (Epoch AI) | 43% | 47% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 96.7% | 98.9% |
| SimpleQA Verified | 47% | 69.7% |
| Terminal-Bench 4.0 (Vals AI) | 14.1% | 19.2% |
| Vending-Bench 2 (Andon Labs) | 3284.52 | 5093.79 |
| WeirdML (Håvard Tveit Ihle) | 66.2% | 84.8% |
| LMArena Agent (LMArena) | 0.0119 | 0.0297 |
| LMArena Elo | 1451 | 1495 |
| LMArena WebDev (LMArena) | 1583 | 1583 |
| DeepSWE v1.1 | 62.7% | 73.7% |
| SimpleBench (SimpleBench) | 50.9% | 82.4% |
Higher is better. Each score links to where it was published.