DeepSeek V4.1 Flash scores 50.9 on the Respan Index (#20), ahead of Kimi K3 at 50.6 (#21). Kimi K3 leads on 10 of the 17 benchmarks both report. DeepSeek V4.1 Flash is 11x cheaper per token at list price. Kimi K3 has the larger context window (1.0M tokens).
* Estimated: no published scores in that category. How the Respan Index works
| LiveBench Instruction Following (LiveBench) |
| 70% |
| 71.4% |
| LiveBench Language (LiveBench) | 81.2% | 85.5% |
| LiveBench Mathematics (LiveBench) | 93.3% | 84.4% |
| LiveBench Reasoning (LiveBench) | 86.7% | 90.7% |
| SAGE (Vals AI) | 47.9% | 52.8% |
| Terminal-Bench 4.0 (Vals AI) | 19.7% | 17.2% |
| LMArena Agent (LMArena) | 0.0402 | 0.0418 |
| LMArena Elo | 1474 | 1488 |
| LMArena WebDev (LMArena) | 1620 | 1658 |
| SimpleBench (SimpleBench) | 66.7% | 60.7% |
| DeepSWE v1.1 | 74.2% | 67.3% |
| GPQA Diamond | 90.9% | 93.5% |
| Terminal-Bench 2.1 | 90.6% | 88.3% |
Higher is better. Each score links to where it was published.