o1 vs o4-mini
Respan Index by category
Each category is scored 0 to 100, and how far ahead the winner is. Leads under a point are close to even.
| Category | o1 | o4-mini |
|---|---|---|
| Coding | 7.1 o1 | 7.7 o4-mini |
| Agents | 19.3* o1 | 23.7* o4-mini |
| Reasoning | 23.2 o1 | 27.2 o4-mini |
| Knowledge & language | 40.9 o1 | 19.6 o4-mini |
| Human preference | 45.2* o1 | 46.7* o4-mini |
* Estimated: no published scores in that category. How the Respan Index works
Benchmarks both report
o4-mini leads on 7 of the 10 benchmarks both report. Higher is better. Each score links to where it was published.
| Benchmark | o1 | o4-mini |
|---|---|---|
| AIME 2025 | 81.7% | 91.7% |
| Chess Puzzles (Epoch AI) | 10% | 22% |
| FrontierMath Tiers 1-3 v2 (Epoch AI) | 14.7% | 36.1% |
| GPQA Diamond | 75.7% | 77.6% |
| MATH Level 5 (Epoch AI) | 94.7% | 97.8% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 73.3% | 81.7% |
| SimpleBench (SimpleBench) | 40.1% | 38.7% |
| SimpleQA Verified | 41.1% | 19.6% |
| WeirdML (Håvard Tveit Ihle) | 46.1% | 52.6% |
| MMLU | 91.8% | 90% |
FAQ
Is o1 better than o4-mini?
o4-mini scores 23.6 on the Respan Index (#99), ahead of o1 at 23.3 (#100). o4-mini leads on 7 of the 10 benchmarks both report.
Which is cheaper, o1 or o4-mini?
o1 lists at $15 input and $60 output per 1M tokens; o4-mini at $1.1 and $4.4. o4-mini is 14x cheaper per token at list price.
Which has the larger context window?
Both accept 200K tokens of context.