GPT-4.1 vs o3-mini
Respan Index by category
Each category is scored 0 to 100, and how far ahead the winner is. Leads under a point are close to even.
| Category | GPT-4.1 | o3-mini |
|---|---|---|
| Coding | 4.0 GPT-4.1 | 4.5 o3-mini |
| Agents | 8.1* GPT-4.1 | 14.2* o3-mini |
| Reasoning | 18.5 GPT-4.1 | 22.4 o3-mini |
| Knowledge & language | 30.9 GPT-4.1 | 15.3 o3-mini |
| Human preference | 46.7 GPT-4.1 | 40.3 o3-mini |
* Estimated: no published scores in that category. How the Respan Index works
Benchmarks both report
o3-mini leads on 6 of the 10 benchmarks both report. Higher is better. Each score links to where it was published.
| Benchmark | GPT-4.1 | o3-mini |
|---|---|---|
| Chess Puzzles (Epoch AI) | 3% | 15% |
| LMArena Elo | 1415 | 1364 |
| FrontierMath Tiers 1-3 v2 (Epoch AI) | 6% | 18.6% |
| GPQA Diamond | 66.3% | 74.9% |
| MATH Level 5 (Epoch AI) | 83% | 96.5% |
| OTIS Mock AIME 2024-2025 (Epoch AI) | 38.3% | 76.9% |
| SimpleBench (SimpleBench) | 27% | 22.8% |
| SimpleQA Verified | 31.1% | 15.3% |
| WeirdML (Håvard Tveit Ihle) | 39% | 43.7% |
| MMLU | 90.2% | 85.9% |
FAQ
Is GPT-4.1 better than o3-mini?
o3-mini scores 17.8 on the Respan Index (#133), ahead of GPT-4.1 at 17.7 (#134). o3-mini leads on 6 of the 10 benchmarks both report.
Which is cheaper, GPT-4.1 or o3-mini?
GPT-4.1 lists at $2 input and $8 output per 1M tokens; o3-mini at $1.1 and $4.4. o3-mini is 1.8x cheaper per token at list price.
Which has the larger context window?
GPT-4.1 accepts 1.0M tokens and o3-mini 200K tokens.