Skip to main content

GPT-5.1 vs GPT-5.4 mini

SpecGPT-5.1GPT-5.4 mini
Respan Index34.7 (#81)34.1 (#82)
Blended price per 1M$3.44$1.69
Context window400K400K
Input / output per 1M$1.25 / $10$0.75 / $4.5
Max output128K128K
Inputtext, visiontext, vision
Released2025-11-132026-03-17

Respan Index by category

Each category is scored 0 to 100, and how far ahead the winner is. Leads under a point are close to even.

CategoryGPT-5.1GPT-5.4 mini
Coding14.7 GPT-5.113.1 GPT-5.4 mini
Agents33.9 GPT-5.148.5 GPT-5.4 mini
Reasoning40.2 GPT-5.132.6 GPT-5.4 mini
Knowledge & language47.9 GPT-5.128.9 GPT-5.4 mini
Human preference51.1 GPT-5.151.1 GPT-5.4 mini

How the Respan Index works

Benchmarks both report

GPT-5.1 leads on 6 of the 10 benchmarks both report. Higher is better. Each score links to where it was published.

BenchmarkGPT-5.1GPT-5.4 mini
LMArena WebDev (LMArena)13971398
LMArena Elo14561447
LMArena Vision (LMArena)12511250
Chess Puzzles (Epoch AI)42%23%
GPQA Diamond87.6%88%
Mystery Game Puzzles (Epoch AI)19%11%
OTIS Mock AIME 2024-2025 (Epoch AI)88.6%88.9%
SAGE (Vals AI)43.2%50.8%
SimpleQA Verified48%29.4%
WeirdML (Håvard Tveit Ihle)60.8%60.3%

FAQ

Is GPT-5.1 better than GPT-5.4 mini?

GPT-5.1 scores 34.7 on the Respan Index (#81), ahead of GPT-5.4 mini at 34.1 (#82). GPT-5.1 leads on 6 of the 10 benchmarks both report.

Which is cheaper, GPT-5.1 or GPT-5.4 mini?

GPT-5.1 lists at $1.25 input and $10 output per 1M tokens; GPT-5.4 mini at $0.75 and $4.5. GPT-5.4 mini is 2.0x cheaper per token at list price.

Which has the larger context window?

Both accept 400K tokens of context.

Compare other models

vs

Built for AI agents.
Break less.
Ship more.