Skip to main content

Llama 3.1 8B Instruct vs Llama 3.2 1B Instruct

SpecLlama 3.1 8B InstructLlama 3.2 1B Instruct
Respan Index7.2 (#175)5.3 (#176)
Blended price per 1M$0.025$0.02
Context window128K128K
Input / output per 1M$0.02 / $0.04$0.02 / $0.02
Max output--
Inputtexttext
Released2024-07-232024-09-25

Respan Index by category

Each category is scored 0 to 100, and how far ahead the winner is. Leads under a point are close to even.

CategoryLlama 3.1 8B InstructLlama 3.2 1B Instruct
Coding0.0 Llama 3.1 8B Instruct0.0* Llama 3.2 1B Instruct
Agents1.2 Llama 3.1 8B Instruct0.2 Llama 3.2 1B Instruct
Reasoning14.1 Llama 3.1 8B Instruct12.5 Llama 3.2 1B Instruct
Knowledge & language0.9 Llama 3.1 8B Instruct0.3* Llama 3.2 1B Instruct
Human preference21.9 Llama 3.1 8B Instruct13.8 Llama 3.2 1B Instruct

* Estimated: no published scores in that category. How the Respan Index works

Benchmarks both report

Llama 3.1 8B Instruct leads on 6 of the 6 benchmarks both report. Higher is better. Each score links to where it was published.

BenchmarkLlama 3.1 8B InstructLlama 3.2 1B Instruct
LMArena Elo12111111
GPQA Diamond27%23.9%
OTIS Mock AIME 2024-2025 (Epoch AI)1.7%0.6%
BALROG (BALROG)15.1%6.6%
IFEval80.4%59.5%
MMLU69.4%49.3%

FAQ

Is Llama 3.1 8B Instruct better than Llama 3.2 1B Instruct?

Llama 3.1 8B Instruct scores 7.2 on the Respan Index (#175), ahead of Llama 3.2 1B Instruct at 5.3 (#176). Llama 3.1 8B Instruct leads on 6 of the 6 benchmarks both report.

Which is cheaper, Llama 3.1 8B Instruct or Llama 3.2 1B Instruct?

Llama 3.1 8B Instruct lists at $0.02 input and $0.04 output per 1M tokens; Llama 3.2 1B Instruct at $0.02 and $0.02. Llama 3.2 1B Instruct is 1.3x cheaper per token at list price.

Which has the larger context window?

Both accept 128K tokens of context.

Compare other models

vs

Built for AI agents.
Break less.
Ship more.