GPT-4o mini vs Llama 3.1 8B Instruct
| Spec | GPT-4o mini | Llama 3.1 8B Instruct |
|---|---|---|
| Respan Index | 10.7 (#157) | 6.9 (#161) |
| Blended price per 1M | $0.262 | $0.025 |
| Context window | 128K | 128K |
| Input / output per 1M | $0.15 / $0.6 | $0.02 / $0.04 |
| Max output | 16K | - |
| Input | text, vision | text |
| Released | 2024-07-18 | 2024-07-23 |
Respan Index by category
Each category is scored 0 to 100, and how far ahead the winner is. Leads under a point are close to even.
| Category | GPT-4o mini | Llama 3.1 8B Instruct |
|---|---|---|
| Coding | 0.6 GPT-4o mini | 0.0 Llama 3.1 8B Instruct |
| Agents | 1.8 GPT-4o mini | 0.8 Llama 3.1 8B Instruct |
| Reasoning | 17.7 GPT-4o mini | 13.8 Llama 3.1 8B Instruct |
| Knowledge & language | 8.2 GPT-4o mini | 0.4 Llama 3.1 8B Instruct |
| Human preference | 32.2 GPT-4o mini | 21.6 Llama 3.1 8B Instruct |
Benchmarks both report
GPT-4o mini leads on 7 of the 7 benchmarks both report. Higher is better. Each score links to where it was published.
FAQ
Is GPT-4o mini better than Llama 3.1 8B Instruct?
GPT-4o mini scores 10.7 on the Respan Index (#157), ahead of Llama 3.1 8B Instruct at 6.9 (#161). GPT-4o mini leads on 7 of the 7 benchmarks both report.
Which is cheaper, GPT-4o mini or Llama 3.1 8B Instruct?
GPT-4o mini lists at $0.15 input and $0.6 output per 1M tokens; Llama 3.1 8B Instruct at $0.02 and $0.04. Llama 3.1 8B Instruct is 10x cheaper per token at list price.
Which has the larger context window?
Both accept 128K tokens of context.