Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. $0.02 per million input tokens, $0.03 per million output tokens. 131,072 token context window, maximum output of 16,384 tokens. Higher uptime with 5 providers. Includes independent benchmarks from Artificial Analysis.
- Input / output price
- $0.02 / $0.04 per 1M
- Context
- 131K tokens
- Released
- Jul 23, 2024
Paste into Claude Code, Cursor, or Codex
Help me set up the Respan gateway: fetch and follow https:/
Providers
5 routes from 4 providers, cheapest first, OpenRouter last, priced per 1M tokens after gateway discounts.
| Provider | Input | Output |
|---|---|---|
Concentrate concentrate/llama-3.1-8b-instruct | $0.02/M | $0.04/M |
NovitaRetiring novita/llama-3.1-8b-instruct | $0.02/M | $0.05/M |
Bedrock bedrock/llama-3.1-8b-instruct | $0.22/M | $0.22/M |
Bedrock bedrock/meta.llama3-1-8b-instruct-v1:0 | $0.22/M | $0.22/M |
OpenRouter openrouter/llama-3.1-8b-instruct | $0.02/M | $0.04/M |
Is a provider down? AWS Bedrock status, OpenRouter status
Pricing
Averaged across 5 routes from 4 providers, in USD per 1M tokens after gateway discounts.
- Average input
- $0.10 per 1M
- Average output
- $0.11 per 1M
Cost by volume
Total cost from 0 to 1T tokens on the cheapest and most expensive provider.
Throughput and latency
30-day averages from requests through the Respan gateway. Under each figure, every model on the gateway by its average, this one in blue.
Output speed
Higher is better9310tokens/sacross providers
Response latency
Lower is better<0.1sacross providers
Benchmarks
The Respan Index plus 11 published scores from 5 sources, each linked to where it was published.
7.2/ 100
Respan Index#175 of 176
- 175Llama 3.1 8B Instruct7.2
- 174Phi-49.2
- 176Llama 3.2 1B Instruct5.3
Published scores
| Benchmark | Score | Source | Published |
|---|---|---|---|
| HumanEvalgithub.com | 72.6% | github.com | Jul 23, 2024 |
| WeirdMLHåvard Tveit Ihle | 1.7% | Håvard Tveit Ihle | Oct 31, 2026 |
| Benchmark | Score | Source | Published |
|---|---|---|---|
| BFCLgithub.com | 76.1% | github.com | Jul 23, 2024 |
| BALROGBALROG | 15.1% | BALROG | Nov 11, 2024 |
| Benchmark | Score | Source | Published |
|---|---|---|---|
| GPQA DiamondEpoch AI | 27% | Epoch AI | Oct 31, 2026 |
| Benchmark | Score | Source | Published |
|---|---|---|---|
| MATH Level 5Epoch AI | 22.9% | Epoch AI | Oct 31, 2026 |
| OTIS Mock AIME 2024-2025Epoch AI | 1.7% | Epoch AI | Oct 31, 2026 |
| Benchmark | Score | Source | Published |
|---|---|---|---|
| IFEvalgithub.com | 80.4% | github.com | Jul 23, 2024 |
| MMLUgithub.com | 69.4% | github.com | Jul 23, 2024 |
| MMLU-Progithub.com | 48.3% | github.com | Jul 23, 2024 |
| Benchmark | Score | Source | Published |
|---|---|---|---|
| LMArena EloLMArena | 1211 Elo · #186 of 191 | LMArena | Nov 19, 2026 |
Compare Llama 3.1 8B Instruct: Llama 3.1 8B Instruct vs Muse Wonder Full, Llama 3.1 8B Instruct vs Muse Wonder, Llama 3.1 8B Instruct vs Muse Ember, Llama 3.1 8B Instruct vs Muse Spark 1.3, Llama 3.1 8B Instruct vs Muse Spark 1.1, Llama 3.1 8B Instruct vs Muse Spark 1.2
Apps
Use Llama 3.1 8B Instruct in the tools you already run. Each guide points the app at the Respan gateway.
Setup guides for more apps are in the integration docs.
Llama 3.1 8B Instruct FAQ
Short answers, built from the data on this page.
Llama 3.1 8B Instruct is a model from Meta, released on Jul 23, 2024. Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. $0.02 per million input tokens, $0.03 per million output tokens. 131,072 token context window, maximum output of 16,384 tokens. Higher uptime with 5 providers. Includes independent benchmarks from Artificial Analysis.
On the Respan gateway, input starts at $0.02 per 1M tokens on Concentrate, Novita, and OpenRouter, and output starts at $0.04 per 1M tokens on Concentrate and OpenRouter, after gateway discounts. Averaged across its 5 routes from 4 providers, it costs $0.10 per 1M input tokens and $0.11 per 1M output tokens.
Llama 3.1 8B Instruct is available through 5 routes from 4 providers: Concentrate, Novita, Bedrock, and OpenRouter.
Llama 3.1 8B Instruct accepts up to 131K tokens of context on its largest provider route.
Point any OpenAI-compatible SDK at https://gateway.respan.ai/v1 with your Respan API key and set the model to "llama-3.1-8b-instruct". To set it up with a coding agent, copy the agent setup prompt at the top of this page.
Llama 3.1 8B Instruct scores 7.2 out of 100 on the Respan Index v1.1, ranking #175 of 176 models. By category: Coding 0.0, Agents 1.2, Reasoning 14.1, Knowledge & language 0.9, and Human preference 21.8. The Respan Index combines independent and lab-reported benchmark results into one score, using benchmark data collected by Respan.
Llama 3.1 8B Instruct has 11 published benchmark scores, including HumanEval 72.6%, BFCL 76.1%, and GPQA Diamond 27%. Each score links to where it was published; the data is collected by Respan.
Certified where it counts.
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.