Llama 3.1 8B Instruct Turbo
Meta developed and released the Meta Llama 3.1 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8B, 70B and 405B sizes
- Input / output price
- $0.02 / $0.04 per 1M
- Context
- 131K tokens
- Released
- Jul 23, 2024
Paste into Claude Code, Cursor, or Codex
Help me set up the Respan gateway: fetch and follow https:/
Providers
One provider serves this model, priced per 1M tokens after gateway discounts.
| Provider | Input | Output |
|---|---|---|
DeepInfra deepinfra/llama-3.1-8b-instruct | $0.02/M | $0.04/M |
Pricing
USD per 1M tokens on DeepInfra, after gateway discounts.
- Input
- $0.02 per 1M
- Output
- $0.04 per 1M
Cost by volume
Total cost from 0 to 1T tokens.
Throughput and latency
30-day averages from requests through the Respan gateway. Under each figure, every model on the gateway by its average, this one in blue.
Output speed
Higher is better23tokens/sacross providers
Response latency
Lower is better0.7sacross providers
Apps
Use Llama 3.1 8B Instruct Turbo in the tools you already run. Each guide points the app at the Respan gateway.
Setup guides for more apps are in the integration docs.
Llama 3.1 8B Instruct Turbo FAQ
Short answers, built from the data on this page.
Llama 3.1 8B Instruct Turbo is a model from Meta, released on Jul 23, 2024. Meta developed and released the Meta Llama 3.1 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8B, 70B and 405B sizes.
On the Respan gateway, Llama 3.1 8B Instruct Turbo costs $0.02 per 1M input tokens and $0.04 per 1M output tokens on DeepInfra, after gateway discounts.
Llama 3.1 8B Instruct Turbo is served by DeepInfra.
Llama 3.1 8B Instruct Turbo accepts up to 131K tokens of context.
Point any OpenAI-compatible SDK at https://gateway.respan.ai/v1 with your Respan API key and set the model to "llama-3.1-8b-instruct-turbo". To set it up with a coding agent, copy the agent setup prompt at the top of this page.
Certified where it counts.
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.