Skip to main content

Llama 3.2 1B Instruct

Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows it to operate efficiently in low-resource environments while maintaining strong task performance. Supporting eight core languages and fine-tunable for more, Llama 1.3B is ideal for businesses or developers seeking lightweight yet powerful AI solutions that can operate in diverse multilingual settings without the high computational demand of larger models. Click here for the original model card. Usage of this model is subject to Meta's Acceptable Use Policy.

Input / output price
$0.02 / $0.02 per 1M
Context
131K tokens
Released
Sep 25, 2024
Agent setup

Paste into Claude Code, Cursor, or Codex

Help me set up the Respan gateway: fetch and follow https://www.respan.ai/docs/agent-setup.md. Use model "llama-3.2-1b-instruct".

Read docs

Providers

4 providers, cheapest first, OpenRouter last, priced per 1M tokens after gateway discounts.

ProviderInputOutput
Novitanovita/llama-3.2-1b-instruct
$0.02/M$0.02/M
ConcentrateRetiringconcentrate/llama-3.2-1b-instruct
$0.027/M$0.201/M
Inference.netinference_net/llama-3.2-1b-instruct
$0.027/M$0.201/M
OpenRouterRetiringopenrouter/llama-3.2-1b-instruct
$0.027/M$0.201/M

Is a provider down? OpenRouter status

Pricing

Averaged across 4 providers, in USD per 1M tokens after gateway discounts.

Average input
$0.03 per 1M
Average output
$0.16 per 1M
Average cache read
$0.0050 per 1M

Cost by volume

Total cost from 0 to 1T tokens on the cheapest and most expensive provider.

Highest$0.027/MConcentrate, Inference.net, and OpenRouterLowest$0.02/MNovita

Throughput and latency

30-day averages from requests through the Respan gateway. Under each figure, every model on the gateway by its average, this one in blue.

Output speed

Higher is better

46tokens/sacross providers

Faster than 63% of the other 599 models on the gateway

Time to first token

Lower is better

0.6sacross providers

Faster than 86% of the other 150 models on the gateway

Response latency

Lower is better

0.5sacross providers

Faster than 84% of the other 780 models on the gateway

Benchmarks

The Respan Index plus 6 published scores from 4 sources, each linked to where it was published.

5.3/ 100

Respan Index#176 of 176

176 ranked models. The shaded band is this model's 95% interval, 4.5 to 6.2.
Llama 3.2 1B Instruct by category: Coding 0.0 (estimated), Agents 0.2, Reasoning 12.5, Knowledge & language 0.3 (estimated), Human preference 13.8
  1. 176Llama 3.2 1B Instruct5.3
  2. 174Phi-49.2
  3. 175Llama 3.1 8B Instruct7.2

Published scores

BenchmarkScore
BALROGBALROG6.6%

Compare Llama 3.2 1B Instruct: Llama 3.2 1B Instruct vs Muse Wonder Full, Llama 3.2 1B Instruct vs Muse Wonder, Llama 3.2 1B Instruct vs Muse Ember, Llama 3.2 1B Instruct vs Muse Spark 1.3, Llama 3.2 1B Instruct vs Muse Spark 1.1, Llama 3.2 1B Instruct vs Muse Spark 1.2

Apps

Use Llama 3.2 1B Instruct in the tools you already run. Each guide points the app at the Respan gateway.

Setup guides for more apps are in the integration docs.

Llama 3.2 1B Instruct FAQ

Short answers, built from the data on this page.

Llama 3.2 1B Instruct is a model from Meta, released on Sep 25, 2024. Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows it to operate efficiently in low-resource environments while maintaining strong task performance. Supporting eight core languages and fine-tunable for more, Llama 1.3B is ideal for businesses or developers seeking lightweight yet powerful AI solutions that can operate in diverse multilingual settings without the high computational demand of larger models. Click here for the original model card. Usage of this model is subject to Meta's Acceptable Use Policy.

On the Respan gateway, Llama 3.2 1B Instruct costs from $0.02 per 1M input tokens and $0.02 per 1M output tokens on Novita, after gateway discounts. Averaged across its 4 providers, it costs $0.03 per 1M input tokens and $0.16 per 1M output tokens.

Llama 3.2 1B Instruct is available through 4 providers: Novita, Concentrate, Inference.net, and OpenRouter.

Llama 3.2 1B Instruct accepts up to 131K tokens of context on its largest provider route.

Point any OpenAI-compatible SDK at https://gateway.respan.ai/v1 with your Respan API key and set the model to "llama-3.2-1b-instruct". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Llama 3.2 1B Instruct scores 5.3 out of 100 on the Respan Index v1.1, ranking #176 of 176 models. By category: Coding 0.0 (estimated), Agents 0.2, Reasoning 12.5, Knowledge & language 0.3 (estimated), and Human preference 13.8. The Respan Index combines independent and lab-reported benchmark results into one score, using benchmark data collected by Respan.

Llama 3.2 1B Instruct has 6 published benchmark scores, including BALROG 6.6%, GPQA Diamond 23.9%, and OTIS Mock AIME 2024-2025 0.6%. Each score links to where it was published; the data is collected by Respan.

Certified where it counts.

Built to meet the security and privacy standards that enterprise and healthcare teams require.

ISO 27001

The internationally recognized standard for information security management.

SOC 2

Secure, compliant management of your data across all of our systems.

GDPR

Operated under GDPR, the world's strictest standard for data privacy.

HIPAA

HIPAA compliant, with a BAA available for healthcare teams.

Works with your entire stack

Use Respan with your favorite frameworks and tools.

AnthropicAI21 LabsxAIVercel AI SDK
LangChainOpenRouterAssemblyAICursor
LiteLLMGroqBasetenMem0
CohereCogneeLlamaIndexFireworks
DeepSeekLinkupHaystackTogether AI
PerplexityInference.netPostHogRubyLLM
SlackMastraAzure OpenAIMistral
AWS BedrockMoonshotHyperspellBAML
ModaInstructorGoogle GeminiParasail
ReductoZapierAgnoNebius
OpenAINovita AIReplicateSuperagent

Built for AI agents.
Break less.
Ship more.