Question 1

What is Llama 3.2 3B Instruct?

Accepted Answer

Llama 3.2 3B Instruct is a model from Meta, released on Sep 25, 2024. Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it supports eight languages, including English, Spanish, and Hindi, and is adaptable for additional languages. Trained on 9 trillion tokens, the Llama 3.2 3B model excels in instruction-following, complex reasoning, and tool use. Its balanced performance makes it ideal for applications needing accuracy and efficiency in text generation across multilingual settings. Click here for the original model card. Usage of this model is subject to Meta's Acceptable Use Policy.

Question 2

How much does Llama 3.2 3B Instruct cost?

Accepted Answer

On the Respan gateway, input starts at $0.05 per 1M tokens on OpenRouter, and output starts at $0.06 per 1M tokens on TogetherAI, after gateway discounts. Averaged across 5 providers, it costs $0.05 per 1M input tokens and $0.28 per 1M output tokens.

Question 3

Which providers serve Llama 3.2 3B Instruct on Respan?

Accepted Answer

5 providers serve Llama 3.2 3B Instruct: OpenRouter, Inference.net, Parasail, and TogetherAI. TogetherAI requires your own provider API key (BYOK).

Question 4

What is Llama 3.2 3B Instruct's context window?

Accepted Answer

Llama 3.2 3B Instruct accepts up to 131K tokens of context on its largest provider route.

Question 5

How do I use Llama 3.2 3B Instruct with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "llama-3.2-3b-instruct". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is Llama 3.2 3B Instruct?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was OpenRouter at 11 tokens per second, and the lowest response latency was 1.0 seconds on OpenRouter. Speed varies with request size and provider.

Provider	Context	Input	Output
OpenRouter`openrouter/meta-llama/llama-3.2-3b-instruct`	131K	$0.05/M	$0.33/M
Inference.net`inference_net/llama-3.2-3b-instruct`	131K	$0.05/M	$0.33/M
Parasail`parasail/meta-llama/Llama-3.2-3B-Instruct`	131K	$0.05/M	$0.33/M
Parasail`parasail/parasail-llama-32-3b-instruct`	131K	$0.05/M	$0.33/M
TogetherAIBYOK only`together_ai/meta-llama/Llama-3.2-3B-Instruct`	131K	$0.06/M	$0.06/M

Llama 3.2 3B Instruct

Providers

Certified where it counts.

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps