Question 1

What is Llama 3.2 1B Instruct?

Accepted Answer

Llama 3.2 1B Instruct is a model from Meta, released on Sep 25, 2024. Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows it to operate efficiently in low-resource environments while maintaining strong task performance. Supporting eight core languages and fine-tunable for more, Llama 1.3B is ideal for businesses or developers seeking lightweight yet powerful AI solutions that can operate in diverse multilingual settings without the high computational demand of larger models. Click here for the original model card. Usage of this model is subject to Meta's Acceptable Use Policy.

Question 2

How much does Llama 3.2 1B Instruct cost?

Accepted Answer

On the Respan gateway, input starts at $0.02 per 1M tokens on Novita, and output starts at $0.02 per 1M tokens on Novita, after gateway discounts. Averaged across 4 providers, it costs $0.03 per 1M input tokens and $0.12 per 1M output tokens.

Question 3

Which providers serve Llama 3.2 1B Instruct on Respan?

Accepted Answer

4 providers serve Llama 3.2 1B Instruct: Novita, Inference.net, OpenRouter, and TogetherAI. TogetherAI requires your own provider API key (BYOK).

Question 4

What is Llama 3.2 1B Instruct's context window?

Accepted Answer

Llama 3.2 1B Instruct accepts up to 131K tokens of context on its largest provider route.

Question 5

How do I use Llama 3.2 1B Instruct with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "llama-3.2-1b-instruct". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is Llama 3.2 1B Instruct?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was OpenRouter at 48 tokens per second, and the lowest response latency was 0.3 seconds on OpenRouter. Speed varies with request size and provider.

Provider	Context	Input	Output	Capabilities
NovitaSave 10%`novita/meta-llama/llama-3.2-1b-instruct`	131K	$0.02/M	$0.02/M	—
Inference.net`inference_net/llama-3.2-1b-instruct`	60K	$0.03/M	$0.20/M
OpenRouter`openrouter/meta-llama/llama-3.2-1b-instruct`	60K	$0.03/M	$0.20/M
TogetherAIBYOK only`together_ai/meta-llama/Llama-3.2-1B-Instruct`	131K	$0.06/M	$0.06/M

Llama 3.2 1B Instruct

Providers

Certified where it counts.

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps