Works with your entire stack
Use Respan with your favorite frameworks and tools.
Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it supports eight languages, including English, Spanish, and Hindi, and is adaptable for additional languages. Trained on 9 trillion tokens, the Llama 3.2 3B model excels in instruction-following, complex reasoning, and tool use. Its balanced performance makes it ideal for applications needing accuracy and efficiency in text generation across multilingual settings. Click here for the original model card. Usage of this model is subject to Meta's Acceptable Use Policy.
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="inference_net/llama-3.2-3b-instruct", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="inference_net/llama-3.2-3b-instruct", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)Gateway routes for this model on the Respan gateway, including fallback routes when configured.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| inference_net/llama-3.2-3b-instruct | 131K | $0.05/M | $0.33/M | Read:$0.00/MWrite:$0.00/M | — | — |
Other models from the same provider available through the gateway.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| inference_net/deepseek-v3.2 | 164K | $0.70/M | $2.00/M | Read:$0.35/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-flash | 1M | $0.23/M | $0.62/M | Read:$0.0028/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-flash-0731 | 1.0M | $0.53/M | $1.58/M | Read:$0.02/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-pro | 1.0M | $2.10/M | $4.20/M | Read:$0.0036/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-pro-0813 | 1.0M | $1.32/M | $3.96/M | Read:$0.04/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4.1-flash | 1.0M | $0.30/M | $1.00/M | Read:$0.0070/MWrite:$0.00/M | — | — | |
| inference_net/gemini-2.5-flash | 1.0M | $0.30/M | $2.50/M | Read:$0.03/MWrite:$0.00/M | — | — | |
| inference_net/gemini-2.5-flash-lite | 1.0M | $0.10/M | $0.40/M | Read:$0.01/MWrite:$0.00/M | — | — | |
| inference_net/gemini-2.5-pro | 1.0M | $1.25/M | $10.00/M | Read:$0.13/MWrite:$0.00/M | — | — | |
| inference_net/gemini-3-flash-preview | 1.0M | $0.50/M | $3.00/M | Read:$0.05/MWrite:$0.00/M | — | — | |
| inference_net/gemini-3.1-flash-lite | 1.0M | $0.25/M | $1.50/M | Read:$0.03/MWrite:$0.00/M | — | — | |
| inference_net/gemini-3.1-pro-preview | 1.0M | $2.00/M | $12.00/M | Read:$0.20/MWrite:$0.00/M | — | — |
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Use Respan with your favorite frameworks and tools.