Works with your entire stack
Use Respan with your favorite frameworks and tools.
The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks. Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Model Card
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="inference_net/llama-3.3-70b-instruct", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="inference_net/llama-3.3-70b-instruct", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)Gateway routes for this model on the Respan gateway, including fallback routes when configured.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| inference_net/llama-3.3-70b-instruct | 131K | $0.13/M | $0.40/M | Read:$0.00/MWrite:$0.00/M | — | — |
Other models from the same provider available through the gateway.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| inference_net/deepseek-v3.2 | 164K | $0.70/M | $2.00/M | Read:$0.35/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-flash | 1M | $0.23/M | $0.62/M | Read:$0.0028/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-flash-0731 | 1.0M | $0.53/M | $1.58/M | Read:$0.02/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-pro | 1.0M | $2.10/M | $4.20/M | Read:$0.0036/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4-pro-0813 | 1.0M | $1.32/M | $3.96/M | Read:$0.04/MWrite:$0.00/M | — | — | |
| inference_net/deepseek-v4.1-flash | 1.0M | $0.30/M | $1.00/M | Read:$0.0070/MWrite:$0.00/M | — | — | |
| inference_net/gemini-2.5-flash | 1.0M | $0.30/M | $2.50/M | Read:$0.03/MWrite:$0.00/M | — | — | |
| inference_net/gemini-2.5-flash-lite | 1.0M | $0.10/M | $0.40/M | Read:$0.01/MWrite:$0.00/M | — | — | |
| inference_net/gemini-2.5-pro | 1.0M | $1.25/M | $10.00/M | Read:$0.13/MWrite:$0.00/M | — | — | |
| inference_net/gemini-3-flash-preview | 1.0M | $0.50/M | $3.00/M | Read:$0.05/MWrite:$0.00/M | — | — | |
| inference_net/gemini-3.1-flash-lite | 1.0M | $0.25/M | $1.50/M | Read:$0.03/MWrite:$0.00/M | — | — | |
| inference_net/gemini-3.1-pro-preview | 1.0M | $2.00/M | $12.00/M | Read:$0.20/MWrite:$0.00/M | — | — |
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Use Respan with your favorite frameworks and tools.