Works with your entire stack
Use Respan with your favorite frameworks and tools.
Meta.Llama3 8b Instruct V1:0 is an open-weight Llama-class model commonly used for chat, fine-tuning, and on-prem or hosted inference. Meta.Llama3 8b Instruct V1:0 is an open-weight Llama-class model commonly used for chat, fine-tuning, and on-prem or hosted inference. Supports explicit caching and implicit caching. Up to 8K context window.
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="bedrock/meta.llama3-8b-instruct-v1:0", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="bedrock/meta.llama3-8b-instruct-v1:0", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)Gateway routes for this model on the Respan gateway, including fallback routes when configured.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| bedrock/meta.llama3-8b-instruct-v1:0 | 8K | $0.30/M | $0.60/M | Read:$0.00/MWrite:$0.00/M | — | — |
Other models from the same provider available through the gateway.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| bedrock/amazon.nova-lite-v1:0 | 300K | $0.06/M | $0.24/M | Read:$0.01/MWrite:$0.00/M | — | +2 | — |
| bedrock/deepseek.v3-v1:0 | 164K | $0.58/M | $1.68/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| bedrock/deepseek.v3.2 | 164K | $0.62/M | $1.85/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| bedrock/global.amazon.nova-2-lite-v1:0 | 1M | $0.30/M | $2.50/M | Read:$0.07/MWrite:$0.00/M | — | +2 | — |
| bedrock/global.anthropic.claude-haiku-4-5-20251001-v1:0 | 200K | $1.00/M | $5.00/M | Read:$0.10/MWrite:$1.25/M | — | +2 | — |
| bedrock/global.anthropic.claude-opus-4-5-20251101-v1:0 | 200K | $5.00/M | $25.00/M | Read:$0.50/MWrite:$6.25/M | — | +2 | — |
| bedrock/global.anthropic.claude-opus-5-5 | 1M | $4.00/M | $20.00/M | Read:$0.20/MWrite:$5.00/M | — | +2 | — |
| bedrock/global.anthropic.claude-sonnet-4-20250514-v1:0 | 200K | $3.00/M | $15.00/M | Read:$0.30/MWrite:$3.75/M | — | +2 | — |
| bedrock/global.anthropic.claude-sonnet-4-5-20250929-v1:0 | 200K | $3.00/M | $15.00/M | Read:$0.30/MWrite:$3.75/M | — | +2 | — |
| bedrock/global.anthropic.claude-sonnet-5-5 | 1M | $2.00/M | $10.00/M | Read:$0.20/MWrite:$2.50/M | — | +2 | — |
| bedrock/global.moonshotai.kimi-k3 | 1M | $3.00/M | $15.00/M | Read:$0.30/MWrite:$3.75/M | — | +2 | — |
| bedrock/global.openai.gpt-5.6-luna | 1.1M | $0.20/M | $1.20/M | Read:$0.02/MWrite:$0.25/M | — | — |
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Use Respan with your favorite frameworks and tools.