Works with your entire stack
Use Respan with your favorite frameworks and tools.
The GPT-3.5 Turbo (currently points to gpt-3.5-turbo-0125. ) is OpenAI's advanced model designed for rapid performance in both understanding and generating text. Optimized for interactive chat and comprehensive text completion tasks, it seamlessly processes natural language and code. This version of GPT-3.5 Turbo delivers enhanced accuracy in generating responses in diverse formats, effectively addressing previous encoding issues with non-English languages. The model supports a context size of 16,385 tokens and a maximum of 4,096 output tokens, providing substantial flexibility for various applications. Training data for this model cuts off in September 2021. For additional details on the capabilities and updates of the GPT-3.5 Turbo, you can visit OpenAI's resource [here](https://platform.openai.com/docs/models/gpt-3-5-turbo).
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openai/gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["gpt-3.5-turbo"], },)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openai/gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["gpt-3.5-turbo"], },)print(response.choices[0].message.content)Gateway routes for this model on the Respan gateway, including fallback routes when configured.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| openai/gpt-3.5-turbo | 16K | $0.50/M | $1.50/M | — | 1.4s | 6tps |
Other models from the same provider available through the gateway.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| openai/babbage-002 | 16K | $0.40/M | $0.40/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/chat-latest | 400K | $5.00/M | $30.00/M | Read:$0.50/MWrite:$0.00/M | — | +2 | — |
| openai/davinci-002 | 16K | $2.00/M | $2.00/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-3.5-turbo-0125 | 16K | $0.50/M | $1.50/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-3.5-turbo-1106 | 16K | $0.50/M | $1.50/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-3.5-turbo-instruct | 4K | $1.50/M | $2.00/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-4 | 8K | $30.00/M | $60.00/M | — | 1.9s | 5tps | |
| openai/gpt-4-0613 | 8K | $30.00/M | $60.00/M | — | 1.2s | 8tps | |
| openai/gpt-4-turbo | 128K | $10.00/M | $30.00/M | Read:$0.00/MWrite:$0.00/M | 1.4s | 6tps | |
| openai/gpt-4-turbo-2024-04-09 | 128K | $10.00/M | $30.00/M | — | 1.8s | 5tps | |
| openai/gpt-4.1 | 1M | $2.00/M | $8.00/M | — | 1.0s | 87tps | |
| openai/gpt-4.1-2025-04-14 | 1M | $2.00/M | $8.00/M | — | 0.5s | 19tps |
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Use Respan with your favorite frameworks and tools.