Works with your entire stack
Use Respan with your favorite frameworks and tools.
GPT-4o mini is OpenAI's newest model after GPT-4 Omni, supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable than other recent frontier models, and more than 60% cheaper than GPT-3.5 Turbo. It maintains SOTA intelligence, while being significantly more cost-effective. GPT-4o mini achieves an 82% score on MMLU and presently ranks higher than GPT-4 on chat preferences common leaderboards. Check out the launch announcement to learn more. #multimodal
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openai/gpt-4o-mini-2024-07-18", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["gpt-4o-mini-2024-07-18"], },)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openai/gpt-4o-mini-2024-07-18", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["gpt-4o-mini-2024-07-18"], },)print(response.choices[0].message.content)Gateway routes for this model on the Respan gateway, including fallback routes when configured.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| openai/gpt-4o-mini-2024-07-18 | 128K | $0.15/M | $0.60/M | Read:$0.07/MWrite:— | 0.5s | 17tps |
Other models from the same provider available through the gateway.
| Model | Capabilities | ||||||
|---|---|---|---|---|---|---|---|
| openai/babbage-002 | 16K | $0.40/M | $0.40/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/chat-latest | 400K | $5.00/M | $30.00/M | Read:$0.50/MWrite:$0.00/M | — | +2 | — |
| openai/davinci-002 | 16K | $2.00/M | $2.00/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-3.5-turbo | 16K | $0.50/M | $1.50/M | — | 1.4s | 6tps | |
| openai/gpt-3.5-turbo-0125 | 16K | $0.50/M | $1.50/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-3.5-turbo-1106 | 16K | $0.50/M | $1.50/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-3.5-turbo-instruct | 4K | $1.50/M | $2.00/M | Read:$0.00/MWrite:$0.00/M | — | — | |
| openai/gpt-4 | 8K | $30.00/M | $60.00/M | — | 1.9s | 5tps | |
| openai/gpt-4-0613 | 8K | $30.00/M | $60.00/M | — | 1.2s | 8tps | |
| openai/gpt-4-turbo | 128K | $10.00/M | $30.00/M | Read:$0.00/MWrite:$0.00/M | 1.4s | 6tps | |
| openai/gpt-4-turbo-2024-04-09 | 128K | $10.00/M | $30.00/M | — | 1.8s | 5tps | |
| openai/gpt-4.1 | 1M | $2.00/M | $8.00/M | — | 1.0s | 87tps |
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Use Respan with your favorite frameworks and tools.