Skip to Content
Launching the open-source gateway

Providers

Every provider the gateway calls, and how to pick one.

Change the provider

A model name such as gpt-5.5 can be served by any provider that has it. Put a provider’s prefix in front, such as azure/gpt-5.5, to keep the call on that provider.

Terminal
curl https://gateway.respan.ai/v1/chat/completions \ -H "Authorization: Bearer $RESPAN_API_KEY" \ -H "Content-Type: application/json" \ -d '{"model": "azure/gpt-5.5", "messages": [{"role": "user", "content": "Hello!"}]}'

Provider list

Put a provider’s pin prefix in front of a model ID to keep the call on that provider. To run on your own account with a provider, add its key under API keys › BYOK (Team and above); your own keys serve first.

ProviderPin prefixYour own key needs
OpenAIopenai/API key
Anthropicanthropic/API key
Google Geminigemini/API key
xAIxai/API key
AWS Bedrockbedrock/AWS access key, secret key, region
Google Vertex AIvertex_ai/Project, location, service account JSON
Azure OpenAIazure/API key, endpoint URL, API version
Mistralmistral/API key
DeepSeekdeepseek/API key
Groqgroq/API key
Coherecohere/API key
Perplexityperplexity/API key
Together AItogetherai/API key
Fireworks AIfireworks/API key
Cerebrascerebras/API key
OpenRouteropenrouter/API key
Replicatereplicate/API key
Basetenbaseten/API key, endpoint URL
Moonshotmoonshot/API key
Nebiusnebius/API key
Novita AInovita/API key
FriendliAIfriendliai/Endpoint URL, API key
Parasailparasail/Endpoint URL, API key
Teratera/Endpoint URL, API key
Inference.netinference_net/API key, endpoint URL
AI21 Labsai21_labs/API key
Waferwafer/Endpoint URL, API key
Nextbitnextbit256/API key, endpoint URL
TypeSafetypesafe/API key
Azure DeepSeekazure_deepseek/API key, endpoint URL
Google PaLMgoogle_palm/API key
CustomThe provider ID you setEndpoint URL, API key

Custom providers

To call a self-hosted or other OpenAI-compatible endpoint, go to API keys › BYOK, click New custom provider, and enter a Provider ID, a Provider name, and the endpoint’s Base URL, which must be a public address. Add its key with Add deployment. Then, for each model it serves, go to Gateway › Models, click New custom model, pick your provider, and send the Model ID the dialog shows as model.

Become a Respan provider

To offer your models to everyone on Respan, reach out to team@respan.ai.