Quickstart

pip install respan-gateway

This installs the respan-gateway command. To use cargo, a release binary or Docker instead, see Install.

respan-gateway --version

Export a key for each provider you want to use:

export OPENAI_API_KEY="sk-..."
export ANTHROPIC_API_KEY="sk-ant-..."

The gateway also reads the nearest .env file in the current directory or its parents. Variables already set in your shell win over .env. Other vendors use their own variables, such as GEMINI_API_KEY or GROQ_API_KEY; see Providers.

respan-gateway

It listens on 127.0.0.1:8080 and prints the providers it found, the endpoints it serves, and the web UI’s address. To use another address, pass --listen, such as --listen 9000.

curl http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-6-luna",
    "messages": [{"role": "user", "content": "Say hello"}]
  }'

from openai import OpenAI

client = OpenAI(base_url="http://localhost:8080/v1", api_key="unused")
reply = client.chat.completions.create(
    model="claude-haiku-5-5",
    messages=[{"role": "user", "content": "Say hello"}],
)
print(reply.choices[0].message.content)

With no client keys set, any API key value works, and the gateway only answers on loopback. To require keys, see Client keys.

Open localhost:8080/ui/ . The request log shows each call with its provider, model, latency, tokens and cost.