Skip to navigation

Route omp’s LLM calls through the Respan gateway for automatic logging, caching, and model switching. omp loads custom providers from ~/.oh-omp/agent/models.yml, so only your RESPAN_API_KEY is needed.

Setup

1

Install omp

curl -fsSL https://omp.sh/install | sh

Or install from npm, which exposes the binary as oh-omp:

npm install -g @oh-labs/oh-omp
2

Add Respan as a provider

Create or edit ~/.oh-omp/agent/models.yml:

providers:
respan:
baseUrl: https://api.respan.ai/api
apiKey: RESPAN_API_KEY
api: openai-completions
models:
- id: gpt-4o
name: GPT-4o
- id: claude-sonnet-4-5-20250929
name: Claude Sonnet 4.5

apiKey is the name of the environment variable that holds your key. Export it in your shell profile:

export RESPAN_API_KEY="YOUR_RESPAN_API_KEY"

No separate provider key needed. The Respan gateway handles provider authentication.

3

Run omp

omp --model respan/gpt-4o

For a one-shot, non-interactive run:

omp -p --model respan/gpt-4o "your prompt"

All LLM calls now route through Respan.

Switch models

Add more entries under models and pick any of them with --model respan/<id>. Any of the 1000+ models available through the gateway work, for example:

gpt-4o
claude-sonnet-4-5-20250929
gemini/gemini-3.5-flash

See the full model list.