Hermes Agent (gateway)

Route Hermes Agent ’s LLM calls through the Respan gateway for automatic logging, caching, and model switching. Hermes talks to any OpenAI-compatible endpoint, so only your RESPAN_API_KEY is needed.

Paste this into your coding agent:


Help me set up the Respan gateway with the Hermes Agent integration.
Follow https://www.respan.ai/docs/integrations/gateway/hermes-agent.md

Setup

Install Hermes Agent

Terminal


curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash

On Windows PowerShell:

PowerShell


iex (irm https://hermes-agent.nousresearch.com/install.ps1)

Point Hermes at the Respan gateway

Edit ~/.hermes/config.yaml and set a custom OpenAI-compatible provider:

YAML


model:
  default: gpt-4o
  provider: custom
  base_url: "https://gateway.respan.ai"
  api_key: "YOUR_RESPAN_API_KEY"

Or run the interactive picker, choose Custom endpoint (self-hosted / VLLM / etc.), and enter the same base URL, key, and model name:

Terminal


hermes model

No separate provider key needed. The Respan gateway handles provider authentication.

Run Hermes

Terminal


hermes

For a one-shot, non-interactive run:

Terminal


hermes chat -q "your prompt" --oneshot

All LLM calls now route through Respan.

Set the gateway in config.yaml (or with hermes model), not through OPENAI_BASE_URL and OPENAI_API_KEY. Hermes only reads those variables for its openai-api provider, which sends OpenAI-only parameters such as reasoning.effort and fails on non-reasoning models.

Switch models

Change model.default in ~/.hermes/config.yaml to use any of the 1000+ models available through the gateway.

YAML


model:
  default: gpt-4o
  # default: claude-sonnet-4-5-20250929
  # default: gemini/gemini-3.5-flash

See the full model list .