Skip to main content

Enterprise AI gateway and observability

Every model call, on your terms.

Cloud or self-hosted. SAML SSO and admin roles, SOC 2, HIPAA BAA and custom SLAs.

emily.carter@acme.com · Member7 of 8 rooms

acme.com · SAML
AlphaSense
Mem0
Whatnot
Mercor
Gumloop
Retell AI
Govly
Datacurve
Freebuff
Command Code
Algolia
06Security

SOC 2 audited, ISO 27001 certified, HIPAA with a BAA, GDPR compliant.

SOC 2 · Independent audit of our security controls. Report on request.

  • Enterprise
Request the SOC 2 report
05Data

You choose what Respan keeps, and for how long.

Explore observability
Logging
Saves the whole request
PII redactionHides 17 kinds of personal data from the model
Retention
Set per project, up to your plan’s window: 30 days on Free and Team
ExportCSV or JSONL, once or every 15 minutes
OpenAIgpt-6.1-solAES-256 at rest · TLS 1.2+
Prompt

Hi, I’m Jane Doe. My card 4242 4242 4242 4242 was charged twice.

Reply

Sorry, I’ve refunded the charge.

Metrics

412 tokens · $0.0013 · 1.21s

In Respan30 daysDeleted Nov 28
Your exportYours to keep
Features

Respan keeps every call private, running and on budget.

01

PII masking

Masks personal data before the model sees it.

you send

Refund order 8841 for Jane Doe, card 4242 4242 4242 4242, receipt to jane@acme.com.

model sees

Refund order 8841 for , card , receipt to .

3 masked · name, card, emailnone reached the model

02

Fallbacks and retries

When a provider goes down, calls move to the next one.

This callUptimeDowntime / monthAnthropic directly429 · failed99.78%~1.6 hThrough Respan200 · 1.81s99.9999%~2 s
claude-opus-5-5429 · 3 tries · 0.85s
gpt-6.1-sol200 · 0.96s
glm-5.3-primestandby
03

Load balancing

Spread load across providers and your own keys.

claude-sonnet-5-540%
Anthropic20%
Amazon Bedrock10%
Vertex AI10%
gpt-6.1-sol40%
Primary key20%
Overflow key10%
Batch key10%
gemini-3.8-flash20%
Google20%
04

Budgets per customer

Each customer’s calls stop at the budget you set.

acme-corp$482.10 / $50096%
globex$1,000 / $1,000blocked
hooli$388.00 / $2,00019%
initech$212.40 / $1,00021%
umbrella$64.90 / $25025%
02Performance

Respan Gateway beats LiteLLM on throughput, latency and memory.

Explore the AI gateway
07Customers

AI teams scale to hundreds of millions of requests on Respan.

All customer stories
“We scaled from 5M to 500M+ monthly API calls quickly. Respan gave us the debugging layer to resolve production issues 10x faster.”
Read story
Zexia ZhangCTO
“Imagine jumping to a log immediately after every LLM call. This is the dream for debugging.”
Daniel WolfProduct lead
“Respan has been key in helping us scale to hundreds of millions of requests with reliable observability into our LLM calls and failure rates.”
Read story
Deshraj YadavCo-founder and CTO

Bring us your security review.