Skip to main content
Launching the open-source gateway

AI evaluation platform

Know when your agent gets it wrong.

Code checks, LLM judges and human review score your test sets and live traffic.

Get API keyRead the docs
Is my order delayed?support_agentquality passed
Can I change my shipping address?support_agentquality passed
Where is my refund?refund_agentquality passed
Do you ship to Canada?quality · contradicts policyfailed
Cancel my subscriptionbilling_agentquality passed
Track order 4812support_agentquality passed
Update my cardbilling_agentquality passed
AlphaSense
Mem0
Whatnot
Mercor
Gumloop
Retell AI
Proximal
Datacurve
Freebuff
Command Code
Algolia
Features

Respan scores every change, before and after you ship.

01

Evaluators

Code checks, LLM judges and human review roll up to one score.

qualityevaluatora91c3e0
in
Do you ship to Canada?
out
Sorry, we only ship within the US.
Code checkpython · under 600 characterspassed
LLM judgeclaude-opus-5-5 · follows policyfailed
Human reviewsupport team · ground truthfailed
Scorequality checkFailed
02

Experiments

Run two versions on real cases. Ship the one that wins.

support_agentprompt v3 vs v450 cases from production
Where is my refund?
Do you ship to Canada?failed
Cancel my subscription
Track order 4812
Apply my promo codefailed
Update my card
Return a damaged itemfailedfailed
Can I change my shipping address?
Talk to a human
03

Monitoring

Alerts on errors, cost and user frustration.

BehaviorsLiveuser frustrationrefund requestsoff-topicSignalsIssuesLatencyCostUptime1h agonow
429 rate limitedgpt-6.1-sol · alert senterror rate above threshold
07Customers

AI teams scale to hundreds of millions of requests on Respan.

All customer stories
“We scaled from 5M to 500M+ monthly API calls quickly. Respan gave us the debugging layer to resolve production issues 10x faster.”
Read story
Zexia ZhangCTO
“Imagine jumping to a log immediately after every LLM call. This is the dream for debugging.”
Daniel WolfProduct lead
“Respan has been key in helping us scale to hundreds of millions of requests with reliable observability into our LLM calls and failure rates.”
Read story
Deshraj YadavCo-founder and CTO

Know it works before you ship.

Get API keyRead the docs