Skip to main content

AI observability

See every step of every call.

Traces, evals, metrics and alerts for every agent.

load_context0.17s
classify_intent0.58s
openai.chat0.57s
retrieve_policies0.40s
query_points0.38s
resolution_agent1.79s
lookup_order0.07s
GET /v1/orders64ms
openai.chat1.70s
check_reply0.10s
AlphaSense
Mem0
Whatnot
Mercor
Gumloop
Retell AI
Govly
Datacurve
Freebuff
Command Code
Algolia
Features

Respan traces every call and flags the bad ones.

01

Evals

Scores live traces, flags the bad ones.

Is my order delayed?support_agentquality passed
Can I change my shipping address?support_agentquality passed
Where is my refund?refund_agentquality passed
Do you ship to Canada?quality · contradicts policyfailed
Cancel my subscriptionbilling_agentquality passed
Track order 4812support_agentquality passed
Update my cardbilling_agentquality passed
02

Metrics

Spot a spike, open its requests.

Requests
Errors
Error rate
Cost
03

Query

Ask in SQL, plain English or your terminal.

SQL editor
1SELECT timestamp, customer_identifier,2       total_request_tokens, latency, cost3FROM logs4WHERE model = 'gpt-6.1-sol'5  AND cost > 0.016  AND timestamp >= now() - INTERVAL 1 HOUR7ORDER BY cost DESC8LIMIT 8
expensive gpt-6.1-sol calls in the last hour
Last hourModelisgpt-6.1-solCost>0.01

Which gpt-6.1-sol calls cost the most in the last hour?

Model is gpt-6.1-sol, cost over $0.01, last hourMost expensive first · 8 requests back

Eight calls cost over $0.01, all long support threads. The top one used 18.4K tokens.

$npm install -g @respan/cli$respan auth login$respan logs list \  --filter model::gpt-6.1-sol \  --filter cost:gt:0.01 \  --sort-by -cost --limit 8
$claude mcp add --transport http --scope user \  respan https://mcp.respan.ai/mcp
Claude Code

>What were my 8 most expensive gpt-6.1-sol calls in the last hour?

respan · log_list

8 requests

14:09:32cus_566e9018.4K4.12s$0.0312
13:51:07cus_8a1f0215.0K3.64s$0.0253
14:00:44cus_3c77b511.3K3.05s$0.0191
13:27:15cus_d2490e9.1K2.71s$0.0153
13:40:58cus_71b3c87.6K2.48s$0.0129
13:58:21cus_b4e2177.0K2.31s$0.0118
13:33:46cus_09fa636.4K2.19s$0.0109
14:05:13cus_6d82c06.1K2.06s$0.0103

8 rows · 182 ms

04

Monitoring

Alerts on errors, cost and user frustration.

BehaviorsLiveuser frustrationrefund requestsoff-topicSignalsIssuesLatencyCostUptime1h agonow
429 rate limitedgpt-6.1-sol · alert senterror rate above threshold
05Data

You choose what Respan keeps, and for how long.

Explore observability
Logging
Saves the whole request
PII redactionHides 17 kinds of personal data from the model
Retention
Set per project, up to your plan’s window: 30 days on Free and Team
ExportCSV or JSONL, once or every 15 minutes
OpenAIgpt-6.1-solAES-256 at rest · TLS 1.2+
Prompt

Hi, I’m Jane Doe. My card 4242 4242 4242 4242 was charged twice.

Reply

Sorry, I’ve refunded the charge.

Metrics

412 tokens · $0.0013 · 1.21s

In Respan30 daysDeleted Nov 28
Your exportYours to keep
07Customers

AI teams scale to hundreds of millions of requests on Respan.

All customer stories
“We scaled from 5M to 500M+ monthly API calls quickly. Respan gave us the debugging layer to resolve production issues 10x faster.”
Read story
Zexia ZhangCTO
“Imagine jumping to a log immediately after every LLM call. This is the dream for debugging.”
Daniel WolfProduct lead
“Respan has been key in helping us scale to hundreds of millions of requests with reliable observability into our LLM calls and failure rates.”
Read story
Deshraj YadavCo-founder and CTO

Catch the bad answer before your users do.