Evals
Scores live traces, flags the bad ones.
See every step of every call.
Traces, evals, metrics and alerts for every agent.
gpt-6.1-sol · 768 tokens · $0.0013
Scores live traces, flags the bad ones.
Failedquality check
Why it failed
The reply says Acme doesn’t ship to Canada. The shipping policy lists Canada, 5 to 8 business days.
Passedquality check
Rationale
The reply answers the question and follows policy.
Last hour92% passed · 4 failed
1h agonow
Spot a spike, open its requests.
Ask in SQL, plain English or your terminal.
1SELECT timestamp, customer_identifier,2 total_request_tokens, latency, cost3FROM logs4WHERE model = 'gpt-6.1-sol'5 AND cost > 0.016 AND timestamp >= now() - INTERVAL 1 HOUR7ORDER BY cost DESC8LIMIT 8
Which gpt-6.1-sol calls cost the most in the last hour?
Model is gpt-6.1-sol, cost over $0.01, last hourMost expensive first · 8 requests back
Eight calls cost over $0.01, all long support threads. The top one used 18.4K tokens.
$npm install -g @respan/cli$respan auth login$respan logs list \ --filter model::gpt-6.1-sol \ --filter cost:gt:0.01 \ --sort-by -cost --limit 8
$claude mcp add --transport http --scope user \ respan https://mcp.respan.ai/mcp
>What were my 8 most expensive gpt-6.1-sol calls in the last hour?
respan · log_list
8 requests
8 rows · 182 ms
Alerts on errors, cost and user frustration.
Hi, I’m Jane DoeName. My card 4242 4242 4242 4242Card was charged twice.Not saved
Sorry Jane, I’ve refunded card 4242.Sorry, I’ve refunded the charge.Not saved
412 tokens · $0.0013 · 1.21sNot saved
“We scaled from 5M to 500M+ monthly API calls quickly. Respan gave us the debugging layer to resolve production issues 10x faster.”Read story
“This one felt pretty nice.”
“Imagine jumping to a log immediately after every LLM call. This is the dream for debugging.”
Watch film“Respan legit has some of the best UX/DX I’ve ever seen in my life. I truly don’t think I’ve ever integrated a product that was as easy.”
“Respan has been key in helping us scale to hundreds of millions of requests with reliable observability into our LLM calls and failure rates.”Read story
“Great product, really love the metrics dashboard.”