Respan
Nested traces for every LLM call, tool run, and agent turn
Respan Gateway: up to 55% off tokens on Gemini, GPT, Claude and 1,000+ more models. One API key, 0% fee.
Phoenix is the open-source observability and evaluation platform built by Arize AI for LLM and agent applications. It is OpenTelemetry-native, which means traces written through Phoenix can flow into any OTel-compatible backend in addition to Phoenix's own UI. The platform includes built-in evaluators for hallucination detection, retrieval relevance, and QA correctness, plus dataset management and prompt playground features. Phoenix can be deployed via Docker for self-hosting or used in Arize's managed cloud. The open-source core makes it attractive to teams that want to inspect and customize the observability layer, while the integration with the full Arize platform provides an upgrade path for organizations that need enterprise features like RBAC, SSO, and SLA-backed support.
Core capabilities this platform advertises.
What this tool does well, and the limitations to keep in mind.
Pros
Cons
Engineering teams building agent and RAG systems who want OpenTelemetry-native observability with both self-hosted and managed options
Respan lets you trace LLM and agent calls across any model or framework, A/B test prompts on production traffic, and route requests across 1,000+ models through one gateway.
Top companies in Observability, Prompts & Evals you can use instead of Phoenix.
Respan
Nested traces for every LLM call, tool run, and agent turn
LangSmith
Native tracing for LangChain and LangGraph
MLflow
OpenTelemetry-based tracing for LLMs and agents
Weights & Biases
ML experiment tracking
Arize AI
ML observability with LLM support
Langfuse
Tracing for LLM calls, tool runs, and agent steps
Helicone
Traceloop
OpenTelemetry
Datadog LLM
LLM monitoring within Datadog platform
Braintrust
Experiments comparing prompts and models
HoneyHive
Prompt management
Promptfoo
Patronus AI
Automated LLM evaluation platform
Portkey
Humanloop
DeepEval
Sentry
Ragas
RAG-specific evaluation framework
LangWatch
Multi-turn agent simulation testing
Galileo AI
LLM output quality evaluation
PromptLayer
Confident AI
DeepEval open-source evaluation framework
Maxim AI
Distributed tracing for LLM and agent apps
Opik
Agenta
Future AGI
Multimodal evaluation (text, image, audio, video)
Lunary
Parea AI
Ashr
Multi-modal synthetic testing
Sentrial
Agent failure root cause analysis
Moda
Hallucination detection
Athina AI
Chamber
ML infrastructure automation
Fiddler AI
Agentic observability across multi-step agent workflows
AgentOps
Session replay with time-travel debugging
Prefactor
Traces and spans for every agent run, with cost and data risk per step
Laminar
Agent tracing with a readable transcript view
OpenObserve
Logs, metrics, traces, RUM, and session replay
Side-by-side comparisons with other tools in this category.
Companies from adjacent layers in the AI stack that work well with Phoenix.