Respan
LLM tracing, evals, and gateway
Phoenix is the open-source observability and evaluation platform built by Arize AI for LLM and agent applications. It is OpenTelemetry-native, which means traces written through Phoenix can flow into any OTel-compatible backend in addition to Phoenix's own UI. The platform includes built-in evaluators for hallucination detection, retrieval relevance, and QA correctness, plus dataset management and prompt playground features. Phoenix can be deployed via Docker for self-hosting or used in Arize's managed cloud. The open-source core makes it attractive to teams that want to inspect and customize the observability layer, while the integration with the full Arize platform provides an upgrade path for organizations that need enterprise features like RBAC, SSO, and SLA-backed support.
Core capabilities this platform advertises.
What this tool does well, and the limitations to keep in mind.
Pros
Cons
Engineering teams building agent and RAG systems who want OpenTelemetry-native observability with both self-hosted and managed options
Top companies in Observability, Prompts & Evals you can use instead of Phoenix.
Side-by-side comparisons with other tools in this category.
Companies from adjacent layers in the AI stack that work well with Phoenix.
Respan lets you trace LLM and agent calls across any model or framework, A/B test prompts on production traffic, and route requests across 1,000+ models through one gateway.
LangSmith vs Phoenix