Developer (Free)
Free
- All platform features
- 50K logs/month
- 14-day data retention
- 2 users
- 3 Scenarios + 3 Simulations
- Community support
Respan Gateway: up to 55% off tokens on Gemini, GPT, Claude and 1,000+ more models. One API key, 0% fee.
LangWatch is an open-source LLMOps platform focused on testing, evaluating, and monitoring AI agents. Founded in 2023 in Amsterdam by Rogerio Chaves (CTO, ex-Booking.com, ex-Lightspeed) and Manouk Draisma (CEO), the company raised EUR 1M in pre-seed funding led by Passion Capital with participation from Volta Ventures and Antler.
LangWatch's standout differentiator is its Scenario framework — an open-source agent testing library (804 GitHub stars) that enables multi-turn, simulation-based testing of AI agents. Unlike static input/output evaluations, Scenario provides a User Simulator Agent that generates realistic conversations against your agent, with a Judge Agent evaluating pass/fail at every turn. Available in Python, TypeScript, and Go, it works with any agent framework (LangGraph, CrewAI, Pydantic AI, OpenAI, Vercel AI SDK, Google ADK).
The platform combines OpenTelemetry-native tracing, custom evaluators with real-time scoring, prompt and model management with version control, and dataset management that converts production traces into reusable test cases. LangWatch processes 900K+ daily evaluations, has 780K+ monthly package installs, and holds ISO 27001 and SOC2 certifications. It supports self-hosted deployment via Docker and Kubernetes with no feature gating.
Core capabilities this platform advertises.
What this tool does well, and the limitations to keep in mind.
Pros
Cons
What's included in each plan, and how the tiers compare.
Free
€59/seat/month
Monthly
Custom
Contact sales for a quote
AI teams building and testing LLM-powered agents
LangWatch and Respan serve complementary roles in the AI observability stack. LangWatch excels at pre-production agent testing and evaluation through its simulation framework, while Respan provides production-grade LLM monitoring, cost tracking, and gateway management. Together they cover the full agent lifecycle from testing to production.
Respan lets you trace LLM and agent calls across any model or framework, A/B test prompts on production traffic, and route requests across 1,000+ models through one gateway.
Top companies in Observability, Prompts & Evals you can use instead of LangWatch.
Respan
Nested traces for every LLM call, tool run, and agent turn
LangSmith
Native tracing for LangChain and LangGraph
MLflow
OpenTelemetry-based tracing for LLMs and agents
Weights & Biases
ML experiment tracking
Arize AI
ML observability with LLM support
Langfuse
Tracing for LLM calls, tool runs, and agent steps
Helicone
Traceloop
OpenTelemetry
Datadog LLM
LLM monitoring within Datadog platform
Braintrust
Experiments comparing prompts and models
HoneyHive
Prompt management
Promptfoo
Patronus AI
Automated LLM evaluation platform
Phoenix
OpenTelemetry-based LLM and agent tracing
Humanloop
Portkey
DeepEval
Ragas
RAG-specific evaluation framework
Sentry
Galileo AI
LLM output quality evaluation
PromptLayer
Confident AI
DeepEval open-source evaluation framework
Maxim AI
Distributed tracing for LLM and agent apps
Opik
Agenta
Future AGI
Multimodal evaluation (text, image, audio, video)
Lunary
Parea AI
Ashr
Multi-modal synthetic testing
Sentrial
Agent failure root cause analysis
Moda
Hallucination detection
Athina AI
Chamber
ML infrastructure automation
Fiddler AI
Agentic observability across multi-step agent workflows
Laminar
Agent tracing with a readable transcript view
OpenObserve
Logs, metrics, traces, RUM, and session replay
AgentOps
Session replay with time-travel debugging
Prefactor
Traces and spans for every agent run, with cost and data risk per step
Side-by-side comparisons with other tools in this category.
Companies from adjacent layers in the AI stack that work well with LangWatch.
Last verified: March 27, 2026