# Respan Docs ## Instructions for AI Agents - For clean Markdown of any page, append `.md` to the page URL - For section-specific indexes, append `/llms.txt` to any section URL - For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://respan.ai/_mcp/server ## Docs - [Overview](https://respan.ai/docs/documentation/overview.md): Respan is the full-stack AI engineering platform for LLM and agent products: an AI gateway to 1000+ models, tracing and monitoring, prompt management, evaluations, and agent security testing, all on one span-based data model. - [Project settings](https://respan.ai/docs/documentation/admin/projects.md): Navigate project settings, manage project identity, and review high-impact controls. - [Collaborate](https://respan.ai/docs/documentation/admin/collaborate.md): Invite team members and assign roles to control access. - [API keys](https://respan.ai/docs/documentation/admin/respan-api-keys.md): Manage your Respan API keys. - [Provider keys](https://respan.ai/docs/documentation/admin/llm-provider-keys.md): Add your LLM provider credentials to use with the gateway. - [Data webhooks](https://respan.ai/docs/documentation/admin/webhooks.md): Send recorded span events to an external HTTPS endpoint. - [Billing and credits](https://respan.ai/docs/documentation/admin/credits-billing.md): Add Gateway credits, configure balance controls, or use your own provider credentials. - [Run a Red Team campaign](https://respan.ai/docs/documentation/red-team/run-assessment.md): Choose a connection method, verify access, and launch an authorized assessment. - [Review results and troubleshoot](https://respan.ai/docs/documentation/red-team/results.md): Follow a live Red Team campaign, interpret its report, and recover from common failures. - [MCP](https://respan.ai/docs/documentation/mcp.md): Access your Respan data and documentation from your AI coding tools. - [CLI](https://respan.ai/docs/documentation/cli.md): Manage your Respan observability from the command line. - [Respan Agent](https://respan.ai/docs/documentation/agent.md): Investigate telemetry, work with prompts, configure monitoring, and run evaluations through Respan AI. - [Tracing quickstart](https://respan.ai/docs/documentation/features/tracing/quickstart.md): Get your first trace in Respan in 5 minutes. - [Overview](https://respan.ai/docs/integrations/overview.md): Trace your LLM stack with Respan. - [OpenTelemetry (tracing)](https://respan.ai/docs/integrations/opentelemetry.md): Send traces from any OpenTelemetry-instrumented application to Respan. - [OpenAI Agents (tracing)](https://respan.ai/docs/integrations/openai-agents-sdk.md): Trace OpenAI Agents SDK workflows with Respan — auto-instrumented spans, gateway routing, and full observability. - [Claude Agent SDK (tracing)](https://respan.ai/docs/integrations/claude-agents-sdk.md): Trace Claude Agent SDK workflows with Respan using the Claude Agent SDK instrumentation plugin for Python and TypeScript. - [Vercel AI SDK (tracing)](https://respan.ai/docs/integrations/vercel-ai-sdk.md): Trace Vercel AI SDK calls with Respan — model calls, tool execution, token usage, and workflow context. - [Pydantic AI (tracing)](https://respan.ai/docs/integrations/pydantic-ai.md): Trace Pydantic AI agent runs with Respan — auto-instrumented spans, gateway routing, and full observability. - [CrewAI (tracing)](https://respan.ai/docs/integrations/crewai.md): Trace CrewAI workflows with canonical task, agent, tool, and chat spans, including model and token usage. - [Haystack (tracing)](https://respan.ai/docs/integrations/haystack.md): Trace Haystack pipelines with Respan - auto-instrumented pipeline, component, and LLM spans. - [LangChain (tracing)](https://respan.ai/docs/integrations/langchain.md): Trace LangChain workflows with Respan — callback spans, gateway routing, and full observability. - [LangGraph (tracing)](https://respan.ai/docs/integrations/langgraph.md): Trace LangGraph stateful agent workflows with Respan — callback spans, gateway routing, and full observability. - [Langflow (tracing)](https://respan.ai/docs/integrations/langflow.md): Trace Langflow visual AI workflows with Respan — callback spans, gateway routing, and full observability. - [Mirascope (tracing)](https://respan.ai/docs/integrations/mirascope.md): Trace Mirascope 2.x model calls, streams, context calls, and toolkit execution with Respan. - [LlamaIndex (tracing)](https://respan.ai/docs/integrations/llama-index.md): Trace LlamaIndex Core and standalone Workflows with Respan using one native instrumentation package. - [Temporal (tracing)](https://respan.ai/docs/integrations/temporal.md): Trace Temporal Python workflows, activities, signals, queries, and updates with Respan. - [AgentOps (tracing)](https://respan.ai/docs/integrations/agentops.md): Export AgentOps Python decorator spans through Respan with AgentOps-native operation details. - [OpenLIT (tracing)](https://respan.ai/docs/integrations/openlit.md): Send OpenLIT's native OpenTelemetry spans to Respan with canonical chat, embedding, tool, agent, and workflow fields. - [Apache Burr (tracing)](https://respan.ai/docs/integrations/burr.md): Trace Apache Burr applications, state-machine actions, custom spans, streams, and failures with Respan. - [Restate (tracing)](https://respan.ai/docs/integrations/restate.md): Trace Restate Python Services, Virtual Objects, Workflows, replay context, and terminal failures with Respan. - [AutoGen (tracing)](https://respan.ai/docs/integrations/autogen.md): Trace AutoGen AgentChat workflows with Respan — auto-instrumented spans and full observability. - [DSPy (tracing)](https://respan.ai/docs/integrations/dspy.md): Trace DSPy programs with Respan — native callback instrumentation, optional gateway routing, and full observability. - [Google ADK (tracing)](https://respan.ai/docs/integrations/google-adk.md): Trace Google ADK agent workflows with Respan. - [Microsoft Agent Framework (tracing)](https://respan.ai/docs/integrations/microsoft-agent-framework.md): Trace Microsoft Agent Framework agents, tools, chat completions, and workflows with Respan. - [Semantic Kernel (tracing)](https://respan.ai/docs/integrations/semantic-kernel.md): Trace Microsoft Semantic Kernel functions, chat completions, plugin calls, and failures with Respan. - [AgentScope (tracing)](https://respan.ai/docs/integrations/agentscope.md): Trace AgentScope agents, model calls, tool executions, streaming output, and failures with Respan. - [Watson Orchestrate ADK (tracing)](https://respan.ai/docs/integrations/watson-orchestrate-adk.md): Trace IBM watsonx Orchestrate ADK tools, run clients, and chat clients with Respan. - [Smolagents (tracing)](https://respan.ai/docs/integrations/smolagents.md): Trace Smolagents workflows with Respan — auto-instrumented spans, gateway routing, and full observability. - [Strands Agents (tracing)](https://respan.ai/docs/integrations/strands-agents.md): Trace Strands Agents workflows with Respan. - [AgentSpec (tracing)](https://respan.ai/docs/integrations/agent-spec.md): Trace AgentSpec agent workflows with Respan — auto-instrumented spans, gateway routing, and full observability. - [Guardrails (tracing)](https://respan.ai/docs/integrations/guardrails.md): Trace Guardrails AI validation workflows with Respan — auto-instrumented spans, gateway routing, and full observability. - [Agno (tracing)](https://respan.ai/docs/integrations/agno.md): Trace Agno agents and teams with Respan using native respan-tracing instrumentation and optional gateway routing. - [MCP (tracing)](https://respan.ai/docs/integrations/mcp.md): Trace MCP clients and servers with Respan, including tool calls, resources, prompts, and server handlers. - [BeeAI (tracing)](https://respan.ai/docs/integrations/bee-ai.md): Trace BeeAI agent workflows with Respan — auto-instrumented spans, gateway routing, and full observability. - [Flue (tracing)](https://respan.ai/docs/integrations/flue.md): Trace Flue TypeScript runtime workflows and agents with Respan including model turns, tools, tasks, shell operations, compaction, and structured logs. - [Pipecat (tracing)](https://respan.ai/docs/integrations/pipecat.md): Trace Pipecat real-time voice and multimodal AI pipelines with Respan — auto-instrumented spans, gateway routing, and full observability. - [Mastra (tracing)](https://respan.ai/docs/integrations/mastra.md): Trace Mastra TypeScript agents and workflows with Respan — agent spans, model generations, tool calls, gateway routing, and full observability. - [Superagent (tracing)](https://respan.ai/docs/integrations/superagent.md): Trace Superagent safety-agent guardrails with Respan — auto-instrumented guardrail and tool spans, workflow context, and gateway routing. - [BAML (tracing)](https://respan.ai/docs/integrations/baml.md): Trace BAML structured outputs with Respan. - [Arize (tracing)](https://respan.ai/docs/integrations/arize.md): Trace Arize SDK operations with Respan and capture task-level telemetry in one stream. - [Dify (tracing)](https://respan.ai/docs/integrations/dify.md): Trace official Dify Service API clients with Respan in Python and JavaScript. - [LiveKit (tracing)](https://respan.ai/docs/integrations/livekit.md): Trace LiveKit Agents calls with Respan including agent sessions, turns, LLM nodes, function tools, and handoffs. - [OpenRouter (tracing)](https://respan.ai/docs/integrations/openrouter-tracing.md): Trace OpenRouter calls made through the OpenAI-compatible Python client with Respan. - [Codex SDK (tracing)](https://respan.ai/docs/integrations/codex-sdk.md): Trace OpenAI Codex SDK turns with Respan including streamed turns, command execution, MCP tool calls, file changes, and structured output. - [Cursor SDK (tracing)](https://respan.ai/docs/integrations/cursor-sdk.md): Trace Cursor hook events and Cursor TypeScript SDK agent runs with Respan. - [Pi Coding Agent SDK (tracing)](https://respan.ai/docs/integrations/pi-sdk.md): Trace pi coding-agent SDK sessions with Respan: every agent run, LLM call, tool execution, and compaction from @earendil-works/pi-coding-agent. - [Eve (tracing)](https://respan.ai/docs/integrations/eve.md): Trace Eve agent turns, AI SDK model calls, tools, and delegated subagents with Respan. - [OpenAI SDK (tracing)](https://respan.ai/docs/integrations/openai-sdk.md): Trace and observe OpenAI SDK calls with Respan — auto-instrumented spans, gateway routing, and prompt management. - [Azure OpenAI (tracing)](https://respan.ai/docs/integrations/azure-openai-tracing.md): Trace Azure OpenAI SDK calls with Respan in Python and TypeScript. - [Instructor (tracing)](https://respan.ai/docs/integrations/instructor.md): Trace Instructor structured-output LLM SDK calls with Respan. - [Anthropic SDK (tracing)](https://respan.ai/docs/integrations/anthropic.md): Trace Anthropic SDK calls with Respan — auto-instrumented spans, gateway routing, and full observability. - [Google GenAI (tracing)](https://respan.ai/docs/integrations/google-genai.md): Trace Google GenAI SDK calls with Respan — auto-instrumented spans, gateway routing, and full observability. - [LiteLLM (tracing)](https://respan.ai/docs/integrations/litellm.md): Trace LiteLLM calls with Respan - native callback instrumentation, gateway routing, and full observability. - [RubyLLM (tracing)](https://respan.ai/docs/integrations/ruby-llm.md): Use RubyLLM with Respan — gateway routing, model switching, and full observability. - [Vertex AI (tracing)](https://respan.ai/docs/integrations/vertex-ai.md): Trace Vertex AI SDK calls with Respan. - [AWS Bedrock (tracing)](https://respan.ai/docs/integrations/aws-bedrock.md): Trace Amazon Bedrock calls with Respan in Python or TypeScript. - [Cohere (tracing)](https://respan.ai/docs/integrations/cohere.md): Trace Cohere SDK chat, streaming, embeddings, and rerank calls with Respan in Python or TypeScript. - [Groq (tracing)](https://respan.ai/docs/integrations/groq-tracing.md): Trace Groq Python SDK chat, streaming, and tool calls with Respan. - [Mistral AI (tracing)](https://respan.ai/docs/integrations/mistral-tracing.md): Trace Mistral AI Python SDK chat, multi-turn, and async calls with Respan. - [Ollama (tracing)](https://respan.ai/docs/integrations/ollama.md): Trace Ollama Python SDK chat, generation, tool calls, and embeddings with Respan. - [Portkey (tracing)](https://respan.ai/docs/integrations/portkey.md): Trace Portkey Python SDK chat and async calls with Respan. - [Watsonx (tracing)](https://respan.ai/docs/integrations/watsonx.md): Trace IBM watsonx.ai SDK calls with Respan. - [Together AI (tracing)](https://respan.ai/docs/integrations/together-ai.md): Trace Together AI SDK chat, streaming, async, embeddings, rerank, image generation, and tool calls with Respan in Python or TypeScript. - [Aleph Alpha (tracing)](https://respan.ai/docs/integrations/aleph-alpha.md): Trace official Aleph Alpha Python SDK calls with Respan auto-instrumentation. - [Hugging Face (tracing)](https://respan.ai/docs/integrations/huggingface.md): Trace Hugging Face Transformers text-generation pipelines with Respan auto-instrumentation. - [Replicate (tracing)](https://respan.ai/docs/integrations/replicate.md): Trace Replicate model predictions with Respan — auto-instrumented spans and full observability. - [SageMaker (tracing)](https://respan.ai/docs/integrations/sagemaker.md): Trace Amazon SageMaker endpoint invocations with Respan — auto-instrumented spans and full observability. - [Writer (tracing)](https://respan.ai/docs/integrations/writer.md): Trace Writer SDK calls with Respan in Python or TypeScript. - [Respan API (tracing)](https://respan.ai/docs/integrations/respan-api.md): Route LLM calls through the Respan gateway using the API directly — full observability, 1000+ models, prompt management. - [Claude Code (tracing)](https://respan.ai/docs/integrations/claude-code.md): Trace Claude Code conversations with Respan — hook-based tracing, gateway routing, and full observability. - [Codex CLI (tracing)](https://respan.ai/docs/integrations/codex-cli.md): Trace Codex CLI conversations with Respan — auto-instrumented spans, gateway routing, and full observability. - [Gemini CLI (tracing)](https://respan.ai/docs/integrations/gemini-cli.md): Trace Gemini CLI conversations with Respan — auto-instrumented spans, gateway routing, and full observability. - [OpenCode (tracing)](https://respan.ai/docs/integrations/open-code.md): Trace OpenCode conversations with Respan — auto-instrumented spans, gateway routing, and full observability. - [Cursor (tracing)](https://respan.ai/docs/integrations/cursor.md): Trace Cursor AI agent conversations with Respan — hook-based tracing and full observability. - [pi (tracing)](https://respan.ai/docs/integrations/pi.md): Trace interactive pi coding sessions with Respan using the @respan/instrumentation-pi package: turns, model calls, tool executions, and compactions. - [Chroma (tracing)](https://respan.ai/docs/integrations/chroma.md): Trace Chroma vector operations with Respan — auto-instrumented spans and full observability. - [Elasticsearch (tracing)](https://respan.ai/docs/integrations/elasticsearch.md): Trace synchronous and asynchronous Elasticsearch operations with Respan, including searches, indexing, bulk requests, responses, and failures. - [LanceDB (tracing)](https://respan.ai/docs/integrations/lance-db.md): Trace LanceDB vector search operations with Respan — auto-instrumented spans and full observability. - [Marqo (tracing)](https://respan.ai/docs/integrations/marqo.md): Trace Marqo tensor search operations with Respan — auto-instrumented spans and full observability. - [Milvus (tracing)](https://respan.ai/docs/integrations/milvus.md): Trace Milvus vector search operations with Respan — auto-instrumented spans and full observability. - [Pinecone (tracing)](https://respan.ai/docs/integrations/pinecone.md): Trace Pinecone vector search operations with Respan — auto-instrumented spans and full observability. - [pgvector (tracing)](https://respan.ai/docs/integrations/pgvector.md): Trace pgvector registration, SQL execution, and fetched vector results with Respan. - [Qdrant (tracing)](https://respan.ai/docs/integrations/qdrant.md): Trace Qdrant collection, point, payload, and vector-query operations with Respan. - [Weaviate (tracing)](https://respan.ai/docs/integrations/weaviate.md): Trace Weaviate v4 collection, data, query, aggregate, and batch operations with Respan. - [Pytest (tracing)](https://respan.ai/docs/integrations/pytest.md): Trace Pytest sessions and individual tests with Respan, including outcomes, phases, parametrization, nested application spans, and failures. - [Ragas (tracing)](https://respan.ai/docs/integrations/ragas.md): Trace Ragas metrics, dataset evaluations, experiments, and experiment rows as canonical Respan task spans. - [Mem0](https://respan.ai/docs/integrations/mem0.md): Use Mem0 with Respan — gateway routing for memory-backed LLM apps with full observability. - [Hyperspell](https://respan.ai/docs/integrations/hyperspell.md): Trace Hyperspell memory operations with Respan — full observability over store, retrieve, and context management. - [Cognee](https://respan.ai/docs/integrations/cognee.md): Trace Cognee semantic memory workflows with Respan — auto-instrumented spans and full observability. - [Slack](https://respan.ai/docs/integrations/slack.md): Connect a Slack workspace to Respan to send monitor alerts and workflow notifications into Slack channels. - [Microsoft Teams](https://respan.ai/docs/integrations/microsoft-teams.md): Connect Microsoft Teams to Respan to send monitor alerts and workflow notifications into Teams channels. - [n8n](https://respan.ai/docs/integrations/n-8-n.md): Trace n8n's native OpenTelemetry spans or call Respan Gateway from an n8n workflow. - [Exa (tracing)](https://respan.ai/docs/integrations/exa.md): Trace Exa search, contents, grounded answers, streaming, tool helpers, and Agent runs with Respan. - [Linkup](https://respan.ai/docs/integrations/linkup.md): Use Linkup web search with Respan via the gateway — sourced answers as template variables, full observability. - [PostHog](https://respan.ai/docs/integrations/posthog.md): Forward Respan LLM events to PostHog via the gateway for product analytics and observability. - [Moda](https://respan.ai/docs/integrations/moda.md): Forward Respan LLM events to Moda via the gateway for product analytics and observability. - [AssemblyAI](https://respan.ai/docs/integrations/assemblyai.md): Call and log AssemblyAI speech-to-text models through the Respan gateway with full observability. - [Zapier](https://respan.ai/docs/integrations/zapier.md): Connect Zapier automations with Respan for LLM monitoring and event-driven workflows. - [Braintrust](https://respan.ai/docs/integrations/braintrust.md): Trace Braintrust evaluation and logging workflows with Respan. - [Helicone (tracing)](https://respan.ai/docs/integrations/helicone.md): Trace Helicone Manual Logger calls from Python and TypeScript with canonical Respan spans. - [Langfuse](https://respan.ai/docs/integrations/langfuse.md): Redirect Langfuse traces to Respan — auto-instrumented spans, gateway routing, and full observability. - [Metrics](https://respan.ai/docs/documentation/features/monitoring/metrics.md): Watch requests, cost, tokens, latency, and errors over time. - [Logs](https://respan.ai/docs/documentation/features/observe/explore-spans.md): Search, filter and export every span, trace and thread your app sends to Respan. - [Signals and errors](https://respan.ai/docs/documentation/features/pulse/errors.md): Spot errors, incidents, and behavior trends above your logs. - [Behaviors](https://respan.ai/docs/documentation/features/pulse/behaviors.md): Flag refusals, missed instructions, completed tasks, and your own definitions on every span. - [Inspect spans and traces](https://respan.ai/docs/documentation/features/observe/view-debug-traces.md): Open a span, trace or thread to see its messages, tools, metrics and metadata. - [Retention & export](https://respan.ai/docs/documentation/features/observe/export-retention.md): Control how long logs remain available and create one-time or recurring export jobs. - [Users](https://respan.ai/docs/documentation/features/customer-identifier.md): Track per-user metrics, set budgets, and apply rate limits to your LLM users. - [Custom IDs & attributes](https://respan.ai/docs/documentation/features/observe/custom-ids.md): Track related AI activity with your application's IDs and custom properties. - [Monitors & notifications](https://respan.ai/docs/documentation/features/monitoring/monitors.md): Create, test, and operate metric-based alerts for your LLM applications. - [Schedule usage reports](https://respan.ai/docs/documentation/features/monitoring/reports.md): Send a recurring digest of usage, cost, and performance. - [SQL editor](https://respan.ai/docs/documentation/features/observe/sql-editor.md): Query recorded spans, inspect results, and reuse saved queries. - [PII redaction](https://respan.ai/docs/documentation/pii-redaction.md): Detect and mask personal information before it reaches providers or your telemetry. - [Support](https://respan.ai/docs/documentation/support.md): Get help and connect with the Respan community - [Gateway quickstart](https://respan.ai/docs/documentation/features/gateway/gateway-quickstart.md): Send your model calls through Respan by changing one base URL. - [Overview](https://respan.ai/docs/integrations/gateway/overview.md): Route calls from your agent framework, LLM SDK, or coding agent through the Respan gateway. - [OpenAI Agents (gateway)](https://respan.ai/docs/integrations/gateway/open-ai-agents.md): Set up OpenAI Agents SDK with the Respan gateway. - [Claude Agent SDK (gateway)](https://respan.ai/docs/integrations/gateway/claude-agent-sdk.md): Set up Claude Agent SDK with the Respan gateway. - [Vercel AI SDK (gateway)](https://respan.ai/docs/integrations/gateway/vercel-ai-sdk.md): Set up Vercel AI SDK with the Respan gateway. - [Pydantic AI (gateway)](https://respan.ai/docs/integrations/gateway/pydantic-ai.md): Set up Pydantic AI with the Respan gateway. - [CrewAI (gateway)](https://respan.ai/docs/integrations/gateway/crew-ai.md): Set up CrewAI with the Respan gateway. - [Haystack (gateway)](https://respan.ai/docs/integrations/gateway/haystack.md): Set up Haystack with the Respan gateway. - [LangChain (gateway)](https://respan.ai/docs/integrations/gateway/lang-chain.md): Set up LangChain with the Respan gateway. - [LangGraph (gateway)](https://respan.ai/docs/integrations/gateway/lang-graph.md): Set up LangGraph with the Respan gateway. - [Langflow (gateway)](https://respan.ai/docs/integrations/gateway/langflow.md): Set up Langflow with the Respan gateway. - [Dify (gateway)](https://respan.ai/docs/integrations/gateway/dify.md): Route Dify LLM calls through the Respan gateway with Dify's official OpenAI-compatible model provider. - [n8n (gateway)](https://respan.ai/docs/integrations/gateway/n-8-n.md): Call the Respan gateway from an n8n workflow with the built-in HTTP Request node. - [LlamaIndex (gateway)](https://respan.ai/docs/integrations/gateway/llama-index.md): Set up LlamaIndex with the Respan gateway. - [AutoGen (gateway)](https://respan.ai/docs/integrations/gateway/auto-gen.md): Set up AutoGen with the Respan gateway. - [DSPy (gateway)](https://respan.ai/docs/integrations/gateway/ds-py.md): Set up DSPy with the Respan gateway. - [Google ADK (gateway)](https://respan.ai/docs/integrations/gateway/google-adk.md): Set up Google ADK with the Respan gateway. - [Microsoft Agent Framework (gateway)](https://respan.ai/docs/integrations/gateway/microsoft-agent-framework.md): Set up Microsoft Agent Framework with the Respan gateway. - [Semantic Kernel (gateway)](https://respan.ai/docs/integrations/gateway/semantic-kernel.md): Set up Semantic Kernel with the Respan gateway. - [AgentScope (gateway)](https://respan.ai/docs/integrations/gateway/agent-scope.md): Set up AgentScope with the Respan gateway. - [Smolagents (gateway)](https://respan.ai/docs/integrations/gateway/smolagents.md): Set up Smolagents with the Respan gateway. - [Strands Agents (gateway)](https://respan.ai/docs/integrations/gateway/strands-agents.md): Set up Strands Agents with the Respan gateway. - [AgentSpec (gateway)](https://respan.ai/docs/integrations/gateway/agent-spec.md): Set up AgentSpec with the Respan gateway. - [Guardrails (gateway)](https://respan.ai/docs/integrations/gateway/guardrails.md): Set up Guardrails AI with the Respan gateway. - [Agno (gateway)](https://respan.ai/docs/integrations/gateway/agno.md): Set up Agno with the Respan gateway. - [BeeAI (gateway)](https://respan.ai/docs/integrations/gateway/bee-ai.md): Set up BeeAI with the Respan gateway. - [Pipecat (gateway)](https://respan.ai/docs/integrations/gateway/pipecat.md): Set up Pipecat with the Respan gateway. - [Superagent (gateway)](https://respan.ai/docs/integrations/gateway/superagent.md): Set up Superagent with the Respan gateway. - [OpenRouter (gateway)](https://respan.ai/docs/integrations/gateway/openrouter.md): Route OpenRouter requests through the Respan gateway. - [Codex SDK (gateway)](https://respan.ai/docs/integrations/gateway/codex-sdk.md): Set up OpenAI Codex SDK with the Respan gateway. - [Eve (gateway)](https://respan.ai/docs/integrations/gateway/eve.md): Route Eve model calls through the Respan gateway with an AI SDK provider model. - [OpenAI SDK (gateway)](https://respan.ai/docs/integrations/gateway/open-ai-sdk.md): Set up OpenAI SDK with the Respan gateway. - [Azure OpenAI (gateway)](https://respan.ai/docs/integrations/gateway/azure-open-ai.md): Route Azure OpenAI code through the Respan gateway by switching to the OpenAI client. - [Instructor (gateway)](https://respan.ai/docs/integrations/gateway/instructor.md): Set up Instructor with the Respan gateway. - [Anthropic SDK (gateway)](https://respan.ai/docs/integrations/gateway/anthropic-sdk.md): Set up Anthropic SDK with the Respan gateway. - [Google GenAI (gateway)](https://respan.ai/docs/integrations/gateway/google-gen-ai.md): Set up Google Gen AI with the Respan gateway. - [LiteLLM (gateway)](https://respan.ai/docs/integrations/gateway/lite-llm.md): Set up LiteLLM with the Respan gateway. - [RubyLLM (gateway)](https://respan.ai/docs/integrations/gateway/ruby-llm.md): Set up RubyLLM with the Respan gateway. - [Vertex AI (gateway)](https://respan.ai/docs/integrations/gateway/vertex-ai.md): Set up Vertex AI through the Respan gateway. - [AWS Bedrock (gateway)](https://respan.ai/docs/integrations/gateway/aws-bedrock.md): Set up Amazon Bedrock with the Respan gateway. - [Cohere (gateway)](https://respan.ai/docs/integrations/gateway/cohere.md): Set up Cohere with the Respan gateway. - [Groq (gateway)](https://respan.ai/docs/integrations/gateway/groq.md): Set up Groq model calls with the Respan gateway. - [Mistral AI (gateway)](https://respan.ai/docs/integrations/gateway/mistral-ai.md): Set up Mistral AI model calls with the Respan gateway. - [Ollama (gateway)](https://respan.ai/docs/integrations/gateway/ollama.md): Set up Ollama model calls with the Respan gateway. - [Portkey (gateway)](https://respan.ai/docs/integrations/gateway/portkey.md): Replace Portkey Gateway routing with the Respan gateway. - [Helicone (gateway)](https://respan.ai/docs/integrations/gateway/helicone.md): Replace Helicone Gateway routing with the OpenAI-compatible Respan Gateway. - [Watsonx (gateway)](https://respan.ai/docs/integrations/gateway/watsonx.md): Set up IBM watsonx.ai with the Respan gateway. - [Together AI (gateway)](https://respan.ai/docs/integrations/gateway/together-ai.md): Set up Together AI model calls with the Respan gateway. - [Aleph Alpha (gateway)](https://respan.ai/docs/integrations/gateway/aleph-alpha.md): Set up Aleph Alpha with the Respan gateway. - [Hugging Face (gateway)](https://respan.ai/docs/integrations/gateway/huggingface.md): Set up Hugging Face with the Respan gateway. - [Replicate (gateway)](https://respan.ai/docs/integrations/gateway/replicate.md): Set up Replicate with the Respan gateway. - [SageMaker (gateway)](https://respan.ai/docs/integrations/gateway/sage-maker.md): Set up Amazon SageMaker with the Respan gateway. - [Respan API (gateway)](https://respan.ai/docs/integrations/gateway/respan-api.md): Set up Respan API with the Respan gateway. - [Claude Code (gateway)](https://respan.ai/docs/integrations/gateway/claude-code.md): Set up Claude Code with the Respan gateway. - [Codex CLI (gateway)](https://respan.ai/docs/integrations/gateway/codex-cli.md): Set up Codex CLI with the Respan gateway. - [Gemini CLI (gateway)](https://respan.ai/docs/integrations/gateway/gemini-cli.md): Set up Gemini CLI with the Respan gateway. - [OpenCode (gateway)](https://respan.ai/docs/integrations/gateway/open-code.md): Set up OpenCode with the Respan gateway. - [Hermes Agent (gateway)](https://respan.ai/docs/integrations/gateway/hermes-agent.md): Set up Hermes Agent with the Respan gateway. - [OpenClaw (gateway)](https://respan.ai/docs/integrations/gateway/open-claw.md): Set up OpenClaw with the Respan gateway. - [Kilo Code (gateway)](https://respan.ai/docs/integrations/gateway/kilo-code.md): Set up Kilo Code with the Respan gateway. - [Cline (gateway)](https://respan.ai/docs/integrations/gateway/cline.md): Set up Cline with the Respan gateway. - [Roo Code (gateway)](https://respan.ai/docs/integrations/gateway/roo-code.md): Set up Roo Code with the Respan gateway. - [Aider (gateway)](https://respan.ai/docs/integrations/gateway/aider.md): Set up Aider with the Respan gateway. - [pi (gateway)](https://respan.ai/docs/integrations/gateway/pi.md): Set up pi with the Respan gateway. - [Cursor (gateway)](https://respan.ai/docs/integrations/gateway/cursor.md): Set up Cursor with the Respan gateway. - [OpenHands (gateway)](https://respan.ai/docs/integrations/gateway/open-hands.md): Set up OpenHands with the Respan gateway. - [omp (gateway)](https://respan.ai/docs/integrations/gateway/omp.md): Set up omp (oh-my-pi) with the Respan gateway. - [Qwen Code (gateway)](https://respan.ai/docs/integrations/gateway/qwen-code.md): Set up Qwen Code with the Respan gateway. - [goose (gateway)](https://respan.ai/docs/integrations/gateway/goose.md): Set up goose with the Respan gateway. - [Zed (gateway)](https://respan.ai/docs/integrations/gateway/zed.md): Set up the Zed editor's agent with the Respan gateway. - [DeepSeek Harness (gateway)](https://respan.ai/docs/integrations/gateway/deep-seek-harness.md): Set up DeepSeek Harness (dsh) with the Respan gateway. - [Quickstart](https://respan.ai/docs/documentation/span-01/quickstart.md): Score a conversation for escalation with one API call. - [span-01](https://respan.ai/docs/documentation/span-01/concept.md): span-01 is Respan's reasoning classifier. It applies plain-language behavior definitions to agent traces and returns present, absent, and not-observable probabilities in a single forward pass. - [Quickstart](https://respan.ai/docs/documentation/features/gateway/span-router/quickstart.md): Send your first request to span-router. - [span-router](https://respan.ai/docs/documentation/features/gateway/span-router/concept.md): One model ID that picks the model for each task, with context, capabilities, and cache-aware cost in mind. - [Provider: OpenAI](https://respan.ai/docs/integrations/gateway/model-providers/openai.md): Call OpenAI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Anthropic](https://respan.ai/docs/integrations/gateway/model-providers/anthropic.md): Call Anthropic models through Respan Gateway with unified logs, cost, and latency. - [Provider: Google Gemini](https://respan.ai/docs/integrations/gateway/model-providers/gemini.md): Call Google Gemini models through Respan Gateway with unified logs, cost, and latency. - [Provider: xAI](https://respan.ai/docs/integrations/gateway/model-providers/xAI.md): Call xAI models through Respan Gateway with unified logs, cost, and latency. - [Provider: AWS Bedrock](https://respan.ai/docs/integrations/gateway/model-providers/bedrock.md): Call AWS Bedrock models through Respan Gateway with unified logs, cost, and latency. - [Provider: Google Vertex AI](https://respan.ai/docs/integrations/gateway/model-providers/vertex.md): Call Google Vertex AI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Azure OpenAI](https://respan.ai/docs/integrations/gateway/model-providers/azure.md): Call Azure OpenAI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Mistral AI](https://respan.ai/docs/integrations/gateway/model-providers/mistral.md): Call Mistral AI models through Respan Gateway with unified logs, cost, and latency. - [Provider: DeepSeek](https://respan.ai/docs/integrations/gateway/model-providers/deepseek.md): Call DeepSeek models through Respan Gateway with unified logs, cost, and latency. - [Provider: Groq](https://respan.ai/docs/integrations/gateway/model-providers/groq.md): Call Groq models through Respan Gateway with unified logs, cost, and latency. - [Provider: Cohere](https://respan.ai/docs/integrations/gateway/model-providers/cohere.md): Call Cohere models through Respan Gateway with unified logs, cost, and latency. - [Provider: Perplexity](https://respan.ai/docs/integrations/gateway/model-providers/perplexity.md): Call Perplexity models through Respan Gateway with unified logs, cost, and latency. - [Provider: Together AI](https://respan.ai/docs/integrations/gateway/model-providers/together.md): Call Together AI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Fireworks AI](https://respan.ai/docs/integrations/gateway/model-providers/fireworks.md): Call Fireworks AI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Cerebras](https://respan.ai/docs/integrations/gateway/model-providers/cerebras.md): Call Cerebras models through Respan Gateway with unified logs, cost, and latency. - [Provider: OpenRouter](https://respan.ai/docs/integrations/gateway/model-providers/openrouter.md): Call OpenRouter models through Respan Gateway with unified logs, cost, and latency. - [Provider: Replicate](https://respan.ai/docs/integrations/gateway/model-providers/replicate.md): Configure Replicate credentials and check Gateway model availability. - [Provider: Baseten](https://respan.ai/docs/integrations/gateway/model-providers/baseten.md): Call Baseten models through Respan Gateway with unified logs, cost, and latency. - [Provider: Moonshot AI](https://respan.ai/docs/integrations/gateway/model-providers/moonshot.md): Call Moonshot AI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Nebius](https://respan.ai/docs/integrations/gateway/model-providers/nebius.md): Call Nebius models through Respan Gateway with unified logs, cost, and latency. - [Provider: Novita](https://respan.ai/docs/integrations/gateway/model-providers/novita.md): Call Novita models through Respan Gateway with unified logs, cost, and latency. - [Provider: FriendliAI](https://respan.ai/docs/integrations/gateway/model-providers/friendli.md): Call FriendliAI models through Respan Gateway with unified logs, cost, and latency. - [Provider: Parasail](https://respan.ai/docs/integrations/gateway/model-providers/parasail.md): Call Parasail models through Respan Gateway with unified logs, cost, and latency. - [Provider: Tera](https://respan.ai/docs/integrations/gateway/model-providers/tera.md): Call Tera models through Respan Gateway with unified logs, cost, and latency. - [Provider: Inference.net](https://respan.ai/docs/integrations/gateway/model-providers/inference.md): Call Inference.net models through Respan Gateway with unified logs, cost, and latency. - [Provider: AI21 Labs](https://respan.ai/docs/integrations/gateway/model-providers/ai21labs.md): Configure AI21 Labs credentials and check Gateway model availability. - [Provider: Reducto](https://respan.ai/docs/integrations/gateway/model-providers/reducto.md): Reducto availability and provider billing. - [Provider: Wafer](https://respan.ai/docs/integrations/gateway/model-providers/wafer.md): Call Wafer models through Respan Gateway with unified logs, cost, and latency. - [Provider: Nextbit](https://respan.ai/docs/integrations/gateway/model-providers/nextbit.md): Call Nextbit models through Respan Gateway with unified logs, cost, and latency. - [Provider: TypeSafe](https://respan.ai/docs/integrations/gateway/model-providers/typesafe.md): Call TypeSafe Jev through Respan Gateway with unified logs and latency. - [Provider: Azure DeepSeek](https://respan.ai/docs/integrations/gateway/model-providers/azure-deepseek.md): Call Azure DeepSeek models through Respan Gateway with unified logs, cost, and latency. - [Provider: Google PaLM](https://respan.ai/docs/integrations/gateway/model-providers/google-palm.md): Call Google PaLM models through Respan Gateway with unified logs, cost, and latency. - [Provider: Custom / Self-hosted](https://respan.ai/docs/integrations/gateway/model-providers/custom.md): Call your own self-hosted or custom LLM endpoint through Respan Gateway. - [Respan params & metadata](https://respan.ai/docs/documentation/features/gateway/respan-params.md): Tag every gateway request with customer, metadata, and observability fields. - [Model catalog](https://respan.ai/docs/documentation/features/gateway/models-catalog.md): Find a model, see how it's billed, and control which model and credentials each request uses. - [Routing & passthrough](https://respan.ai/docs/documentation/features/gateway/routing-and-passthrough.md): Two ways to call Respan: a unified router or a provider-native passthrough. - [Fallback](https://respan.ai/docs/documentation/features/gateway/advanced.md): Try alternate models in order after the current route exhausts its eligible attempts. - [Load balancing](https://respan.ai/docs/documentation/features/gateway/load-balancing.md): Distribute traffic across models and deployments with configurable weights. - [Retries and fallback order](https://respan.ai/docs/documentation/features/gateway/retries.md): Understand which route is attempted, when a request retries, and when the gateway advances to a fallback model. - [Respan caching](https://respan.ai/docs/documentation/features/gateway/caching.md): Cache LLM responses to reduce costs and latency. - [Prompt caching](https://respan.ai/docs/documentation/features/gateway/prompt-caching.md): Use Anthropic prompt caching through the Respan gateway. - [Limits](https://respan.ai/docs/documentation/features/gateway/limits.md): Control spend and usage with per-API-key caps, organization spend caps, and per-customer budgets. - [Guardrails](https://respan.ai/docs/documentation/features/gateway/guardrails.md): Catch prompt injections, jailbreaks, system prompt leaks, and unsafe content before they reach your models and tools. Built on span-01, free with the Respan gateway. - [Quickstart](https://respan.ai/docs/documentation/features/prompt-management/prompt-management-quickstart.md): Create, configure, version, and deploy prompt templates. - [Structured output](https://respan.ai/docs/documentation/features/prompt-management/structured-output.md): Define a JSON schema, deploy it with a prompt version, invoke the prompt, and verify the response. - [Tool calling](https://respan.ai/docs/documentation/features/prompt-management/tool-calling.md): Let the model call functions in your code to fetch data before it answers. - [Prompt composition](https://respan.ai/docs/documentation/features/prompt-management/prompt-composition.md): Reference one prompt from another and inject its rendered output at request time. - [Advanced configurations](https://respan.ai/docs/documentation/features/prompt-management/advanced.md): Prompt schema, deployment and versioning, fallback models, streaming, and logging for prompt templates. - [Playground](https://respan.ai/docs/documentation/features/prompt-management/playground.md): Test, iterate, and compare prompt variants interactively. - [Filters API Reference](https://respan.ai/docs/apis/reference/filters-api-reference.md): This document describes the filtering system used across Respan endpoints (spans, traces, threads, etc.). - [Changelog](https://respan.ai/docs/changelog/changelog/llms.txt) ## API Docs - API Reference > Respan Models [Run Span-01](https://respan.ai/docs/apis/respan-models/score-span-behaviors.md) - API Reference > Spans [Create a span](https://respan.ai/docs/apis/spans/create-span.md) - API Reference > Spans [Create spans in bulk](https://respan.ai/docs/apis/spans/bulk-create-spans.md) - API Reference > Spans [List spans](https://respan.ai/docs/apis/spans/list-spans.md) - API Reference > Spans [Get a span](https://respan.ai/docs/apis/spans/retrieve-span.md) - API Reference > Spans [Get span summary](https://respan.ai/docs/apis/spans/get-spans-summary.md) - API Reference > Spans [List span groups](https://respan.ai/docs/apis/spans/request-logs-groups-list.md) - API Reference > Spans [List span groups with filters](https://respan.ai/docs/apis/spans/request-logs-groups-filter.md) - API Reference > Traces [List traces](https://respan.ai/docs/apis/traces/list-traces.md) - API Reference > Traces [Delete traces in bulk](https://respan.ai/docs/apis/traces/bulk-delete-traces.md) - API Reference > Traces [Get a trace](https://respan.ai/docs/apis/traces/retrieve-trace.md) - API Reference > Traces [Delete a trace](https://respan.ai/docs/apis/traces/delete-trace.md) - API Reference > Traces [Update trace sharing](https://respan.ai/docs/apis/traces/share-trace.md) - API Reference > Traces [Get a public trace](https://respan.ai/docs/apis/traces/retrieve-public-trace.md) - API Reference > Traces [Ingest spans (legacy)](https://respan.ai/docs/apis/traces/create-trace-legacy.md) - API Reference > Traces [Ingest traces (OTLP)](https://respan.ai/docs/apis/traces/create-trace.md) - API Reference > Threads [List threads](https://respan.ai/docs/apis/threads/list-threads.md) - API Reference > Users [List users](https://respan.ai/docs/apis/users/list-customers.md) - API Reference > Users [Get a user](https://respan.ai/docs/apis/users/retrieve-user.md) - API Reference > Users [Update a user](https://respan.ai/docs/apis/users/update-user.md) - API Reference > Users [Delete a user](https://respan.ai/docs/apis/users/delete-user.md) - API Reference > Gateway [Create a chat completion](https://respan.ai/docs/apis/gateway/create-chat-completion.md) - API Reference > Gateway [Create a response](https://respan.ai/docs/apis/gateway/create-response.md) - API Reference > Gateway [Get model summary](https://respan.ai/docs/apis/models/filter-models-summary.md) - API Reference > Gateway [List models](https://respan.ai/docs/apis/models/filter-models.md) - API Reference > Gateway [List public models](https://respan.ai/docs/apis/models/list-models.md) - API Reference > Gateway [Create or update a custom model](https://respan.ai/docs/apis/models/create-custom-model.md) - API Reference > Gateway [Get a model](https://respan.ai/docs/apis/models/retrieve-custom-model.md) - API Reference > Gateway [Update a custom model](https://respan.ai/docs/apis/models/update-custom-model.md) - API Reference > Gateway [Delete a custom model](https://respan.ai/docs/apis/models/delete-custom-model.md) - API Reference > Gateway [List custom providers](https://respan.ai/docs/apis/models/list-custom-providers.md) - API Reference > Gateway [Create a custom provider](https://respan.ai/docs/apis/models/create-custom-provider.md) - API Reference > Gateway [Get a custom provider](https://respan.ai/docs/apis/models/retrieve-custom-provider.md) - API Reference > Gateway [Update a custom provider](https://respan.ai/docs/apis/models/update-custom-provider.md) - API Reference > Gateway [Delete a custom provider](https://respan.ai/docs/apis/models/delete-custom-provider.md) - API Reference > Gateway [Replace a custom model](https://respan.ai/docs/apis/models/replace-custom-model.md) - API Reference > Gateway [Replace a custom provider](https://respan.ai/docs/apis/models/replace-custom-provider.md) - API Reference > Gateway [Get model status](https://respan.ai/docs/apis/models/api-models-status-retrieve.md) - API Reference > Gateway [Get model status with filters](https://respan.ai/docs/apis/models/api-models-status-create.md) - API Reference > Passthrough [Evaluate state with TypeSafe Jev](https://respan.ai/docs/apis/type-safe-gateway/typesafe-systemone.md) - API Reference > Passthrough [Create an Anthropic message](https://respan.ai/docs/apis/anthropic-gateway/api-anthropic-v-1-messages-create.md) - API Reference > Passthrough [Generate Google model content](https://respan.ai/docs/apis/google-gateway/api-google-v-1-beta-models-create.md) - API Reference > Passthrough [Create an OpenRouter chat completion](https://respan.ai/docs/apis/open-router-gateway/openrouter-native-chat-completions.md) - API Reference > Prompts [List prompts](https://respan.ai/docs/apis/prompts/list-prompts.md) - API Reference > Prompts [Create a prompt](https://respan.ai/docs/apis/prompts/create-prompt.md) - API Reference > Prompts [Update, commit, or deploy prompts in bulk](https://respan.ai/docs/apis/prompts/process-prompt-bulk-operations.md) - API Reference > Prompts [Get a prompt](https://respan.ai/docs/apis/prompts/retrieve-prompt.md) - API Reference > Prompts [Update a prompt](https://respan.ai/docs/apis/prompts/update-prompt.md) - API Reference > Prompts [Delete a prompt](https://respan.ai/docs/apis/prompts/delete-prompt.md) - API Reference > Prompts [Create a prompt version](https://respan.ai/docs/apis/prompts/create-prompt-version.md) - API Reference > Prompts [List prompt versions](https://respan.ai/docs/apis/prompts/list-prompt-versions.md) - API Reference > Prompts [Get a prompt version](https://respan.ai/docs/apis/prompts/retrieve-prompt-version.md) - API Reference > Prompts [Update a prompt version](https://respan.ai/docs/apis/prompts/update-prompt-version.md) - API Reference > Prompts [Delete a prompt version](https://respan.ai/docs/apis/prompts/delete-prompt-version.md) - API Reference > Prompts [Commit a prompt version](https://respan.ai/docs/apis/prompts/commit-prompt-version.md) - API Reference > Prompts [Deploy a prompt version](https://respan.ai/docs/apis/prompts/deploy-prompt-version.md) - API Reference > Prompts [Get prompt summary](https://respan.ai/docs/apis/prompts/get-prompts-summary-with-filters.md) - API Reference > Prompts [List response format presets](https://respan.ai/docs/apis/prompts/api-response-format-presets-list.md) - API Reference > Prompts [Create a response format preset](https://respan.ai/docs/apis/prompts/api-response-format-presets-create.md) - API Reference > Prompts [Get a response format preset](https://respan.ai/docs/apis/prompts/api-response-format-presets-retrieve.md) - API Reference > Prompts [Delete a response format preset](https://respan.ai/docs/apis/prompts/api-response-format-presets-destroy.md) - API Reference > Prompts [Update a response format preset](https://respan.ai/docs/apis/prompts/api-response-format-presets-partial-update.md) - API Reference > Workflows [List workflows](https://respan.ai/docs/apis/workflows/api-workflows-list.md) - API Reference > Workflows [List workflows with filters](https://respan.ai/docs/apis/workflows/filter-workflows.md) - API Reference > Workflows [Create a workflow](https://respan.ai/docs/apis/workflows/create-workflow.md) - API Reference > Workflows [Get a workflow](https://respan.ai/docs/apis/workflows/get-workflow.md) - API Reference > Workflows [Update a workflow](https://respan.ai/docs/apis/workflows/update-workflow.md) - API Reference > Workflows [Delete a workflow](https://respan.ai/docs/apis/workflows/delete-workflow.md) - API Reference > Workflows [List workflow versions](https://respan.ai/docs/apis/workflows/list-workflow-versions.md) - API Reference > Workflows [Create a workflow draft](https://respan.ai/docs/apis/workflows/create-workflow-version.md) - API Reference > Workflows [Get a workflow version](https://respan.ai/docs/apis/workflows/get-workflow-version.md) - API Reference > Workflows [Update a workflow version](https://respan.ai/docs/apis/workflows/update-workflow-version.md) - API Reference > Workflows [Commit a workflow draft](https://respan.ai/docs/apis/workflows/api-workflows-commits-create.md) - API Reference > Workflows [Deploy a workflow version](https://respan.ai/docs/apis/workflows/deploy-workflow.md) - API Reference > Workflows [Undeploy a workflow](https://respan.ai/docs/apis/workflows/undeploy-workflow.md) - API Reference > Workflows [Validate a workflow](https://respan.ai/docs/apis/workflows/validate-workflow.md) - API Reference > Datasets [Create a dataset](https://respan.ai/docs/apis/datasets/create-dataset.md) - API Reference > Datasets [List datasets](https://respan.ai/docs/apis/datasets/list-datasets.md) - API Reference > Datasets [Get a dataset](https://respan.ai/docs/apis/datasets/retrieve-dataset.md) - API Reference > Datasets [Update a dataset](https://respan.ai/docs/apis/datasets/update-dataset.md) - API Reference > Datasets [Delete a dataset](https://respan.ai/docs/apis/datasets/delete-dataset.md) - API Reference > Datasets [Create a dataset row](https://respan.ai/docs/apis/datasets/create-dataset-log.md) - API Reference > Datasets [List dataset rows](https://respan.ai/docs/apis/datasets/list-dataset-logs.md) - API Reference > Datasets [Get a dataset row](https://respan.ai/docs/apis/datasets/retrieve-dataset-log.md) - API Reference > Datasets [Update a dataset row](https://respan.ai/docs/apis/datasets/update-dataset-log.md) - API Reference > Datasets [Delete a dataset row](https://respan.ai/docs/apis/datasets/delete-dataset-log.md) - API Reference > Datasets [Create dataset rows in bulk](https://respan.ai/docs/apis/datasets/bulk-create-dataset-logs.md) - API Reference > Datasets [Run evaluators on a dataset](https://respan.ai/docs/apis/datasets/run-eval-on-dataset.md) - API Reference > Datasets [List dataset evaluation runs](https://respan.ai/docs/apis/datasets/list-dataset-eval-runs.md) - API Reference > Datasets [Replace a dataset row](https://respan.ai/docs/apis/datasets/replace-dataset-log.md) - API Reference > Datasets [Import spans or traces into a dataset](https://respan.ai/docs/apis/datasets/import-dataset-logs.md) - API Reference > Datasets [Remove dataset rows](https://respan.ai/docs/apis/datasets/remove-dataset-logs.md) - API Reference > Datasets [Get dataset row summary](https://respan.ai/docs/apis/datasets/summarize-dataset-logs-filtered.md) - API Reference > Testsets [Create a testset](https://respan.ai/docs/apis/testsets/create-testset.md) - API Reference > Testsets [List testsets](https://respan.ai/docs/apis/testsets/list-testsets.md) - API Reference > Testsets [Get a testset](https://respan.ai/docs/apis/testsets/retrieve-testset.md) - API Reference > Testsets [Update a testset](https://respan.ai/docs/apis/testsets/update-testset.md) - API Reference > Testsets [Delete a testset](https://respan.ai/docs/apis/testsets/delete-testset.md) - API Reference > Testsets [Create testset rows](https://respan.ai/docs/apis/testsets/create-testset-rows.md) - API Reference > Testsets [List testset rows](https://respan.ai/docs/apis/testsets/list-testset-rows.md) - API Reference > Testsets [Update a testset row](https://respan.ai/docs/apis/testsets/update-testset-row.md) - API Reference > Testsets [Delete a testset row](https://respan.ai/docs/apis/testsets/delete-testset-row.md) - API Reference > Testsets [Get testset summary](https://respan.ai/docs/apis/testsets/get-filtered-testsets-summary.md) - API Reference > Testsets [Replace a testset](https://respan.ai/docs/apis/testsets/replace-testset.md) - API Reference > Testsets [Delete testset rows](https://respan.ai/docs/apis/testsets/delete-testset-rows.md) - API Reference > Testsets [Get a testset row](https://respan.ai/docs/apis/testsets/retrieve-testset-row.md) - API Reference > Testsets [Replace a testset row](https://respan.ai/docs/apis/testsets/replace-testset-row.md) - API Reference > Evaluators [Create an evaluator](https://respan.ai/docs/apis/evaluators/create-evaluator.md) - API Reference > Evaluators [List evaluators](https://respan.ai/docs/apis/evaluators/list-evaluators.md) - API Reference > Evaluators [Get an evaluator](https://respan.ai/docs/apis/evaluators/retrieve-evaluator.md) - API Reference > Evaluators [Update an evaluator](https://respan.ai/docs/apis/evaluators/update-evaluator.md) - API Reference > Evaluators [Delete an evaluator](https://respan.ai/docs/apis/evaluators/delete-evaluator.md) - API Reference > Evaluators [Run an evaluator](https://respan.ai/docs/apis/evaluators/run-evaluator.md) - API Reference > Evaluators [Get evaluator summary](https://respan.ai/docs/apis/evaluators/get-filtered-evaluators-summary.md) - API Reference > Evaluators [Replace an evaluator](https://respan.ai/docs/apis/evaluators/replace-evaluator.md) - API Reference > Evaluators [List evaluator versions](https://respan.ai/docs/apis/evaluators/list-evaluator-versions.md) - API Reference > Evaluators [Commit an evaluator draft](https://respan.ai/docs/apis/evaluators/create-evaluator-version.md) - API Reference > Evaluators [Get an evaluator version](https://respan.ai/docs/apis/evaluators/retrieve-evaluator-version.md) - API Reference > Evaluators [Replace an evaluator version](https://respan.ai/docs/apis/evaluators/replace-evaluator-version.md) - API Reference > Evaluators [Update an evaluator version](https://respan.ai/docs/apis/evaluators/update-evaluator-version.md) - API Reference > Scores [Create a score](https://respan.ai/docs/apis/scores/create-score.md) - API Reference > Scores [Get a score](https://respan.ai/docs/apis/scores/retrieve-score.md) - API Reference > Scores [Update a score](https://respan.ai/docs/apis/scores/update-score.md) - API Reference > Scores [Delete a score](https://respan.ai/docs/apis/scores/delete-score.md) - API Reference > Scores [Create or update a span score](https://respan.ai/docs/apis/scores/create-span-score.md) - API Reference > Scores [List span scores](https://respan.ai/docs/apis/scores/list-span-scores.md) - API Reference > Scores [Get a span score](https://respan.ai/docs/apis/scores/retrieve-span-score.md) - API Reference > Scores [Update a span score](https://respan.ai/docs/apis/scores/update-span-score.md) - API Reference > Scores [Delete a span score](https://respan.ai/docs/apis/scores/delete-span-score.md) - API Reference > Scores [List scores](https://respan.ai/docs/apis/scores/filter-scores.md) - API Reference > Scores [Replace a score](https://respan.ai/docs/apis/scores/replace-score.md) - API Reference > Scores [Replace a span score](https://respan.ai/docs/apis/scores/replace-span-score.md) - API Reference > Experiments [Create an experiment](https://respan.ai/docs/apis/experiments/create-experiment.md) - API Reference > Experiments [List experiments](https://respan.ai/docs/apis/experiments/list-experiments.md) - API Reference > Experiments [Get an experiment](https://respan.ai/docs/apis/experiments/retrieve-experiment.md) - API Reference > Experiments [Delete an experiment](https://respan.ai/docs/apis/experiments/delete-experiment.md) - API Reference > Experiments [List experiment traces](https://respan.ai/docs/apis/experiments/list-experiment-spans.md) - API Reference > Experiments [Get an experiment trace](https://respan.ai/docs/apis/experiments/retrieve-experiment-span.md) - API Reference > Experiments [Resume a paused experiment trace](https://respan.ai/docs/apis/experiments/update-experiment-span.md) - API Reference > Experiments [Get experiment summary](https://respan.ai/docs/apis/experiments/filter-experiments-summary.md) - API Reference > Experiments [Replace an experiment](https://respan.ai/docs/apis/experiments/replace-experiment.md) - API Reference > Experiments [Update an experiment](https://respan.ai/docs/apis/experiments/update-experiment.md) - API Reference > Experiments [Get experiment trace summary](https://respan.ai/docs/apis/experiments/filter-experiment-spans-summary.md) - API Reference > Experiments [Get experiment score histogram](https://respan.ai/docs/apis/experiments/filter-experiment-score-histogram.md) - API Reference > Open AI Batch [Upload a file](https://respan.ai/docs/apis/open-ai-batch/upload-file.md) - API Reference > Open AI Batch [List files](https://respan.ai/docs/apis/open-ai-batch/list-files.md) - API Reference > Open AI Batch [Get a file](https://respan.ai/docs/apis/open-ai-batch/retrieve-file.md) - API Reference > Open AI Batch [Delete a file](https://respan.ai/docs/apis/open-ai-batch/delete-file.md) - API Reference > Open AI Batch [Download file content](https://respan.ai/docs/apis/open-ai-batch/retrieve-file-content.md) - API Reference > Open AI Batch [Create a batch](https://respan.ai/docs/apis/open-ai-batch/create-batch.md) - API Reference > Open AI Batch [Get a batch](https://respan.ai/docs/apis/open-ai-batch/retrieve-batch.md) - API Reference > Open AI Batch [Cancel a batch](https://respan.ai/docs/apis/open-ai-batch/cancel-batch.md) - API Reference > Open AI Batch [List batches](https://respan.ai/docs/apis/open-ai-batch/api-v-1-batches-retrieve.md) - API Reference > Multimodal [Create embeddings](https://respan.ai/docs/apis/multimodal/create-embeddings.md) - API Reference > Multimodal [Transcribe audio](https://respan.ai/docs/apis/multimodal/speech-to-text.md) - API Reference > Multimodal [Generate speech](https://respan.ai/docs/apis/multimodal/text-to-speech.md) - API Reference > Multimodal [Get an AssemblyAI transcript](https://respan.ai/docs/apis/multimodal/retrieve-assemblyai-transcript.md) - API Reference > Multimodal [Create an AssemblyAI transcript](https://respan.ai/docs/apis/multimodal/api-assemblyai-v-2-transcript-create.md) - API Reference > Temporary API Keys [Create a temporary API key](https://respan.ai/docs/apis/temporary-api-keys/create-api-key.md) - API Reference > Temporary API Keys [List temporary API keys](https://respan.ai/docs/apis/temporary-api-keys/list-api-keys.md) - API Reference > Temporary API Keys [Get a temporary API key](https://respan.ai/docs/apis/temporary-api-keys/retrieve-api-key.md) - API Reference > Temporary API Keys [Update a temporary API key](https://respan.ai/docs/apis/temporary-api-keys/update-api-key.md) - API Reference > Temporary API Keys [Revoke a temporary API key](https://respan.ai/docs/apis/temporary-api-keys/delete-api-key.md) - API Reference > Limit Policies [Create a limit policy](https://respan.ai/docs/apis/limit-policies/create-limit-policy.md) - API Reference > Limit Policies [List limit policies](https://respan.ai/docs/apis/limit-policies/list-limit-policies.md) - API Reference > Limit Policies [Get a limit policy](https://respan.ai/docs/apis/limit-policies/retrieve-limit-policy.md) - API Reference > Limit Policies [Update a limit policy](https://respan.ai/docs/apis/limit-policies/update-limit-policy.md) - API Reference > Limit Policies [Delete a limit policy](https://respan.ai/docs/apis/limit-policies/delete-limit-policy.md) - API Reference > Credit Transactions [List credit transactions](https://respan.ai/docs/apis/credit-transactions/list-credit-transactions.md) - API Reference > Credit Transactions [Get a credit transaction](https://respan.ai/docs/apis/credit-transactions/retrieve-credit-transaction.md) - API Reference > Dashboard [Get LLM metrics over time](https://respan.ai/docs/apis/dashboard/list-llm-metrics.md) - API Reference > Dashboard [Get LLM metric summary](https://respan.ai/docs/apis/dashboard/get-llm-metrics-summary.md) - API Reference > Dashboard [Get performance quantiles over time](https://respan.ai/docs/apis/dashboard/list-quantiles.md) - API Reference > Dashboard [Get performance quantile summary](https://respan.ai/docs/apis/dashboard/get-quantiles-summary.md) - API Reference > Dashboard [Get metrics by dimension](https://respan.ai/docs/apis/dashboard/list-metrics-breakdown.md) - API Reference > Dashboard [Get active users over time](https://respan.ai/docs/apis/dashboard/list-active-users.md) - API Reference > Dashboard [Get total users over time](https://respan.ai/docs/apis/dashboard/get-total-users.md) - API Reference > Dashboard [Get cache hits over time](https://respan.ai/docs/apis/dashboard/list-cache-hit-metrics.md) - API Reference > Dashboard [Get cache hit summary](https://respan.ai/docs/apis/dashboard/get-cache-hit-metrics-summary.md) - API Reference > Dashboard [Get lifetime cache hit totals](https://respan.ai/docs/apis/dashboard/get-lifetime-cache-hit-totals.md) - API Reference > Dashboard [Get evaluation scores over time](https://respan.ai/docs/apis/dashboard/list-eval-results.md) - API Reference > Dashboard [Get evaluation score summary](https://respan.ai/docs/apis/dashboard/get-eval-results-summary.md) - API Reference > Dashboard [Get storage volume over time](https://respan.ai/docs/apis/dashboard/list-storage-volume.md) - API Reference > Dashboard [Get storage volume summary](https://respan.ai/docs/apis/dashboard/get-storage-volume-summary.md) - API Reference > Dashboard [Get public platform statistics](https://respan.ai/docs/apis/dashboard/get-platform-stats.md) - API Reference > Caches [List cached responses](https://respan.ai/docs/apis/caches/filter-cached-responses.md) - API Reference > Caches [Get cache summary](https://respan.ai/docs/apis/caches/get-filtered-cached-responses-summary.md) - API Reference > Caches [Delete cached responses in bulk](https://respan.ai/docs/apis/caches/bulk-delete-cached-responses.md) - API Reference > Caches [Get a cached response](https://respan.ai/docs/apis/caches/api-caches-retrieve.md) - API Reference > Caches [Delete a cached response](https://respan.ai/docs/apis/caches/api-caches-destroy-2.md) - API Reference > Caches [Update a cached response](https://respan.ai/docs/apis/caches/api-caches-partial-update-2.md) ## OpenAPI Specification The raw OpenAPI 3.1 specification for this API is available at: - [OpenAPI JSON](https://respan.ai/docs/openapi.json) - [OpenAPI YAML](https://respan.ai/docs/openapi.yaml)