Haystack | Respan Docs

Set up Respan

Sign up — Create an account at platform.respan.ai
Create an API key — Generate one on the API keys page
Add credits or a provider key — Add credits on the Credits page or connect your own provider key on the Integrations page

Use AI

Add the Docs MCP to your AI coding tool to get help building with Respan. No API key needed.

1 {
2   "mcpServers": {
3     "respan-docs": {
4       "url": "https://mcp.respan.ai/mcp/docs"
5     }
6   }
7 }

What is Haystack?

Haystack is a Python framework for building production-ready LLM pipelines. It provides components for retrieval, generation, and processing that can be composed into pipelines.

Setup

Install packages

$ pip install respan-exporter-haystack haystack-ai

Set environment variables

$ export RESPAN_API_KEY="YOUR_RESPAN_API_KEY"
$ export OPENAI_API_KEY="YOUR_OPENAI_API_KEY"

Add RespanConnector to your pipeline

1 from haystack import Pipeline
2 from haystack.components.generators import OpenAIGenerator
3 from respan_exporter_haystack import RespanConnector
4 
5 pipeline = Pipeline()
6 pipeline.add_component("respan", RespanConnector(api_key="your-api-key"))
7 pipeline.add_component("llm", OpenAIGenerator(model="gpt-4o-mini"))
8 pipeline.connect("respan", "llm")
9 
10 result = pipeline.run({"respan": {"prompt": "Tell me a joke about AI"}})
11 print(result)

View your trace

Open the Traces page to see your pipeline trace.

Configuration

See the Haystack Exporter SDK reference for the full API.

Component	Description
`RespanConnector`	Connects pipelines to Respan for tracing.
`RespanTracer`	Alternative tracing integration.
`RespanGenerator`	Routes LLM calls through the Respan gateway.
`RespanChatGenerator`	Chat-specific gateway component.

Attributes

Pass Respan attributes through the connector:

1 result = pipeline.run({
2     "respan": {
3         "prompt": "Tell me a joke",
4         "customer_identifier": "user-123",
5         "metadata": {"team": "ml"},
6     }
7 })

Attribute	Description
`customer_identifier`	User/customer identifier.
`metadata`	Custom key-value pairs.

Prompts

Use Respan-managed prompts in Haystack pipelines:

1 from respan_exporter_haystack import RespanGenerator
2 
3 generator = RespanGenerator(
4     api_key="your-api-key",
5     model="gpt-4o-mini",
6     prompt_id="your-prompt-id",
7     prompt_version=1,
8 )

Looking for gateway integration? See Gateway > Haystack.