Setup

Set up Respan

Sign up — Create an account at platform.respan.ai
Create an API key — Generate one on the API keys page
Add credits or a provider key — Add credits on the Credits page or connect your own provider key on the Integrations page

Supported models

After you integrate the LLM proxy, you can choose a model from the Models page. You can see each model’s description, pricing, and other metrics.

Model family

Click an exact model to see its model family — a group of models hosted by different LLM providers.

Integration code

Click the Code button to copy the integration code with the language you are using.

Call models in different frameworks

OpenAI Python SDK
OpenAI TypeScript SDK
Standard API

from openai import OpenAI

client = OpenAI(
    base_url="https://api.respan.ai/api/",
    api_key="YOUR_RESPAN_API_KEY",
)

response = client.chat.completions.create(
    model="claude-3-5-haiku-20241022",
    messages=[
        {"role": "user", "content": "Tell me a long story"}
    ]
)

import { OpenAI } from "openai";

const client = new OpenAI({
  baseURL: "https://api.respan.ai/api",
  apiKey: "YOUR_RESPAN_API_KEY",
});

const response = await client.chat.completions
  .create({
    messages: [{ role: "user", content: "Say this is a test" }],
    model: "claude-3-5-sonnet-20241022"
  })
  .asResponse();

console.log(await response.json());

import requests
def demo_call(input,
              model="groq/llama-3.3-70b-specdec",
              token="YOUR_RESPAN_API_KEY",
              ):
    headers = {
        'Content-Type': 'application/json',
        'Authorization': f'Bearer {token}',
    }

    data = {
        'model': model,
        'messages': [{'role': 'user', 'content': input}],
    }

    response = requests.post('https://api.respan.ai/api/chat/completions', headers=headers, json=data)
    return response

messages = "Say 'Hello World'"
print(demo_call(messages).json())

Get started

Features

Admin

Security

Resources

Help & Community

Supported models

Model family

Integration code

Call models in different frameworks

Get started

Features

Admin

Security

Resources

Help & Community

​Supported models

​Model family

​Integration code

​Call models in different frameworks

Supported models

Model family

Integration code

Call models in different frameworks