Fireworks AI

1
{
2
  "mcpServers": {
3
    "respan-docs": {
4
      "url": "https://docs.respan.ai/mcp"
5
    }
6
  }
7
}

Use Respan Gateway to call Fireworks AI models while keeping unified observability (logs, cost, latency, and reliability metrics) in Respan — and optionally charge usage to your own Fireworks credits.

Prerequisites

• A Respan API key
• A Fireworks API key (BYOK credits)

Supported SDKs / integrations

Configuration

There are 2 ways to add your Fireworks credentials to your requests:

Via UI (Global)

1

Navigate to Providers

Go to the Providers page. This page allows you to manage credentials for over 20+ supported providers.

2

Add your Fireworks API Key

Select Fireworks and paste your API key.

3

Configure Load Balancing (Optional)

You can add multiple Fireworks API keys for redundancy. Use the Load balancing weight field to determine how traffic is distributed between keys.

Via code (Per-Request)

You can pass credentials dynamically in the request body. This is useful if you need to use your users’ own API keys (BYOK credits).

Add the customer_credentials parameter to your Gateway request:

1
{
2
  // Rest of the request body
3
  "customer_credentials": {
4
    "fireworks": {
5
      "api_key": "YOUR_FIREWORKS_API_KEY"
6
    }
7
  }
8
}

Log Fireworks AI requests

If you are not using the Gateway to proxy requests, you can still log your Fireworks requests to Respan asynchronously. This allows you to track cost, latency, and performance metrics for external calls.

1
import requests
2
3
url = "https://api.respan.ai/api/request-logs/create/"
4
payload = {
5
    "model": "accounts/fireworks/models/llama-v3p1-8b-instruct",
6
    "prompt_messages": [
7
        {
8
            "role": "user",
9
            "content": "Summarize the benefits of renewable energy"
10
        }
11
    ],
12
    "completion_message": {
13
        "role": "assistant",
14
        "content": "Renewable energy offers benefits like lower emissions, improved air quality, and long-term cost stability..."
15
    },
16
    "cost": 0.0003,
17
    "generation_time": 1.5,
18
    "customer_params": {
19
        "customer_identifier": "user_202"
20
    }
21
}
22
headers = {
23
    "Authorization": "Bearer YOUR_RESPAN_API_KEY",
24
    "Content-Type": "application/json"
25
}
26
27
response = requests.post(url, headers=headers, json=payload)