List latency / TTFT / TPS quantiles

POST

https://api.respan.ai/api/dashboard/quantiles/

POST

/api/dashboard/quantiles/

curl -X POST https://api.respan.ai/api/dashboard/quantiles/ \
     -H "Authorization: Bearer <respanApiKey>" \
     -H "Content-Type: application/json" \
     -d '{}'

200Successful

{
  "data": [
    {
      "date_group": "2024-01-15T09:30:00Z",
      "latency_quantiles_p_50": 1.1,
      "latency_quantiles_p_90": 1.1,
      "latency_quantiles_p_95": 1.1,
      "latency_quantiles_p_99": 1.1,
      "ttft_quantiles_p_50": 1.1,
      "ttft_quantiles_p_90": 1.1,
      "ttft_quantiles_p_95": 1.1,
      "ttft_quantiles_p_99": 1.1,
      "tps_quantiles_p_50": 1.1,
      "tps_quantiles_p_90": 1.1,
      "tps_quantiles_p_95": 1.1,
      "tps_quantiles_p_99": 1.1,
      "prompt_tokens_quantiles_p_50": 1.1,
      "prompt_tokens_quantiles_p_90": 1.1,
      "prompt_tokens_quantiles_p_95": 1.1,
      "prompt_tokens_quantiles_p_99": 1.1,
      "completion_tokens_quantiles_p_50": 1.1,
      "completion_tokens_quantiles_p_90": 1.1,
      "completion_tokens_quantiles_p_95": 1.1,
      "completion_tokens_quantiles_p_99": 1.1
    }
  ]
}

Returns p50, p90, p95, and p99 distributions for latency, time-to-first-token, and tokens-per-second, bucketed by time_tick.

Authentication

AuthorizationBearer

Use your Respan API key for Respan API authentication. Enter only the Respan API key value; clients send Authorization: Bearer <RESPAN_API_KEY>. For /api/responses, provider credentials such as Perplexity, OpenAI, or Azure OpenAI go in Settings -> Providers or respan_params.credential_override in the request body, not in this authentication field.

AuthorizationBearer

Use a dashboard JWT only for dashboard-authenticated endpoints. Respan API-key endpoints use the respanApiKey auth field instead.

Query parameters

summary_typeenumOptionalDefaults to all

Preset time range. Use this or explicit start_time / end_time.

datedateOptional

Base date used with summary_type presets.

start_timedatetimeOptional

Optional explicit ISO start time.

end_timedatetimeOptional

Optional explicit ISO end time.

time_tickenumOptionalDefaults to hour

Bucket granularity for time-series responses.

Allowed values:

timezone_offsetdoubleOptionalDefaults to 0

Timezone offset, in hours, used when resolving preset ranges.

Request

This endpoint expects an object.

filtersobjectOptional

Filter criteria. See Filters API Reference for operator syntax.

metrics_to_aggregatelist of enumsOptional

Quantile metric families to calculate.

Response

Successful response.

datalist of objects