Llm Models Foundation Models List

GET

https://api.respan.ai/llm_models/foundation_models/

GET

/llm_models/foundation_models/

$ curl https://api.respan.ai/llm_models/foundation_models/ \
>      -H "Authorization: Bearer <token>"

200Retrieved

1 [
2   {
3     "id": 1,
4     "model_name": "string",
5     "updated_at": "2024-01-15T09:30:00Z",
6     "display_name": "string",
7     "speed": 1.1,
8     "max_context_window": 1,
9     "model_size": 1,
10     "mmlu_score": 1.1,
11     "mt_bench_score": 1.1,
12     "big_bench_score": 1.1,
13     "input_cost": 1.1,
14     "output_cost": 1.1,
15     "rate_limit": 1,
16     "token_rate_limit": 1,
17     "multilingual": 1,
18     "streaming_support": 1,
19     "function_call": 1,
20     "enforce_function_call": 1,
21     "weight": 1.1,
22     "image_support": 1,
23     "hf_url": "string",
24     "model_description": "string",
25     "model_params": [
26       "string"
27     ],
28     "total_requests": 1,
29     "total_cost": 1.1,
30     "total_tokens": 1,
31     "total_completion_tokens": 1,
32     "total_prompt_tokens": 1,
33     "avg_tps": 1.1
34   }
35 ]

Authentication

AuthorizationBearer

JWT access token or Respan API key

Response

idintegerRead-only

model_namestring<=255 characters

updated_atdatetimeRead-only

display_namestring<=255 characters

speeddouble

max_context_windowinteger-2147483648-2147483647

model_sizeinteger-2147483648-2147483647

mmlu_scoredouble

mt_bench_scoredouble

big_bench_scoredouble

input_costdouble

output_costdouble

rate_limitinteger-2147483648-2147483647

token_rate_limitinteger-2147483648-2147483647

multilingualinteger-2147483648-2147483647

streaming_supportinteger-2147483648-2147483647

function_callinteger-2147483648-2147483647

enforce_function_callinteger-2147483648-2147483647

weightdouble

image_supportinteger-2147483648-2147483647

hf_urlstringformat: "uri"<=200 characters

model_descriptionstring

model_paramslist of strings

total_requestsinteger-2147483648-2147483647

total_costdouble

total_tokenslong-9223372036854776000-9223372036854776000

total_completion_tokenslong-9223372036854776000-9223372036854776000

total_prompt_tokenslong-9223372036854776000-9223372036854776000

avg_tpsdouble