Llm Models Foundation Models List

GET

https://api.respan.ai/llm_models/foundation_models/

GET

/llm_models/foundation_models/

$ curl https://api.respan.ai/llm_models/foundation_models/ \
>      -H "Authorization: Bearer <token>"

200Retrieved

1 [
2   {
3     "id": 1,
4     "model_name": "string",
5     "updated_at": "2024-01-15T09:30:00Z",
6     "display_name": "string",
7     "speed": 1.1,
8     "max_context_window": 1,
9     "model_size": 1,
10     "mmlu_score": 1.1,
11     "mt_bench_score": 1.1,
12     "big_bench_score": 1.1,
13     "input_cost": 1.1,
14     "output_cost": 1.1,
15     "rate_limit": 1,
16     "token_rate_limit": 1,
17     "multilingual": 1,
18     "streaming_support": 1,
19     "function_call": 1,
20     "enforce_function_call": 1,
21     "weight": 1.1,
22     "image_support": 1,
23     "hf_url": "string",
24     "model_description": "string",
25     "model_params": [
26       "string"
27     ],
28     "total_requests": 1,
29     "total_cost": 1.1,
30     "total_tokens": 1,
31     "total_completion_tokens": 1,
32     "total_prompt_tokens": 1,
33     "avg_tps": 1.1
34   }
35 ]

Authentication

AuthorizationBearer

JWT access token or Respan API key

Response

idintegerRead-only

model_namestring<=255 characters

updated_atdatetimeRead-only

display_namestringOptional<=255 characters

speeddoubleOptional

max_context_windowintegerOptional-2147483648-2147483647

model_sizeintegerOptional-2147483648-2147483647

mmlu_scoredoubleOptional

mt_bench_scoredoubleOptional

big_bench_scoredoubleOptional

input_costdoubleOptional

output_costdoubleOptional

rate_limitintegerOptional-2147483648-2147483647

token_rate_limitintegerOptional-2147483648-2147483647

multilingualintegerOptional-2147483648-2147483647

streaming_supportintegerOptional-2147483648-2147483647

function_callintegerOptional-2147483648-2147483647

enforce_function_callintegerOptional-2147483648-2147483647

weightdoubleOptional

image_supportintegerOptional-2147483648-2147483647

hf_urlstringOptionalformat: "uri"<=200 characters

model_descriptionstringOptional

model_paramslist of stringsOptional

total_requestsintegerOptional-2147483648-2147483647

total_costdoubleOptional

total_tokenslongOptional-9223372036854776000-9223372036854776000

total_completion_tokenslongOptional-9223372036854776000-9223372036854776000

total_prompt_tokenslongOptional-9223372036854776000-9223372036854776000

avg_tpsdoubleOptional