Llm Models Foundation Model Retrieve 2

GET

https://api.respan.ai/llm_models/foundation_model/:model_name/

GET

/llm_models/foundation_model/:model_name/

$ curl https://api.respan.ai/llm_models/foundation_model/model_name/ \
>      -H "Authorization: Bearer <token>"

200Retrieved

1 {
2   "id": 1,
3   "variants": "string",
4   "model_name": "string",
5   "updated_at": "2024-01-15T09:30:00Z",
6   "display_name": "string",
7   "speed": 1.1,
8   "max_context_window": 1,
9   "model_size": 1,
10   "mmlu_score": 1.1,
11   "mt_bench_score": 1.1,
12   "big_bench_score": 1.1,
13   "input_cost": 1.1,
14   "output_cost": 1.1,
15   "rate_limit": 1,
16   "token_rate_limit": 1,
17   "multilingual": 1,
18   "streaming_support": 1,
19   "function_call": 1,
20   "enforce_function_call": 1,
21   "weight": 1.1,
22   "image_support": 1,
23   "hf_url": "string",
24   "model_description": "string",
25   "model_params": [
26     "string"
27   ],
28   "total_requests": 1,
29   "total_cost": 1.1,
30   "total_tokens": 1,
31   "total_completion_tokens": 1,
32   "total_prompt_tokens": 1,
33   "avg_tps": 1.1
34 }

Foundation model detail by model_name. Auth optional — API key OR JWT parsed if present, anonymous allowed. Serializer filters variants by org when authenticated. See FoundationModelView for why the optional mixin replaces the bare JWT authenticator (it 401’d valid API-key callers).

Authentication

AuthorizationBearer

JWT access token or Respan API key

Path parameters

model_namestringRequired

Response

idintegerRead-only

variantsstringRead-only

model_namestring<=255 characters

updated_atdatetimeRead-only

display_namestring<=255 characters

speeddouble

max_context_windowinteger-2147483648-2147483647

model_sizeinteger-2147483648-2147483647

mmlu_scoredouble

mt_bench_scoredouble

big_bench_scoredouble

input_costdouble

output_costdouble

rate_limitinteger-2147483648-2147483647

token_rate_limitinteger-2147483648-2147483647

multilingualinteger-2147483648-2147483647

streaming_supportinteger-2147483648-2147483647

function_callinteger-2147483648-2147483647

enforce_function_callinteger-2147483648-2147483647

weightdouble

image_supportinteger-2147483648-2147483647

hf_urlstringformat: "uri"<=200 characters

model_descriptionstring

model_paramslist of strings

total_requestsinteger-2147483648-2147483647

total_costdouble

total_tokenslong-9223372036854776000-9223372036854776000

total_completion_tokenslong-9223372036854776000-9223372036854776000

total_prompt_tokenslong-9223372036854776000-9223372036854776000

avg_tpsdouble