Llm Models Models List

GET

https://api.respan.ai/llm_models/models/

GET

/llm_models/models/

$ curl https://api.respan.ai/llm_models/models/ \
>      -H "Authorization: Bearer <token>"

200Retrieved

1 {
2   "count": 25,
3   "results": [
4     {
5       "provider": {
6         "provider_name": "string",
7         "provider_id": "string",
8         "created_at": "2024-01-15T09:30:00Z",
9         "updated_at": "2024-01-15T09:30:00Z",
10         "id": "string",
11         "project": "string",
12         "respan_discount_rate": 1.1
13       },
14       "supported_params": "string",
15       "model_name": "string",
16       "id": "string",
17       "is_byok": true,
18       "effective_discount_rate": 1.1,
19       "project": "string",
20       "affiliation_category": "custom",
21       "is_managed": true,
22       "is_called_by_custom_name": true,
23       "base_model_name": "string",
24       "display_name": "string",
25       "max_context_window": 1,
26       "input_cost": 1.1,
27       "output_cost": 1.1,
28       "cache_hit_input_cost": 1.1,
29       "cache_creation_input_cost": 1.1,
30       "respan_discount_rate": 1.1,
31       "streaming_support": 1,
32       "function_call": 1,
33       "image_support": 1,
34       "overridden_fields": [
35         "string"
36       ],
37       "status": "active",
38       "is_verified": true,
39       "source": "hardcoded",
40       "model_type": "chat",
41       "metadata": {
42         "privacy_policy_url": "string",
43         "zero_data_retention": true,
44         "prompt_training": true,
45         "prompt_logging": true,
46         "moderation": true,
47         "is_available_on_credits": true,
48         "stream_cancellation_supported": true,
49         "precision": "string",
50         "quantization": "string",
51         "release_date": "string",
52         "context_size": 1,
53         "weekly_tokens": 1,
54         "daily_tokens": 1,
55         "benchmarks": {
56           "deepswe": {
57             "version": "string",
58             "generated_at": "string",
59             "n_tasks_in_set": 1,
60             "model": "string",
61             "harness": "string",
62             "reasoning_effort": "string",
63             "config": "string",
64             "source": "string",
65             "pass_rate": 0.5,
66             "pass_at_1": 0.5,
67             "pass_at_4": 0.5
68           }
69         }
70       }
71     }
72   ],
73   "next": "string",
74   "previous": "string",
75   "total_count": 100,
76   "current_filters": {},
77   "filters_data": {}
78 }

GET/POST /api/llm_models/models/ (platform - shows global + custom) GET/POST /api/llm-models/custom-models/ (public API - shows ONLY custom)

Unified endpoint for models.

GET: List models

Platform: global + org’s custom (same for superadmin - no cross-org listing)
Public (custom-models path): ONLY org’s custom models Filter with standard syntax: { “filters”: { “affiliation_category”: { “value”: [“CUSTOM”] } } }

POST:

Without ‘model_name’ in body: Filter/list models (backward compatible)
With ‘model_name’ in body: Create model
- organization_id=null + superadmin: Create global model
- Otherwise: Create custom model for target org (superadmin can specify organization_id)

Note: Uses SuperAdminMixin for consistency, but queryset is intentionally the same for both regular users and superadmins (global + org’s custom pattern).

GET/POST /api/llm_models/models/ (platform - shows global + custom) GET/POST /api/llm-models/custom-models/ (public API - shows ONLY custom) Unified endpoint for models. GET: List models - Platform: global + org's custom (same for superadmin - no cross-org listing) - Public (custom-models path): ONLY org's custom models Filter with standard syntax: { "filters": { "affiliation_category": { "value": ["CUSTOM"] } } } POST: - Without 'model_name' in body: Filter/list models (backward compatible) - With 'model_name' in body: Create model - organization_id=null + superadmin: Create global model - Otherwise: Create custom model for target org (superadmin can specify organization_id) Note: Uses SuperAdminMixin for consistency, but queryset is intentionally the same for both regular users and superadmins (global + org's custom pattern).

Authentication

AuthorizationBearer

JWT access token or Respan API key

Query parameters

pageintegerOptional

A page number within the paginated result set.

page_sizeintegerOptional

Number of results to return per page.

Response

countinteger

resultslist of objects

nextstring or nullformat: "uri"

previousstring or nullformat: "uri"

total_countinteger

current_filtersobject

Pydantic model for FilterParamDict. A dictionary that maps metric names to their filter parameters.

Each key is a metric name (str), and each value can be:

A single MetricFilterParamPydantic (one condition)
A List[MetricFilterParamPydantic] (multiple conditions for same metric)
A FilterBundlePydantic (nested filter bundle with connector)

Note: Uses extra=“allow” for dynamic metric name fields. The pydantic_extra annotation tells Pydantic what types to expect for extra fields, and generates typed additionalProperties in JSON Schema.

filters_dataobject