Eval Sets Retrieve

GET

https://api.respan.ai/evaluations/eval-sets/:id/

GET

/evaluations/eval-sets/:id/

$ curl https://api.respan.ai/evaluations/eval-sets/id/ \
>      -H "Authorization: Bearer <token>"

200Retrieved

1 {
2   "id": "string",
3   "completed_annotation_count": 1,
4   "updated_by": {
5     "id": 1,
6     "email": "string",
7     "name": "string",
8     "username": "string",
9     "first_name": "string",
10     "last_name": "string"
11   },
12   "tags": [
13     {
14       "id": "string",
15       "name": "string",
16       "color": "string",
17       "created_at": "2024-01-15T09:30:00Z",
18       "updated_at": "2024-01-15T09:30:00Z"
19     }
20   ],
21   "name": "string",
22   "granularity": "logs",
23   "created_at": "2024-01-15T09:30:00Z",
24   "updated_at": "2024-01-15T09:30:00Z",
25   "log_count": 1,
26   "status": "initializing",
27   "organization": 1,
28   "initial_log_filters": {},
29   "project": "string",
30   "type": "llm",
31   "description": "string",
32   "running_progress": 1.1,
33   "running_status": "draft",
34   "running_at": "2024-01-15T09:30:00Z",
35   "unique_organization_ids": [
36     "string"
37   ],
38   "timestamps": [
39     "2024-01-15T09:30:00Z"
40   ],
41   "ingest_workflow_id": "string",
42   "starred": true,
43   "evaluator": "string"
44 }

Retrieve, update, and delete a dataset

Endpoints: GET /api/datasets/{dataset_id}/ PATCH /api/datasets/{dataset_id}/ DELETE /api/datasets/{dataset_id}/

Superadmin: Can READ any dataset across all organizations via JWT. Cannot WRITE via JWT - must use API key for write operations. Regular users: Can only access datasets in their organization.

Defense-in-depth:

Args (PATCH):

name (Optional): string
description (Optional): string

Returns (GET 200): { “id”: “dataset_id”, “name”: “Support Conversations - July”, “type”: “sampling”, “description”: “Sampled support chats for July”, “created_at”: “2025-07-26T00:00:00Z”, “updated_at”: “2025-07-27T08:10:00Z”, “organization”: 123, “initial_log_filters”: {“status_code”: {“operator”: “eq”, “value”: 200}}, “unique_organization_ids”: [], “timestamps”: [], “log_count”: 250, “evaluator”: null, “status”: “ready”, “running_status”: “pending”, “running_progress”: 0, “running_at”: null, “completed_annotation_count”: 0 }

Returns (PATCH 200): Same shape as GET with updated fields Returns (DELETE 204): No content

Defense-in-depth: SuperAdminMixin provides queryset routing + object-level ownership.

Retrieve, update, and delete a dataset Endpoints: GET /api/datasets/{dataset_id}/ PATCH /api/datasets/{dataset_id}/ DELETE /api/datasets/{dataset_id}/ Superadmin: Can READ any dataset across all organizations via JWT. Cannot WRITE via JWT - must use API key for write operations. Regular users: Can only access datasets in their organization. Defense-in-depth: Args (PATCH): - name (Optional): string - description (Optional): string Returns (GET 200): { "id": "dataset_id", "name": "Support Conversations - July", "type": "sampling", "description": "Sampled support chats for July", "created_at": "2025-07-26T00:00:00Z", "updated_at": "2025-07-27T08:10:00Z", "organization": 123, "initial_log_filters": {"status_code": {"operator": "eq", "value": 200}}, "unique_organization_ids": [], "timestamps": [], "log_count": 250, "evaluator": null, "status": "ready", "running_status": "pending", "running_progress": 0, "running_at": null, "completed_annotation_count": 0 } Returns (PATCH 200): Same shape as GET with updated fields Returns (DELETE 204): No content Defense-in-depth: SuperAdminMixin provides queryset routing + object-level ownership.

Authentication

AuthorizationBearer

JWT access token or Respan API key

Path parameters

idstringRequired

Response

idstringRead-only

completed_annotation_countintegerRead-only

updated_byobject

tagslist of objectsRead-only

namestring<=255 characters

granularityenum

Eval unit for this dataset: ‘logs’ (one span per row) or ‘traces’ (one root row per trace). Chosen at creation and immutable.

logs - Logs
traces - Traces
threads - Threads

created_atdatetimeRead-only

updated_atdatetimeRead-only

log_countintegerRead-only

statusenum

initializing - Initializing
ready - Ready
failed - Failed
loading - Loading

organizationinteger

initial_log_filtersobject

Pydantic model for FilterParamDict. A dictionary that maps metric names to their filter parameters.

Each key is a metric name (str), and each value can be:

A single MetricFilterParamPydantic (one condition)
A List[MetricFilterParamPydantic] (multiple conditions for same metric)
A FilterBundlePydantic (nested filter bundle with connector)

Note: Uses extra=“allow” for dynamic metric name fields. The pydantic_extra annotation tells Pydantic what types to expect for extra fields, and generates typed additionalProperties in JSON Schema.

projectstring or null

typeenum

llm - Llm
human - Human
dataset - Dataset
sampling - Sampling
reference - Reference

descriptionstring

running_progressdouble

running_statusenum

draft - Draft
pending - Pending
paused - Paused
running - Running
waiting_for_annotations - Waiting For Annotations
completed - Completed
failed - Failed

running_atdatetime or null

unique_organization_idslist of strings

timestampslist of datetimes

ingest_workflow_idstring or null<=255 characters

starredboolean

evaluatorstring or null