List evaluators with filters

curl -X POST "https://api.respan.ai/api/evaluators/list/?sort_by=name" \
     -H "Authorization: Bearer sk_live_xxxxx" \
     -H "Content-Type: application/json" \
     -d '{}'

{
  "count": 1,
  "results": [
    {
      "id": "evl_550e8400",
      "name": "Response Quality",
      "type": "llm",
      "score_value_type": "numerical",
      "version_id": "evlv_550e8400",
      "version": 1,
      "is_read_only": false,
      "version_description": "Tightened rubric wording",
      "evaluator_slug": "response_quality",
      "eval_class": "keywordsai_custom_llm",
      "description": "Grades whether the response is accurate and complete.",
      "score_config": {
        "min_score": 1,
        "max_score": 5,
        "choices": [
          {
            "name": "Excellent",
            "value": "excellent"
          }
        ]
      },
      "passing_conditions": {
        "primary_score": {
          "operator": "gte",
          "value": 3
        }
      },
      "llm_config": {
        "model": "gpt-4o-mini",
        "evaluator_definition": "Rate the response quality.\n<input>{{input}}</input>\n<output>{{output}}</output>",
        "scoring_rubric": "1=Poor, 5=Excellent",
        "temperature": 0.1,
        "max_tokens": 200,
        "top_p": 0.9,
        "frequency_penalty": 0.5,
        "presence_penalty": 0.3,
        "stop": [
          "\n"
        ],
        "response_format": {},
        "tools": [
          {}
        ],
        "verbosity": "detailed"
      },
      "code_config": {
        "eval_code_snippet": "def main(eval_inputs):\n    return 1 if eval_inputs.get('output') else 0"
      },
      "configurations": {},
      "categorical_choices": [
        {
          "name": "Excellent",
          "value": "excellent"
        }
      ],
      "starred": false,
      "created_at": "2024-01-15T09:30:00Z",
      "updated_at": "2024-01-15T09:30:00Z",
      "created_by": {
        "id": 101,
        "first_name": "Alice",
        "last_name": "Johnson",
        "email": "alice.johnson@respan.ai"
      },
      "updated_by": {
        "id": 102,
        "first_name": "Bob",
        "last_name": "Smith",
        "email": "bob.smith@respan.ai"
      },
      "editor": {
        "id": 103,
        "first_name": "Carol",
        "last_name": "Davis",
        "email": "carol.davis@respan.ai"
      },
      "tags": [
        {
          "id": 10,
          "name": "Quality",
          "color": "#4CAF50"
        }
      ]
    }
  ],
  "next": "https://api.respan.ai/api/evaluators/list/?page=2",
  "previous": "https://api.respan.ai/api/evaluators/list/?page=1",
  "current_filters": {},
  "filters_data": {}
}

List evaluators using POST-for-filtering. The backend returns only the current draft/latest row for each evaluator and includes filter metadata for dashboard clients.

Query parameters

pageintegerOptional>=1

Page number.

page_sizeintegerOptional1-100

Number of results to return per page. Maximum 100.

sort_bystringOptional

Field to sort by. Prefix with - for descending order.

Request

This endpoint expects an object.

filtersobjectOptional

Filter criteria using the standard Respan filter format.

is_exportingbooleanOptionalDefaults to false

Reserved for dashboard exports.

Response

Paginated filtered evaluator list.

countinteger

Number of resources returned on this page.

resultslist of objects

nextstring or null

URL for the next page, if any.

previousstring or null

URL for the previous page, if any.

current_filtersobject

Normalized filters applied to this request.

filters_datamap from strings to any

Available filter options for evaluator list UI clients.

Errors

400

Bad Request Error

401

Unauthorized Error

Headers

Query parameters

Request

Response

Errors