Replace evaluator version

curl -X PUT https://api.respan.ai/api/evaluators/evaluator_id/versions/1/ \
     -H "Authorization: Bearer sk_live_xxxxx" \
     -H "Content-Type: application/json" \
     -d '{
  "name": "Response Quality",
  "type": "llm",
  "score_value_type": "numerical",
  "evaluator_slug": "response_quality",
  "eval_class": "keywordsai_custom_llm",
  "score_config": {
    "min_score": 1,
    "max_score": 5
  },
  "passing_conditions": {
    "primary_score": {
      "operator": "gte",
      "value": 3
    }
  },
  "llm_config": {
    "model": "gpt-4o-mini",
    "evaluator_definition": "Rate the quality.\n<input>{{input}}</input>\n<output>{{output}}</output>",
    "scoring_rubric": "1=Poor, 5=Excellent"
  }
}'

{
  "id": "evl_550e8400",
  "version_id": "evlv_550e8400",
  "version": 1,
  "is_read_only": false,
  "name": "Response Quality",
  "type": "llm",
  "score_value_type": "numerical",
  "version_description": "Tightened rubric wording",
  "description": "Grades whether the response is accurate and complete.",
  "score_config": {
    "min_score": 1,
    "max_score": 5,
    "choices": [
      {
        "name": "Excellent",
        "value": "excellent"
      }
    ]
  },
  "passing_conditions": {
    "primary_score": {
      "operator": "gte",
      "value": 3
    }
  },
  "llm_config": {
    "model": "gpt-4o-mini",
    "evaluator_definition": "Rate the response quality.\n<input>{{input}}</input>\n<output>{{output}}</output>",
    "scoring_rubric": "1=Poor, 5=Excellent",
    "temperature": 0.1,
    "max_tokens": 200,
    "top_p": 0.9,
    "frequency_penalty": 0.5,
    "presence_penalty": 0.3,
    "stop": [
      "###"
    ],
    "response_format": {},
    "tools": [
      {}
    ],
    "verbosity": "detailed"
  },
  "code_config": {
    "eval_code_snippet": "def main(eval_inputs):\n    return 1 if eval_inputs.get('output') else 0"
  },
  "configurations": {},
  "categorical_choices": [
    {
      "name": "Excellent",
      "value": "excellent"
    }
  ],
  "eval_class": "keywordsai_custom_llm",
  "starred": false,
  "created_at": "2024-01-15T09:30:00Z",
  "updated_at": "2024-01-15T09:30:00Z",
  "created_by": {
    "id": 101,
    "first_name": "Alice",
    "last_name": "Johnson",
    "email": "alice.johnson@respan.ai"
  },
  "updated_by": {
    "id": 102,
    "first_name": "Bob",
    "last_name": "Smith",
    "email": "bob.smith@respan.ai"
  }
}

Replace a specific evaluator version. Only the current draft (is_read_only: false) can be edited.

Path parameters

evaluator_idstringRequired

Evaluator ID. To run a specific version, pass an ID with a version suffix where supported, for example evl_abc123:2.

versionintegerRequired>=0

Evaluator version number.

Request

This endpoint expects an object.

namestringRequired

typeenumRequired

Allowed values:

score_value_typeenumRequired

evaluator_slugstringOptional

Organization-scoped evaluator slug.

eval_classenumOptional

Optional pre-built evaluator template.

Allowed values:

descriptionstring or nullOptional

score_configobjectOptional

Score configuration. For numerical/percentage scores, use min_score and max_score. For select scores, use choices.

passing_conditionsobject or nullOptional

Passing conditions in the standard Respan filter format.

llm_configobject or nullOptional

LLM grader configuration. The backend validates this against the selected evaluator form.

code_configobject or nullOptional

Code grader configuration.

configurationsmap from strings to anyOptional

Legacy user-facing configuration object. New clients should prefer llm_config, code_config, score_config, and passing_conditions.

categorical_choiceslist of objectsOptional

starredbooleanOptional

Response

Updated evaluator version.

idstring

Stable evaluator ID shared by all versions.

version_idstring

Unique ID for this evaluator version.

versioninteger

Version number. The first draft is version 0.

is_read_onlyboolean

Whether this version is committed and immutable.

namestring

typeenum

Allowed values:

score_value_typeenum

version_descriptionstring

Commit message for this version.

descriptionstring or null

score_configobject

Score configuration. For numerical/percentage scores, use min_score and max_score. For select scores, use choices.

passing_conditionsobject or null

Passing conditions in the standard Respan filter format.

llm_configobject or null

LLM grader configuration. The backend validates this against the selected evaluator form.

code_configobject or null

Code grader configuration.

configurationsmap from strings to any

Legacy user-facing configuration object. New clients should prefer llm_config, code_config, score_config, and passing_conditions.

categorical_choiceslist of objects or null

eval_classenum

Optional pre-built evaluator template.

Allowed values:

starredboolean

created_atdatetime

updated_atdatetime

created_byobject

updated_byobject

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

Path parameters

Headers

Request

Response

Errors