Run an evaluator

POST

https://api.respan.ai/api/evaluators/:evaluator_id/run/

Run an evaluator against spans or a dataset to generate scores.

evaluator_idstringRequired

Evaluator Id

This endpoint expects an object.

log_idslist of stringsOptional

Span IDs to evaluate.

dataset_idstringOptional

Dataset ID to evaluate all spans in.

Successful response for Run evaluator

inputsobject

401

Unauthorized Error

1	curl -X POST https://api.respan.ai/api/evaluators/evaluator_id/run/ \
2	-H "Authorization: Bearer sk_live_xxxxx" \
3	-H "Content-Type: application/json" \
4	-d '{}'

1	{
2	"inputs": {
3	"input": {},
4	"output": {},
5	"metrics": {},
6	"metadata": {},
7	"llm_input": "Evaluate the following spans for accuracy and relevance.",
8	"llm_output": "The spans were evaluated with an overall accuracy score of 92%. Key metrics indicate strong relevance and coherence."
9	}
10	}