FeaturesEvals

Datasets

Create and manage datasets for evaluations and experiments.
  1. Sign up — Create an account at platform.respan.ai
  2. Create an API key — Generate one on the API keys page
  3. Add credits or a provider key — Add credits on the Credits page or connect your own provider key on the Integrations page

Add the Docs MCP to your AI coding tool to get help building with Respan. No API key needed.

1{
2  "mcpServers": {
3    "respan-docs": {
4      "url": "https://docs.respan.ai/mcp"
5    }
6  }
7}

A dataset is a curated collection of logs (inputs/outputs + metadata) that you can evaluate, annotate, and use to power experiments.

Create from existing logs

Sample production logs into a dataset by applying filters, time ranges, and sampling percentages.

1

Go to Datasets and click Create

Navigate to Datasets and click Create dataset. Choose From logs (sampling).

Create dataset from logs
2

Set filters, time range, and sampling percentage

Configure filters (e.g. status_code = 200, specific model, metadata), time range, and sampling percentage.

Dataset filters
3

Create and verify

Click Create. Once ingestion finishes, open the dataset and confirm logs appear.

Dataset logs

Create manually

Create an empty dataset and add logs by hand — via JSON, CSV, or API.

1

Create an empty dataset

Navigate to Datasets, click Create dataset, and choose Create empty.

Create empty dataset
2

Add logs

Click Insert new log and provide JSON with input and output, or click Import from CSV to upload a batch.

Insert JSON log

CSV template (Google Drive)