FeaturesEvals

Testsets

Create and manage test cases for evaluating prompts.
  1. Sign up — Create an account at platform.respan.ai
  2. Create an API key — Generate one on the API keys page
  3. Add credits or a provider key — Add credits on the Credits page or connect your own provider key on the Integrations page

Add the Docs MCP to your AI coding tool to get help building with Respan. No API key needed.

1{
2  "mcpServers": {
3    "respan-docs": {
4      "url": "https://mcp.respan.ai/mcp/docs"
5    }
6  }
7}

Testsets are collections of test cases for evaluating prompts. Each row maps to your prompt variables.

Create a testset

Upload a CSV — create a CSV with column headers matching your prompt variable names (without {{}}). Include an ideal_output column for expected outputs.

Import the CSV and edit it like a spreadsheet — add, delete, or modify rows.

Add test cases from logs — if your logs contain prompt variables, you can add them directly to a testset. Click a log with variables, then click the + button to add it to a testset.