List LLM metrics

POST

https://api.respan.ai/api/dashboard/llm-metrics/

POST

/api/dashboard/llm-metrics/

curl -X POST https://api.respan.ai/api/dashboard/llm-metrics/ \
     -H "Authorization: Bearer <respanApiKey>" \
     -H "Content-Type: application/json" \
     -d '{}'

200Successful

{
  "data": [
    {
      "date_group": "2024-01-15T09:30:00Z",
      "number_of_requests": 1,
      "total_cost": 1.1,
      "total_prompt_tokens": 1,
      "total_completion_tokens": 1,
      "total_tokens": 1,
      "max_tpm": 1,
      "error_count": 1,
      "error_percentage": 1.1,
      "average_prompt_tokens": 1.1,
      "average_completion_tokens": 1.1,
      "average_tokens": 1.1,
      "average_cost": 1.1,
      "average_latency": 1.1,
      "average_tps": 1.1,
      "average_ttft": 1.1,
      "prompt_cache_hit_tokens": 1,
      "reasoning_tokens": 1,
      "cache_hit_percentage": 1.1,
      "requests_per_second": 1.1,
      "latency": 1.1,
      "time_to_first_token": 1.1
    }
  ],
  "summary": {},
  "filter_options": {}
}

Returns LLM usage metrics (requests, tokens, cost, latency, cache hit rate, etc.) bucketed by time_tick (minute / hour / day).

Authentication

AuthorizationBearer

Use your Respan API key for Respan API authentication. Enter only the Respan API key value; clients send Authorization: Bearer <RESPAN_API_KEY>. For /api/responses, provider credentials such as Perplexity, OpenAI, or Azure OpenAI go in Settings -> Providers or respan_params.credential_override in the request body, not in this authentication field.

AuthorizationBearer

Use a dashboard JWT only for dashboard-authenticated endpoints. Respan API-key endpoints use the respanApiKey auth field instead.

Query parameters

summary_typeenumOptionalDefaults to all

Preset time range. Use this or explicit start_time / end_time.

datedateOptional

Base date used with summary_type presets.

start_timedatetimeOptional

Optional explicit ISO start time.

end_timedatetimeOptional

Optional explicit ISO end time.

time_tickenumOptionalDefaults to hour

Bucket granularity for time-series responses.

Allowed values:

timezone_offsetdoubleOptionalDefaults to 0

Timezone offset, in hours, used when resolving preset ranges.

fetch_filtersenumOptionalDefaults to true

Whether to include available filter options in the response.

Allowed values:

Request

This endpoint expects an object.

filtersobjectOptional

Filter criteria. See Filters API Reference for operator syntax.

Response

Successful response.

datalist of objects

summarymap from strings to any

filter_optionsmap from strings to any or null