LiteLLM Exporter
Installation
Classes
RespanLiteLLMCallback
LiteLLM-native callback handler that sends completion logs to Respan.
Methods
Helper functions
NamedCallbackRegistry
Named registry for managing LiteLLM callbacks.
$ pip install respan-exporter-litellm
LiteLLM-native callback handler that sends completion logs to Respan.
1 from respan_exporter_litellm import RespanLiteLLMCallback
| Parameter | Type | Default | Description |
|---|---|---|---|
api_key | str | None | None | Respan API key. Falls back to RESPAN_API_KEY env var. |
base_url | str | None | None | API base URL. Falls back to RESPAN_BASE_URL. |
| Method | Description |
|---|---|
log_success_event(kwargs, response_obj, start_time, end_time) | Log a successful LLM completion. |
log_failure_event(kwargs, response_obj, start_time, end_time) | Log a failed LLM completion. |
async_log_success_event(kwargs, response_obj, start_time, end_time) | Async version of success logging. |
async_log_failure_event(kwargs, response_obj, start_time, end_time) | Async version of failure logging. |
| Function | Description |
|---|---|
register_litellm_callbacks(name) | Register Respan callbacks on the LiteLLM instance. |
Named registry for managing LiteLLM callbacks.
1 import litellm 2 from respan_exporter_litellm import RespanLiteLLMCallback 3 4 # Register callback 5 respan_callback = RespanLiteLLMCallback(api_key="your-api-key") 6 litellm.callbacks = [respan_callback] 7 8 # Use LiteLLM normally — all calls are automatically logged 9 response = litellm.completion( 10 model="gpt-4o-mini", 11 messages=[{"role": "user", "content": "Tell me a joke"}], 12 ) 13 print(response.choices[0].message.content)
1 import litellm 2 from respan_exporter_litellm import RespanLiteLLMCallback 3 4 litellm.callbacks = [RespanLiteLLMCallback(api_key="your-api-key")] 5 6 response = await litellm.acompletion( 7 model="gpt-4o-mini", 8 messages=[{"role": "user", "content": "Tell me a joke"}], 9 )