Cohere (gateway)

Route Cohere chat through the Respan gateway to use Cohere models through the OpenAI-compatible API. Only your Respan API key is needed - no separate Cohere key is required in your application.

Setup

Install packages

$ pip install respan-ai respan-instrumentation-cohere cohere python-dotenv

Set environment variables

$ export RESPAN_API_KEY="YOUR_RESPAN_API_KEY"

No CO_API_KEY needed - the Respan gateway handles provider authentication.

Point to the Respan gateway

1 import os
2 from openai import OpenAI
3 
4 client = OpenAI(
5     api_key=os.getenv("RESPAN_API_KEY"),
6     base_url="https://api.respan.ai/api",
7 )
8 
9 response = client.chat.completions.create(
10     model="command-r",
11     messages=[{"role": "user", "content": "Say hello in three languages."}],
12 )
13 print(response.choices[0].message.content)

Switch models

Change the model parameter to use Cohere or any other gateway-supported model through the same gateway.

1 response = client.chat.completions.create(model="command-r", messages=messages)
2 response = client.chat.completions.create(model="command-r-plus", messages=messages)
3 response = client.chat.completions.create(model="gpt-4.1-nano", messages=messages)

See the full model list.

1	import os
2	from openai import OpenAI
3
4	client = OpenAI(
5	api_key=os.getenv("RESPAN_API_KEY"),
6	base_url="https://api.respan.ai/api",
7	)
8
9	response = client.chat.completions.create(
10	model="command-r",
11	messages=[{"role": "user", "content": "Say hello in three languages."}],
12	)
13	print(response.choices[0].message.content)