For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
DiscordPlatform
DocumentationIntegrationsAPI referenceSDKsChangelog
DocumentationIntegrationsAPI referenceSDKsChangelog
    • Overview
  • Tracing
  • Gateway
      • OpenAI Agents
      • Claude Agent SDK
      • Vercel AI SDK
      • Pydantic AI
      • CrewAI
      • Haystack
      • LangChain
      • LangGraph
      • Langflow
      • LlamaIndex
      • AutoGen
      • DSPy
      • Google ADK
      • Smolagents
      • Strands Agents
      • AgentSpec
      • Guardrails
      • Agno
      • MCP
      • BeeAI
      • Pipecat
      • Superagent
  • Others
  • Migrating
    • Braintrust
    • Portkey
    • Langfuse
LogoLogo
DiscordPlatform
On this page
  • Setup
  • Switch models
GatewayAgent Frameworks

Langflow (gateway)

Was this page helpful?
Previous

LlamaIndex (gateway)

Next
Built with

Route Langflow’s underlying LLM calls through the Respan gateway to use 250+ models from different providers. Only your Respan API key is needed — no separate provider keys required.

Setup

1

Install packages

$pip install respan-tracing respan-instrumentation-langchain langflow langchain langchain-openai python-dotenv
2

Set environment variables

Set the OpenAI environment variables to point at the Respan gateway. Langflow components built on langchain-openai will pick these up automatically.

$export OPENAI_API_KEY="YOUR_RESPAN_API_KEY"
$export OPENAI_BASE_URL="https://api.respan.ai/api"

No real OpenAI key needed — the Respan gateway handles provider authentication.

3

Run your flow

1from langflow.load import run_flow_from_json
2
3result = run_flow_from_json(
4 flow="path/to/your/flow.json",
5 input_value="What is the meaning of life?",
6)
7print(result)

Switch models

Change the model in your flow’s OpenAI component to use 250+ models from different providers through the same gateway, for example gpt-4.1-nano, claude-sonnet-4-5-20250929, or gemini-2.5-flash.

See the full model list.