Skip to content
MCP server

Litellm MCP

Give AI agents access to 100+ LLMs. Call any model, compare outputs.

Runs locallyStatus and history
Install
Pricing
Open source
Runs
Locally
Version
1.0.1
Listing updated
4 days ago

About Litellm MCP

Litellm MCP is an open-source MCP server. It runs locally on your machine and is started by your AI client.

Install

Run in a terminal

claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' -- uvx litellm-mcp

Add to claude_desktop_config.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "litellm-mcp": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}

Configuration

  • OPENAI_API_KEYOpenAI API key for GPT models
  • ANTHROPIC_API_KEYAnthropic API key for Claude models

Pricing

Open source

Litellm MCP FAQ

Is Litellm MCP free?

Yes. Litellm MCP is open source, so you can use and self-host it for free.

How do I add Litellm MCP to Claude Code?

Run this command in your terminal: claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' -- uvx litellm-mcp