Skip to content
MCP server

LiteLLM Multi-Model API

Access 100+ LLMs with one API: GPT-4, Claude, Gemini, Mistral, and more.

Runs locallyStatus and history
Pricing
Open source
Runs
Locally
Version
1.0.2
Listing updated
4 days ago

About LiteLLM Multi-Model API

LiteLLM Multi-Model API is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.

Install

Run in a terminal

claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' --env LITELLM_API_KEY='<LITELLM_API_KEY>' -- uvx litellm-mcp

Add to claude_desktop_config.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "LITELLM_API_KEY": "<LITELLM_API_KEY>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "LITELLM_API_KEY": "<LITELLM_API_KEY>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "litellm-mcp": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "LITELLM_API_KEY": "<LITELLM_API_KEY>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "LITELLM_API_KEY": "<LITELLM_API_KEY>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "LITELLM_API_KEY": "<LITELLM_API_KEY>"
      }
    }
  }
}

Configuration

  • OPENAI_API_KEYOpenAI API key for GPT models
  • ANTHROPIC_API_KEYAnthropic API key for Claude models
  • LITELLM_API_BASELiteLLM Proxy base URL (optional)
  • LITELLM_API_KEYLiteLLM Proxy API key (optional)

Pricing

Open source

LiteLLM Multi-Model API FAQ

Is LiteLLM Multi-Model API free?

Yes. LiteLLM Multi-Model API is open source, so you can use and self-host it for free.

How do I add LiteLLM Multi-Model API to Claude Code?

Run this command in your terminal: claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' --env LITELLM_API_KEY='<LITELLM_API_KEY>' -- uvx litellm-mcp

What are the best alternatives to LiteLLM Multi-Model API?

The closest alternatives to LiteLLM Multi-Model API are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to LiteLLM Multi-Model API

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling