LiteLLM Multi-Model API
Access 100+ LLMs with one API: GPT-4, Claude, Gemini, Mistral, and more.
- Pricing
- Open source
- Runs
- Locally
- Version
- 1.0.2
- Listing updated
- 4 days ago
About LiteLLM Multi-Model API
LiteLLM Multi-Model API is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.
Install
Run in a terminal
claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' --env LITELLM_API_KEY='<LITELLM_API_KEY>' -- uvx litellm-mcpAdd to claude_desktop_config.json
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
"LITELLM_API_KEY": "<LITELLM_API_KEY>"
}
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
"LITELLM_API_KEY": "<LITELLM_API_KEY>"
}
}
}
}Add to .vscode/mcp.json
{
"servers": {
"litellm-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
"LITELLM_API_KEY": "<LITELLM_API_KEY>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
"LITELLM_API_KEY": "<LITELLM_API_KEY>"
}
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
"LITELLM_API_KEY": "<LITELLM_API_KEY>"
}
}
}
}Configuration
OPENAI_API_KEYOpenAI API key for GPT modelsANTHROPIC_API_KEYAnthropic API key for Claude modelsLITELLM_API_BASELiteLLM Proxy base URL (optional)LITELLM_API_KEYLiteLLM Proxy API key (optional)
Pricing
Open source
LiteLLM Multi-Model API FAQ
Is LiteLLM Multi-Model API free?
Yes. LiteLLM Multi-Model API is open source, so you can use and self-host it for free.
How do I add LiteLLM Multi-Model API to Claude Code?
Run this command in your terminal: claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' --env LITELLM_API_KEY='<LITELLM_API_KEY>' -- uvx litellm-mcp
What are the best alternatives to LiteLLM Multi-Model API?
The closest alternatives to LiteLLM Multi-Model API are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to LiteLLM Multi-Model API

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools