MCP server
Litellm MCP
Give AI agents access to 100+ LLMs. Call any model, compare outputs.
Runs locallyStatus and history
- Pricing
- Open source
- Runs
- Locally
- Version
- 1.0.1
- Listing updated
- 4 days ago
About Litellm MCP
Litellm MCP is an open-source MCP server. It runs locally on your machine and is started by your AI client.
Install
Run in a terminal
claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' -- uvx litellm-mcpAdd to claude_desktop_config.json
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}Add to .vscode/mcp.json
{
"servers": {
"litellm-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}Configuration
OPENAI_API_KEYOpenAI API key for GPT modelsANTHROPIC_API_KEYAnthropic API key for Claude models
Pricing
Open source
Litellm MCP FAQ
Is Litellm MCP free?
Yes. Litellm MCP is open source, so you can use and self-host it for free.
How do I add Litellm MCP to Claude Code?
Run this command in your terminal: claude mcp add litellm-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' -- uvx litellm-mcp