Skip to content
MCP server

Ollama / vLLM Bridge

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

Runs locallyStatus and history
Install
Pricing
Open source
Runs
Locally
Version
1.0.6
Listing updated
5 days ago

About Ollama / vLLM Bridge

Ollama / vLLM Bridge is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.

Install

Run in a terminal

claude mcp add mcp-ollama-vllm --env LOCAL_API_KEY='<LOCAL_API_KEY>' -- uvx mcp-ollama-vllm

Add to claude_desktop_config.json

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_API_KEY": "<LOCAL_API_KEY>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_API_KEY": "<LOCAL_API_KEY>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "mcp-ollama-vllm": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_API_KEY": "<LOCAL_API_KEY>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_API_KEY": "<LOCAL_API_KEY>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm"
      ],
      "env": {
        "LOCAL_API_KEY": "<LOCAL_API_KEY>"
      }
    }
  }
}

Configuration

  • LOCAL_BACKENDBackend to use: ollama, vllm or openai
  • LOCAL_HOSTModel endpoint URL; must be local or on your own network. Required for the openai backend
  • LOCAL_API_KEYOptional bearer token, openai backend only; sent as a header, never logged
  • LOCAL_TIMEOUTRead timeout in seconds
  • LOCAL_EMBED_MODELDefault embedding model
  • LOCAL_EMBED_PATHOptional, openai backend only: embedding endpoint path
  • LOCAL_SCHEMA_MODEOptional, openai backend only: auto, response_format or none

Pricing

Open source

Ollama / vLLM Bridge FAQ

Is Ollama / vLLM Bridge free?

Yes. Ollama / vLLM Bridge is open source, so you can use and self-host it for free.

How do I add Ollama / vLLM Bridge to Claude Code?

Run this command in your terminal: claude mcp add mcp-ollama-vllm --env LOCAL_API_KEY='<LOCAL_API_KEY>' -- uvx mcp-ollama-vllm

What are the best alternatives to Ollama / vLLM Bridge?

The closest alternatives to Ollama / vLLM Bridge are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to Ollama / vLLM Bridge

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling