# llm-sidecar

> llm-sidecar is an open-source MCP server for agent tooling. Local MCP server giving AI clients keyless web search, cited answers and claim checking. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** CLI, API, macOS, Linux, Windows, Self-hosted
- **Repository:** https://github.com/awaistechnologist/llm-sidecar
- **MCP Registry name:** io.github.awaistechnologist/llm-sidecar
- **Categories:** [agent tooling](https://ai-powered.com/categories/agent-tooling)
- **Listing updated:** 2026-11-19

## About

The README describes llm-sidecar as a local process that sits next to the tools on your machine and handles grounded question answering, web search, page reading and fact-checking, while choosing which model to run without being told. Requests are routed across Ollama for local models and OpenRouter for free or paid cloud models, and the project says a model is only used after a short probe confirms it actually answers.

According to the README, answers are built from pages fetched during the request and come with source links. When the sources disagree or do not settle a question, the tool is designed to say so instead of guessing. Claims can be graded as supported, contradicted or unverified, and whole documents can be checked claim by claim.

The project is aimed at developers who want one shared layer for grounded AI work across several local tools, and it ships as a Python package with an HTTP daemon, a CLI and an MCP server. The README marks the project as early (0.6.0) and warns that responses can take tens of seconds.

## Features

- **Keyless web search:** Searches the web through DuckDuckGo by default, with an optional self-hosted SearXNG instance.
- **Cited answers:** Answers questions from fetched pages and lists the sources used, flagging when evidence is not conclusive.
- **Claim verification:** Grades claims as supported, contradicted or unverified against live evidence, each with citations.
- **Routed model selection:** Chooses between Ollama models and OpenRouter models by tier and budget, probing candidates before use.
- **Page reading:** Fetches a URL and returns its main text with navigation and header content removed.
- **Usage ledger:** Records model usage and cost so spending can be reviewed over time.

## Good for

- Give a coding assistant a way to look up current facts with source links
- Check the factual claims in a draft document before publishing
- Run bulk summarisation or classification on cheaper local or free models
- Keep search and model access on one machine instead of per-tool API keys

## Install

### Claude Code (Terminal)

```sh
claude mcp add llm-sidecar -- uvx llm-sidecar
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "llm-sidecar": {
      "command": "uvx",
      "args": [
        "llm-sidecar"
      ]
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "llm-sidecar": {
      "command": "uvx",
      "args": [
        "llm-sidecar"
      ]
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "llm-sidecar": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "llm-sidecar"
      ]
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "llm-sidecar": {
      "command": "uvx",
      "args": [
        "llm-sidecar"
      ]
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "llm-sidecar": {
      "command": "uvx",
      "args": [
        "llm-sidecar"
      ]
    }
  }
}
```

## Tools

- `search_web`: Keyless web search.
- `answer_question`: Answers a question from fetched sources with citations.
- `read_url`: Returns the main text of a web page.
- `verify_claims`: Grades claims against live evidence.
- `extract_claims`: Pulls claims out of text.
- `fact_check_document`: Extracts and verifies every claim in a document.
- `summarise`: Bounded summarisation of text.
- `classify`: Assigns text to provided labels.
- `extract_fields`: Extracts named fields from text.
- `delegate`: Offloads bulk work to a cheap model.
- `list_image_profiles`: Lists image generation profiles.
- `generate_image`: Generates an image locally on Apple Silicon.
- `edit_with_references`: Edits an image using reference images.
- `upscale_image`: Upscales an image.
- `usage_report`: Reports model usage and spend.
- `sidecar_status`: Reports daemon status.
- `whats_new`: Lists changes since a given version.

## FAQ

### Does llm-sidecar need an API key?

The README says it works with no API key if Ollama is installed; an OpenRouter key is optional for free cloud models and paid routing.

### How do I install llm-sidecar?

The README recommends installing with pipx, then running pipx install llm-sidecar; it also lists a run-from-source option.

### Which MCP tools are exposed?

The README lists 17 tools, including search_web, answer_question, read_url, verify_claims, extract_claims and fact_check_document.

### Is llm-sidecar fast?

The README says a grounded answer involves a search, page fetches and a model call, so it can take tens of seconds, longer on free models.

### Is llm-sidecar free?

Yes. llm-sidecar is open source, so you can use and self-host it for free.

### How do I add llm-sidecar to Claude Code?

Run this command in your terminal: claude mcp add llm-sidecar -- uvx llm-sidecar

## Where this comes from

- Description: written from the project's README and its MCP Registry entry.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [replynodes](https://ai-powered.com/mcp/replynodes-2): replynodes is an MCP server for web search and scraping.

---
Source: https://ai-powered.com/mcp/llm-sidecar
