Skip to content
MCP server

Sezzlee Local LLM

MCP server that hands bounded language tasks to a local Ollama model from your agent

Runs locallyStatus and history
Install
Pricing
Open source
Platforms
CLI, macOS, Linux
Runs
Locally
Version
0.1.3
Listing updated
1 day ago

About Sezzlee Local LLM

Sezzlee Local LLM is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.

The idea is to keep a planning agent's context small. The agent passes a file path, the server reads the file itself and runs the task on a model served by your own Ollama, and only the short answer returns to the agent. Files are read only inside a configured workspace folder, and output goes into a folder inside it.

Three tools are offered. local_task runs one summarize, extract, classify, transform or free task over short text or up to eight files, returning JSON when given a JSON Schema; summarize and extract chunk oversized input, other kinds refuse it, and nothing is silently truncated. local_map labels every row of a CSV (up to 2,000 rows, 2 to 50 labels) and writes a new file with a label column, returning counts and a few sample rows per label. local_status reports whether the model is reachable, its context window and input budget.

It needs Node.js 22 or later and Ollama running; the docs suggest qwen3:8b for an 8 GB GPU. Settings are passed as environment variables.

Install

Run in a terminal

claude mcp add llm --env SEZZLEE_LLM_MODEL='<SEZZLEE_LLM_MODEL>' -- npx -y @sezzlee/llm-mcp

Add to claude_desktop_config.json

{
  "mcpServers": {
    "llm": {
      "command": "npx",
      "args": [
        "-y",
        "@sezzlee/llm-mcp"
      ],
      "env": {
        "SEZZLEE_LLM_MODEL": "<SEZZLEE_LLM_MODEL>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "llm": {
      "command": "npx",
      "args": [
        "-y",
        "@sezzlee/llm-mcp"
      ],
      "env": {
        "SEZZLEE_LLM_MODEL": "<SEZZLEE_LLM_MODEL>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "llm": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@sezzlee/llm-mcp"
      ],
      "env": {
        "SEZZLEE_LLM_MODEL": "<SEZZLEE_LLM_MODEL>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "llm": {
      "command": "npx",
      "args": [
        "-y",
        "@sezzlee/llm-mcp"
      ],
      "env": {
        "SEZZLEE_LLM_MODEL": "<SEZZLEE_LLM_MODEL>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "llm": {
      "command": "npx",
      "args": [
        "-y",
        "@sezzlee/llm-mcp"
      ],
      "env": {
        "SEZZLEE_LLM_MODEL": "<SEZZLEE_LLM_MODEL>"
      }
    }
  }
}

Configuration

  • SEZZLEE_LLM_MODELOllama model to callRequired
  • SEZZLEE_LLM_BASE_URLOllama base URL
  • SEZZLEE_LLM_NUM_CTXContext window in tokens
  • SEZZLEE_LLM_TIMEOUT_MSPer-call timeout in milliseconds
  • SEZZLEE_LLM_KEEP_ALIVEHow long Ollama keeps the model loaded
  • SEZZLEE_LLM_ROOTWorkspace folder paths resolve against
  • SEZZLEE_LLM_OUTPUT_DIRFolder local_map writes its CSV into

Tools this server provides (3)

Taken from the project documentation; the running server may differ.

local_task
Runs one bounded language task (classify, extract, summarize, transform or free) on the local model.
local_map
Labels every row of a CSV file and writes a new file with a label column.
local_status
Reports whether the local model is reachable, its context window, input budget and queue.

What it does

Local task runner
Summarises, extracts, classifies or transforms text and files.
CSV labelling
Labels each row of a CSV with chosen labels and writes a new file.
Status check
Reports model reachability, context window and queue.
Private context
File contents never enter the calling agent's context.
Workspace sandbox
Reads only inside a configured folder.
Chunked long inputs
Summarize and extract split oversized input without truncating.

Good for

  • Summarise meeting notes without sending them to a cloud model
  • Tag thousands of support tickets by category
  • Extract structured fields from files as JSON
  • Offload routine text work from an expensive planning agent

Pricing

Open source

Free npm package; runs on your own Ollama

Prices change. Check docs.sezzlee.app before you buy.

Sezzlee Local LLM FAQ

What do I need installed?

Node.js 22 or later, jq for the docs recipes and a running Ollama with a model that can follow a JSON schema.

Which model should I use?

The docs suggest qwen3:8b on a machine with 8 GB of GPU memory.

What if Ollama is not running?

The server starts, local_status reports reachable false and tasks fail with backend_unavailable.

Does it write files?

Only local_map, which adds new files to its own output directory.

Is Sezzlee Local LLM free?

Yes. Sezzlee Local LLM is open source, so you can use and self-host it for free.

How do I add Sezzlee Local LLM to Claude Code?

Run this command in your terminal: claude mcp add llm --env SEZZLEE_LLM_MODEL='<SEZZLEE_LLM_MODEL>' -- npx -y @sezzlee/llm-mcp

What are the best alternatives to Sezzlee Local LLM?

The closest alternatives to Sezzlee Local LLM are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to Sezzlee Local LLM

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling