Skip to content
MCP server

Llmxray

See what Ollama is really doing with your prompts, with plain-language fixes

Runs locallyStatus and history
Install
Pricing
Free
Platforms
self-hosted, CLI, Web
Runs
Locally
Version
0.8.13
Listing updated
3 days ago

About Llmxray

Llmxray is a free MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.

LLMxRay sits between your tools and a local Ollama on a second port, 11435, forwards everything and records counts and timings. The MCP server lets an agent read that record and ask what went wrong with its own recent calls. It is read-only, runs over stdio from the llmxray npm package, and reads from the running LLMxRay server plus the Ollama daemon for its list_local_models tool.

Findings are written as sentences with the fix: a chat that outgrew the context and lost its oldest messages (raise num_ctx), a changing timestamp near the top of the prompt that breaks the cache (move it to the end), two tools evicting each other's model on one GPU (keep_alive and num_ctx settings), and agents that start a fresh conversation at every step. Only counts and timings are stored, on your machine for 30 days; prompt text is opt-in.

The site claims it is free and local, with no account or key, and turns can be sent on as OpenTelemetry spans.

Install

Run in a terminal

claude mcp add llmxray -- npx -y llmxray

Add to claude_desktop_config.json

{
  "mcpServers": {
    "llmxray": {
      "command": "npx",
      "args": [
        "-y",
        "llmxray"
      ]
    }
  }
}
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "llmxray": {
      "command": "npx",
      "args": [
        "-y",
        "llmxray"
      ]
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "llmxray": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "llmxray"
      ]
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "llmxray": {
      "command": "npx",
      "args": [
        "-y",
        "llmxray"
      ]
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "llmxray": {
      "command": "npx",
      "args": [
        "-y",
        "llmxray"
      ]
    }
  }
}

Configuration

  • LLMXRAY_URLThe running LLMxRay server the tools read from (start it with `npx llmxray`).
  • OLLAMA_URLThe Ollama daemon, for the list_local_models tool.

Tools this server provides (1)

Taken from the project documentation; the running server may differ.

list_local_models
Lists models on the local Ollama daemon.

What it does

Plain-sentence findings
Each diagnosis links to the turn that proves it.
Cache break detection
Shows where a prompt stopped matching the previous one.
Silent truncation
Reveals when Ollama cut context to fit.
GPU contention
Names which tool evicted which model and what it cost.
Local and private
Counts and timings stay on your machine for 30 days.
OpenTelemetry export
Send turns on to Jaeger, Phoenix, Langfuse or Grafana.

Good for

  • Ask an agent why its last Ollama calls were slow
  • Find out whether a prompt was truncated by the context window
  • Spot a timestamp that keeps invalidating the cache
  • Work out which tool is hogging a shared GPU
  • List models available on the local Ollama

Pricing

Free

Free and local; no account or key.

Prices change. Check lognebudo.github.io before you buy.

Llmxray FAQ

Does it need an account or API key?

No. It is described as free and local with no cloud.

How do I point my tools at it?

Use port 11435 instead of Ollama's 11434.

Does it store my prompts?

Only counts and timings by default; prompt text is an opt-in written to a local file.

How do I start it?

Run npx llmxray or the Docker image, then add the llmxray-mcp server to your client.

Is Llmxray free?

Yes. Llmxray is free to use.

How do I add Llmxray to Claude Code?

Run this command in your terminal: claude mcp add llmxray -- npx -y llmxray

What are the best alternatives to Llmxray?

The closest alternatives to Llmxray are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to Llmxray

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools