Llmxray
See what Ollama is really doing with your prompts, with plain-language fixes
- Pricing
- Free
- Platforms
- self-hosted, CLI, Web
- Runs
- Locally
- Version
- 0.8.13
- Listing updated
- 3 days ago
About Llmxray
Llmxray is a free MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.
LLMxRay sits between your tools and a local Ollama on a second port, 11435, forwards everything and records counts and timings. The MCP server lets an agent read that record and ask what went wrong with its own recent calls. It is read-only, runs over stdio from the llmxray npm package, and reads from the running LLMxRay server plus the Ollama daemon for its list_local_models tool.
Findings are written as sentences with the fix: a chat that outgrew the context and lost its oldest messages (raise num_ctx), a changing timestamp near the top of the prompt that breaks the cache (move it to the end), two tools evicting each other's model on one GPU (keep_alive and num_ctx settings), and agents that start a fresh conversation at every step. Only counts and timings are stored, on your machine for 30 days; prompt text is opt-in.
The site claims it is free and local, with no account or key, and turns can be sent on as OpenTelemetry spans.
Install
Run in a terminal
claude mcp add llmxray -- npx -y llmxrayAdd to claude_desktop_config.json
{
"mcpServers": {
"llmxray": {
"command": "npx",
"args": [
"-y",
"llmxray"
]
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"llmxray": {
"command": "npx",
"args": [
"-y",
"llmxray"
]
}
}
}Add to .vscode/mcp.json
{
"servers": {
"llmxray": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"llmxray"
]
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"llmxray": {
"command": "npx",
"args": [
"-y",
"llmxray"
]
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"llmxray": {
"command": "npx",
"args": [
"-y",
"llmxray"
]
}
}
}Configuration
LLMXRAY_URLThe running LLMxRay server the tools read from (start it with `npx llmxray`).OLLAMA_URLThe Ollama daemon, for the list_local_models tool.
Tools this server provides (1)
Taken from the project documentation; the running server may differ.
- list_local_models
- Lists models on the local Ollama daemon.
What it does
- Plain-sentence findings
- Each diagnosis links to the turn that proves it.
- Cache break detection
- Shows where a prompt stopped matching the previous one.
- Silent truncation
- Reveals when Ollama cut context to fit.
- GPU contention
- Names which tool evicted which model and what it cost.
- Local and private
- Counts and timings stay on your machine for 30 days.
- OpenTelemetry export
- Send turns on to Jaeger, Phoenix, Langfuse or Grafana.
Good for
- Ask an agent why its last Ollama calls were slow
- Find out whether a prompt was truncated by the context window
- Spot a timestamp that keeps invalidating the cache
- Work out which tool is hogging a shared GPU
- List models available on the local Ollama
Pricing
Free
Free and local; no account or key.
Prices change. Check lognebudo.github.io before you buy.
Llmxray FAQ
Does it need an account or API key?
No. It is described as free and local with no cloud.
How do I point my tools at it?
Use port 11435 instead of Ollama's 11434.
Does it store my prompts?
Only counts and timings by default; prompt text is an opt-in written to a local file.
How do I start it?
Run npx llmxray or the Docker image, then add the llmxray-mcp server to your client.
Is Llmxray free?
Yes. Llmxray is free to use.
How do I add Llmxray to Claude Code?
Run this command in your terminal: claude mcp add llmxray -- npx -y llmxray
What are the best alternatives to Llmxray?
The closest alternatives to Llmxray are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.
Alternatives to Llmxray

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Codebase Memory
MCP serverLocal MCP server that builds a code knowledge graph for AI coding agents
Runs locally- Open source
- 48.7K GitHub stars
- Knowledge and memory

GitHub
MCP serverOfficial MCP server connecting AI assistants to GitHub repos, issues and workflows
Not checked yet- Remote
- Open source
- 34.5K GitHub stars
- Developer tools

Serena MCP: the IDE for your agent
MCP serverMCP toolkit giving coding agents symbol-level code retrieval and editing
Runs locally- Open source
- 31.5K GitHub stars
- Developer tools

XERJ
MCP serverLocal search engine for AI agents with cited answers over your code and docs
Runs locally- Open source
- 19.2K GitHub stars
- Knowledge and memory

Ouroboros
MCP serverSpec-first layer that pins requirements and verifies results of AI coding agent work
Runs locally- Open source
- 6.4K GitHub stars
- Developer tools