# LEEVAR reliability battery

> LEEVAR reliability battery is a freemium MCP server for ai models and llm tooling. MCP server that grades an AI agent's conversations on 18 reliability tests. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Freemium
- **Platforms:** macOS, Windows, Linux, CLI, API
- **Website:** https://www.leevar.live/clinic
- **Repository:** https://github.com/forevercrab321-svg/leevar-battery/tree/HEAD/packages/mcp
- **MCP Registry name:** io.github.forevercrab321-svg/leevar
- **Categories:** AI models and LLM tooling, developer tools
- **Listing updated:** 2026-11-16

## About

This server wraps the LEEVAR reliability battery so an MCP client can score how well another AI agent behaved in real conversations. You pass in one to eight conversation samples and get back a written report, with a letter grade only when the evidence supports one.

Its rule is never to guess: a dimension the samples cannot evidence is reported as NOT TESTED, and below 13 of 18 evidenced tests no grade is issued at all. The 18 tests fall into six areas, including citation fabrication, multi-step task completion, output consistency, tool use, long-thread recall and error recovery.

Samples are sent to LEEVAR's hosted service and graded by third-party language models. The README says they are deleted 30 days after the scan completes and that the tool descriptions tell the assistant to ask before sending anything. Strip keys and personal data first.

## Features

- **Transcript scanning:** leevar_scan_transcript sends 1-8 conversation samples to the hosted battery and returns a scan id.
- **Status and report:** leevar_scan_status returns status, grade if issued, coverage and the written report.
- **Battery listing:** leevar_battery lists the 18 tests and the failure each one catches.
- **No guessed grades:** Untestable dimensions show as NOT TESTED and under 13 evidenced tests no grade is issued.
- **Failure credit:** If a scan fails because of LEEVAR, the free scan is credited back.

## Good for

- Check a support bot's conversations for hallucinated policies
- Gate a release on grade and coverage
- Find which reliability dimension an agent breaks first
- Choose which transcripts to sample so the battery is exercised

## Install

### Claude Code (Terminal)

```sh
claude mcp add leevar -- npx -y https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "leevar": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb"
      ]
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "leevar": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb"
      ]
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "leevar": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb"
      ]
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "leevar": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb"
      ]
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "leevar": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb"
      ]
    }
  }
}
```

## Tools

- `leevar_scan_transcript`: Sends 1-8 real conversation samples to the hosted battery and returns a scan id.
- `leevar_scan_status`: Reads the scan result: status, grade, coverage and written report.
- `leevar_battery`: Lists the 18 tests and the failure each one catches.

## FAQ

### Is it free?

The README says 5 scans a month per email, with no account needed. The website also sells a $99 Full Diagnostic + Treatment.

### What happens to my transcripts?

They go to the hosted service, are graded by third-party models and are deleted 30 days after the scan; redact secrets and personal data first.

### Can it run fully locally?

The repository's root scanner (deno task scan) grades on your own machine with a model you choose.

### What does it need to run?

Node 18 or later; it is installed from the v0.1.0 release, not npm.

### Is LEEVAR reliability battery free?

LEEVAR reliability battery has a free plan, with paid plans for more usage or features.

### How do I add LEEVAR reliability battery to Claude Code?

Run this command in your terminal: claude mcp add leevar -- npx -y https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb

### What are the best alternatives to LEEVAR reliability battery?

The closest alternatives to LEEVAR reliability battery are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [GitHub](https://ai-powered.com/mcp/github-2): GitHub is an open-source MCP server for developer tools.
- [Serena MCP: the IDE for your agent](https://ai-powered.com/mcp/serena-mcp-the-ide-for-your-agent): Serena MCP: the IDE for your agent is an open-source MCP server for developer tools.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.
- [Ouroboros](https://ai-powered.com/mcp/ouroboros): Ouroboros is an open-source MCP server for developer tools.
- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [Concord MCP](https://ai-powered.com/mcp/concord-mcp): Concord MCP is a freemium MCP server for developer tools.

---
Source: https://ai-powered.com/mcp/leevar-reliability-battery
