# Agent Referee

> Agent Referee is a freemium MCP server for ai models and llm tooling. Neutral tie-breaks between AI agents and independent review of an agent's output. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Freemium
- **Platforms:** CLI, API
- **Website:** https://agentreferee.ai
- **Repository:** https://github.com/ccheez34/agent-referee-mcp
- **MCP Registry name:** io.github.ccheez34/agent-referee
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-14

## About

Two agents from different owners sometimes reach a deadlock that neither should settle alone, and a single agent's claim that its work is correct is weak evidence. Agent Referee covers both, returning an Ed25519-signed receipt that anyone can check offline against a pinned key.

For disputes there are tiers from a weighted coin flip and picking one of 2 to 20 options, through rock-paper-scissors, to AI judges applying rules both sides agreed to. Judge tiers use one, two or three judges from different AI companies, and the receipt names every model and version. For solo work, sealed review sends an agent's output and task to independent reviewers who do not see each other's verdicts and return pass, needs changes, fail or cannot assess, with the problems found. The receipt holds a fingerprint of the output, not the output.

The free tools are a demo match, receipt verification and a daily allowance of free reviews, which the README gives as 3 single-reviewer reviews and 1 three-reviewer review per address per day. Paid calls use USDC on Base over x402 from a wallet you configure, with a default spend limit of $1.00 per UTC day. The README says results are advisory and not for legal or contractual disputes.

## Features

- **Signed receipts:** Decisions and reviews come with Ed25519-signed receipts checkable offline.
- **Multi-company judges:** Judge and review tiers can draw models from different AI companies and name them in the receipt.
- **Sealed review:** Independent reviewers check one agent's output without seeing each other's verdicts.
- **Free demo and reviews:** A demo match and a daily allowance of free reviews need no wallet.
- **Spend cap:** A daily limit, default $1.00, caps what the server may spend; 0 turns paid calls off.
- **Receipt verification:** Confirms a receipt matches exactly the task and output it claims.

## Good for

- Settle a deadlock between two agents owned by different parties
- Get an independent check of an agent's output before handing it on
- Verify that a receipt belongs to a specific piece of work
- Try a tie-break with the free demo

## Install

### Claude Code (Terminal)

```sh
claude mcp add agent-referee --env AGENT_REFEREE_PRIVATE_KEY='<AGENT_REFEREE_PRIVATE_KEY>' -- npx -y agent-referee-mcp
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "agent-referee": {
      "command": "npx",
      "args": [
        "-y",
        "agent-referee-mcp"
      ],
      "env": {
        "AGENT_REFEREE_PRIVATE_KEY": "<AGENT_REFEREE_PRIVATE_KEY>"
      }
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "agent-referee": {
      "command": "npx",
      "args": [
        "-y",
        "agent-referee-mcp"
      ],
      "env": {
        "AGENT_REFEREE_PRIVATE_KEY": "<AGENT_REFEREE_PRIVATE_KEY>"
      }
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "agent-referee": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "agent-referee-mcp"
      ],
      "env": {
        "AGENT_REFEREE_PRIVATE_KEY": "<AGENT_REFEREE_PRIVATE_KEY>"
      }
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "agent-referee": {
      "command": "npx",
      "args": [
        "-y",
        "agent-referee-mcp"
      ],
      "env": {
        "AGENT_REFEREE_PRIVATE_KEY": "<AGENT_REFEREE_PRIVATE_KEY>"
      }
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "agent-referee": {
      "command": "npx",
      "args": [
        "-y",
        "agent-referee-mcp"
      ],
      "env": {
        "AGENT_REFEREE_PRIVATE_KEY": "<AGENT_REFEREE_PRIVATE_KEY>"
      }
    }
  }
}
```

## Tools

- `demo_match`: Run a complete demo tie-break in one call
- `tiebreak`: Settle a deadlock with another agent
- `sealed_review`: Independent reviewers check an agent's output and return a signed receipt
- `verify_receipt`: Check a receipt offline against the pinned signing key
- `review_result`: Return a sealed review that was still running
- `saved_receipts`: List receipts saved locally and today's spend

## FAQ

### Do I need a wallet?

Not for the free tools. Paid tiers need a Base wallet holding USDC.

### Is it suitable for legal disputes?

No. The README says it is for technical evaluation and results are advisory.

### What does a review cost?

From $0.05 for one reviewer and $0.20 for three, per the README, after the free daily allowance.

### Does the receipt contain my output?

No, it holds a fingerprint of the output.

### Is Agent Referee free?

Agent Referee has a free plan, with paid plans for more usage or features.

### How do I add Agent Referee to Claude Code?

Run this command in your terminal: claude mcp add agent-referee --env AGENT_REFEREE_PRIVATE_KEY='<AGENT_REFEREE_PRIVATE_KEY>' -- npx -y agent-referee-mcp

### What are the best alternatives to Agent Referee?

The closest alternatives to Agent Referee are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

## Alternatives

- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [signafAIde](https://ai-powered.com/mcp/signafaide): signafAIde is a freemium MCP server for security.
- [Toolkien](https://ai-powered.com/mcp/toolkien): Toolkien is an open-source MCP server for ai models and llm tooling.
- [Lugh](https://ai-powered.com/mcp/lugh): Lugh is an open-source MCP server for ai models and llm tooling.
- [HypePaper](https://ai-powered.com/mcp/hypepaper): HypePaper is a freemium MCP server for ai models and llm tooling.
- [Agent Data Tools: Compact (find, describe, run)](https://ai-powered.com/mcp/agent-data-tools-compact-find-describe-run): Agent Data Tools: Compact (find, describe, run) is a freemium MCP server for developer tools.
- [Angel Agent Guard: pre-purchase check + prompt-injection scan](https://ai-powered.com/mcp/angel-agent-guard-pre-purchase-check-prompt-injection-scan): Angel Agent Guard: pre-purchase check + prompt-injection scan is a freemium MCP server for ai models and llm tooling.
- [Mizan Calibration](https://ai-powered.com/mcp/mizan-calibration): Mizan Calibration is a free MCP server for ai models and llm tooling.

---
Source: https://ai-powered.com/mcp/agent-referee
