Skip to content
MCP server

EvalGate

Run AI evaluations, record agent traces and gate releases from your coding agent

Install
Pricing
Freemium
Platforms
Web, API
Runs
Remotely
Version
1.0.0
Listing updated
2 days ago

About EvalGate

EvalGate is a freemium MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.

EvalGate's server exposes its evaluation platform to agents through a permission-filtered endpoint at /api/mcp. Anonymous clients can discover the protocol and read-only schemas, but cannot run product tools; everything else needs an API key as a bearer token. Each write tool lists a minimum role and a required scope, such as eval:write or runs:write, and says how to verify the effect, for example reading back an ID or polling runs_list and run_explain.

Authoring tools include evaluations_create, test_cases_add (locked evaluations refuse), runs_start (after readiness and spend guards) and traces_create, with a reminder to redact content and check retention. The docs also describe repository improvement campaigns in which an agent can compile an optimisation contract and open a draft PR, but cannot approve a hosted contract, adopt a candidate or merge. Merging is never automated.

A separate docs endpoint is public. The older /api/mcp/tools and /api/mcp/call belong to a different proprietary HTTP Tool API. Plans start free with 1,000 test results a month, and extra results cost $1 per 1,000.

Install

Run in a terminal

claude mcp add --transport http evalgate https://www.evalgate.com/api/mcp

Add to Settings → Connectors → Add custom connector

https://www.evalgate.com/api/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "evalgate": {
      "url": "https://www.evalgate.com/api/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "evalgate": {
      "type": "http",
      "url": "https://www.evalgate.com/api/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "evalgate": {
      "serverUrl": "https://www.evalgate.com/api/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "evalgate": {
      "type": "http",
      "url": "https://www.evalgate.com/api/mcp"
    }
  }
}

Tools this server provides (6)

Taken from the project documentation; the running server may differ.

evaluations_create
Creates an evaluation and returns its ID.
test_cases_add
Adds a reviewed test case; locked evaluations refuse.
runs_start
Starts a run after readiness and spend guards.
traces_create
Records an agent trace.
runs_list
Lists runs so progress can be polled.
run_explain
Explains the outcome of a run.

What it does

Evaluation authoring
Create evaluations and add reviewed test cases from an agent.
Guarded runs
Start runs only after readiness and spend checks, then poll for results.
Trace recording
Record agent traces with a reminder to redact content.
Scoped access
Each tool has a minimum role and a required scope.
Human approval limits
Agents cannot approve hosted contracts, adopt candidates or merge PRs.
Public docs endpoint
A separate docs server needs no key.

Good for

  • Create an evaluation from a coding assistant
  • Start an evaluation run and read why it failed
  • Record an agent trace for later review
  • Gate a release on test evidence

Pricing

Freemium, from $99 a month

Free 1,000 results/month; Team $99, Scale $499, Business $1,500; extra $1 per 1,000

Prices change. Check evalgate.com before you buy.

EvalGate FAQ

Can anonymous clients run tools?

No. Anonymous clients can discover the protocol and schemas but cannot execute product tools.

How do I authenticate?

Send an EvalGate API key as an Authorization bearer header.

What does it cost?

A free Developer plan includes 1,000 results a month; Team is $99 for 100,000 and extra results are $1 per 1,000.

Can an agent merge a pull request?

No. The docs say merging is never automated by EvalGate.

Whose model costs apply?

Your own provider bill, with no EvalGate markup.

Is EvalGate free?

EvalGate has a free plan, with paid plans for more usage or features. Paid plans start at $99 a month.

How do I add EvalGate to Claude Code?

Run this command in your terminal: claude mcp add --transport http evalgate https://www.evalgate.com/api/mcp

What are the best alternatives to EvalGate?

The closest alternatives to EvalGate are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to EvalGate

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools