EvalGate
Run AI evaluations, record agent traces and gate releases from your coding agent
- Pricing
- Freemium
- Platforms
- Web, API
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 2 days ago
About EvalGate
EvalGate is a freemium MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
EvalGate's server exposes its evaluation platform to agents through a permission-filtered endpoint at /api/mcp. Anonymous clients can discover the protocol and read-only schemas, but cannot run product tools; everything else needs an API key as a bearer token. Each write tool lists a minimum role and a required scope, such as eval:write or runs:write, and says how to verify the effect, for example reading back an ID or polling runs_list and run_explain.
Authoring tools include evaluations_create, test_cases_add (locked evaluations refuse), runs_start (after readiness and spend guards) and traces_create, with a reminder to redact content and check retention. The docs also describe repository improvement campaigns in which an agent can compile an optimisation contract and open a draft PR, but cannot approve a hosted contract, adopt a candidate or merge. Merging is never automated.
A separate docs endpoint is public. The older /api/mcp/tools and /api/mcp/call belong to a different proprietary HTTP Tool API. Plans start free with 1,000 test results a month, and extra results cost $1 per 1,000.
Install
Run in a terminal
claude mcp add --transport http evalgate https://www.evalgate.com/api/mcpAdd to Settings → Connectors → Add custom connector
https://www.evalgate.com/api/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"evalgate": {
"url": "https://www.evalgate.com/api/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"evalgate": {
"type": "http",
"url": "https://www.evalgate.com/api/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"evalgate": {
"serverUrl": "https://www.evalgate.com/api/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"evalgate": {
"type": "http",
"url": "https://www.evalgate.com/api/mcp"
}
}
}Tools this server provides (6)
Taken from the project documentation; the running server may differ.
- evaluations_create
- Creates an evaluation and returns its ID.
- test_cases_add
- Adds a reviewed test case; locked evaluations refuse.
- runs_start
- Starts a run after readiness and spend guards.
- traces_create
- Records an agent trace.
- runs_list
- Lists runs so progress can be polled.
- run_explain
- Explains the outcome of a run.
What it does
- Evaluation authoring
- Create evaluations and add reviewed test cases from an agent.
- Guarded runs
- Start runs only after readiness and spend checks, then poll for results.
- Trace recording
- Record agent traces with a reminder to redact content.
- Scoped access
- Each tool has a minimum role and a required scope.
- Human approval limits
- Agents cannot approve hosted contracts, adopt candidates or merge PRs.
- Public docs endpoint
- A separate docs server needs no key.
Good for
- Create an evaluation from a coding assistant
- Start an evaluation run and read why it failed
- Record an agent trace for later review
- Gate a release on test evidence
Pricing
Freemium, from $99 a month
Free 1,000 results/month; Team $99, Scale $499, Business $1,500; extra $1 per 1,000
Prices change. Check evalgate.com before you buy.
EvalGate FAQ
Can anonymous clients run tools?
No. Anonymous clients can discover the protocol and schemas but cannot execute product tools.
How do I authenticate?
Send an EvalGate API key as an Authorization bearer header.
What does it cost?
A free Developer plan includes 1,000 results a month; Team is $99 for 100,000 and extra results are $1 per 1,000.
Can an agent merge a pull request?
No. The docs say merging is never automated by EvalGate.
Whose model costs apply?
Your own provider bill, with no EvalGate markup.
Is EvalGate free?
EvalGate has a free plan, with paid plans for more usage or features. Paid plans start at $99 a month.
How do I add EvalGate to Claude Code?
Run this command in your terminal: claude mcp add --transport http evalgate https://www.evalgate.com/api/mcp
What are the best alternatives to EvalGate?
The closest alternatives to EvalGate are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.
Alternatives to EvalGate

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Codebase Memory
MCP serverLocal MCP server that builds a code knowledge graph for AI coding agents
Runs locally- Open source
- 48.7K GitHub stars
- Knowledge and memory

GitHub
MCP serverOfficial MCP server connecting AI assistants to GitHub repos, issues and workflows
Not checked yet- Remote
- Open source
- 34.5K GitHub stars
- Developer tools

Serena MCP: the IDE for your agent
MCP serverMCP toolkit giving coding agents symbol-level code retrieval and editing
Runs locally- Open source
- 31.5K GitHub stars
- Developer tools

XERJ
MCP serverLocal search engine for AI agents with cited answers over your code and docs
Runs locally- Open source
- 19.2K GitHub stars
- Knowledge and memory

Ouroboros
MCP serverSpec-first layer that pins requirements and verifies results of AI coding agent work
Runs locally- Open source
- 6.4K GitHub stars
- Developer tools