evalship
Hosted MCP server that lets coding agents read eval to-dos, production issues and PR
The server answered 3 hours ago with a sign-in request for a bearer token (HTTP 401), so we could not list its tools.
- Pricing
- Freemium
- Platforms
- API, CLI, Web
- Runs
- Remotely
- Access
- Needs sign-in (bearer token)
- Version
- 1.2.0
- Listing updated
- today
Similar MCP servers
About evalship
evalship is a freemium MCP server for developer tools. It runs as a hosted remote server, so there is nothing to install locally.
The README-style registry entry describes a server that reads a repository's to-do list, production issues and pull request reports from evalship. The server exposes four read tools: todo, issue, calls and pull_request. Access uses a read token that the user approves in a browser, and the server changes nothing by default. An optional flag adds a fifth tool that can propose a dismissal of a flagged flaw, which still needs someone with push access to accept it.
The server sits on top of evalship's hosted eval service, which runs LLM evals from GitHub Actions and posts results on pull requests. It is aimed at developers who already use evalship and want their coding agent to pull failing-eval context into its work. The docs also say production calls are visible only to repository members, even on public repositories.
The site describes a paid hosted plan alongside a free tier, but the MCP server itself is reached through the evalship account rather than installed locally.
Install
Run in a terminal
claude mcp add --transport http evalship https://evalship.com/mcpAdd to Settings → Connectors → Add custom connector
https://evalship.com/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"evalship": {
"url": "https://evalship.com/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"evalship": {
"type": "http",
"url": "https://evalship.com/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"evalship": {
"serverUrl": "https://evalship.com/mcp"
}
}
}Add to Grok Bot desktop app → Connect apps → Add a custom connector
https://evalship.com/mcpEnter a Name (for example "evalship"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin. When we checked, this server asked for a bearer token. Add it under HTTP headers as Authorization: Bearer <your token>.
Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"evalship": {
"type": "http",
"url": "https://evalship.com/mcp"
}
}
}Using several servers? Build one config file with the MCP config generator.
Tools this server provides (4)
Taken from the project documentation; the running server may differ.
- todo
- Returns the repository's open To do items with links and fix prompts.
- issue
- Returns one production issue with its failing calls, latest trace and suggested fix.
- calls
- Lists production AI calls, newest first, with optional filters.
- pull_request
- Returns a pull request's eval report: which evals broke, why, and the flaws.
What it does
- Read-only repository tools
- Four read tools return open to-do items, production issues, AI call records and pull request eval reports.
- Browser-approved read token
- Setup creates a read token through a browser approval page before adding the server to a client.
- Optional dismissal proposals
- An opt-in fifth tool lets the agent propose dismissing a flaw, which a person must accept on the report.
- Remote streamable HTTP endpoint
- The server is served over streamable HTTP at a single URL with a bearer token header.
Good for
- Letting a coding agent check which eval flaws block a pull request before editing code
- Pulling recent failing production AI calls into a debugging session
- Reading open eval to-do items for a repository from inside an agent client
Pricing
Freemium, from $29 a month
Free plan; Pro $29/mo; Business $99/mo; the MCP server is available through the account
Prices change. Check evalship.com before you buy.
evalship FAQ
Can the server change anything in my repository?
By default no. The docs say a read token reads what you see on evalship and changes nothing, and a proposal dismisses no flaw until someone accepts it.
Which tools does the server expose?
Four read tools are listed: todo, issue, calls and pull_request. A fifth, propose_dismissal, appears only if the user opts in during setup.
Does it work with chat clients like claude.ai?
Not yet. The docs say claude.ai and other chat clients that sign in with OAuth are not supported.
Is evalship free?
evalship has a free plan, with paid plans for more usage or features. Paid plans start at $29 a month.
How do I add evalship to Claude Code?
Run this command in your terminal: claude mcp add --transport http evalship https://evalship.com/mcp
What are the best alternatives to evalship?
The closest alternatives to evalship are EvalGate, Errilo, Feedbacks, PathToShip: production readiness for AI-built apps and CueApril.
Where this comes from
- Description: written from the project's website and its MCP Registry entry.
- Status: checked automatically by AIPoweredBot on 19 November 2026.
- Install steps: from the official MCP Registry entry.