Evalview MCP
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI…
- Pricing
- Open source
- Runs
- Locally
- Version
- 0.6.0
- Listing updated
- 5 days ago
About Evalview MCP
Evalview MCP is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
Install
Run in a terminal
claude mcp add evalview-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' -- uvx evalviewAdd to claude_desktop_config.json
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>"
}
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>"
}
}
}
}Add to .vscode/mcp.json
{
"servers": {
"evalview-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"evalview"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>"
}
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>"
}
}
}
}Configuration
OPENAI_API_KEYOpenAI API key for LLM-as-judge output quality scoring. Optional — deterministic tool/sequence evaluation works without it.
Pricing
Open source
Evalview MCP FAQ
Is Evalview MCP free?
Yes. Evalview MCP is open source, so you can use and self-host it for free.
How do I add Evalview MCP to Claude Code?
Run this command in your terminal: claude mcp add evalview-mcp --env OPENAI_API_KEY='<OPENAI_API_KEY>' -- uvx evalview
What are the best alternatives to Evalview MCP?
The closest alternatives to Evalview MCP are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to Evalview MCP

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools