Skip to content
MCP server

Codabench MCP

MCP server for the Codabench REST API — drives a full ML-benchmark participant workflow.

Runs locallyStatus and history
Install
Pricing
Open source
Runs
Locally
Version
0.1.1
Listing updated
5 days ago

About Codabench MCP

Codabench MCP is an open-source MCP server. It runs locally on your machine and is started by your AI client.

Install

Run in a terminal

claude mcp add codabench-mcp --env CODABENCH_API_TOKEN='<CODABENCH_API_TOKEN>' -- uvx codabench-mcp

Add to claude_desktop_config.json

{
  "mcpServers": {
    "codabench-mcp": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "<CODABENCH_API_TOKEN>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "codabench-mcp": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "<CODABENCH_API_TOKEN>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "codabench-mcp": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "<CODABENCH_API_TOKEN>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "codabench-mcp": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "<CODABENCH_API_TOKEN>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "codabench-mcp": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "<CODABENCH_API_TOKEN>"
      }
    }
  }
}

Configuration

  • CODABENCH_API_TOKENDRF token for Codabench. Obtain via https://www.codabench.org/api/docs/ > api-token-auth > Try it out.Required

Pricing

Open source

Codabench MCP FAQ

Is Codabench MCP free?

Yes. Codabench MCP is open source, so you can use and self-host it for free.

How do I add Codabench MCP to Claude Code?

Run this command in your terminal: claude mcp add codabench-mcp --env CODABENCH_API_TOKEN='<CODABENCH_API_TOKEN>' -- uvx codabench-mcp