# MCP Selection Lab

> MCP Selection Lab is an MCP server for developer tools. Benchmark how well an agent picks the right MCP tool from metadata alone. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Platforms:** Web, API
- **Website:** https://agenttrustlab.com
- **Repository:** https://github.com/changhuliu/mcp-selection-lab
- **MCP Registry name:** io.github.ChanghuLiu/mcp-selection-lab
- **Categories:** [developer tools](https://ai-powered.com/categories/developer-tools), [AI models and LLM tooling](https://ai-powered.com/categories/ai-and-llm)
- **Listing updated:** 2026-11-18

## About

The Agent Trust Lab site behind this server is a workspace for exploring MCP providers, inspecting versioned evidence per capability, and reviewing task-specific options before use. The server's own focus is tool selection: routing, collision, abstention and holdout checks that use only metadata.

The site draws careful lines. Its free scan generates test cases from tool descriptions, so it does not measure natural-language or real-model routing accuracy, and it does not call a provider's business tools. Data-quality grades come from five Registry criteria, are calibrated within its own dataset, and are explicitly not safety, accuracy, availability or reliability ratings. Evidence grades do not certify safety or rank providers.

The catalogue is indexed from the Official MCP Registry, and endpoints have not been checked.

## Features

- **Metadata-only routing check:** Tests whether tool descriptions let an agent choose correctly.
- **Collision checks:** Looks for tools whose descriptions overlap.
- **Abstention and holdout:** Includes checks for when an agent should decline and for held-out cases.
- **Registry data grades:** Grades listing data quality from five registry criteria.
- **Versioned evidence:** Shows evidence by capability and version.

## Good for

- Check whether your MCP tool descriptions are distinguishable
- Compare MCP providers before adopting one
- Review registry changes between snapshots

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http mcp-selection-lab https://agenttrustlab.com/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://agenttrustlab.com/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "mcp-selection-lab": {
      "url": "https://agenttrustlab.com/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "mcp-selection-lab": {
      "type": "http",
      "url": "https://agenttrustlab.com/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "mcp-selection-lab": {
      "serverUrl": "https://agenttrustlab.com/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "mcp-selection-lab": {
      "type": "http",
      "url": "https://agenttrustlab.com/mcp"
    }
  }
}
```

## FAQ

### Does it call my tools?

No. The scan inspects public discovery metadata and doesn't call business tools.

### Does it measure real model accuracy?

No. The free scan generates cases from tool descriptions.

### Are the grades safety ratings?

No. They describe registry data quality only.

### How do I add MCP Selection Lab to Claude Code?

Run this command in your terminal: claude mcp add --transport http mcp-selection-lab https://agenttrustlab.com/mcp

### What are the best alternatives to MCP Selection Lab?

The closest alternatives to MCP Selection Lab are REA, Context7, Chrome DevTools MCP, Codebase Memory and GitHub.

## Where this comes from

- Description: written from the project's README and the project's website.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [Context7](https://ai-powered.com/mcp/context7): Context7 is a freemium MCP server for developer tools.
- [Chrome DevTools MCP](https://ai-powered.com/mcp/chrome-devtools-mcp-2): Chrome DevTools MCP is an open-source MCP server for browser automation.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [GitHub](https://ai-powered.com/mcp/github-2): GitHub is an open-source MCP server for developer tools.
- [Serena MCP: the IDE for your agent](https://ai-powered.com/mcp/serena-mcp-the-ide-for-your-agent): Serena MCP: the IDE for your agent is an open-source MCP server for developer tools.
- [awesome-mcp-servers](https://ai-powered.com/mcp/awesome-mcp-servers-2): awesome-mcp-servers is an open-source MCP server for developer tools.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.

---
Source: https://ai-powered.com/mcp/mcp-selection-lab
