Skip to content
MCP server

Model Tested

Independent open-weight LLM test scores: which local model fits your GPU or Mac

Install
Pricing
Free
Platforms
API, Web
Runs
Remotely
Version
1.0.0
Listing updated
1 day ago

About Model Tested

Model Tested is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.

Model Tested runs open-weight models on practical work and publishes the scores; the MCP server exposes those numbers to an assistant, covering 70 models as of the November 14, 2026 update. It is free, read-only and needs no account or API key, and the site says it does not log what you ask.

The benchmark uses three tests: coding graded by running the model's code against hidden unit tests in a no-network Docker sandbox, document reading graded field by field against a calculated key, and decisions scored on accuracy and Brier calibration. Most questions are hidden, and the server never returns them or the models' answers. Models run through OpenRouter, with some Q4 downloads also tried on a Mac mini M4 with 16 GB.

Memory estimates assume an 8k-token context. The project deliberately publishes no speed figures, because they depend on hardware.

Install

Run in a terminal

claude mcp add --transport http llm-benchmarks https://modeltested.com/mcp

Add to Settings → Connectors → Add custom connector

https://modeltested.com/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "llm-benchmarks": {
      "url": "https://modeltested.com/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "llm-benchmarks": {
      "type": "http",
      "url": "https://modeltested.com/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "llm-benchmarks": {
      "serverUrl": "https://modeltested.com/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "llm-benchmarks": {
      "type": "http",
      "url": "https://modeltested.com/mcp"
    }
  }
}

Tools this server provides (5)

Taken from the project documentation; the running server may differ.

find_models
Best models for a task, optionally limited to those fitting a given GPU or Mac memory.
get_model
All data on one model: scores, rank, memory per quantization and smallest hardware that fits.
compare_models
Two to six models side by side.
decision_models
Decision model rankings with accuracy, hard tasks, calibration and cost per 1,000 calls.
search_articles
Search articles and ranking pages by keyword.

What it does

Fit by hardware
Finds models that fit a graphics card or Mac of a given memory size.
Task rankings
Best models overall or for coding, documents, decisions and hard tasks.
Side-by-side comparison
Two to six models compared on scores and memory.
Decision model rankings
Accuracy, honesty of confidence and cost per 1,000 calls.
No account needed
Free, read-only, no API key.

Good for

  • Pick a local model for a 16 GB GPU
  • Find the best coding model for a 32 GB Mac
  • Compare two similar models before downloading
  • Check memory needed at a given quantization

Pricing

Free

Free, read-only, no account

Prices change. Check modeltested.com before you buy.

Model Tested FAQ

Is it free?

Yes, free and read-only with no account or key.

Which clients work?

Claude, ChatGPT, Cursor, VS Code and any app that supports remote MCP over HTTP.

Does it report speed?

No. The project does not measure speed because it depends on hardware.

Are the test questions exposed?

No. The server returns only scores, never hidden questions or answers.

Is Model Tested free?

Yes. Model Tested is free to use.

How do I add Model Tested to Claude Code?

Run this command in your terminal: claude mcp add --transport http llm-benchmarks https://modeltested.com/mcp

What are the best alternatives to Model Tested?

The closest alternatives to Model Tested are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to Model Tested

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling