Model Tested
Independent open-weight LLM test scores: which local model fits your GPU or Mac
- Pricing
- Free
- Platforms
- API, Web
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 1 day ago
About Model Tested
Model Tested is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
Model Tested runs open-weight models on practical work and publishes the scores; the MCP server exposes those numbers to an assistant, covering 70 models as of the November 14, 2026 update. It is free, read-only and needs no account or API key, and the site says it does not log what you ask.
The benchmark uses three tests: coding graded by running the model's code against hidden unit tests in a no-network Docker sandbox, document reading graded field by field against a calculated key, and decisions scored on accuracy and Brier calibration. Most questions are hidden, and the server never returns them or the models' answers. Models run through OpenRouter, with some Q4 downloads also tried on a Mac mini M4 with 16 GB.
Memory estimates assume an 8k-token context. The project deliberately publishes no speed figures, because they depend on hardware.
Install
Run in a terminal
claude mcp add --transport http llm-benchmarks https://modeltested.com/mcpAdd to Settings → Connectors → Add custom connector
https://modeltested.com/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"llm-benchmarks": {
"url": "https://modeltested.com/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"llm-benchmarks": {
"type": "http",
"url": "https://modeltested.com/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"llm-benchmarks": {
"serverUrl": "https://modeltested.com/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"llm-benchmarks": {
"type": "http",
"url": "https://modeltested.com/mcp"
}
}
}Tools this server provides (5)
Taken from the project documentation; the running server may differ.
- find_models
- Best models for a task, optionally limited to those fitting a given GPU or Mac memory.
- get_model
- All data on one model: scores, rank, memory per quantization and smallest hardware that fits.
- compare_models
- Two to six models side by side.
- decision_models
- Decision model rankings with accuracy, hard tasks, calibration and cost per 1,000 calls.
- search_articles
- Search articles and ranking pages by keyword.
What it does
- Fit by hardware
- Finds models that fit a graphics card or Mac of a given memory size.
- Task rankings
- Best models overall or for coding, documents, decisions and hard tasks.
- Side-by-side comparison
- Two to six models compared on scores and memory.
- Decision model rankings
- Accuracy, honesty of confidence and cost per 1,000 calls.
- No account needed
- Free, read-only, no API key.
Good for
- Pick a local model for a 16 GB GPU
- Find the best coding model for a 32 GB Mac
- Compare two similar models before downloading
- Check memory needed at a given quantization
Pricing
Free
Free, read-only, no account
Prices change. Check modeltested.com before you buy.
Model Tested FAQ
Is it free?
Yes, free and read-only with no account or key.
Which clients work?
Claude, ChatGPT, Cursor, VS Code and any app that supports remote MCP over HTTP.
Does it report speed?
No. The project does not measure speed because it depends on hardware.
Are the test questions exposed?
No. The server returns only scores, never hidden questions or answers.
Is Model Tested free?
Yes. Model Tested is free to use.
How do I add Model Tested to Claude Code?
Run this command in your terminal: claude mcp add --transport http llm-benchmarks https://modeltested.com/mcp
What are the best alternatives to Model Tested?
The closest alternatives to Model Tested are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to Model Tested

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools