Clearbar model verdicts
Look up the cheapest LLM that passes a task, with pass rates and cost per success
- Pricing
- Freemium
- Platforms
- Web, API
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 2 days ago
About Clearbar model verdicts
Clearbar model verdicts is a freemium MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
Clearbar prices a model by what a correct answer costs, not by token price. Every attempt, including retries after invalid output or API errors, is summed through OpenRouter's reported cost and divided by the tasks that passed. A model that looks cheap per token but needs three tries shows its real cost.
The MCP server answers from stored verdicts on five public datasets: Amazon Polarity sentiment, glaive function-calling arguments, SMS spam, BANKING77 intents and JSON extraction. Each has a pass-rate bar and a dated OpenRouter price snapshot. Answers include the cheapest passing model, pass rate, cost per successful task, the run file and a script to repeat the run. Re-runs are expected to land within about 5 points of pass rate and 10% of cost.
The server is read-only, needs no account or key and works with any client that supports streamable HTTP.
Install
Run in a terminal
claude mcp add --transport http verdicts https://clearbar.grain64.com/mcpAdd to Settings → Connectors → Add custom connector
https://clearbar.grain64.com/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"verdicts": {
"url": "https://clearbar.grain64.com/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"verdicts": {
"type": "http",
"url": "https://clearbar.grain64.com/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"verdicts": {
"serverUrl": "https://clearbar.grain64.com/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"verdicts": {
"type": "http",
"url": "https://clearbar.grain64.com/mcp"
}
}
}Tools this server provides (2)
Taken from the project documentation; the running server may differ.
- list_verdicts
- List every verdict with its cheapest passing model, optionally filtered by task
- get_verdict
- Return the full table for one task by slug
What it does
- Cost per successful task
- Retries and failed attempts are priced in and divided by the passes.
- Stored verdicts
- Covers sentiment, tool calls, spam, banking intents and JSON extraction.
- Pass bar with intervals
- Statuses use a 95% Wilson interval: cleared, borderline, below bar or errored.
- Reproducible runs
- Each verdict links a script to repeat it with your own OpenRouter key.
- Read-only access
- Two tools, no account and no key.
Good for
- Pick a cheaper model for a spam or intent classifier
- Compare model cost on tool-call argument accuracy
- Ask a coding agent which model to use for JSON extraction
- Re-check a model choice when prices change
Pricing
Freemium
MCP verdicts are free; workspace has 3 free runs a month and larger runs are paid
Prices change. Check clearbar.grain64.com before you buy.
Clearbar model verdicts FAQ
Which tools does it expose?
list_verdicts, with an optional task filter, and get_verdict, which takes a slug.
Do I need a key?
No. The MCP server is open and read-only. Running your own verdict uses your own OpenRouter key.
Can I test my own examples?
Yes, in the Clearbar workspace: 3 free runs a month with up to 100 examples and 6 models.
How repeatable are the numbers?
Models run at temperature 0 but are not fully deterministic, so expect about 5 points of pass rate and 10% of cost.
Is Clearbar model verdicts free?
Clearbar model verdicts has a free plan, with paid plans for more usage or features.
How do I add Clearbar model verdicts to Claude Code?
Run this command in your terminal: claude mcp add --transport http verdicts https://clearbar.grain64.com/mcp
What are the best alternatives to Clearbar model verdicts?
The closest alternatives to Clearbar model verdicts are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to Clearbar model verdicts

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools