Skip to content
MCP server

Clearbar model verdicts

Look up the cheapest LLM that passes a task, with pass rates and cost per success

Install
Pricing
Freemium
Platforms
Web, API
Runs
Remotely
Version
1.0.0
Listing updated
2 days ago

About Clearbar model verdicts

Clearbar model verdicts is a freemium MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.

Clearbar prices a model by what a correct answer costs, not by token price. Every attempt, including retries after invalid output or API errors, is summed through OpenRouter's reported cost and divided by the tasks that passed. A model that looks cheap per token but needs three tries shows its real cost.

The MCP server answers from stored verdicts on five public datasets: Amazon Polarity sentiment, glaive function-calling arguments, SMS spam, BANKING77 intents and JSON extraction. Each has a pass-rate bar and a dated OpenRouter price snapshot. Answers include the cheapest passing model, pass rate, cost per successful task, the run file and a script to repeat the run. Re-runs are expected to land within about 5 points of pass rate and 10% of cost.

The server is read-only, needs no account or key and works with any client that supports streamable HTTP.

Install

Run in a terminal

claude mcp add --transport http verdicts https://clearbar.grain64.com/mcp

Add to Settings → Connectors → Add custom connector

https://clearbar.grain64.com/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "verdicts": {
      "url": "https://clearbar.grain64.com/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "verdicts": {
      "type": "http",
      "url": "https://clearbar.grain64.com/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "verdicts": {
      "serverUrl": "https://clearbar.grain64.com/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "verdicts": {
      "type": "http",
      "url": "https://clearbar.grain64.com/mcp"
    }
  }
}

Tools this server provides (2)

Taken from the project documentation; the running server may differ.

list_verdicts
List every verdict with its cheapest passing model, optionally filtered by task
get_verdict
Return the full table for one task by slug

What it does

Cost per successful task
Retries and failed attempts are priced in and divided by the passes.
Stored verdicts
Covers sentiment, tool calls, spam, banking intents and JSON extraction.
Pass bar with intervals
Statuses use a 95% Wilson interval: cleared, borderline, below bar or errored.
Reproducible runs
Each verdict links a script to repeat it with your own OpenRouter key.
Read-only access
Two tools, no account and no key.

Good for

  • Pick a cheaper model for a spam or intent classifier
  • Compare model cost on tool-call argument accuracy
  • Ask a coding agent which model to use for JSON extraction
  • Re-check a model choice when prices change

Pricing

Freemium

MCP verdicts are free; workspace has 3 free runs a month and larger runs are paid

Prices change. Check clearbar.grain64.com before you buy.

Clearbar model verdicts FAQ

Which tools does it expose?

list_verdicts, with an optional task filter, and get_verdict, which takes a slug.

Do I need a key?

No. The MCP server is open and read-only. Running your own verdict uses your own OpenRouter key.

Can I test my own examples?

Yes, in the Clearbar workspace: 3 free runs a month with up to 100 examples and 6 models.

How repeatable are the numbers?

Models run at temperature 0 but are not fully deterministic, so expect about 5 points of pass rate and 10% of cost.

Is Clearbar model verdicts free?

Clearbar model verdicts has a free plan, with paid plans for more usage or features.

How do I add Clearbar model verdicts to Claude Code?

Run this command in your terminal: claude mcp add --transport http verdicts https://clearbar.grain64.com/mcp

What are the best alternatives to Clearbar model verdicts?

The closest alternatives to Clearbar model verdicts are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to Clearbar model verdicts

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling