Skip to content
MCP server

RealRun

Independent AI model scores on inbox, scheduling, receipts, finance and support replies

Install
Pricing
Free
Platforms
API, CLI
Runs
Remotely
Version
0.1.1
Listing updated
2 days ago

About RealRun

RealRun is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.

Choosing a model for a routine business task is easier with test results than with a hunch. RealRun publishes its own scores for AI models on five everyday jobs, and this server makes those headline numbers available to an agent so it can ask which model to use for a given task.

The five task ids are inbox-triage, meeting-scheduling, receipts, finance and support-replies. The site says each test uses realistic items, fresh held-back sets the prompts were never tuned on, scam-safety checks and published methods, with 9 to 10 models per test. The recommend_model tool picks one model plus two alternatives by accuracy, cost or a balance, and never picks a model flagged as not recommended.

All tools are read-only and stateless. Full prompts and item-level results sit in paid playbooks ($29 each, or $99 for all five). The README says metering is planned but switched off, so nobody is charged for lookups.

Install

Run in a terminal

claude mcp add --transport http realrun https://realrun.baseledgerip.com/mcp

Add to Settings → Connectors → Add custom connector

https://realrun.baseledgerip.com/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "realrun": {
      "url": "https://realrun.baseledgerip.com/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "realrun": {
      "type": "http",
      "url": "https://realrun.baseledgerip.com/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "realrun": {
      "serverUrl": "https://realrun.baseledgerip.com/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "realrun": {
      "type": "http",
      "url": "https://realrun.baseledgerip.com/mcp"
    }
  }
}

Tools this server provides (4)

Taken from the project documentation; the running server may differ.

list_tasks
Tested tasks, item counts, dates, results pages and playbook prices.
get_scores
Every model's headline score for a task, best first, with cost tier.
recommend_model
One pick plus two alternatives for a task by priority.
get_warnings
Not-recommended and caution flags for a task.

What it does

Per-task scores
Returns every tested model's headline score for a task, best first.
Model recommendation
Suggests one model and two alternatives by accuracy, cost or balance.
Warning flags
Lists not-recommended and caution flags such as scam failures or invented data.
Task catalogue
Lists tested tasks, item counts, dates and playbook prices.
Read-only and stateless
Stores nothing and needs no authentication.

Good for

  • Choose a model for email triage
  • Check which models fell for scam invoices
  • Pick the cheapest model that scores well on receipts
  • Add a model-choice step to an agent workflow

Pricing

Free

Lookups free; playbooks $29 each or $99 for all five

Prices change. Check realrun.baseledgerip.com before you buy.

RealRun FAQ

Does it need an account?

No. The README says the server has no auth and stores nothing.

Is it free?

Lookups are free for now; the README says per-call billing is planned but off. Playbooks cost $29 each or $99 for five.

Which tasks are covered?

Inbox triage, meeting scheduling, receipts, finance and customer support replies.

Can I run it locally?

Yes, over stdio with npx -y realrun-mcp, or use the remote endpoint.

Is RealRun free?

Yes. RealRun is free to use.

How do I add RealRun to Claude Code?

Run this command in your terminal: claude mcp add --transport http realrun https://realrun.baseledgerip.com/mcp

What are the best alternatives to RealRun?

The closest alternatives to RealRun are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to RealRun

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling