RealRun
Independent AI model scores on inbox, scheduling, receipts, finance and support replies
- Pricing
- Free
- Platforms
- API, CLI
- Runs
- Remotely
- Version
- 0.1.1
- Listing updated
- 2 days ago
About RealRun
RealRun is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
Choosing a model for a routine business task is easier with test results than with a hunch. RealRun publishes its own scores for AI models on five everyday jobs, and this server makes those headline numbers available to an agent so it can ask which model to use for a given task.
The five task ids are inbox-triage, meeting-scheduling, receipts, finance and support-replies. The site says each test uses realistic items, fresh held-back sets the prompts were never tuned on, scam-safety checks and published methods, with 9 to 10 models per test. The recommend_model tool picks one model plus two alternatives by accuracy, cost or a balance, and never picks a model flagged as not recommended.
All tools are read-only and stateless. Full prompts and item-level results sit in paid playbooks ($29 each, or $99 for all five). The README says metering is planned but switched off, so nobody is charged for lookups.
Install
Run in a terminal
claude mcp add --transport http realrun https://realrun.baseledgerip.com/mcpAdd to Settings → Connectors → Add custom connector
https://realrun.baseledgerip.com/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"realrun": {
"url": "https://realrun.baseledgerip.com/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"realrun": {
"type": "http",
"url": "https://realrun.baseledgerip.com/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"realrun": {
"serverUrl": "https://realrun.baseledgerip.com/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"realrun": {
"type": "http",
"url": "https://realrun.baseledgerip.com/mcp"
}
}
}Tools this server provides (4)
Taken from the project documentation; the running server may differ.
- list_tasks
- Tested tasks, item counts, dates, results pages and playbook prices.
- get_scores
- Every model's headline score for a task, best first, with cost tier.
- recommend_model
- One pick plus two alternatives for a task by priority.
- get_warnings
- Not-recommended and caution flags for a task.
What it does
- Per-task scores
- Returns every tested model's headline score for a task, best first.
- Model recommendation
- Suggests one model and two alternatives by accuracy, cost or balance.
- Warning flags
- Lists not-recommended and caution flags such as scam failures or invented data.
- Task catalogue
- Lists tested tasks, item counts, dates and playbook prices.
- Read-only and stateless
- Stores nothing and needs no authentication.
Good for
- Choose a model for email triage
- Check which models fell for scam invoices
- Pick the cheapest model that scores well on receipts
- Add a model-choice step to an agent workflow
Pricing
Free
Lookups free; playbooks $29 each or $99 for all five
Prices change. Check realrun.baseledgerip.com before you buy.
RealRun FAQ
Does it need an account?
No. The README says the server has no auth and stores nothing.
Is it free?
Lookups are free for now; the README says per-call billing is planned but off. Playbooks cost $29 each or $99 for five.
Which tasks are covered?
Inbox triage, meeting scheduling, receipts, finance and customer support replies.
Can I run it locally?
Yes, over stdio with npx -y realrun-mcp, or use the remote endpoint.
Is RealRun free?
Yes. RealRun is free to use.
How do I add RealRun to Claude Code?
Run this command in your terminal: claude mcp add --transport http realrun https://realrun.baseledgerip.com/mcp
What are the best alternatives to RealRun?
The closest alternatives to RealRun are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to RealRun

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools