Skip to content

AI tools, MCP servers and agent skills for benchmarks

53 MCP servers, 2 AI tools and 2 agent skills for benchmarks in AI models and LLM tooling, including Huggingface best, Huggingface community evals and rllm, most popular first. 41 of the 57 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 1–30 of 31

  1. Curated reading list on making AI agents reliable in long-running work

    • Free
    • Open-source agent
    • 4.7K GitHub stars
    • AI models and LLM tooling
  2. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling
  3. Calibration test showing whether an agent says it doesn't know at the right time

    • 10 tools
    • Remote
    • Free
    • AI models and LLM tooling
  4. Benchmarks LLM trading agents on news replayed by publication time, plus paper trading

    Runs locally
    • Open source
    • Finance and payments
  5. Cheapest LLM that passes each task, with cost per successful task and pass rate

    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  6. Compare LLM list prices by provider venue and tier, plus live time-to-first-token probes

    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  7. Leaklens

    MCP server

    Check SWE-bench tasks for leaked fixes: tier, quoted evidence and fix-commit date

    • 2 tools
    • Remote
    • Freemium
    • Developer tools
  8. LLM Prover

    MCP server

    Compare models on cost and quality, score outputs and analyse agent runs

    Not checked yet
    • Remote
    • Paid
    • AI models and LLM tooling
  9. NL;NL Labs

    MCP server

    Read-only access to NL;NL Labs' daily AI model test results for business jobs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  10. OPSIN

    MCP server

    Signed, preregistered experiments on which prompts and tools help AI agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  11. Look up the cheapest LLM that passes a task, with pass rates and cost per success

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • AI models and LLM tooling
  12. Run your own agent through six refereed jobs with hidden traps and get a report card

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  13. Spring Prompt

    MCP server

    Lets a coding agent test your prompts across models and rewrite them, with evidence

    Not checked yet
    • Remote
    • Free trial
    • AI models and LLM tooling
  14. Local AI Prices

    MCP server

    Daily prices, stock and measured speeds for computers that run local AI models

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • AI models and LLM tooling
  15. ProveCart

    MCP server

    Practice exam and public score for AI shopping, booking and reservation agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  16. Measured Agents

    MCP server

    Read-only MCP catalog of agent packs graded against human expert agreement

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  17. Modelglass

    MCP server

    Sourced AI model pricing and capability data via API, MCP and VS Code extensions

    Not checked yet
    • Remote
    • Freemium
    • 1 GitHub star
    • AI models and LLM tooling
  18. BenchLeader

    MCP server

    Free read-only MCP server for the daily LLM leaderboard, benchmarks and model comparisons

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  19. Directional answers on whether quantizing an LLM saves GPU energy, with stated basis

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  20. Screen AI agents, read signed Badge fitness scores and browse the Talent Pool

    Runs locally
    • 1 tool
    • Freemium
    • AI models and LLM tooling
  21. TriedAgents

    MCP server

    Look up AI agent use cases that were re-run, scored out of 10 and graded by access level

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  22. Daily data on LLM API prices, GPU sizing, cloud agents and AI funding, free to query

    Not checked yet
    • Remote
    • Freemium
    • Cloud and infrastructure
  23. The Neural Net

    MCP server

    Sourced register of open-weight AI model releases and AI news, open to agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  24. Model Tested

    MCP server

    Independent open-weight LLM test scores: which local model fits your GPU or Mac

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • AI models and LLM tooling
  25. BenchGecko

    MCP server

    Read-only MCP server for AI model prices, benchmark scores and independent model tests

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  26. Attic Standard

    MCP server

    AI inference price indexes, market KPIs and model-level prices from Attic Standard

    Not checked yet
    • 10 tools
    • Remote
    • Freemium
    • Analytics and data
  27. Compare LLM API prices, filter model capabilities and inspect dated benchmark evidence

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  28. A2APark

    MCP server

    Public test arena where AI agents run stateful scenarios and earn signed scorecards

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling