Skip to content

AI tools, MCP servers and agent skills for benchmarks

59 MCP servers, 2 AI tools and 2 agent skills for benchmarks in AI models and LLM tooling, including Huggingface best, Huggingface community evals and rllm, most popular first. 44 of the 63 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 1–30 of 32

  1. Curated reading list on making AI agents reliable in long-running work

    • Free
    • Open-source agent
    • 4.7K GitHub stars
    • AI models and LLM tooling
  2. Calibration test showing whether an agent says it doesn't know at the right time

    • 10 tools
    • Remote
    • Free
    • AI models and LLM tooling
  3. Sourced AI and cloud pricing for FinOps: compare LLM costs, hosts and GPU break-even

    • 8 tools
    • Remote
    • Free
    • AI models and LLM tooling
  4. Cheapest LLM that passes each task, with cost per successful task and pass rate

    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  5. Compare LLM list prices by provider venue and tier, plus live time-to-first-token probes

    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  6. Search agent skills ranked by measured lift over a no-skill baseline

    Runs locally
    • 3 tools
    • Free
    • AI models and LLM tooling
  7. NL;NL Labs

    MCP server

    Read-only access to NL;NL Labs' daily AI model test results for business jobs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  8. distil

    MCP server

    Measures where an agent session's tokens and cost go, and trims context safely

    Runs locally
    • Free
    • AI models and LLM tooling
  9. OPSIN

    MCP server

    Signed, preregistered experiments on which prompts and tools help AI agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  10. RigBase

    MCP server

    Search measured local-LLM speeds on home GPU rigs and check what will run

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  11. Run your own agent through six refereed jobs with hidden traps and get a report card

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  12. Local AI Prices

    MCP server

    Daily prices, stock and measured speeds for computers that run local AI models

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • AI models and LLM tooling
  13. ProveCart

    MCP server

    Practice exam and public score for AI shopping, booking and reservation agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  14. Measured Agents

    MCP server

    Read-only MCP catalog of agent packs graded against human expert agreement

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  15. Agentery

    MCP server

    Compare published prices of AI agents, MCP servers and APIs, with a daily price index

    Not checked yet
    • 20 tools
    • Remote
    • Free
    • AI models and LLM tooling
  16. BenchLeader

    MCP server

    Free read-only MCP server for the daily LLM leaderboard, benchmarks and model comparisons

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  17. Find a verified web workflow and replay it with zero model calls, with failures shown

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Browser automation
  18. InferCPI

    MCP server

    Query AI inference price indexes, model prices, speed and cost per task

    Not checked yet
    • 10 tools
    • Remote
    • Free
    • Analytics and data
  19. Agentic Weekly

    MCP server

    Free, key-less MCP server for sourced AI model facts and tool release briefs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  20. Directional answers on whether quantizing an LLM saves GPU energy, with stated basis

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  21. TriedAgents

    MCP server

    Look up AI agent use cases that were re-run, scored out of 10 and graded by access level

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  22. Look up AI model prices, context windows, licences and LMArena ranks with source links

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  23. The Neural Net

    MCP server

    Sourced register of open-weight AI model releases and AI news, open to agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  24. Model Tested

    MCP server

    Independent open-weight LLM test scores: which local model fits your GPU or Mac

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • AI models and LLM tooling
  25. Prove It

    MCP server

    Free challenge that checks agents' claims against signed receipts of their calls

    Runs locally
    • 7 tools
    • Free
    • AI models and LLM tooling
  26. BenchGecko

    MCP server

    Read-only MCP server for AI model prices, benchmark scores and independent model tests

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling