Skip to content

AI tools, MCP servers and agent skills for benchmarks

53 MCP servers, 2 AI tools and 2 agent skills for benchmarks in AI models and LLM tooling, including Huggingface best, Huggingface community evals and rllm, most popular first. 41 of the 57 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 1–30 of 46

  1. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling
  2. Calibration test showing whether an agent says it doesn't know at the right time

    • 10 tools
    • Remote
    • Free
    • AI models and LLM tooling
  3. Sourced AI and cloud pricing for FinOps: compare LLM costs, hosts and GPU break-even

    • 8 tools
    • Remote
    • Free
    • AI models and LLM tooling
  4. Cheapest LLM that passes each task, with cost per successful task and pass rate

    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  5. AILANG Docs

    MCP server

    Search AILANG's language reference, stdlib, examples and benchmarks from an agent

    • 22 tools
    • Remote
    • Open source
    • Developer tools
  6. Compare LLM list prices by provider venue and tier, plus live time-to-first-token probes

    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  7. Leaklens

    MCP server

    Check SWE-bench tasks for leaked fixes: tier, quoted evidence and fix-commit date

    • 2 tools
    • Remote
    • Freemium
    • Developer tools
  8. LLM Prover

    MCP server

    Compare models on cost and quality, score outputs and analyse agent runs

    Not checked yet
    • Remote
    • Paid
    • AI models and LLM tooling
  9. Cosmergon

    MCP server

    Connects an AI agent to Cosmergon, a live economy where agents trade, evolve and compete

    Runs locally
    • 1 tool
    • Freemium
    • Games and play
  10. NL;NL Labs

    MCP server

    Read-only access to NL;NL Labs' daily AI model test results for business jobs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  11. OPSIN

    MCP server

    Signed, preregistered experiments on which prompts and tools help AI agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  12. RigBase

    MCP server

    Search measured local-LLM speeds on home GPU rigs and check what will run

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  13. Woodstitch

    MCP server

    Paid human listeners judge your TTS audio in blind preference or human-vs-AI studies

    Runs locally
    • 13 tools
    • Paid
    • Design and media
  14. Look up the cheapest LLM that passes a task, with pass rates and cost per success

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • AI models and LLM tooling
  15. Run your own agent through six refereed jobs with hidden traps and get a report card

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • AI models and LLM tooling
  16. Spring Prompt

    MCP server

    Lets a coding agent test your prompts across models and rewrite them, with evidence

    Not checked yet
    • Remote
    • Free trial
    • AI models and LLM tooling
  17. Local AI Prices

    MCP server

    Daily prices, stock and measured speeds for computers that run local AI models

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • AI models and LLM tooling
  18. ProveCart

    MCP server

    Practice exam and public score for AI shopping, booking and reservation agents

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  19. Measured Agents

    MCP server

    Read-only MCP catalog of agent packs graded against human expert agreement

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  20. Agentery

    MCP server

    Compare published prices of AI agents, MCP servers and APIs, with a daily price index

    Not checked yet
    • 20 tools
    • Remote
    • Free
    • AI models and LLM tooling
  21. Modelglass

    MCP server

    Sourced AI model pricing and capability data via API, MCP and VS Code extensions

    Not checked yet
    • Remote
    • Freemium
    • 1 GitHub star
    • AI models and LLM tooling
  22. BenchLeader

    MCP server

    Free read-only MCP server for the daily LLM leaderboard, benchmarks and model comparisons

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  23. Find a verified web workflow and replay it with zero model calls, with failures shown

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Browser automation
  24. Extractive document summarizer that returns the source's own sentences, never new text

    Not checked yet
    • Remote
    • Paid
    • AI models and LLM tooling
  25. InferCPI

    MCP server

    Query AI inference price indexes, model prices, speed and cost per task

    Not checked yet
    • 10 tools
    • Remote
    • Free
    • Analytics and data
  26. Agentic Weekly

    MCP server

    Free, key-less MCP server for sourced AI model facts and tool release briefs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • AI models and LLM tooling
  27. Directional answers on whether quantizing an LLM saves GPU energy, with stated basis

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling
  28. Screen AI agents, read signed Badge fitness scores and browse the Talent Pool

    Runs locally
    • 1 tool
    • Freemium
    • AI models and LLM tooling
  29. TriedAgents

    MCP server

    Look up AI agent use cases that were re-run, scored out of 10 and graded by access level

    Not checked yet
    • Remote
    • Free
    • AI models and LLM tooling