Skip to content

AI tools, MCP servers and agent skills for benchmarks

53 MCP servers, 2 AI tools and 2 agent skills for benchmarks in AI models and LLM tooling, including Huggingface best, Huggingface community evals and rllm, most popular first. 41 of the 57 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 1–19 of 19

  1. Reinforcement-learning framework for training language agents on any harness

    • Open source
    • Open-source agent
    • 5.9K GitHub stars
    • AI models and LLM tooling
  2. Benchmarks LLM trading agents on news replayed by publication time, plus paper trading

    Runs locally
    • Open source
    • Finance and payments
  3. AILANG Docs

    MCP server

    Search AILANG's language reference, stdlib, examples and benchmarks from an agent

    • 22 tools
    • Remote
    • Open source
    • Developer tools
  4. Search agent skills ranked by measured lift over a no-skill baseline

    Runs locally
    • 3 tools
    • Free
    • AI models and LLM tooling
  5. Cosmergon

    MCP server

    Connects an AI agent to Cosmergon, a live economy where agents trade, evolve and compete

    Runs locally
    • 1 tool
    • Freemium
    • Games and play
  6. distil

    MCP server

    Measures where an agent session's tokens and cost go, and trims context safely

    Runs locally
    • Free
    • AI models and LLM tooling
  7. Woodstitch

    MCP server

    Paid human listeners judge your TTS audio in blind preference or human-vs-AI studies

    Runs locally
    • 13 tools
    • Paid
    • Design and media
  8. Local AI MCP

    MCP server

    Local MCP server to check VRAM fit, manage models and delegate work to local LLM runtimes

    Runs locally
    • 19 tools
    • Open source
    • AI models and LLM tooling
  9. Agentery

    MCP server

    Compare published prices of AI agents, MCP servers and APIs, with a daily price index

    Not checked yet
    • 20 tools
    • Remote
    • Free
    • AI models and LLM tooling
  10. InferCPI

    MCP server

    Query AI inference price indexes, model prices, speed and cost per task

    Not checked yet
    • 10 tools
    • Remote
    • Free
    • Analytics and data
  11. Screen AI agents, read signed Badge fitness scores and browse the Talent Pool

    Runs locally
    • 1 tool
    • Freemium
    • AI models and LLM tooling
  12. Xzar

    MCP server

    Test your agent on real tariff and patent decisions graded against the actual outcome

    Not checked yet
    • 9 tools
    • Remote
    • Paid
    • AI models and LLM tooling
  13. ModelSpec

    MCP server

    Shortlist AI models for a job from requirements, sourced benchmarks and real cost

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • AI models and LLM tooling
  14. Prove It

    MCP server

    Free challenge that checks agents' claims against signed receipts of their calls

    Runs locally
    • 7 tools
    • Free
    • AI models and LLM tooling
  15. Implicit Core

    MCP server

    Local MCP server for addressing synthetic agent-environment state and checking provenance

    Runs locally
    • 8 tools
    • Open source
    • Developer tools
  16. VerifyAX

    MCP server

    Register AI agents, generate scenarios and run simulation tests on VerifyAX

    Not checked yet
    • Remote
    • Free trial
    • AI models and LLM tooling
  17. Ask several LLMs at once and get one judged answer through MCP

    Runs locally
    • 11 tools
    • Paid
    • AI models and LLM tooling
  18. Toolc

    MCP server

    Compiler that merges many MCP servers and REST APIs into one lean tool endpoint

    Runs locally
    • 2 tools
    • Open source
    • AI models and LLM tooling