Skip to content

AI tools, MCP servers and agent skills for benchmarks

53 MCP servers, 2 AI tools and 2 agent skills for benchmarks in AI models and LLM tooling, including Huggingface best, Huggingface community evals and rllm, most popular first. 41 of the 57 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 1–9 of 9

  1. Recommend top Hugging Face models for a task from official leaderboards and device limits

    • Open source
    • 11.4K GitHub stars
    • AI models and LLM tooling
  2. Run local evals on Hugging Face models with inspect-ai or lighteval and pick a backend

    • Open source
    • 11.4K GitHub stars
    • AI models and LLM tooling
  3. Reinforcement-learning framework for training language agents on any harness

    • Open source
    • Open-source agent
    • 5.9K GitHub stars
    • AI models and LLM tooling
  4. Benchmarks LLM trading agents on news replayed by publication time, plus paper trading

    Runs locally
    • Open source
    • Finance and payments
  5. AILANG Docs

    MCP server

    Search AILANG's language reference, stdlib, examples and benchmarks from an agent

    • 22 tools
    • Remote
    • Open source
    • Developer tools
  6. Local AI MCP

    MCP server

    Local MCP server to check VRAM fit, manage models and delegate work to local LLM runtimes

    Runs locally
    • 19 tools
    • Open source
    • AI models and LLM tooling
  7. Implicit Core

    MCP server

    Local MCP server for addressing synthetic agent-environment state and checking provenance

    Runs locally
    • 8 tools
    • Open source
    • Developer tools
  8. Nonobench

    MCP server

    Remote MCP endpoint for the Nonobench LLM nonogram puzzle benchmark

    Not checked yet
    • Remote
    • Open source
    • AI models and LLM tooling
  9. Toolc

    MCP server

    Compiler that merges many MCP servers and REST APIs into one lean tool endpoint

    Runs locally
    • 2 tools
    • Open source
    • AI models and LLM tooling