Skip to content

MCP Test Runner vs Test

MCP Test Runner is an open-source MCP server for developer tools. Test is an open-source MCP server for developer tools.

  • MCP Test Runner is best for verifying an ai agent's claims about code behaviour by running the relevant tests.
  • Test is best for letting a coding agent run the test suite and act on failing tests.
What it is
MCP Test Runner is an open-source MCP server for developer tools.
Test is an open-source MCP server for developer tools.
Best for
Verifying an AI agent's claims about code behaviour by running the relevant tests
Letting a coding agent run the test suite and act on failing tests
Kind
MCP server
MCP server
Pricing
Open source
Open source
Platforms
CLI, self-hosted, Linux, macOS
CLI, Linux, macOS, Windows, self-hosted
Runs
Locally
Locally
Open source
Good for
Verifying an AI agent's claims about code behaviour by running the relevant tests; Running a single failing pytest or Jest test from an agent workflow; Collecting pytest coverage totals during codebase onboarding
Letting a coding agent run the test suite and act on failing tests; Reading pass and fail counts from pytest, jest or vitest without parsing terminal text; Keeping test output consistent across operating systems and framework versions

What MCP Test Runner does

  • Pytest execution

    Runs pytest in a bounded working directory with optional test filtering and resource limits.

  • Jest execution

    Runs Jest through npx with JSON output written to a file.

  • Single test targeting

    Runs one pytest node id or one Jest test-name pattern.

  • Normalized result parsing

    Converts pytest and Jest JSON output into one shared result schema.

  • Coverage totals

    Returns pytest-cov coverage totals from a JSON coverage report.

  • Resource-capped subprocesses

    Applies timeouts and POSIX CPU and memory limits to test runs.

What Test does

  • Framework auto-detection

    Identifies whether a project uses pytest, jest or vitest without manual configuration.

  • Structured test results

    Returns typed, schema-validated JSON alongside human-readable text output.

  • Tool filtering

    Environment variables can limit which tools the server registers.

  • Stdio transport

    Runs as a local npm package over stdio for MCP clients.

MCP Test Runner vs Test: questions

Is MCP Test Runner or Test cheaper?

Both are open source. Compare current plans on each official site.

What is the difference between MCP Test Runner and Test?

MCP Test Runner is an open-source MCP server for developer tools. Test is an open-source MCP server for developer tools.

Keep comparing