MCP Test Runner vs Test
MCP Test Runner is an open-source MCP server for developer tools. Test is an open-source MCP server for developer tools.
- MCP Test Runner is best for verifying an ai agent's claims about code behaviour by running the relevant tests.
- Test is best for letting a coding agent run the test suite and act on failing tests.
- What it is
- MCP Test Runner is an open-source MCP server for developer tools.Test is an open-source MCP server for developer tools.
- Best for
- Verifying an AI agent's claims about code behaviour by running the relevant testsLetting a coding agent run the test suite and act on failing tests
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- CLI, self-hosted, Linux, macOSCLI, Linux, macOS, Windows, self-hosted
- Runs
- LocallyLocally
- Open source
- Good for
- Verifying an AI agent's claims about code behaviour by running the relevant tests; Running a single failing pytest or Jest test from an agent workflow; Collecting pytest coverage totals during codebase onboardingLetting a coding agent run the test suite and act on failing tests; Reading pass and fail counts from pytest, jest or vitest without parsing terminal text; Keeping test output consistent across operating systems and framework versions
What MCP Test Runner does
Pytest execution
Runs pytest in a bounded working directory with optional test filtering and resource limits.
Jest execution
Runs Jest through npx with JSON output written to a file.
Single test targeting
Runs one pytest node id or one Jest test-name pattern.
Normalized result parsing
Converts pytest and Jest JSON output into one shared result schema.
Coverage totals
Returns pytest-cov coverage totals from a JSON coverage report.
Resource-capped subprocesses
Applies timeouts and POSIX CPU and memory limits to test runs.
What Test does
Framework auto-detection
Identifies whether a project uses pytest, jest or vitest without manual configuration.
Structured test results
Returns typed, schema-validated JSON alongside human-readable text output.
Tool filtering
Environment variables can limit which tools the server registers.
Stdio transport
Runs as a local npm package over stdio for MCP clients.
MCP Test Runner vs Test: questions
Is MCP Test Runner or Test cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between MCP Test Runner and Test?
MCP Test Runner is an open-source MCP server for developer tools. Test is an open-source MCP server for developer tools.