Skip to content
MCP server

Backtest Auditor

Red-team checks for trading backtests: lookahead lint, Deflated Sharpe, costs, local

Runs locallyStatus and history
Install
Pricing
Free
Platforms
CLI, self-hosted
Runs
Locally
Version
0.7.0
Listing updated
1 day ago

About Backtest Auditor

Backtest Auditor is a free MCP server for finance and payments. It runs locally on your machine and is started by your AI client.

Backtest Auditor reads your strategy code, return series or trade log and reports the errors that most often make a backtest look better than it is. It reads code without executing it. The seven areas are lookahead bias, survivorship bias, ticker reuse, unrealistic costs, overfitting and multiple testing, sub-period instability and concentration.

Findings carry a rule ID, severity, exact line and a one-line reason; for a few unambiguous patterns it suggests a minimal edit and rechecks it. Return and trade-log audits compute break-even cost, Sharpe significance, the Deflated Sharpe Ratio for the number of variants tried, drawdown and a benchmark comparison. Verdicts range from major red flags to no red flags found, which the site says does not mean a strategy will make money.

Version 0.7 is a free MCP server and Python library on PyPI that runs on your machine, with three bundled prompts. Its hosted web check is off for now.

Install

Run in a terminal

claude mcp add backtest-auditor -- uvx backtest-auditor

Add to claude_desktop_config.json

{
  "mcpServers": {
    "backtest-auditor": {
      "command": "uvx",
      "args": [
        "backtest-auditor"
      ]
    }
  }
}
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "backtest-auditor": {
      "command": "uvx",
      "args": [
        "backtest-auditor"
      ]
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "backtest-auditor": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "backtest-auditor"
      ]
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "backtest-auditor": {
      "command": "uvx",
      "args": [
        "backtest-auditor"
      ]
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "backtest-auditor": {
      "command": "uvx",
      "args": [
        "backtest-auditor"
      ]
    }
  }
}

Tools this server provides (6)

Taken from the project documentation; the running server may differ.

check_path
Reads Python files or folders without running them and flags bias patterns.
audit_backtest
Runs every applicable check and gives one combined verdict.
check_code
Lints pasted strategy code for lookahead and survivorship leaks.
audit_returns
Audits a return series for costs, Sharpe significance and drawdown.
audit_trade_log
Rebuilds daily results from a trade log and runs the audit.
explain
Explains what a check does and how to fix it.

What it does

Lookahead lint
Flags code that uses future data, with line and reason.
Return series audit
Costs, Sharpe significance, Deflated Sharpe and drawdown.
Trade log audit
Rebuilds daily results and adds survivorship hints.
Combined verdict
One verdict with reasons for each part.
Read-only code checks
Code is read, never executed.
Prompts included
Three one-click prompts for audits and drafting.

Good for

  • Find look-ahead bias in a strategy repository
  • Check whether costs erase a strategy's edge
  • Adjust a Sharpe for the number of variants tested
  • Audit a broker trade log for concentration

Pricing

Free

Free on PyPI; runs locally

Prices change. Check nothingbutalpha.app before you buy.

Backtest Auditor FAQ

Does it run my code?

No. The site says code is read, never executed.

Is it free?

Yes, free on PyPI and runs on your machine.

Does a clean report mean the strategy works?

No. It only means these checks found no common errors.

How do I add it?

claude mcp add backtest-auditor -- uvx backtest-auditor.

Is Backtest Auditor free?

Yes. Backtest Auditor is free to use.

How do I add Backtest Auditor to Claude Code?

Run this command in your terminal: claude mcp add backtest-auditor -- uvx backtest-auditor

What are the best alternatives to Backtest Auditor?

The closest alternatives to Backtest Auditor are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to Backtest Auditor

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools