
Backtest Auditor
Red-team checks for trading backtests: lookahead lint, Deflated Sharpe, costs, local
- Pricing
- Free
- Platforms
- CLI, self-hosted
- Runs
- Locally
- Version
- 0.7.0
- Listing updated
- 1 day ago
About Backtest Auditor
Backtest Auditor is a free MCP server for finance and payments. It runs locally on your machine and is started by your AI client.
Backtest Auditor reads your strategy code, return series or trade log and reports the errors that most often make a backtest look better than it is. It reads code without executing it. The seven areas are lookahead bias, survivorship bias, ticker reuse, unrealistic costs, overfitting and multiple testing, sub-period instability and concentration.
Findings carry a rule ID, severity, exact line and a one-line reason; for a few unambiguous patterns it suggests a minimal edit and rechecks it. Return and trade-log audits compute break-even cost, Sharpe significance, the Deflated Sharpe Ratio for the number of variants tried, drawdown and a benchmark comparison. Verdicts range from major red flags to no red flags found, which the site says does not mean a strategy will make money.
Version 0.7 is a free MCP server and Python library on PyPI that runs on your machine, with three bundled prompts. Its hosted web check is off for now.
Install
Run in a terminal
claude mcp add backtest-auditor -- uvx backtest-auditorAdd to claude_desktop_config.json
{
"mcpServers": {
"backtest-auditor": {
"command": "uvx",
"args": [
"backtest-auditor"
]
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"backtest-auditor": {
"command": "uvx",
"args": [
"backtest-auditor"
]
}
}
}Add to .vscode/mcp.json
{
"servers": {
"backtest-auditor": {
"type": "stdio",
"command": "uvx",
"args": [
"backtest-auditor"
]
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"backtest-auditor": {
"command": "uvx",
"args": [
"backtest-auditor"
]
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"backtest-auditor": {
"command": "uvx",
"args": [
"backtest-auditor"
]
}
}
}Tools this server provides (6)
Taken from the project documentation; the running server may differ.
- check_path
- Reads Python files or folders without running them and flags bias patterns.
- audit_backtest
- Runs every applicable check and gives one combined verdict.
- check_code
- Lints pasted strategy code for lookahead and survivorship leaks.
- audit_returns
- Audits a return series for costs, Sharpe significance and drawdown.
- audit_trade_log
- Rebuilds daily results from a trade log and runs the audit.
- explain
- Explains what a check does and how to fix it.
What it does
- Lookahead lint
- Flags code that uses future data, with line and reason.
- Return series audit
- Costs, Sharpe significance, Deflated Sharpe and drawdown.
- Trade log audit
- Rebuilds daily results and adds survivorship hints.
- Combined verdict
- One verdict with reasons for each part.
- Read-only code checks
- Code is read, never executed.
- Prompts included
- Three one-click prompts for audits and drafting.
Good for
- Find look-ahead bias in a strategy repository
- Check whether costs erase a strategy's edge
- Adjust a Sharpe for the number of variants tested
- Audit a broker trade log for concentration
Pricing
Free
Free on PyPI; runs locally
Prices change. Check nothingbutalpha.app before you buy.
Backtest Auditor FAQ
Does it run my code?
No. The site says code is read, never executed.
Is it free?
Yes, free on PyPI and runs on your machine.
Does a clean report mean the strategy works?
No. It only means these checks found no common errors.
How do I add it?
claude mcp add backtest-auditor -- uvx backtest-auditor.
Is Backtest Auditor free?
Yes. Backtest Auditor is free to use.
How do I add Backtest Auditor to Claude Code?
Run this command in your terminal: claude mcp add backtest-auditor -- uvx backtest-auditor
What are the best alternatives to Backtest Auditor?
The closest alternatives to Backtest Auditor are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.
Alternatives to Backtest Auditor

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Codebase Memory
MCP serverLocal MCP server that builds a code knowledge graph for AI coding agents
Runs locally- Open source
- 48.7K GitHub stars
- Knowledge and memory

GitHub
MCP serverOfficial MCP server connecting AI assistants to GitHub repos, issues and workflows
Not checked yet- Remote
- Open source
- 34.5K GitHub stars
- Developer tools

Serena MCP: the IDE for your agent
MCP serverMCP toolkit giving coding agents symbol-level code retrieval and editing
Runs locally- Open source
- 31.5K GitHub stars
- Developer tools

XERJ
MCP serverLocal search engine for AI agents with cited answers over your code and docs
Runs locally- Open source
- 19.2K GitHub stars
- Knowledge and memory

Ouroboros
MCP serverSpec-first layer that pins requirements and verifies results of AI coding agent work
Runs locally- Open source
- 6.4K GitHub stars
- Developer tools