
mizan-ledger
Local calibration ledger that scores an agent's declared confidence against real outcomes
- Pricing
- Open source
- Platforms
- CLI, API, self-hosted
- Runs
- Locally
- Version
- 0.1.5
- Listing updated
- today
Similar MCP servers
About mizan-ledger
mizan-ledger is an open-source MCP server for agent benchmarks. It runs locally on your machine and is started by your AI client.
The README describes mizan-ledger as a way to record how confident an agent is before a task, store only a salted SHA-256 commitment of that declaration, and later score it against the result of the agent's own tests or checks. Scoring covers Brier score, ECE, log loss, accuracy and coverage of declared, resolved and pending records.
The library runs entirely on the local machine with no network access or telemetry, and the core has no required dependencies. Public receipt and resolution files can be checked offline with a verify command that walks the hash chains, while openings are kept in a private directory that should stay out of version control.
It suits developers who want to measure whether an agent's stated certainty matches how often it is right. The project is labelled early alpha, and the README is explicit that scores measure calibration rather than whether an agent is good, safe or secure.
Install
Run in a terminal
claude mcp add mizan-ledger -- uvx mizan-ledgerAdd to claude_desktop_config.json
{
"mcpServers": {
"mizan-ledger": {
"command": "uvx",
"args": [
"mizan-ledger"
]
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"mizan-ledger": {
"command": "uvx",
"args": [
"mizan-ledger"
]
}
}
}Add to .vscode/mcp.json
{
"servers": {
"mizan-ledger": {
"type": "stdio",
"command": "uvx",
"args": [
"mizan-ledger"
]
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"mizan-ledger": {
"command": "uvx",
"args": [
"mizan-ledger"
]
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"mizan-ledger": {
"command": "uvx",
"args": [
"mizan-ledger"
]
}
}
}Using several servers? Build one config file with the MCP config generator.
Tools this server provides (4)
Taken from the project documentation; the running server may differ.
- commit_confidence
- Declare confidence before the task.
- resolve_outcome
- Record the real outcome of a declared task.
- get_calibration
- Read-only calibration scores.
- verify_ledger
- Read-only offline check of the ledger.
What it does
- Hash-committed confidence declarations
- Each declared probability is stored as a salted SHA-256 commitment before the outcome is known.
- Calibration scoring
- Computes Brier score, expected calibration error, log loss and accuracy with confidence intervals.
- Offline chain verification
- A verify command checks hash chains, openings and scores without any network access.
- Pytest plugin
- Marks tests with a confidence value and records pass or fail as the outcome.
- Optional local MCP server
- A stdio server exposes commit, resolve, calibration and verify tools to MCP clients on the same machine.
- Coverage reporting
- Counts declared, resolved and pending records so unresolved answers cannot be silently dropped.
Good for
- Measuring whether a coding agent's stated confidence matches its test pass rate
- Tracking calibration of an agent across repeated tasks in a pytest suite
- Checking a local agent's confidence history offline with a tamper-evident chain
- Comparing calibration of two agent versions over a set of resolved tasks
Pricing
Open source
Free and MIT licensed; runs locally.
Prices change. Check qants-site.qants.workers.dev before you buy.
mizan-ledger FAQ
What license is mizan-ledger under?
The README states it is MIT licensed.
Does the library send any data over the network?
The README says the core library has no network access, no telemetry and no dependencies.
Can the library verify that outcomes are honest?
No. The README says it cannot tell whether an outcome supplied by the caller is honest, and recommends an outcome source the agent does not control.
How is it installed?
With pip install mizan-ledger on Python 3.9 or later. The optional MCP server requires pip install 'mizan-ledger[mcp]' and Python 3.10 or later.
Is mizan-ledger free?
Yes. mizan-ledger is open source, so you can use and self-host it for free.
How do I add mizan-ledger to Claude Code?
Run this command in your terminal: claude mcp add mizan-ledger -- uvx mizan-ledger
What are the best alternatives to mizan-ledger?
The closest alternatives to mizan-ledger are Mizan Calibration and Agent Reliability.
Where this comes from
- Description: written from the project's README, the project's website and its MCP Registry entry.
- Install steps: from the official MCP Registry entry.