
EcoCompute Should-I-Quantize Estimator
Directional answers on whether quantizing an LLM saves GPU energy, with stated basis
- Pricing
- Free
- Platforms
- Web, API
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 2 days ago
About EcoCompute Should-I-Quantize Estimator
EcoCompute Should-I-Quantize Estimator is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
EcoCompute is an open micro-benchmark rather than a general claim about quantization. Its protocol samples GPU-package power with NVML for single-stream decoding at batch size 1 and 256 tokens, and the site says 29 of 64 planned cells have been measured. The headline finding is a crossover that depends on model size and hardware, not a rule that NF4 or INT8 always saves energy.
Give the estimator a GPU and model size and it returns a directional verdict on energy per million tokens compared with FP16. Tested configurations are shown as measured, while other sizes come from a fitted curve whose uncertainty is displayed; points measured only once are marked as single observations. INT8 was measured on A800 and RTX 4090 only.
The page asks readers to treat results as directional rather than a production decision. A container and a free Colab T4 route let you produce your own energy.json, and the dataset is archived on Zenodo under CC BY 4.0.
Install
Run in a terminal
claude mcp add --transport http ecocompute-estimator https://ecocompute-estimator.zhanghongping1982.workers.dev/mcpAdd to Settings → Connectors → Add custom connector
https://ecocompute-estimator.zhanghongping1982.workers.dev/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"ecocompute-estimator": {
"url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"ecocompute-estimator": {
"type": "http",
"url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"ecocompute-estimator": {
"serverUrl": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"ecocompute-estimator": {
"type": "http",
"url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
}
}
}What it does
- Directional verdict
- Says whether quantization saves or costs energy for a chosen GPU and model size.
- Stated basis
- Each number is labelled as measured or interpolated.
- Crossover curve
- Shows how savings change with model size, with uncertainty on fitted points.
- Optimize search
- Searches precision, batch and context under your constraints.
- Reproduce it yourself
- A runnable container and Colab path produce your own measurement.
- Citable dataset
- Archived dataset with DOI, protocol and limitations statement.
Good for
- Decide whether to run a 7B model in NF4 on a given GPU
- Check how far a result generalises before citing it
- Reproduce an energy measurement on your own card
- Cite benchmark data in a paper on inference energy
Pricing
Free
Free open research project; data under CC BY 4.0.
Prices change. Check quantenergy.tech before you buy.
EcoCompute Should-I-Quantize Estimator FAQ
Is this a universal law?
No. The site limits claims to the GPUs, stacks, batch sizes and contexts measured so far.
How is power measured?
By NVML GPU-package power sampling, not TDP estimates or wall-plug readings.
Can I verify it without a GPU?
Yes, a free Colab T4 can produce an energy.json.
Where is the data?
On Zenodo under CC BY 4.0.
Is EcoCompute Should-I-Quantize Estimator free?
Yes. EcoCompute Should-I-Quantize Estimator is free to use.
How do I add EcoCompute Should-I-Quantize Estimator to Claude Code?
Run this command in your terminal: claude mcp add --transport http ecocompute-estimator https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp
What are the best alternatives to EcoCompute Should-I-Quantize Estimator?
The closest alternatives to EcoCompute Should-I-Quantize Estimator are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to EcoCompute Should-I-Quantize Estimator

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools