Skip to content
MCP server

EcoCompute Should-I-Quantize Estimator

Directional answers on whether quantizing an LLM saves GPU energy, with stated basis

Install
Pricing
Free
Platforms
Web, API
Runs
Remotely
Version
1.0.0
Listing updated
2 days ago

About EcoCompute Should-I-Quantize Estimator

EcoCompute Should-I-Quantize Estimator is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.

EcoCompute is an open micro-benchmark rather than a general claim about quantization. Its protocol samples GPU-package power with NVML for single-stream decoding at batch size 1 and 256 tokens, and the site says 29 of 64 planned cells have been measured. The headline finding is a crossover that depends on model size and hardware, not a rule that NF4 or INT8 always saves energy.

Give the estimator a GPU and model size and it returns a directional verdict on energy per million tokens compared with FP16. Tested configurations are shown as measured, while other sizes come from a fitted curve whose uncertainty is displayed; points measured only once are marked as single observations. INT8 was measured on A800 and RTX 4090 only.

The page asks readers to treat results as directional rather than a production decision. A container and a free Colab T4 route let you produce your own energy.json, and the dataset is archived on Zenodo under CC BY 4.0.

Install

Run in a terminal

claude mcp add --transport http ecocompute-estimator https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp

Add to Settings → Connectors → Add custom connector

https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "ecocompute-estimator": {
      "url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "ecocompute-estimator": {
      "type": "http",
      "url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "ecocompute-estimator": {
      "serverUrl": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "ecocompute-estimator": {
      "type": "http",
      "url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
    }
  }
}

What it does

Directional verdict
Says whether quantization saves or costs energy for a chosen GPU and model size.
Stated basis
Each number is labelled as measured or interpolated.
Crossover curve
Shows how savings change with model size, with uncertainty on fitted points.
Optimize search
Searches precision, batch and context under your constraints.
Reproduce it yourself
A runnable container and Colab path produce your own measurement.
Citable dataset
Archived dataset with DOI, protocol and limitations statement.

Good for

  • Decide whether to run a 7B model in NF4 on a given GPU
  • Check how far a result generalises before citing it
  • Reproduce an energy measurement on your own card
  • Cite benchmark data in a paper on inference energy

Pricing

Free

Free open research project; data under CC BY 4.0.

Prices change. Check quantenergy.tech before you buy.

EcoCompute Should-I-Quantize Estimator FAQ

Is this a universal law?

No. The site limits claims to the GPUs, stacks, batch sizes and contexts measured so far.

How is power measured?

By NVML GPU-package power sampling, not TDP estimates or wall-plug readings.

Can I verify it without a GPU?

Yes, a free Colab T4 can produce an energy.json.

Where is the data?

On Zenodo under CC BY 4.0.

Is EcoCompute Should-I-Quantize Estimator free?

Yes. EcoCompute Should-I-Quantize Estimator is free to use.

How do I add EcoCompute Should-I-Quantize Estimator to Claude Code?

Run this command in your terminal: claude mcp add --transport http ecocompute-estimator https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp

What are the best alternatives to EcoCompute Should-I-Quantize Estimator?

The closest alternatives to EcoCompute Should-I-Quantize Estimator are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to EcoCompute Should-I-Quantize Estimator

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling