Skip to content
MCP server

Eclipse Benchkit

Free SDK for vendors to self-benchmark tools with Assay scorecards and verifier

Pricing
Free
Platforms
API
Version
0.1.1
Listing updated
today

Similar MCP servers

About Eclipse Benchkit

Eclipse Benchkit is a free MCP server for developer tools. It is available on API.

Eclipse Benchkit is a vendor-side SDK from Cyan Eclipse Technologies. According to its registry entry, it provides the Assay scorecard format and verifier spot-check sampling, so a tool maker can run a self-bench before submitting to a formal evaluation.

It sits alongside the Cyan Eclipse Bazaar, a marketplace for MCP servers and agent tools. The Bazaar certifies listings at its own Verity Bench, which checks security, schema conformance, behavior and error handling, and publishes a scorecard whether the result passes or not. Benchkit appears aimed at letting vendors prepare their tools in a compatible format beforehand.

The registry entry lists no packages, remotes or transports, and gives few details about the tool interface, so setup and usage details should be taken from the GitHub repository.

What it does

Assay scorecard format
Defines a structured scorecard format for recording the results of a tool's self-benchmark.
Verifier spot-check sampling
Samples checks that a verifier can run to spot-check a vendor's self-reported results.
Vendor self-bench
Lets tool vendors benchmark their own tools without waiting on an external review.
Free to use
The registry entry describes the SDK as free.

Good for

  • Self-benchmark an MCP server before submitting it for certification
  • Produce a scorecard in a standard format to publish alongside a tool
  • Let a verifier sample and re-check a vendor's claimed results
  • Prepare a tool for listing on the Cyan Eclipse Bazaar

Pricing

Free

Described as a free vendor self-bench SDK

Prices change. Check eclipsebazaar.com before you buy.

Eclipse Benchkit FAQ

What does Eclipse Benchkit provide?

Per its registry entry, it provides the Assay scorecard format and verifier spot-check sampling as a free vendor self-bench SDK.

Is it free?

Yes, the registry entry describes it as a free SDK.

Who publishes it?

Cyan Eclipse Technologies LLC, which also runs the Cyan Eclipse Bazaar and its Verity Bench.

Does a self-bench result count as a Bazaar certification?

Not as far as the available information shows. The Bazaar's certifications come from its own Verity Bench, which runs against the exact version submitted.

Is Eclipse Benchkit free?

Yes. Eclipse Benchkit is free to use.

What are the best alternatives to Eclipse Benchkit?

The closest alternatives to Eclipse Benchkit are Eclipse Sandclock, Eclipse Bazaar MCP, Eclipse Attest MCP, Eclipse Mockmint and Eclipse Outwatch.

Where this comes from

  • Description: written from the project's website and its MCP Registry entry.

How AIPoweredBot checks servers