Eclipse Benchkit
Free SDK for vendors to self-benchmark tools with Assay scorecards and verifier
- Pricing
- Free
- Platforms
- API
- Version
- 0.1.1
- Listing updated
- today
Similar MCP servers
About Eclipse Benchkit
Eclipse Benchkit is a free MCP server for developer tools. It is available on API.
Eclipse Benchkit is a vendor-side SDK from Cyan Eclipse Technologies. According to its registry entry, it provides the Assay scorecard format and verifier spot-check sampling, so a tool maker can run a self-bench before submitting to a formal evaluation.
It sits alongside the Cyan Eclipse Bazaar, a marketplace for MCP servers and agent tools. The Bazaar certifies listings at its own Verity Bench, which checks security, schema conformance, behavior and error handling, and publishes a scorecard whether the result passes or not. Benchkit appears aimed at letting vendors prepare their tools in a compatible format beforehand.
The registry entry lists no packages, remotes or transports, and gives few details about the tool interface, so setup and usage details should be taken from the GitHub repository.
What it does
- Assay scorecard format
- Defines a structured scorecard format for recording the results of a tool's self-benchmark.
- Verifier spot-check sampling
- Samples checks that a verifier can run to spot-check a vendor's self-reported results.
- Vendor self-bench
- Lets tool vendors benchmark their own tools without waiting on an external review.
- Free to use
- The registry entry describes the SDK as free.
Good for
- Self-benchmark an MCP server before submitting it for certification
- Produce a scorecard in a standard format to publish alongside a tool
- Let a verifier sample and re-check a vendor's claimed results
- Prepare a tool for listing on the Cyan Eclipse Bazaar
Pricing
Free
Described as a free vendor self-bench SDK
Prices change. Check eclipsebazaar.com before you buy.
Eclipse Benchkit FAQ
What does Eclipse Benchkit provide?
Per its registry entry, it provides the Assay scorecard format and verifier spot-check sampling as a free vendor self-bench SDK.
Is it free?
Yes, the registry entry describes it as a free SDK.
Who publishes it?
Cyan Eclipse Technologies LLC, which also runs the Cyan Eclipse Bazaar and its Verity Bench.
Does a self-bench result count as a Bazaar certification?
Not as far as the available information shows. The Bazaar's certifications come from its own Verity Bench, which runs against the exact version submitted.
Is Eclipse Benchkit free?
Yes. Eclipse Benchkit is free to use.
What are the best alternatives to Eclipse Benchkit?
The closest alternatives to Eclipse Benchkit are Eclipse Sandclock, Eclipse Bazaar MCP, Eclipse Attest MCP, Eclipse Mockmint and Eclipse Outwatch.
Where this comes from
- Description: written from the project's website and its MCP Registry entry.