Hive A/B Test
MCP server that assigns agents to A/B test variants and runs Z-test significance checks
We have not yet received an answer to our tool-list check (latest attempt 2 hours ago).
- Pricing
- Open source
- Platforms
- API, self-hosted
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- today
Similar MCP servers
About Hive A/B Test
Hive A/B Test is an open-source MCP server for analytics and data. It runs as a hosted remote server, so there is nothing to install locally.
The README describes this as an inbound-only MCP shim for recording experiments run by autonomous agents. It assigns each agent a sticky variant by hashing the experiment ID with the agent's DID, so repeated calls return the same bucket. Variants can carry weights, for example a 25/75 split.
Conversions are recorded per agent and metric, and aggregate counts are returned with a two-proportion Z-test using pooled variance over the first two registered variants. The output includes z-score, two-sided p-value, relative lift and 95%/99% significance flags. Per the README, the server does not run experiments itself; it only stores assignments and conversions for experiments the caller registers, in a local SQLite database.
The README lists per-call x402 payments in USDC on Base: $0.001 for assignment and $0.005 for conversion recording, with results retrieval free. It is aimed at developers building agent-to-agent systems that need deterministic experiment bucketing.
Install
Run in a terminal
claude mcp add --transport http hive-mcp-abtest https://hive-mcp-abtest.onrender.com/mcpAdd to Settings → Connectors → Add custom connector
https://hive-mcp-abtest.onrender.com/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"hive-mcp-abtest": {
"url": "https://hive-mcp-abtest.onrender.com/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"hive-mcp-abtest": {
"type": "http",
"url": "https://hive-mcp-abtest.onrender.com/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"hive-mcp-abtest": {
"serverUrl": "https://hive-mcp-abtest.onrender.com/mcp"
}
}
}Add to Grok Bot desktop app → Connect apps → Add a custom connector
https://hive-mcp-abtest.onrender.com/mcpEnter a Name (for example "Hive A/B Test"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin.
Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"hive-mcp-abtest": {
"type": "http",
"url": "https://hive-mcp-abtest.onrender.com/mcp"
}
}
}Using several servers? Build one config file with the MCP config generator.
Tools this server provides (3)
Taken from the project documentation; the running server may differ.
- abtest_assign
- Assigns an agent to an experiment variant (paid, $0.001).
- abtest_record_conversion
- Records a conversion for an agent in an experiment (paid, $0.005).
- abtest_results
- Returns experiment results with a Z-test (free).
What it does
- Sticky variant assignment
- Hashes experiment ID and agent DID so each agent keeps the same variant across calls.
- Weighted variant splits
- Variants accept weights, so traffic can be split unevenly such as 25/75.
- Conversion recording
- Records per-agent conversions against a named metric with an optional value.
- Two-proportion Z-test
- Returns z-score, two-sided p-value, relative lift and 95%/99% significance flags.
- Per-call x402 pricing
- Charges small USDC amounts per assignment or conversion call on Base.
Good for
- Splitting agent traffic between two prompt or model versions
- Tracking conversion rates for agent-driven experiments
- Checking whether an observed lift is statistically significant
- Running experiments across agents on the A2A network
Pricing
Open source
MIT-licensed, self-hostable; hosted calls cost $0.001 per assignment and $0.005 per conversion via x402
Prices change. Check hiveagentiq.com before you buy.
Hive A/B Test FAQ
Does the server run the experiments for me?
No. According to the README, it records assignments and conversions for experiments the caller registers and returns aggregate counts and a Z-test on demand.
How are agents assigned to variants?
The bucket is SHA-256 of the experiment ID and agent DID, reduced modulo the sum of variant weights. The first call stores the result and later calls return the same row.
How is the server paid for?
The README lists $0.001 per abtest_assign and $0.005 per abtest_record_conversion in USDC on Base via x402. abtest_results is free.
What license is it under?
The README states MIT.
Is Hive A/B Test free?
Yes. Hive A/B Test is open source, so you can use and self-host it for free.
How do I add Hive A/B Test to Claude Code?
Run this command in your terminal: claude mcp add --transport http hive-mcp-abtest https://hive-mcp-abtest.onrender.com/mcp
What are the best alternatives to Hive A/B Test?
The closest alternatives to Hive A/B Test are A/B Test Sample Size Calculator MCP, Data Compute Stats Mcp, Gtxagent MCP, Hosannaith MCP and Roundhouse.
Where this comes from
- Description: written from the project's README and its MCP Registry entry.
- Status: checked automatically by AIPoweredBot on 19 November 2026.
- Install steps: from the official MCP Registry entry.
