Skip to content
MCP server

Hive A/B Test

MCP server that assigns agents to A/B test variants and runs Z-test significance checks

We have not yet received an answer to our tool-list check (latest attempt 2 hours ago).

Install
Pricing
Open source
Platforms
API, self-hosted
Runs
Remotely
Version
1.0.0
Listing updated
today

Similar MCP servers

About Hive A/B Test

Hive A/B Test is an open-source MCP server for analytics and data. It runs as a hosted remote server, so there is nothing to install locally.

The README describes this as an inbound-only MCP shim for recording experiments run by autonomous agents. It assigns each agent a sticky variant by hashing the experiment ID with the agent's DID, so repeated calls return the same bucket. Variants can carry weights, for example a 25/75 split.

Conversions are recorded per agent and metric, and aggregate counts are returned with a two-proportion Z-test using pooled variance over the first two registered variants. The output includes z-score, two-sided p-value, relative lift and 95%/99% significance flags. Per the README, the server does not run experiments itself; it only stores assignments and conversions for experiments the caller registers, in a local SQLite database.

The README lists per-call x402 payments in USDC on Base: $0.001 for assignment and $0.005 for conversion recording, with results retrieval free. It is aimed at developers building agent-to-agent systems that need deterministic experiment bucketing.

Install

Run in a terminal

claude mcp add --transport http hive-mcp-abtest https://hive-mcp-abtest.onrender.com/mcp

Add to Settings → Connectors → Add custom connector

https://hive-mcp-abtest.onrender.com/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "hive-mcp-abtest": {
      "url": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "hive-mcp-abtest": {
      "type": "http",
      "url": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "hive-mcp-abtest": {
      "serverUrl": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}

Add to Grok Bot desktop app → Connect apps → Add a custom connector

https://hive-mcp-abtest.onrender.com/mcp

Enter a Name (for example "Hive A/B Test"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin.

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "hive-mcp-abtest": {
      "type": "http",
      "url": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}

Using several servers? Build one config file with the MCP config generator.

Tools this server provides (3)

Taken from the project documentation; the running server may differ.

abtest_assign
Assigns an agent to an experiment variant (paid, $0.001).
abtest_record_conversion
Records a conversion for an agent in an experiment (paid, $0.005).
abtest_results
Returns experiment results with a Z-test (free).

What it does

Sticky variant assignment
Hashes experiment ID and agent DID so each agent keeps the same variant across calls.
Weighted variant splits
Variants accept weights, so traffic can be split unevenly such as 25/75.
Conversion recording
Records per-agent conversions against a named metric with an optional value.
Two-proportion Z-test
Returns z-score, two-sided p-value, relative lift and 95%/99% significance flags.
Per-call x402 pricing
Charges small USDC amounts per assignment or conversion call on Base.

Good for

  • Splitting agent traffic between two prompt or model versions
  • Tracking conversion rates for agent-driven experiments
  • Checking whether an observed lift is statistically significant
  • Running experiments across agents on the A2A network

Pricing

Open source

MIT-licensed, self-hostable; hosted calls cost $0.001 per assignment and $0.005 per conversion via x402

Prices change. Check hiveagentiq.com before you buy.

Hive A/B Test FAQ

Does the server run the experiments for me?

No. According to the README, it records assignments and conversions for experiments the caller registers and returns aggregate counts and a Z-test on demand.

How are agents assigned to variants?

The bucket is SHA-256 of the experiment ID and agent DID, reduced modulo the sum of variant weights. The first call stores the result and later calls return the same row.

How is the server paid for?

The README lists $0.001 per abtest_assign and $0.005 per abtest_record_conversion in USDC on Base via x402. abtest_results is free.

What license is it under?

The README states MIT.

Is Hive A/B Test free?

Yes. Hive A/B Test is open source, so you can use and self-host it for free.

How do I add Hive A/B Test to Claude Code?

Run this command in your terminal: claude mcp add --transport http hive-mcp-abtest https://hive-mcp-abtest.onrender.com/mcp

What are the best alternatives to Hive A/B Test?

The closest alternatives to Hive A/B Test are A/B Test Sample Size Calculator MCP, Data Compute Stats Mcp, Gtxagent MCP, Hosannaith MCP and Roundhouse.

Where this comes from

  • Description: written from the project's README and its MCP Registry entry.
  • Status: checked automatically by AIPoweredBot on 19 November 2026.
  • Install steps: from the official MCP Registry entry.

How AIPoweredBot checks servers