# Hive A/B Test

> Hive A/B Test is an open-source MCP server for analytics and data. MCP server that assigns agents to A/B test variants and runs Z-test significance checks. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** API, self-hosted
- **Website:** https://www.hiveagentiq.com
- **Repository:** https://github.com/srotzin/hive-mcp-abtest
- **MCP Registry name:** io.github.srotzin/hive-mcp-abtest
- **Categories:** [analytics and data](https://ai-powered.com/categories/analytics-and-data)
- **Listing updated:** 2026-11-18

## About

The README describes this as an inbound-only MCP shim for recording experiments run by autonomous agents. It assigns each agent a sticky variant by hashing the experiment ID with the agent's DID, so repeated calls return the same bucket. Variants can carry weights, for example a 25/75 split.

Conversions are recorded per agent and metric, and aggregate counts are returned with a two-proportion Z-test using pooled variance over the first two registered variants. The output includes z-score, two-sided p-value, relative lift and 95%/99% significance flags. Per the README, the server does not run experiments itself; it only stores assignments and conversions for experiments the caller registers, in a local SQLite database.

The README lists per-call x402 payments in USDC on Base: $0.001 for assignment and $0.005 for conversion recording, with results retrieval free. It is aimed at developers building agent-to-agent systems that need deterministic experiment bucketing.

## Features

- **Sticky variant assignment:** Hashes experiment ID and agent DID so each agent keeps the same variant across calls.
- **Weighted variant splits:** Variants accept weights, so traffic can be split unevenly such as 25/75.
- **Conversion recording:** Records per-agent conversions against a named metric with an optional value.
- **Two-proportion Z-test:** Returns z-score, two-sided p-value, relative lift and 95%/99% significance flags.
- **Per-call x402 pricing:** Charges small USDC amounts per assignment or conversion call on Base.

## Good for

- Splitting agent traffic between two prompt or model versions
- Tracking conversion rates for agent-driven experiments
- Checking whether an observed lift is statistically significant
- Running experiments across agents on the A2A network

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http hive-mcp-abtest https://hive-mcp-abtest.onrender.com/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://hive-mcp-abtest.onrender.com/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "hive-mcp-abtest": {
      "url": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "hive-mcp-abtest": {
      "type": "http",
      "url": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "hive-mcp-abtest": {
      "serverUrl": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}
```

### Grok Bot (Grok Bot desktop app → Connect apps → Add a custom connector)

```sh
https://hive-mcp-abtest.onrender.com/mcp
```

Enter a Name (for example "Hive A/B Test"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin.

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "hive-mcp-abtest": {
      "type": "http",
      "url": "https://hive-mcp-abtest.onrender.com/mcp"
    }
  }
}
```

## Tools

- `abtest_assign`: Assigns an agent to an experiment variant (paid, $0.001).
- `abtest_record_conversion`: Records a conversion for an agent in an experiment (paid, $0.005).
- `abtest_results`: Returns experiment results with a Z-test (free).

## FAQ

### Does the server run the experiments for me?

No. According to the README, it records assignments and conversions for experiments the caller registers and returns aggregate counts and a Z-test on demand.

### How are agents assigned to variants?

The bucket is SHA-256 of the experiment ID and agent DID, reduced modulo the sum of variant weights. The first call stores the result and later calls return the same row.

### How is the server paid for?

The README lists $0.001 per abtest_assign and $0.005 per abtest_record_conversion in USDC on Base via x402. abtest_results is free.

### What license is it under?

The README states MIT.

### Is Hive A/B Test free?

Yes. Hive A/B Test is open source, so you can use and self-host it for free.

### How do I add Hive A/B Test to Claude Code?

Run this command in your terminal: claude mcp add --transport http hive-mcp-abtest https://hive-mcp-abtest.onrender.com/mcp

### What are the best alternatives to Hive A/B Test?

The closest alternatives to Hive A/B Test are A/B Test Sample Size Calculator MCP, Data Compute Stats Mcp, Gtxagent MCP, Hosannaith MCP and Roundhouse.

## Where this comes from

- Description: written from the project's README and its MCP Registry entry.
- Status: checked automatically by AIPoweredBot on 19 November 2026.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [A/B Test Sample Size Calculator MCP](https://ai-powered.com/mcp/a-b-test-sample-size-calculator-mcp): A/B Test Sample Size Calculator MCP is an open-source MCP server for analytics and data.
- [Data Compute Stats Mcp](https://ai-powered.com/mcp/data-compute-stats-mcp): Data Compute Stats Mcp is a freemium MCP server for analytics and data.
- [Gtxagent MCP](https://ai-powered.com/mcp/gtxagent-mcp): Gtxagent MCP is a paid MCP server for finance and payments.
- [Hosannaith MCP](https://ai-powered.com/mcp/hosannaith-mcp): Hosannaith MCP is a paid MCP server for finance and payments.
- [Roundhouse](https://ai-powered.com/mcp/roundhouse): Roundhouse is a freemium MCP server for analytics and data.
- [Market Pulse](https://ai-powered.com/mcp/market-pulse): Market Pulse is a freemium MCP server for analytics and data.

---
Source: https://ai-powered.com/mcp/hive-a-b-test
