Skip to content
MCP server

OPSIN

Signed, preregistered experiments on which prompts and tools help AI agents

Install
Pricing
Free
Platforms
API, Web
Runs
Remotely
Version
1.0.0
Listing updated
2 days ago

About OPSIN

OPSIN is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.

OPSIN runs an automated lab that toggles individual parts of an AI agent, such as a calculator tool or a prompt instruction, and measures what changes against two controls and a placebo. Each result is a signed verdict marked as exciting, inhibiting, inert or unresolved, with a confidence interval and the number of paired runs. Tasks are drawn by a public randomness beacon and plans are preregistered.

The site reports 767 signed verdicts across 124 notebooks and 545 parts measured. In its first notebook, Claude Haiku 5.5 acting as a trading agent's maths module solved 432 DeFi problems over 14,112 runs, and a calculator tool raised exact answers far more than prompt tricks such as personas or step-by-step wording. Visitors can also try their own instruction on the lab's budget, three free trials a day.

The remote MCP endpoint gives agents access to this record. Preregistrations, per-run CSVs, verdict JSON and the code to rerun experiments are published.

Install

Run in a terminal

claude mcp add --transport http opsin https://opsinlab.io/mcp

Add to Settings → Connectors → Add custom connector

https://opsinlab.io/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "opsin": {
      "url": "https://opsinlab.io/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "opsin": {
      "type": "http",
      "url": "https://opsinlab.io/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "opsin": {
      "serverUrl": "https://opsinlab.io/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "opsin": {
      "type": "http",
      "url": "https://opsinlab.io/mcp"
    }
  }
}

What it does

Signed verdicts
Every result is signed and labelled excites, inhibits, inert or unresolved.
Preregistered notebooks
Plans are fixed in advance and tasks drawn by a public beacon.
Controls and placebo
Effects are measured against two controls and a placebo.
Open data
Per-run CSVs, verdict JSON and rerun code are published.
Try your own line
Test an instruction against Claude Haiku 5.5 on the lab's budget.
On-chain identity
OPSIN lists an ERC-8004 validator identity on Base.

Good for

  • Check whether a prompt trick helps before adopting it
  • Compare a tool against a prompt instruction for maths accuracy
  • Look up evidence on a specific agent skill
  • Rerun a published experiment
  • Back an agent-hiring decision with measured effects

Pricing

Free

Free trials: three a day on the lab's budget

Prices change. Check opsinlab.io before you buy.

OPSIN FAQ

What does OPSIN measure?

Which parts of an agent change exact-answer scores, using paired runs with controls.

Can I test my own instruction?

Yes, three free trials a day, each running three rounds of eight problem pairs.

Are small effects detected?

Not always; the site says 24 pairs only settle big effects and small ones stay unresolved.

Is the data public?

Preregistrations, every run as CSV, verdicts as JSON and the code are published.

Is OPSIN free?

Yes. OPSIN is free to use.

How do I add OPSIN to Claude Code?

Run this command in your terminal: claude mcp add --transport http opsin https://opsinlab.io/mcp

What are the best alternatives to OPSIN?

The closest alternatives to OPSIN are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.

Alternatives to OPSIN

  1. MCP server for searching the Claude Code Ultimate Guide from any MCP client

    Runs locally
    • Open source
    • 6.5K GitHub stars
    • AI models and LLM tooling
  2. signafAIde

    MCP server

    Local MCP server to set up, verify and check coverage of signed agent action records

    Runs locally
    • 5 tools
    • Freemium
    • Security
  3. Toolkien

    MCP server

    One MCP gateway for all your MCP servers, with code mode, permissions and audit

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • AI models and LLM tooling
  4. Lugh

    MCP server

    Write, check and dry-run Lugh agent programs with policy, budgets and approvals

    Runs locally
    • 5 tools
    • Open source
    • AI models and LLM tooling
  5. HypePaper

    MCP server

    Research papers, benchmarks, citations and topic experts for AI assistants

    • 58 tools
    • Remote
    • Freemium
    • AI models and LLM tooling