OPSIN
Signed, preregistered experiments on which prompts and tools help AI agents
- Pricing
- Free
- Platforms
- API, Web
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 2 days ago
About OPSIN
OPSIN is a free MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
OPSIN runs an automated lab that toggles individual parts of an AI agent, such as a calculator tool or a prompt instruction, and measures what changes against two controls and a placebo. Each result is a signed verdict marked as exciting, inhibiting, inert or unresolved, with a confidence interval and the number of paired runs. Tasks are drawn by a public randomness beacon and plans are preregistered.
The site reports 767 signed verdicts across 124 notebooks and 545 parts measured. In its first notebook, Claude Haiku 5.5 acting as a trading agent's maths module solved 432 DeFi problems over 14,112 runs, and a calculator tool raised exact answers far more than prompt tricks such as personas or step-by-step wording. Visitors can also try their own instruction on the lab's budget, three free trials a day.
The remote MCP endpoint gives agents access to this record. Preregistrations, per-run CSVs, verdict JSON and the code to rerun experiments are published.
Install
Run in a terminal
claude mcp add --transport http opsin https://opsinlab.io/mcpAdd to Settings → Connectors → Add custom connector
https://opsinlab.io/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"opsin": {
"url": "https://opsinlab.io/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"opsin": {
"type": "http",
"url": "https://opsinlab.io/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"opsin": {
"serverUrl": "https://opsinlab.io/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"opsin": {
"type": "http",
"url": "https://opsinlab.io/mcp"
}
}
}What it does
- Signed verdicts
- Every result is signed and labelled excites, inhibits, inert or unresolved.
- Preregistered notebooks
- Plans are fixed in advance and tasks drawn by a public beacon.
- Controls and placebo
- Effects are measured against two controls and a placebo.
- Open data
- Per-run CSVs, verdict JSON and rerun code are published.
- Try your own line
- Test an instruction against Claude Haiku 5.5 on the lab's budget.
- On-chain identity
- OPSIN lists an ERC-8004 validator identity on Base.
Good for
- Check whether a prompt trick helps before adopting it
- Compare a tool against a prompt instruction for maths accuracy
- Look up evidence on a specific agent skill
- Rerun a published experiment
- Back an agent-hiring decision with measured effects
Pricing
Free
Free trials: three a day on the lab's budget
Prices change. Check opsinlab.io before you buy.
OPSIN FAQ
What does OPSIN measure?
Which parts of an agent change exact-answer scores, using paired runs with controls.
Can I test my own instruction?
Yes, three free trials a day, each running three rounds of eight problem pairs.
Are small effects detected?
Not always; the site says 24 pairs only settle big effects and small ones stay unresolved.
Is the data public?
Preregistrations, every run as CSV, verdicts as JSON and the code are published.
Is OPSIN free?
Yes. OPSIN is free to use.
How do I add OPSIN to Claude Code?
Run this command in your terminal: claude mcp add --transport http opsin https://opsinlab.io/mcp
What are the best alternatives to OPSIN?
The closest alternatives to OPSIN are Claude Code Ultimate Guide, signafAIde, Toolkien, Lugh and HypePaper.
Alternatives to OPSIN

Claude Code Ultimate Guide
MCP serverMCP server for searching the Claude Code Ultimate Guide from any MCP client
Runs locally- Open source
- 6.5K GitHub stars
- AI models and LLM tooling

signafAIde
MCP serverLocal MCP server to set up, verify and check coverage of signed agent action records
Runs locally- 5 tools
- Freemium
- Security

Toolkien
MCP serverOne MCP gateway for all your MCP servers, with code mode, permissions and audit
Not checked yet- 3 tools
- Remote
- Open source
- AI models and LLM tooling
Lugh
MCP serverWrite, check and dry-run Lugh agent programs with policy, budgets and approvals
Runs locally- 5 tools
- Open source
- AI models and LLM tooling
HypePaper
MCP serverResearch papers, benchmarks, citations and topic experts for AI assistants
- 58 tools
- Remote
- Freemium
- AI models and LLM tooling

One compact entry point that finds, describes and runs hundreds of pay-per-call data tools
- 3 tools
- Remote
- Freemium
- Developer tools