Agent Referee vs Toolkien
Agent Referee is a freemium MCP server for ai models and llm tooling. Toolkien is an open-source MCP server for ai models and llm tooling.
- Toolkien is open source, while Agent Referee is freemium.
- Agent Referee is best for settle a deadlock between two agents owned by different parties.
- Toolkien is best for triage issues across github, linear and slack in one script.
- What it is
- Agent Referee is a freemium MCP server for ai models and llm tooling.Toolkien is an open-source MCP server for ai models and llm tooling.
- Best for
- Settle a deadlock between two agents owned by different partiesTriage issues across GitHub, Linear and Slack in one script
- Kind
- MCP serverMCP server
- Pricing
- FreemiumOpen source
- Platforms
- CLI, APIAPI, self-hosted, Web
- Runs
- LocallyRemotely
- Open source
- Good for
- Settle a deadlock between two agents owned by different parties; Get an independent check of an agent's output before handing it on; Verify that a receipt belongs to a specific piece of workTriage issues across GitHub, Linear and Slack in one script; Give a team shared tools with approval gates; Cut context cost from long tool lists
What Agent Referee does
Signed receipts
Decisions and reviews come with Ed25519-signed receipts checkable offline.
Multi-company judges
Judge and review tiers can draw models from different AI companies and name them in the receipt.
Sealed review
Independent reviewers check one agent's output without seeing each other's verdicts.
Free demo and reviews
A demo match and a daily allowance of free reviews need no wallet.
Spend cap
A daily limit, default $1.00, caps what the server may spend; 0 turns paid calls off.
Receipt verification
Confirms a receipt matches exactly the task and output it claims.
What Toolkien does
Code mode
One TypeScript script replaces many tool calls.
Per-tool permissions
Allow, ask or block each call.
Approvals
Writes can wait for a human and resume later.
Audit trail
Metadata-only log of calls.
Server directory
100 popular remote servers preconfigured.
Connect once
Add a tool once and reach it from every client.
Agent Referee vs Toolkien: questions
Is Agent Referee or Toolkien cheaper?
Toolkien is the cheaper option: it is open source.
What is the difference between Agent Referee and Toolkien?
Agent Referee is a freemium MCP server for ai models and llm tooling. Toolkien is an open-source MCP server for ai models and llm tooling. Toolkien is open source, while Agent Referee is freemium.