Skip to content

Agent Referee vs Toolkien

Agent Referee is a freemium MCP server for ai models and llm tooling. Toolkien is an open-source MCP server for ai models and llm tooling.

  • Toolkien is open source, while Agent Referee is freemium.
  • Agent Referee is best for settle a deadlock between two agents owned by different parties.
  • Toolkien is best for triage issues across github, linear and slack in one script.
What it is
Agent Referee is a freemium MCP server for ai models and llm tooling.
Toolkien is an open-source MCP server for ai models and llm tooling.
Best for
Settle a deadlock between two agents owned by different parties
Triage issues across GitHub, Linear and Slack in one script
Kind
MCP server
MCP server
Pricing
Freemium
Open source
Platforms
CLI, API
API, self-hosted, Web
Runs
Locally
Remotely
Open source
Good for
Settle a deadlock between two agents owned by different parties; Get an independent check of an agent's output before handing it on; Verify that a receipt belongs to a specific piece of work
Triage issues across GitHub, Linear and Slack in one script; Give a team shared tools with approval gates; Cut context cost from long tool lists

What Agent Referee does

  • Signed receipts

    Decisions and reviews come with Ed25519-signed receipts checkable offline.

  • Multi-company judges

    Judge and review tiers can draw models from different AI companies and name them in the receipt.

  • Sealed review

    Independent reviewers check one agent's output without seeing each other's verdicts.

  • Free demo and reviews

    A demo match and a daily allowance of free reviews need no wallet.

  • Spend cap

    A daily limit, default $1.00, caps what the server may spend; 0 turns paid calls off.

  • Receipt verification

    Confirms a receipt matches exactly the task and output it claims.

What Toolkien does

  • Code mode

    One TypeScript script replaces many tool calls.

  • Per-tool permissions

    Allow, ask or block each call.

  • Approvals

    Writes can wait for a human and resume later.

  • Audit trail

    Metadata-only log of calls.

  • Server directory

    100 popular remote servers preconfigured.

  • Connect once

    Add a tool once and reach it from every client.

Agent Referee vs Toolkien: questions

Is Agent Referee or Toolkien cheaper?

Toolkien is the cheaper option: it is open source.

What is the difference between Agent Referee and Toolkien?

Agent Referee is a freemium MCP server for ai models and llm tooling. Toolkien is an open-source MCP server for ai models and llm tooling. Toolkien is open source, while Agent Referee is freemium.