Skip to content

Agent Roast vs Iris

Agent Roast is an open-source MCP server for developer tools. Iris is an open-source MCP server for ai models and llm tooling.

  • Agent Roast is best for stop coding agents from skipping failing tests.
  • Iris is best for catch a pii leak in agent output.
What it is
Agent Roast is an open-source MCP server for developer tools.
Iris is an open-source MCP server for ai models and llm tooling.
Best for
Stop coding agents from skipping failing tests
Catch a PII leak in agent output
Kind
MCP server
MCP server
Pricing
Open source
Open source
Platforms
CLI, Linux, macOS, Windows
self-hosted, CLI, macOS, Linux, Windows
Runs
Locally
Locally
Open source
Good for
Stop coding agents from skipping failing tests; Review uncommitted changes for weakened assertions; Add a pull request check against lowered coverage thresholds
Catch a PII leak in agent output; Flag an agent run that overspent; Audit agent traces from a file

What Agent Roast does

  • Before and after diffing

    Compares changed test and config files to spot weakened checks.

  • Agent hooks

    Hook installation for Claude Code, Codex, Cursor, Gemini CLI, Copilot and Factory Droid.

  • PR and CI check

    Runs as a pull request check or in any CI with SARIF output.

  • Rule set

    Rules for weakened assertions, skipped tests, lowered guards and trivial asserts.

  • Offline operation

    No model, tokens or network are involved.

  • Replay mode

    Shows what it would have reported about recent commits.

What Iris does

  • Rule-based scoring

    28 built-in rules plus custom Zod rules for output quality and safety.

  • PII and injection checks

    21 PII patterns and 38 prompt-injection patterns.

  • Cost tracking

    Per-trace cost in USD with budget thresholds.

  • LLM judge

    Optional judging with your own Anthropic or OpenAI key and a cost cap.

  • Local dashboard

    Trace visualization and failures view backed by SQLite.

  • One-command install

    Writes config for ten MCP clients and pins the version.

Agent Roast vs Iris: questions

Is Agent Roast or Iris cheaper?

Both are open source. Compare current plans on each official site.

What is the difference between Agent Roast and Iris?

Agent Roast is an open-source MCP server for developer tools. Iris is an open-source MCP server for ai models and llm tooling.