# Iris

> Iris is an open-source MCP server for ai models and llm tooling. Score AI agent runs for quality, PII leaks, prompt injection and cost, on your own machine. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** self-hosted, CLI, macOS, Linux, Windows
- **Website:** https://iris-eval.com
- **Repository:** https://github.com/iris-eval/mcp-server
- **MCP Registry name:** io.github.iris-eval/mcp-server
- **Categories:** AI models and LLM tooling, security
- **Listing updated:** 2026-11-15

## About

Iris takes an agent run and returns a verdict instead of leaving quality to eyeballing a few prompts. Your agent calls log_trace, a host hook forwards each turn, or the iris-eval ingest command loads a trace file, and every run received is scored against 28 built-in rules. PII detection covers 21 patterns such as SSN, card numbers, IBAN, medical record numbers, API keys and seed phrases, and prompt injection checks use 38 patterns. Traces record hierarchical spans, per-tool latency, token usage and cost in USD, with budget thresholds per trace or agent.

Twelve tools cover logging, rule evaluation, an LLM-as-judge and semantic citation verification. The judge and citation check use your own Anthropic or OpenAI key, with a per-evaluation cost cap, and no traffic goes through the vendor. Data stays in local SQLite and a dashboard serves at localhost:6920; npx @iris-eval/mcp-server --demo seeds sample failures.

It needs Node.js 22.13 or later, installs for clients such as Claude Code, Cursor, Windsurf, Zed and Codex, and is MIT licensed. Nothing leaves your machine unless you enable an OpenTelemetry export or the LLM judge.

## Features

- **Rule-based scoring:** 28 built-in rules plus custom Zod rules for output quality and safety.
- **PII and injection checks:** 21 PII patterns and 38 prompt-injection patterns.
- **Cost tracking:** Per-trace cost in USD with budget thresholds.
- **LLM judge:** Optional judging with your own Anthropic or OpenAI key and a cost cap.
- **Local dashboard:** Trace visualization and failures view backed by SQLite.
- **One-command install:** Writes config for ten MCP clients and pins the version.

## Good for

- Catch a PII leak in agent output
- Flag an agent run that overspent
- Audit agent traces from a file
- Verify citations in a generated answer

## Install

### Claude Code (Terminal)

```sh
claude mcp add mcp-server --env IRIS_API_KEY='<IRIS_API_KEY>' --env IRIS_ANTHROPIC_API_KEY='<IRIS_ANTHROPIC_API_KEY>' --env IRIS_OPENAI_API_KEY='<IRIS_OPENAI_API_KEY>' --env IRIS_WEBHOOK_SECRET='<IRIS_WEBHOOK_SECRET>' -- npx -y @iris-eval/mcp-server
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<IRIS_API_KEY>",
        "IRIS_ANTHROPIC_API_KEY": "<IRIS_ANTHROPIC_API_KEY>",
        "IRIS_OPENAI_API_KEY": "<IRIS_OPENAI_API_KEY>",
        "IRIS_WEBHOOK_SECRET": "<IRIS_WEBHOOK_SECRET>"
      }
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<IRIS_API_KEY>",
        "IRIS_ANTHROPIC_API_KEY": "<IRIS_ANTHROPIC_API_KEY>",
        "IRIS_OPENAI_API_KEY": "<IRIS_OPENAI_API_KEY>",
        "IRIS_WEBHOOK_SECRET": "<IRIS_WEBHOOK_SECRET>"
      }
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "mcp-server": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<IRIS_API_KEY>",
        "IRIS_ANTHROPIC_API_KEY": "<IRIS_ANTHROPIC_API_KEY>",
        "IRIS_OPENAI_API_KEY": "<IRIS_OPENAI_API_KEY>",
        "IRIS_WEBHOOK_SECRET": "<IRIS_WEBHOOK_SECRET>"
      }
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<IRIS_API_KEY>",
        "IRIS_ANTHROPIC_API_KEY": "<IRIS_ANTHROPIC_API_KEY>",
        "IRIS_OPENAI_API_KEY": "<IRIS_OPENAI_API_KEY>",
        "IRIS_WEBHOOK_SECRET": "<IRIS_WEBHOOK_SECRET>"
      }
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<IRIS_API_KEY>",
        "IRIS_ANTHROPIC_API_KEY": "<IRIS_ANTHROPIC_API_KEY>",
        "IRIS_OPENAI_API_KEY": "<IRIS_OPENAI_API_KEY>",
        "IRIS_WEBHOOK_SECRET": "<IRIS_WEBHOOK_SECRET>"
      }
    }
  }
}
```

## Tools

- `log_trace`: Captures a full agent run with spans, latency, token usage and cost.
- `evaluate_with_llm_judge`: Scores an output with an LLM judge using your own API key.
- `verify_citations`: Checks that cited sources support the output.

## FAQ

### Is it free?

Yes. The core is MIT licensed with no usage limits or account, and no hosted version exists today.

### What does it need?

Node.js 22.13 or later.

### Where is data stored?

Locally in SQLite; nothing leaves your machine unless you enable OpenTelemetry export or the LLM judge.

### Does the LLM judge route through the vendor?

No. It calls Anthropic or OpenAI directly with your own key.

### Is Iris free?

Yes. Iris is open source, so you can use and self-host it for free.

### How do I add Iris to Claude Code?

Run this command in your terminal: claude mcp add mcp-server --env IRIS_API_KEY='<IRIS_API_KEY>' --env IRIS_ANTHROPIC_API_KEY='<IRIS_ANTHROPIC_API_KEY>' --env IRIS_OPENAI_API_KEY='<IRIS_OPENAI_API_KEY>' --env IRIS_WEBHOOK_SECRET='<IRIS_WEBHOOK_SECRET>' -- npx -y @iris-eval/mcp-server

### What are the best alternatives to Iris?

The closest alternatives to Iris are REA, Claude Code Ultimate Guide, Agent Roast, Midplane and Leash.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [Agent Roast](https://ai-powered.com/mcp/agent-roast): Agent Roast is an open-source MCP server for developer tools.
- [Midplane](https://ai-powered.com/mcp/midplane): Midplane is an open-source MCP server for databases.
- [Leash](https://ai-powered.com/mcp/leash): Leash is a free MCP server for security.
- [Tinplate Edge AI Safety, Security & EU Compliance](https://ai-powered.com/mcp/tinplate-edge-ai-safety-security-and-eu-compliance): Tinplate Edge AI Safety, Security & EU Compliance is a freemium MCP server for security.
- [SecureCloud](https://ai-powered.com/mcp/securecloud): SecureCloud is a free MCP server for security.
- [Eikino](https://ai-powered.com/mcp/eikino): Eikino is a freemium MCP server for security.

---
Source: https://ai-powered.com/mcp/iris-4
