# LLM Assure

> LLM Assure is an open-source MCP server for ai models and llm tooling. Red-team chatbots, RAG apps and agents with 41 OWASP LLM Top 10 probes. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** CLI, self-hosted
- **Repository:** https://github.com/k11-software-solutions/k11techlab-llm-assurance-toolkit
- **MCP Registry name:** io.github.K11-Software-Solutions/llm-assure
- **Categories:** [AI models and LLM tooling](https://ai-powered.com/categories/ai-and-llm), [security](https://ai-powered.com/categories/security)
- **Listing updated:** 2026-11-18

## About

LLM Assure comes from the K11 LLM Assurance Toolkit and attacks an application the way a tester would. It sends 41 probes grouped into eight suites, such as prompt injection, system prompt leakage, excessive agency and scope control, mapped to the OWASP Top 10 for LLM Applications (2025). Targets can be an HTTP API, an OpenAI-compatible endpoint, Claude or a Python function.

Detection is deterministic first: canary leaks, PII and secrets, refusals and patterns are checked without any model. Putting a unique canary string in the system prompt lets it spot leaks even when reversed or base64-encoded. An optional Claude judge, enabled with an Anthropic key, handles subtler cases, and judge-only probes are marked needs review otherwise.

The MCP tools let Claude browse probes, run a full assessment, send custom multi-turn prompts and read earlier findings. A separate adaptive mode gives a Claude attacker a fixed query budget. Output includes an HTML report with a score, JUnit XML and a CI gate that fails on a chosen severity. The README's demo bot scores 0 out of 100 before remediation and 99 after.

## Features

- **41 mapped probes:** Eight suites aligned to the OWASP LLM Top 10 for 2025.
- **Deterministic detectors:** Canary, PII, secret, refusal and pattern checks are free and reproducible.
- **Optional Claude judge:** Evaluates nuanced failures when an Anthropic key is set.
- **Adaptive red-teaming:** A Claude attacker agent probes the target within a query budget.
- **CI gate and reports:** Produces JUnit XML, an HTML audit report and a fail-on severity threshold.
- **Custom probe packs:** Adds industry-specific probes through pack directories.

## Good for

- Fail a CI build when a chatbot leaks its system prompt
- Audit a RAG assistant before launch
- Have Claude hunt for injection variants the static suite missed
- Produce a client-ready assurance report

## Install

### Claude Code (Terminal)

```sh
claude mcp add llm-assure --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' -- uvx k11-llm-assure-mcp
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "llm-assure": {
      "command": "uvx",
      "args": [
        "k11-llm-assure-mcp"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "llm-assure": {
      "command": "uvx",
      "args": [
        "k11-llm-assure-mcp"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "llm-assure": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "k11-llm-assure-mcp"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "llm-assure": {
      "command": "uvx",
      "args": [
        "k11-llm-assure-mcp"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "llm-assure": {
      "command": "uvx",
      "args": [
        "k11-llm-assure-mcp"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
      }
    }
  }
}
```

## Tools

- `list_suites`: Browses attack categories.
- `list_probes`: Lists the available probes.
- `run_assessment`: Runs a full audit and writes all reports.
- `send_probe`: Sends a custom prompt with history and returns leak, PII and refusal checks.
- `get_findings`: Reads findings from an earlier assessment.json.

## FAQ

### Does it need an API key?

Not for the quick start or deterministic checks. ANTHROPIC_API_KEY is optional and enables the judge and adaptive mode.

### What can it test?

HTTP APIs, OpenAI-compatible endpoints such as vLLM, Ollama or Azure, Claude, and Python functions.

### Which standard does it follow?

Probes map to the OWASP Top 10 for LLM Applications 2025, plus a business-risk scope suite.

### How do I add it to Claude Code?

Run claude mcp add llm-assure -- uvx k11-llm-assure-mcp.

### Is LLM Assure free?

Yes. LLM Assure is open source, so you can use and self-host it for free.

### How do I add LLM Assure to Claude Code?

Run this command in your terminal: claude mcp add llm-assure --env ANTHROPIC_API_KEY='<ANTHROPIC_API_KEY>' -- uvx k11-llm-assure-mcp

### What are the best alternatives to LLM Assure?

The closest alternatives to LLM Assure are REA, headroom, omniget, next-ai-draw-io and mcp-for-blender.

## Where this comes from

- Description: written from the project's README.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [headroom](https://ai-powered.com/mcp/headroom-3): headroom is an open-source MCP server for ai models and llm tooling.
- [omniget](https://ai-powered.com/mcp/omniget): omniget is an open-source MCP server for ai models and llm tooling.
- [next-ai-draw-io](https://ai-powered.com/mcp/next-ai-draw-io-2): next-ai-draw-io is an open-source MCP server for ai models and llm tooling.
- [mcp-for-blender](https://ai-powered.com/mcp/mcp-for-blender): mcp-for-blender is an open-source MCP server for design and media.
- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [unity-mcp](https://ai-powered.com/mcp/unity-mcp-2): unity-mcp is an open-source MCP server for ai models and llm tooling.
- [fastapi_mcp](https://ai-powered.com/mcp/fastapi-mcp): fastapi_mcp is an open-source MCP server for ai models and llm tooling.

---
Source: https://ai-powered.com/mcp/llm-assure
