# M365 agent evaluator

> M365 agent evaluator is an open-source agent skill for ai models and llm tooling. Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/microsoft/skills/tree/main/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator
- **Repository:** https://github.com/microsoft/skills
- **GitHub stars:** 3,214
- **License:** MIT
- **Skill name:** m365-agent-evaluator
- **Collection:** https://github.com/microsoft/skills
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-17

## About

Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thresholds", "why is my agent failing", or "set up eval environment variables".

## When your agent uses it

> Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thresholds", "why is my agent failing", or "set up eval environment variables".

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Instructions only, no scripts](https://github.com/microsoft/skills/tree/HEAD/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator)
- [License: MIT](https://github.com/microsoft/skills/tree/HEAD/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/m365-agent-evaluator` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.claude/skills/m365-agent-evaluator &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/m365-agent-evaluator` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/m365-agent-evaluator` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.agents/skills/m365-agent-evaluator &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/m365-agent-evaluator` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/m365-agent-evaluator` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.cursor/skills/m365-agent-evaluator &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/m365-agent-evaluator` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/microsoft/skills.git --path .github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator
```

Or copy the folder to `~/.gemini/skills/m365-agent-evaluator` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/m365-agent-evaluator`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.copilot/skills/m365-agent-evaluator &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/m365-agent-evaluator` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/microsoft/skills.git
```

Then copy `skills/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator` into your agent's skills folder as `m365-agent-evaluator`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install M365 agent evaluator in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/m365-agent-evaluator to use it in all your projects, or to .claude/skills/m365-agent-evaluator in one project.

### Does M365 agent evaluator run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use M365 agent evaluator?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to M365 agent evaluator?

The closest alternatives to M365 agent evaluator are Academy guide, MCP builder, Claude API, Nano banana pro openrouter and Generate image.

## Alternatives

- [Academy guide](https://ai-powered.com/skills/academy-guide): Academy guide is an agent skill for ai models and llm tooling.
- [MCP builder](https://ai-powered.com/skills/mcp-builder): MCP builder is an agent skill for ai models and llm tooling.
- [Claude API](https://ai-powered.com/skills/claude-api): Claude API is an agent skill for ai models and llm tooling.
- [Nano banana pro openrouter](https://ai-powered.com/skills/nano-banana-pro-openrouter): Nano banana pro openrouter is an open-source agent skill for design and media.
- [Generate image](https://ai-powered.com/skills/generate-image): Generate image is an open-source agent skill for design and media.
- [Phoenix evals](https://ai-powered.com/skills/phoenix-evals): Phoenix evals is an open-source agent skill for ai models and llm tooling.
- [Tldr prompt](https://ai-powered.com/skills/tldr-prompt): Tldr prompt is an open-source agent skill for ai models and llm tooling.
- [Arize AI provider integration](https://ai-powered.com/skills/arize-ai-provider-integration): Arize AI provider integration is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/m365-agent-evaluator
