
M365 agent evaluator
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @
- Scripts
- None
- Platforms
- Claude Code, Codex, Cursor
- GitHub stars
- 3.2K
- Last commit
- 1 day ago
- License
- MIT
- Listing updated
- today
When your agent uses it
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thresholds", "why is my agent failing", or "set up eval environment variables".
From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.
What it can access
From a static check of its 17 files (72 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.
Install
Copy the skill folder to ~/.claude/skills/m365-agent-evaluator to use it in all your projects:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.claude/skills/m365-agent-evaluator &&
rm -rf "$tmp"For one project only, put the folder in .claude/skills/m365-agent-evaluator inside it instead.
Copy the skill folder to ~/.agents/skills/m365-agent-evaluator to use it in every repository:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.agents/skills/m365-agent-evaluator &&
rm -rf "$tmp"For one repository only, put the folder in .agents/skills/m365-agent-evaluator inside it instead.
Copy the skill folder to ~/.cursor/skills/m365-agent-evaluator to use it in every project:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.cursor/skills/m365-agent-evaluator &&
rm -rf "$tmp"For one project only, put the folder in .cursor/skills/m365-agent-evaluator inside it instead.
Run in a terminal (add --scope workspace to install it for the current workspace only):
gemini skills install https://github.com/microsoft/skills.git --path .github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluatorOr copy the folder to ~/.gemini/skills/m365-agent-evaluator yourself.
For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/m365-agent-evaluator:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/microsoft/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/m365-agent-evaluator &&
cp -R "$tmp/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator" ~/.copilot/skills/m365-agent-evaluator &&
rm -rf "$tmp"For one project only, put the folder in .github/skills/m365-agent-evaluator inside it instead.
Get the folder:
git clone --depth 1 https://github.com/microsoft/skills.gitThen copy skills/.github/plugins/microsoft-365-agents-toolkit/skills/m365-agent-evaluator into your agent's skills folder as m365-agent-evaluator. Agents that support SKILL.md read one folder per skill.
M365 agent evaluator FAQ
How do I install M365 agent evaluator in Claude Code?
Copy the skill folder from GitHub to ~/.claude/skills/m365-agent-evaluator to use it in all your projects, or to .claude/skills/m365-agent-evaluator in one project.
Does M365 agent evaluator run scripts?
No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.
Which AI agents can use M365 agent evaluator?
Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.
What are the best alternatives to M365 agent evaluator?
The closest alternatives to M365 agent evaluator are Academy guide, MCP builder, Claude API, Nano banana pro openrouter and Generate image.
More from microsoft/skills


Diagnose Day-2 AKS GPU and KAITO incidents using profile-aware, read-only evidence
- Open source
- 3.2K GitHub stars

Lookup documented AKS fixes only when the prompt includes an exact catalog signature and all of its qualifiers: VMCannotFitEphemeralOSDisk;
- Open source
- 3.2K GitHub stars

Collects bounded packet captures from AKS nodes and Azure network configuration for wire-level evidence
- Open source
- 3.2K GitHub stars

Debug live Azure Kubernetes Service (AKS) incidents with a read-only, evidence-first investigation
- Open source
- 3.2K GitHub stars

Builds an Azure portal deep link to a specific blade/menu item for supported Microsoft.ContainerService, Microsoft.Kubernetes, and Microsoft
- Open source
- 3.2K GitHub stars
- Cloud and infrastructure
Alternatives to M365 agent evaluator

Academy guide
SkillStop and check this skill before finishing any reply to a question about how to use Claude or a Claude product — it recommends matching cour
- 196K GitHub stars
- AI models and LLM tooling

MCP builder
SkillGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-design
- 196K GitHub stars
- AI models and LLM tooling

Claude API
SkillReference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, caching, token counting, model
- 196K GitHub stars
- AI models and LLM tooling

Generate or edit images via OpenRouter with the Gemini 3 Pro Image model
- Open source
- 41.3K GitHub stars
- Design and media


Phoenix evals
SkillBuild and run evaluators for AI/LLM applications using Phoenix.
- Open source
- 41.3K GitHub stars
- AI models and LLM tooling



