# Agentic eval

> Agentic eval is an open-source agent skill for ai models and llm tooling. Patterns and techniques for evaluating and improving AI agent outputs. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/github/awesome-copilot/tree/main/skills/agentic-eval
- **Repository:** https://github.com/github/awesome-copilot
- **GitHub stars:** 41,254
- **License:** MIT
- **Skill name:** agentic-eval
- **Collection:** https://github.com/github/awesome-copilot
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-17

## About

Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when:
- Implementing self-critique and reflection loops
- Building evaluator-optimizer pipelines for quality-critical generation
- Creating test-driven code refinement workflows
- Designing rubric-based or LLM-as-judge evaluation systems
- Adding iterative improvement to agent outputs (code, reports, analysis)
- Measuring and improving agent response quality

## When your agent uses it

> Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing self-critique and reflection loops - Building evaluator-optimizer pipelines for quality-critical generation - Creating test-driven code refinement workflows - Designing rubric-based or LLM-as-judge evaluation systems - Adding iterative improvement to agent outputs (code, reports, analysis) - Measuring and improving agent response quality

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Instructions only, no scripts](https://github.com/github/awesome-copilot/tree/HEAD/skills/agentic-eval)
- [License: MIT](https://github.com/github/awesome-copilot/tree/HEAD/skills/agentic-eval)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/agentic-eval` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.claude/skills/agentic-eval &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/agentic-eval` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/agentic-eval` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.agents/skills/agentic-eval &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/agentic-eval` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/agentic-eval` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.cursor/skills/agentic-eval &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/agentic-eval` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/github/awesome-copilot.git --path skills/agentic-eval
```

Or copy the folder to `~/.gemini/skills/agentic-eval` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/agentic-eval`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.copilot/skills/agentic-eval &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/agentic-eval` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/github/awesome-copilot.git
```

Then copy `awesome-copilot/skills/agentic-eval` into your agent's skills folder as `agentic-eval`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Agentic eval in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/agentic-eval to use it in all your projects, or to .claude/skills/agentic-eval in one project.

### Does Agentic eval run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Agentic eval?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Agentic eval?

The closest alternatives to Agentic eval are Academy guide, MCP builder, Claude API, Agent governance and AI prompt engineering safety review.

## Alternatives

- [Academy guide](https://ai-powered.com/skills/academy-guide): Academy guide is an agent skill for ai models and llm tooling.
- [MCP builder](https://ai-powered.com/skills/mcp-builder): MCP builder is an agent skill for ai models and llm tooling.
- [Claude API](https://ai-powered.com/skills/claude-api): Claude API is an agent skill for ai models and llm tooling.
- [Agent governance](https://ai-powered.com/skills/agent-governance): Agent governance is an open-source agent skill for ai models and llm tooling.
- [AI prompt engineering safety review](https://ai-powered.com/skills/ai-prompt-engineering-safety-review): AI prompt engineering safety review is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/agentic-eval
