
Agentic eval
Patterns and techniques for evaluating and improving AI agent outputs
- Scripts
- None
- Platforms
- Claude Code, Codex, Cursor
- GitHub stars
- 41.3K
- Last commit
- 1 day ago
- License
- MIT
- Listing updated
- today
When your agent uses it
Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing self-critique and reflection loops - Building evaluator-optimizer pipelines for quality-critical generation - Creating test-driven code refinement workflows - Designing rubric-based or LLM-as-judge evaluation systems - Adding iterative improvement to agent outputs (code, reports, analysis) - Measuring and improving agent response quality
From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.
What it can access
From a static check of its 1 file (6 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.
Install
Copy the skill folder to ~/.claude/skills/agentic-eval to use it in all your projects:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.claude/skills/agentic-eval &&
rm -rf "$tmp"For one project only, put the folder in .claude/skills/agentic-eval inside it instead.
Copy the skill folder to ~/.agents/skills/agentic-eval to use it in every repository:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.agents/skills/agentic-eval &&
rm -rf "$tmp"For one repository only, put the folder in .agents/skills/agentic-eval inside it instead.
Copy the skill folder to ~/.cursor/skills/agentic-eval to use it in every project:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.cursor/skills/agentic-eval &&
rm -rf "$tmp"For one project only, put the folder in .cursor/skills/agentic-eval inside it instead.
Run in a terminal (add --scope workspace to install it for the current workspace only):
gemini skills install https://github.com/github/awesome-copilot.git --path skills/agentic-evalOr copy the folder to ~/.gemini/skills/agentic-eval yourself.
For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/agentic-eval:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/agentic-eval &&
cp -R "$tmp/skills/agentic-eval" ~/.copilot/skills/agentic-eval &&
rm -rf "$tmp"For one project only, put the folder in .github/skills/agentic-eval inside it instead.
Get the folder:
git clone --depth 1 https://github.com/github/awesome-copilot.gitThen copy awesome-copilot/skills/agentic-eval into your agent's skills folder as agentic-eval. Agents that support SKILL.md read one folder per skill.
Agentic eval FAQ
How do I install Agentic eval in Claude Code?
Copy the skill folder from GitHub to ~/.claude/skills/agentic-eval to use it in all your projects, or to .claude/skills/agentic-eval in one project.
Does Agentic eval run scripts?
No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.
Which AI agents can use Agentic eval?
Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.
What are the best alternatives to Agentic eval?
The closest alternatives to Agentic eval are Academy guide, MCP builder, Claude API, Agent governance and AI prompt engineering safety review.
More from github/awesome-copilot

Route gh-aw workflow design/create/debug/upgrade requests to the right prompts.
- Open source
- 41.3K GitHub stars

Review pull requests for repository fit, meaningful value, trustworthy provenance, differentiation, and maintainability in awesome-copilot.
- Open source
- 41.3K GitHub stars
- Developer tools

Create or register a canvas extension in the awesome-copilot repository
- Open source
- 41.3K GitHub stars

Use this skill when the user explicitly asks to map, document, or onboard into an existing codebase
- Open source
- 41.3K GitHub stars

Run the AgentRC readiness assessment on the current repository and produce a static HTML dashboard at reports/index.html
- Open source
- 41.3K GitHub stars
- Developer tools

Generate tailored AI agent instruction files via AgentRC instructions command
- Open source
- 41.3K GitHub stars
Alternatives to Agentic eval

Academy guide
SkillStop and check this skill before finishing any reply to a question about how to use Claude or a Claude product — it recommends matching cour
- 196K GitHub stars
- AI models and LLM tooling

MCP builder
SkillGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-design
- 196K GitHub stars
- AI models and LLM tooling

Claude API
SkillReference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, caching, token counting, model
- 196K GitHub stars
- AI models and LLM tooling

Agent governance
SkillPatterns and techniques for adding governance, safety, and trust controls to AI agent systems
- Open source
- 41.3K GitHub stars
- AI models and LLM tooling

Comprehensive AI prompt engineering safety review and improvement prompt
- Open source
- 41.3K GitHub stars
- AI models and LLM tooling



