# Eval driven dev

> Eval driven dev is an open-source agent skill for ai models and llm tooling. Improve AI application with evaluation-driven development. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/github/awesome-copilot/tree/main/skills/eval-driven-dev
- **Repository:** https://github.com/github/awesome-copilot
- **GitHub stars:** 41,254
- **License:** MIT
- **Skill name:** eval-driven-dev
- **Collection:** https://github.com/github/awesome-copilot
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-17

## About

Improve AI application with evaluation-driven development. Define eval criteria, instrument the application, build golden datasets, observe and evaluate application runs, analyze results, and produce a concrete action plan for improvements. ALWAYS USE THIS SKILL when the user asks to set up QA, add tests, add evals, evaluate, benchmark, fix wrong behaviors, improve quality, or do quality assurance for any Python project that calls an LLM model.

## When your agent uses it

> Improve AI application with evaluation-driven development. Define eval criteria, instrument the application, build golden datasets, observe and evaluate application runs, analyze results, and produce a concrete action plan for improvements. ALWAYS USE THIS SKILL when the user asks to set up QA, add tests, add evals, evaluate, benchmark, fix wrong behaviors, improve quality, or do quality assurance for any Python project that calls an LLM model.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Runs shell and Python scripts](https://github.com/github/awesome-copilot/tree/HEAD/skills/eval-driven-dev)
- [No network calls found in its scripts](https://github.com/github/awesome-copilot/tree/HEAD/skills/eval-driven-dev)
- [License: MIT](https://github.com/github/awesome-copilot/tree/HEAD/skills/eval-driven-dev)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/eval-driven-dev` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/eval-driven-dev &&
cp -R "$tmp/skills/eval-driven-dev" ~/.claude/skills/eval-driven-dev &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/eval-driven-dev` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/eval-driven-dev` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/eval-driven-dev &&
cp -R "$tmp/skills/eval-driven-dev" ~/.agents/skills/eval-driven-dev &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/eval-driven-dev` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/eval-driven-dev` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/eval-driven-dev &&
cp -R "$tmp/skills/eval-driven-dev" ~/.cursor/skills/eval-driven-dev &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/eval-driven-dev` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/github/awesome-copilot.git --path skills/eval-driven-dev
```

Or copy the folder to `~/.gemini/skills/eval-driven-dev` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/eval-driven-dev`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/eval-driven-dev &&
cp -R "$tmp/skills/eval-driven-dev" ~/.copilot/skills/eval-driven-dev &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/eval-driven-dev` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/github/awesome-copilot.git
```

Then copy `awesome-copilot/skills/eval-driven-dev` into your agent's skills folder as `eval-driven-dev`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Eval driven dev in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/eval-driven-dev to use it in all your projects, or to .claude/skills/eval-driven-dev in one project.

### Does Eval driven dev run scripts?

Yes. It runs shell and Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Eval driven dev?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Eval driven dev?

The closest alternatives to Eval driven dev are Academy guide, MCP builder, Claude API, Nano banana pro openrouter and Generate image.

## Alternatives

- [Academy guide](https://ai-powered.com/skills/academy-guide): Academy guide is an agent skill for ai models and llm tooling.
- [MCP builder](https://ai-powered.com/skills/mcp-builder): MCP builder is an agent skill for ai models and llm tooling.
- [Claude API](https://ai-powered.com/skills/claude-api): Claude API is an agent skill for ai models and llm tooling.
- [Nano banana pro openrouter](https://ai-powered.com/skills/nano-banana-pro-openrouter): Nano banana pro openrouter is an open-source agent skill for design and media.
- [Generate image](https://ai-powered.com/skills/generate-image): Generate image is an open-source agent skill for design and media.
- [Phoenix evals](https://ai-powered.com/skills/phoenix-evals): Phoenix evals is an open-source agent skill for ai models and llm tooling.
- [Tldr prompt](https://ai-powered.com/skills/tldr-prompt): Tldr prompt is an open-source agent skill for ai models and llm tooling.
- [Arize AI provider integration](https://ai-powered.com/skills/arize-ai-provider-integration): Arize AI provider integration is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/eval-driven-dev
