# Arize evaluator

> Arize evaluator is an open-source agent skill for ai models and llm tooling. Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, mana. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/github/awesome-copilot/tree/main/skills/arize-evaluator
- **Repository:** https://github.com/github/awesome-copilot
- **GitHub stars:** 41,254
- **License:** MIT
- **Skill name:** arize-evaluator
- **Collection:** https://github.com/github/awesome-copilot
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-17

## About

Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.

## When your agent uses it

> Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Instructions only, no scripts](https://github.com/github/awesome-copilot/tree/HEAD/skills/arize-evaluator)
- [License: MIT](https://github.com/github/awesome-copilot/tree/HEAD/skills/arize-evaluator)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/arize-evaluator` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/arize-evaluator &&
cp -R "$tmp/skills/arize-evaluator" ~/.claude/skills/arize-evaluator &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/arize-evaluator` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/arize-evaluator` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/arize-evaluator &&
cp -R "$tmp/skills/arize-evaluator" ~/.agents/skills/arize-evaluator &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/arize-evaluator` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/arize-evaluator` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/arize-evaluator &&
cp -R "$tmp/skills/arize-evaluator" ~/.cursor/skills/arize-evaluator &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/arize-evaluator` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/github/awesome-copilot.git --path skills/arize-evaluator
```

Or copy the folder to `~/.gemini/skills/arize-evaluator` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/arize-evaluator`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/github/awesome-copilot.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/arize-evaluator &&
cp -R "$tmp/skills/arize-evaluator" ~/.copilot/skills/arize-evaluator &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/arize-evaluator` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/github/awesome-copilot.git
```

Then copy `awesome-copilot/skills/arize-evaluator` into your agent's skills folder as `arize-evaluator`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Arize evaluator in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/arize-evaluator to use it in all your projects, or to .claude/skills/arize-evaluator in one project.

### Does Arize evaluator run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Arize evaluator?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Arize evaluator?

The closest alternatives to Arize evaluator are Academy guide, MCP builder, Claude API, Update llms and Phoenix evals.

## Alternatives

- [Academy guide](https://ai-powered.com/skills/academy-guide): Academy guide is an agent skill for ai models and llm tooling.
- [MCP builder](https://ai-powered.com/skills/mcp-builder): MCP builder is an agent skill for ai models and llm tooling.
- [Claude API](https://ai-powered.com/skills/claude-api): Claude API is an agent skill for ai models and llm tooling.
- [Update llms](https://ai-powered.com/skills/update-llms): Update llms is an open-source agent skill for ai models and llm tooling.
- [Phoenix evals](https://ai-powered.com/skills/phoenix-evals): Phoenix evals is an open-source agent skill for ai models and llm tooling.
- [Nano banana pro openrouter](https://ai-powered.com/skills/nano-banana-pro-openrouter): Nano banana pro openrouter is an open-source agent skill for design and media.
- [Code exemplars blueprint generator](https://ai-powered.com/skills/code-exemplars-blueprint-generator): Code exemplars blueprint generator is an open-source agent skill for ai models and llm tooling.
- [Arize AI provider integration](https://ai-powered.com/skills/arize-ai-provider-integration): Arize AI provider integration is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/arize-evaluator
