# Agent platform autorater customization

> Agent platform autorater customization is an open-source agent skill for ai models and llm tooling. Customizes an autorater (evaluation metric) for an AI agent so its grades match the user's own judgment, starting from the agent's real traj. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/google/skills/tree/main/skills/cloud/agent-platform-autorater-customization
- **Repository:** https://github.com/google/skills
- **GitHub stars:** 24,379
- **License:** Apache-2.0
- **Skill name:** agent-platform-autorater-customization
- **Collection:** https://github.com/google/skills
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-17

## About

Customizes an autorater (evaluation metric) for an AI agent so its grades match the user's own judgment, starting from the agent's real trajectories. Use when a user wants a metric tailored to their agent, wants to turn failing trajectories into rubrics, says an existing autorater grades their agent wrong, or wants an autorater to agree with human labels (autorater hillclimbing, judge calibration). Don't use for quick evals with built-in metrics or for improving the agent itself (use agent-platform-eval-flywheel).

## When your agent uses it

> Customizes an autorater (evaluation metric) for an AI agent so its grades match the user's own judgment, starting from the agent's real trajectories. Use when a user wants a metric tailored to their agent, wants to turn failing trajectories into rubrics, says an existing autorater grades their agent wrong, or wants an autorater to agree with human labels (autorater hillclimbing, judge calibration). Don't use for quick evals with built-in metrics or for improving the agent itself (use agent-platform-eval-flywheel).

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Runs Python scripts](https://github.com/google/skills/tree/HEAD/skills/cloud/agent-platform-autorater-customization)
- [No network calls found in its scripts](https://github.com/google/skills/tree/HEAD/skills/cloud/agent-platform-autorater-customization)
- [License: Apache-2.0](https://github.com/google/skills/tree/HEAD/skills/cloud/agent-platform-autorater-customization)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/agent-platform-autorater-customization` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/google/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/agent-platform-autorater-customization &&
cp -R "$tmp/skills/cloud/agent-platform-autorater-customization" ~/.claude/skills/agent-platform-autorater-customization &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/agent-platform-autorater-customization` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/agent-platform-autorater-customization` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/google/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/agent-platform-autorater-customization &&
cp -R "$tmp/skills/cloud/agent-platform-autorater-customization" ~/.agents/skills/agent-platform-autorater-customization &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/agent-platform-autorater-customization` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/agent-platform-autorater-customization` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/google/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/agent-platform-autorater-customization &&
cp -R "$tmp/skills/cloud/agent-platform-autorater-customization" ~/.cursor/skills/agent-platform-autorater-customization &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/agent-platform-autorater-customization` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/google/skills.git --path skills/cloud/agent-platform-autorater-customization
```

Or copy the folder to `~/.gemini/skills/agent-platform-autorater-customization` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/agent-platform-autorater-customization`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/google/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/agent-platform-autorater-customization &&
cp -R "$tmp/skills/cloud/agent-platform-autorater-customization" ~/.copilot/skills/agent-platform-autorater-customization &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/agent-platform-autorater-customization` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/google/skills.git
```

Then copy `skills/skills/cloud/agent-platform-autorater-customization` into your agent's skills folder as `agent-platform-autorater-customization`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Agent platform autorater customization in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/agent-platform-autorater-customization to use it in all your projects, or to .claude/skills/agent-platform-autorater-customization in one project.

### Does Agent platform autorater customization run scripts?

Yes. It runs Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Agent platform autorater customization?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Agent platform autorater customization?

The closest alternatives to Agent platform autorater customization are Academy guide, MCP builder, Claude API, Nano banana pro openrouter and Dotnet MCP builder.

## Alternatives

- [Academy guide](https://ai-powered.com/skills/academy-guide): Academy guide is an agent skill for ai models and llm tooling.
- [MCP builder](https://ai-powered.com/skills/mcp-builder): MCP builder is an agent skill for ai models and llm tooling.
- [Claude API](https://ai-powered.com/skills/claude-api): Claude API is an agent skill for ai models and llm tooling.
- [Nano banana pro openrouter](https://ai-powered.com/skills/nano-banana-pro-openrouter): Nano banana pro openrouter is an open-source agent skill for design and media.
- [Dotnet MCP builder](https://ai-powered.com/skills/dotnet-mcp-builder): Dotnet MCP builder is an open-source agent skill for ai models and llm tooling.
- [Generate image](https://ai-powered.com/skills/generate-image): Generate image is an open-source agent skill for design and media.
- [Code exemplars blueprint generator](https://ai-powered.com/skills/code-exemplars-blueprint-generator): Code exemplars blueprint generator is an open-source agent skill for ai models and llm tooling.
- [Boost prompt](https://ai-powered.com/skills/boost-prompt): Boost prompt is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/agent-platform-autorater-customization
