Skip to content
Skill

Evaluate cluster

Evaluates an ML GPU cluster for a cloud trial or acceptance test: environment dump, isolated newest PyTorch, matmul FLOPS (MAMF/MSMF) on eve

Install
Scripts
None
Platforms
Claude Code, Codex, Cursor
GitHub stars
19.7K
Last commit
5 days ago
License
CC-BY-SA-4.0
Listing updated
today

When your agent uses it

Evaluates an ML GPU cluster for a cloud trial or acceptance test: environment dump, isolated newest PyTorch, matmul FLOPS (MAMF/MSMF) on every GPU while the others compute, intra-node all-reduce bandwidth and per-call latency of every collective, the same inter-node on every node you were given (omit those sections if there is only one node), fio on local disk and shared FS, dated markdown report. Use when the user asks to evaluate a cluster, kick the tires on trial nodes, run cluster acceptance, or measure GPU/network/storage. Canonical copy: https://github.com/stas00/ml-engineering/blob/master/skills/evaluate-cluster/SKILL.md

From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.

What it can access

From a static check of its 1 file (102 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.

Install

Copy the skill folder to ~/.claude/skills/evaluate-cluster to use it in all your projects:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/stas00/ml-engineering.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/evaluate-cluster &&
cp -R "$tmp/skills/evaluate-cluster" ~/.claude/skills/evaluate-cluster &&
rm -rf "$tmp"

For one project only, put the folder in .claude/skills/evaluate-cluster inside it instead.

Claude Code docs on skills

Copy the skill folder to ~/.agents/skills/evaluate-cluster to use it in every repository:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/stas00/ml-engineering.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/evaluate-cluster &&
cp -R "$tmp/skills/evaluate-cluster" ~/.agents/skills/evaluate-cluster &&
rm -rf "$tmp"

For one repository only, put the folder in .agents/skills/evaluate-cluster inside it instead.

Codex docs on skills

Copy the skill folder to ~/.cursor/skills/evaluate-cluster to use it in every project:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/stas00/ml-engineering.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/evaluate-cluster &&
cp -R "$tmp/skills/evaluate-cluster" ~/.cursor/skills/evaluate-cluster &&
rm -rf "$tmp"

For one project only, put the folder in .cursor/skills/evaluate-cluster inside it instead.

Cursor docs on skills

Run in a terminal (add --scope workspace to install it for the current workspace only):

gemini skills install https://github.com/stas00/ml-engineering.git --path skills/evaluate-cluster

Or copy the folder to ~/.gemini/skills/evaluate-cluster yourself.

Gemini CLI docs on skills

For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/evaluate-cluster:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/stas00/ml-engineering.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/evaluate-cluster &&
cp -R "$tmp/skills/evaluate-cluster" ~/.copilot/skills/evaluate-cluster &&
rm -rf "$tmp"

For one project only, put the folder in .github/skills/evaluate-cluster inside it instead.

VS Code docs on skills

Get the folder:

git clone --depth 1 https://github.com/stas00/ml-engineering.git

Then copy ml-engineering/skills/evaluate-cluster into your agent's skills folder as evaluate-cluster. Agents that support SKILL.md read one folder per skill.

The SKILL.md format

Evaluate cluster FAQ

How do I install Evaluate cluster in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/evaluate-cluster to use it in all your projects, or to .claude/skills/evaluate-cluster in one project.

Does Evaluate cluster run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

Which AI agents can use Evaluate cluster?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

More from stas00/ml-engineering

  1. Field-tested methodology and concrete recipes for training and operating large-scale LLM/VLM/multi-modal models end to end - choosing and be

    • Open source
    • 19.7K GitHub stars
    • Developer tools