# Tao run deft aoi cosmos3

> Tao run deft aoi cosmos3 is an open-source agent skill for ai models and llm tooling. Runs an iterative DEFT loop that improves Cosmos3 bare OK/NG AOI inspection accuracy. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/NVIDIA/skills/tree/main/skills/tao-run-deft-aoi-cosmos3
- **Repository:** https://github.com/nvidia/skills
- **GitHub stars:** 4,037
- **License:** Apache-2.0
- **Skill name:** tao-run-deft-aoi-cosmos3
- **Collection:** https://github.com/NVIDIA/skills
- **Categories:** [AI models and LLM tooling](https://ai-powered.com/categories/ai-and-llm)
- **Listing updated:** 2026-11-18

## About

This skill drives a disk-backed improvement loop for NVIDIA Cosmos Reason 3 (Cosmos3) reasoners aimed at automated optical inspection. It defaults to the Nano variant and uses Edge or Super only when explicitly requested. Each iteration evaluates the base model on a frozen Benchmark split and a Proxy split, mines real image pairs that match Proxy errors, generates synthetic NG defect pairs, assembles a training file, and trains with LoRA SFT on the Cosmos Framework.

The workflow is a state machine recorded in a state file, with validation scripts that check label format, split isolation and a frozen Benchmark hash before each stage. Work runs through the user's chosen compute platform using submit, status, logs and cancel commands, and a pre-flight summary must be approved before any launch. Labels are restricted to bare OK or NG responses; rich or reasoning annotation modes are not supported.

The skill expects ShareGPT annotation files and image folders supplied by the user, a prepared Qwen3-VL checkpoint conversion, the Cosmos Framework container image, and related TAO skills for model, anomaly generation and mining. It is installed as part of a full TAO skill bank and uses Python with pyarrow and yaml.

## When your agent uses it

> Run the disk-backed DEFT AOI improvement loop for NVIDIA Cosmos Reason 3 / Cosmos3 models, using Nano by default and Edge or Super when explicitly requested: evaluate the base model on Proxy and frozen Benchmark splits, mine real image pairs from Proxy gaps, generate AnomalyGen synthetic NG pairs, assemble a per-iteration Train JSON from both producers, train with Cosmos Framework LoRA SFT, and repeat through the selected platform's submit/status/logs/cancel contract. This migration supports bare labels only: the assistant response must be exactly OK or NG. Use for "run Cosmos3 DEFT AOI", "CR3 AOI loop", or "improve Cosmos3 PCB inspection with bare OK/NG"; do not use for rich/reasoning annotation, one-off Cosmos training, or generic anomaly generation.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Runs shell and Python scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/tao-run-deft-aoi-cosmos3)
- [Asks for: Read, Task, Bash, Write](https://github.com/NVIDIA/skills/blob/HEAD/skills/tao-run-deft-aoi-cosmos3/SKILL.md)
- [No network calls found in its scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/tao-run-deft-aoi-cosmos3)
- [License: Apache-2.0](https://github.com/NVIDIA/skills/tree/HEAD/skills/tao-run-deft-aoi-cosmos3)

## Features

- **Frozen Benchmark gating:** Evaluates a frozen Benchmark split at baseline and each iteration to decide whether the loop should stop.
- **Proxy error analysis:** Reviews Proxy false accepts and false rejects to produce root-cause artifacts that guide mining targets.
- **Real image mining:** Selects real image pairs near Proxy gaps using a cosine floor and history checks to avoid reuse.
- **Synthetic NG generation:** Creates synthetic defect pairs with the AnomalyGen tool and converts them into bare NG training records.
- **LoRA training workflow:** Renders Framework training and evaluation configs, trains with LoRA SFT and resumes from prior checkpoints.
- **Resumable run state:** Tracks each stage, duration and event in a state file so interrupted runs can resume and report progress.

## Good for

- Improve a Cosmos3 model's PCB defect detection with bare OK/NG labels
- Run an iterative training loop until a Benchmark recall target is met
- Mine real defect image pairs from evaluation gaps for a new training set
- Generate synthetic NG defect pairs to cover missed defects
- Evaluate a Cosmos Reason 3 base model zero-shot on an inspection benchmark

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/tao-run-deft-aoi-cosmos3` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/tao-run-deft-aoi-cosmos3 &&
cp -R "$tmp/skills/tao-run-deft-aoi-cosmos3" ~/.claude/skills/tao-run-deft-aoi-cosmos3 &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/tao-run-deft-aoi-cosmos3` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/tao-run-deft-aoi-cosmos3` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/tao-run-deft-aoi-cosmos3 &&
cp -R "$tmp/skills/tao-run-deft-aoi-cosmos3" ~/.agents/skills/tao-run-deft-aoi-cosmos3 &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/tao-run-deft-aoi-cosmos3` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/tao-run-deft-aoi-cosmos3` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/tao-run-deft-aoi-cosmos3 &&
cp -R "$tmp/skills/tao-run-deft-aoi-cosmos3" ~/.cursor/skills/tao-run-deft-aoi-cosmos3 &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/tao-run-deft-aoi-cosmos3` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/NVIDIA/skills.git --path skills/tao-run-deft-aoi-cosmos3
```

Or copy the folder to `~/.gemini/skills/tao-run-deft-aoi-cosmos3` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/tao-run-deft-aoi-cosmos3`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/tao-run-deft-aoi-cosmos3 &&
cp -R "$tmp/skills/tao-run-deft-aoi-cosmos3" ~/.copilot/skills/tao-run-deft-aoi-cosmos3 &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/tao-run-deft-aoi-cosmos3` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/NVIDIA/skills.git
```

Then copy `skills/skills/tao-run-deft-aoi-cosmos3` into your agent's skills folder as `tao-run-deft-aoi-cosmos3`. Agents that support SKILL.md read one folder per skill.

## FAQ

### Which Cosmos3 variant does it use by default?

It uses Nano by default. Edge or Super are used only when explicitly requested, and it never switches variants silently.

### What label format does it produce?

Training responses must be exactly OK or NG. Rich, reasoning and multiple-choice annotation modes are not supported.

### Does it start training without approval?

No. A launch review and a pre-flight summary must be explicitly approved before any state, dependency install or native launch.

### What inputs are needed?

User-supplied Proxy and Benchmark annotation files, a mining pool, and images. Specs are generated by the workflow rather than supplied.

### How do I install Tao run deft aoi cosmos3 in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/tao-run-deft-aoi-cosmos3 to use it in all your projects, or to .claude/skills/tao-run-deft-aoi-cosmos3 in one project.

### Does Tao run deft aoi cosmos3 run scripts?

Yes. It runs shell and Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Tao run deft aoi cosmos3?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Tao run deft aoi cosmos3?

The closest alternatives to Tao run deft aoi cosmos3 are Tao train rtdetr, Tao run deft cr its mining, Tao train dinov3, Tao run automl deft pipeline and Tao finetune cosmos reason.

## Where this comes from

- Description: from the skill's own SKILL.md.

## Alternatives

- [Tao train rtdetr](https://ai-powered.com/skills/tao-train-rtdetr): Tao train rtdetr is an open-source agent skill for ai models and llm tooling.
- [Tao run deft cr its mining](https://ai-powered.com/skills/tao-run-deft-cr-its-mining): Tao run deft cr its mining is an open-source agent skill for ai models and llm tooling.
- [Tao train dinov3](https://ai-powered.com/skills/tao-train-dinov3): Tao train dinov3 is an open-source agent skill for ai models and llm tooling.
- [Tao run automl deft pipeline](https://ai-powered.com/skills/tao-run-automl-deft-pipeline): Tao run automl deft pipeline is an open-source agent skill for ai models and llm tooling.
- [Tao finetune cosmos reason](https://ai-powered.com/skills/tao-finetune-cosmos-reason): Tao finetune cosmos reason is an open-source agent skill for design and media.
- [Tao run deft pas](https://ai-powered.com/skills/tao-run-deft-pas): Tao run deft pas is an open-source agent skill for ai models and llm tooling.
- [Tao train deformable detr](https://ai-powered.com/skills/tao-train-deformable-detr): Tao train deformable detr is an open-source agent skill for ai models and llm tooling.
- [Tao generate anomalies](https://ai-powered.com/skills/tao-generate-anomalies): Tao generate anomalies is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/tao-run-deft-aoi-cosmos3
