# Huggingface vision trainer

> Huggingface vision trainer is an open-source agent skill for ai models and llm tooling. Trains and fine-tunes vision models for object detection (D-FINE, RT-DETR v2, DETR, YOLOS), image classification (timm models — MobileNetV3,. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/huggingface/skills/tree/main/skills/huggingface-vision-trainer
- **Repository:** https://github.com/huggingface/skills
- **GitHub stars:** 11,356
- **License:** Apache-2.0
- **Skill name:** huggingface-vision-trainer
- **Collection:** https://github.com/huggingface/skills
- **Categories:** AI models and LLM tooling
- **Listing updated:** 2026-11-17

## About

Trains and fine-tunes vision models for object detection (D-FINE, RT-DETR v2, DETR, YOLOS), image classification (timm models — MobileNetV3, MobileViT, ResNet, ViT/DINOv3 — plus any Transformers classifier), and SAM/SAM2 segmentation using Hugging Face Transformers on Hugging Face Jobs cloud GPUs. Covers COCO-format dataset preparation, Albumentations augmentation, mAP/mAR evaluation, accuracy metrics, SAM segmentation with bbox/point prompts, DiceCE loss, hardware selection, cost estimation, Trackio monitoring, and Hub persistence. Use when users mention training object detection, image classification, SAM, SAM2, segmentation, image matting, DETR, D-FINE, RT-DETR, ViT, timm, MobileNet, ResNet, bounding box models, or fine-tuning vision models on Hugging Face Jobs.

## When your agent uses it

> Trains and fine-tunes vision models for object detection (D-FINE, RT-DETR v2, DETR, YOLOS), image classification (timm models — MobileNetV3, MobileViT, ResNet, ViT/DINOv3 — plus any Transformers classifier), and SAM/SAM2 segmentation using Hugging Face Transformers on Hugging Face Jobs cloud GPUs. Covers COCO-format dataset preparation, Albumentations augmentation, mAP/mAR evaluation, accuracy metrics, SAM segmentation with bbox/point prompts, DiceCE loss, hardware selection, cost estimation, Trackio monitoring, and Hub persistence. Use when users mention training object detection, image classification, SAM, SAM2, segmentation, image matting, DETR, D-FINE, RT-DETR, ViT, timm, MobileNet, ResNet, bounding box models, or fine-tuning vision models on Hugging Face Jobs.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Runs Python scripts](https://github.com/huggingface/skills/tree/HEAD/skills/huggingface-vision-trainer)
- [Network calls found in its scripts](https://github.com/huggingface/skills/tree/HEAD/skills/huggingface-vision-trainer)
- [License: Apache-2.0](https://github.com/huggingface/skills/tree/HEAD/skills/huggingface-vision-trainer)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/huggingface-vision-trainer` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/huggingface-vision-trainer &&
cp -R "$tmp/skills/huggingface-vision-trainer" ~/.claude/skills/huggingface-vision-trainer &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/huggingface-vision-trainer` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/huggingface-vision-trainer` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/huggingface-vision-trainer &&
cp -R "$tmp/skills/huggingface-vision-trainer" ~/.agents/skills/huggingface-vision-trainer &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/huggingface-vision-trainer` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/huggingface-vision-trainer` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/huggingface-vision-trainer &&
cp -R "$tmp/skills/huggingface-vision-trainer" ~/.cursor/skills/huggingface-vision-trainer &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/huggingface-vision-trainer` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/huggingface/skills.git --path skills/huggingface-vision-trainer
```

Or copy the folder to `~/.gemini/skills/huggingface-vision-trainer` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/huggingface-vision-trainer`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/huggingface-vision-trainer &&
cp -R "$tmp/skills/huggingface-vision-trainer" ~/.copilot/skills/huggingface-vision-trainer &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/huggingface-vision-trainer` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/huggingface/skills.git
```

Then copy `skills/skills/huggingface-vision-trainer` into your agent's skills folder as `huggingface-vision-trainer`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Huggingface vision trainer in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/huggingface-vision-trainer to use it in all your projects, or to .claude/skills/huggingface-vision-trainer in one project.

### Does Huggingface vision trainer run scripts?

Yes. It runs Python scripts. Its scripts contain network calls. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Huggingface vision trainer?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Huggingface vision trainer?

The closest alternatives to Huggingface vision trainer are Academy guide, MCP builder, Claude API, Nano banana pro openrouter and Generate image.

## Alternatives

- [Academy guide](https://ai-powered.com/skills/academy-guide): Academy guide is an agent skill for ai models and llm tooling.
- [MCP builder](https://ai-powered.com/skills/mcp-builder): MCP builder is an agent skill for ai models and llm tooling.
- [Claude API](https://ai-powered.com/skills/claude-api): Claude API is an agent skill for ai models and llm tooling.
- [Nano banana pro openrouter](https://ai-powered.com/skills/nano-banana-pro-openrouter): Nano banana pro openrouter is an open-source agent skill for design and media.
- [Generate image](https://ai-powered.com/skills/generate-image): Generate image is an open-source agent skill for design and media.
- [Phoenix evals](https://ai-powered.com/skills/phoenix-evals): Phoenix evals is an open-source agent skill for ai models and llm tooling.
- [Tldr prompt](https://ai-powered.com/skills/tldr-prompt): Tldr prompt is an open-source agent skill for ai models and llm tooling.
- [Arize AI provider integration](https://ai-powered.com/skills/arize-ai-provider-integration): Arize AI provider integration is an open-source agent skill for ai models and llm tooling.

---
Source: https://ai-powered.com/skills/huggingface-vision-trainer
