
Tao finetune video clip
Runs InternVideo2-CLIP video-text retrieval, fine-tuning, ONNX export and TensorRT deploy
- Scripts
- None
- Platforms
- Claude Code, Codex, Cursor
- GitHub stars
- 4K
- Last commit
- 1 day ago
- License
- Apache-2.0
- Listing updated
- today
Similar skills
About Tao finetune video clip
Tao finetune video clip is an open-source agent skill for design and media. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.
This skill guides an agent through the NVIDIA TAO video_clip workflow built on the InternVideo2-CLIP L14 model. It covers training, evaluation, embedding inference and ONNX export in the TAO PyTorch container, with LoRA options for vision-side fine-tuning. A separate TAO Deploy path handles TensorRT engine generation and TensorRT-backed evaluation and inference after export.
The skill sets out a preflight sequence that checks the container image is complete, including the video_clip import and PyAV availability, before any data is pulled or a run is launched. It also lays out a expected workspace layout with metadata JSON in the vadr1_chunks format, spec templates, and bind-mounted data, model and results folders. Offline evaluation expects MobileCLIP and InternVideo2 weights to be staged on disk, and Hugging Face tokens are only needed for online downloads.
The agent needs Docker with nvidia-container-toolkit and an NVIDIA GPU, or a local tao-pytorch checkout with a tao-cli virtualenv. Video records must use absolute video paths, and the skill includes smoke-test overrides and notes on common pitfalls such as precision settings and sidecar files required for deployment.
When your agent uses it
InternVideo2-CLIP L14 (TAO video_clip) for video-text retrieval, zero-shot classification, embedding extraction, LoRA fine-tuning, ONNX export, and TensorRT deployment. Use when the user asks to "fine-tune IV2CLIP", "run video_clip train/evaluate/inference/export", "build a Video-CLIP TensorRT engine", "InternVideo2-CLIP on KPI chunks", or "TAO video_clip on vadr1_chunks JSON".
From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.
What it can access
- Instructions only, no scripts(see the files on GitHub)
- Asks for: Read, Bash(see the files on GitHub)
- License: Apache-2.0(see the files on GitHub)
From a static check of its 17 files (64 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.
Check another skill before you install it.
Install
Copy the skill folder to ~/.claude/skills/tao-finetune-video-clip to use it in all your projects:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/tao-finetune-video-clip &&
cp -R "$tmp/skills/tao-finetune-video-clip" ~/.claude/skills/tao-finetune-video-clip &&
rm -rf "$tmp"For one project only, put the folder in .claude/skills/tao-finetune-video-clip inside it instead.
Copy the skill folder to ~/.agents/skills/tao-finetune-video-clip to use it in every repository:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/tao-finetune-video-clip &&
cp -R "$tmp/skills/tao-finetune-video-clip" ~/.agents/skills/tao-finetune-video-clip &&
rm -rf "$tmp"For one repository only, put the folder in .agents/skills/tao-finetune-video-clip inside it instead.
Copy the skill folder to ~/.cursor/skills/tao-finetune-video-clip to use it in every project:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/tao-finetune-video-clip &&
cp -R "$tmp/skills/tao-finetune-video-clip" ~/.cursor/skills/tao-finetune-video-clip &&
rm -rf "$tmp"For one project only, put the folder in .cursor/skills/tao-finetune-video-clip inside it instead.
Run in a terminal (add --scope workspace to install it for the current workspace only):
gemini skills install https://github.com/NVIDIA/skills.git --path skills/tao-finetune-video-clipOr copy the folder to ~/.gemini/skills/tao-finetune-video-clip yourself.
For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/tao-finetune-video-clip:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/tao-finetune-video-clip &&
cp -R "$tmp/skills/tao-finetune-video-clip" ~/.copilot/skills/tao-finetune-video-clip &&
rm -rf "$tmp"For one project only, put the folder in .github/skills/tao-finetune-video-clip inside it instead.
Get the folder:
git clone --depth 1 https://github.com/NVIDIA/skills.gitThen copy skills/skills/tao-finetune-video-clip into your agent's skills folder as tao-finetune-video-clip. Agents that support SKILL.md read one folder per skill.
What it does
- Training and fine-tuning
- Runs video_clip train with spec overrides, including LoRA configuration for vision-side adaptation.
- Retrieval and classification evaluation
- Scores video-text retrieval or zero-shot classification on a validation split.
- Embedding inference
- Writes video and text embeddings to HDF5 files from a gallery of clips and text prompts.
- ONNX export
- Exports a combined image-and-text ONNX model along with config and tokenizer sidecars.
- TensorRT deployment
- Builds TensorRT engines and runs evaluation and inference through the separate TAO Deploy image.
- Import and environment checks
- Verifies the container image is complete and that PyAV is present before a run starts.
Good for
- Fine-tune InternVideo2-CLIP on a set of labeled video clips
- Evaluate video-text retrieval accuracy on a validation split
- Generate video and text embeddings for a clip gallery
- Export a trained Video-CLIP checkpoint to ONNX
- Build a TensorRT engine from the exported model
Tao finetune video clip FAQ
What does the environment need to run this skill?
Docker with nvidia-container-toolkit and the pinned TAO video_clip PyTorch and Deploy containers, or a local tao-pytorch checkout with a tao-cli virtualenv. MobileCLIP and InternVideo2 weights must be on disk for offline evaluation.
What input format does it expect?
Metadata as a top-level JSON list of vadr1_chunks video records, each with an absolute video_path and nested caption chunks.
Does it use AutoML?
No. AutoML is not packaged for this skill, so training always uses the direct video_clip train action.
Which tools does the skill allow the agent to use?
It is declared to use Read and Bash.
How do I install Tao finetune video clip in Claude Code?
Copy the skill folder from GitHub to ~/.claude/skills/tao-finetune-video-clip to use it in all your projects, or to .claude/skills/tao-finetune-video-clip in one project.
Does Tao finetune video clip run scripts?
No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.
Which AI agents can use Tao finetune video clip?
Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.
What are the best alternatives to Tao finetune video clip?
The closest alternatives to Tao finetune video clip are Skill creator, Rea tool design, Codebase design, Prototype and Brand guidelines.
Where this comes from
- Description: from the skill's own SKILL.md.
More from NVIDIA/skills

Finds and fixes wrong gradients in differentiable NVIDIA Warp programs using
- Open source
- 4K GitHub stars
- Developer tools

Checks whether an existing code path is a credible NVIDIA Warp acceleration candidate
- Open source
- 4K GitHub stars
- Developer tools

Builds or adapts NVIDIA FastGen experiment configs for a network, task and method
- Open source
- 4K GitHub stars
- AI models and LLM tooling

Guides preparing, registering and verifying NVIDIA FastGen training datasets for an agent
- Open source
- 4K GitHub stars
- Design and media

Guides an agent through changing, refactoring or reviewing NVIDIA FastGen library code
- Open source
- 4K GitHub stars
- Developer tools

Guides an agent through generating and inspecting NVIDIA FastGen teacher and student
- Open source
- 4K GitHub stars
- AI models and LLM tooling
Alternatives to Tao finetune video clip

Skill creator
SkillGuides an agent through drafting, testing and tuning new agent skills with measured evals
- Free
- 196K GitHub stars
- AI models and LLM tooling

Rea tool design
SkillAudits and designs REA investigation tools, CLI and MCP contracts and Evidence semantics
- Open source
- 465K GitHub stars
- Design and media

Codebase design
SkillTeaches a deep-module vocabulary for designing interfaces, seams and testable code
- Open source
- 326K GitHub stars
- Design and media

Prototype
SkillBuilds a throwaway prototype to settle a design question: a logic demo or UI variants
- Open source
- 326K GitHub stars
- Developer tools

Brand guidelines
SkillApplies Anthropic's brand colors and Poppins and Lora typography to generated artifacts
- Free
- 196K GitHub stars
- Design and media

Theme factory
SkillApplies one of ten preset color and font themes, or a custom one, to slides and docs
- Free
- 196K GitHub stars
- Design and media



