
Tao run inference service
Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container executi
- Scripts
- None
- Platforms
- Claude Code, Codex, Cursor
- GitHub stars
- 4K
- Last commit
- 1 day ago
- License
- Apache-2.0
- Listing updated
- today
When your agent uses it
Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.
From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.
What it can access
- Instructions only, no scripts(see the files on GitHub)
- Asks for: Read, Bash, Write(see the files on GitHub)
- License: Apache-2.0(see the files on GitHub)
From a static check of its 12 files (78 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.
Install
Copy the skill folder to ~/.claude/skills/tao-run-inference-service to use it in all your projects:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.claude/skills/tao-run-inference-service &&
rm -rf "$tmp"For one project only, put the folder in .claude/skills/tao-run-inference-service inside it instead.
Copy the skill folder to ~/.agents/skills/tao-run-inference-service to use it in every repository:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.agents/skills/tao-run-inference-service &&
rm -rf "$tmp"For one repository only, put the folder in .agents/skills/tao-run-inference-service inside it instead.
Copy the skill folder to ~/.cursor/skills/tao-run-inference-service to use it in every project:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.cursor/skills/tao-run-inference-service &&
rm -rf "$tmp"For one project only, put the folder in .cursor/skills/tao-run-inference-service inside it instead.
Run in a terminal (add --scope workspace to install it for the current workspace only):
gemini skills install https://github.com/NVIDIA/skills.git --path skills/tao-run-inference-serviceOr copy the folder to ~/.gemini/skills/tao-run-inference-service yourself.
For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/tao-run-inference-service:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.copilot/skills/tao-run-inference-service &&
rm -rf "$tmp"For one project only, put the folder in .github/skills/tao-run-inference-service inside it instead.
Get the folder:
git clone --depth 1 https://github.com/NVIDIA/skills.gitThen copy skills/skills/tao-run-inference-service into your agent's skills folder as tao-run-inference-service. Agents that support SKILL.md read one folder per skill.
Tao run inference service FAQ
How do I install Tao run inference service in Claude Code?
Copy the skill folder from GitHub to ~/.claude/skills/tao-run-inference-service to use it in all your projects, or to .claude/skills/tao-run-inference-service in one project.
Does Tao run inference service run scripts?
No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.
Which AI agents can use Tao run inference service?
Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.
More from NVIDIA/skills

Use for NVIDIA-related requests where an NVIDIA skill might help, even if the user did not ask for a skill
- Open source
- 4K GitHub stars

Official NVIDIA-authored guidance for NVIDIA cuDF GPU DataFrames, pandas acceleration, dask-cuDF, ETL, joins, groupby, CSV/Parquet I/O, null
- Open source
- 4K GitHub stars

Customize NVIDIA Nemotron Voice Agent's Generic Pipecat example for healthcare appointment, five-field patient intake, or custom tool-callin
- Open source
- 4K GitHub stars

Calibrate a new dataset from live RTSP camera streams via the AutoMagicCalib REST API
- Open source
- 4K GitHub stars

Calibrates pre-recorded `cam_*.mp4` datasets through the AutoMagicCalib REST API
- Open source
- 4K GitHub stars
- Design and media

Launch AutoMagicCalib microservice and web UI from NGC release images via Docker Compose
- Open source
- 4K GitHub stars