# Tao run inference service

> Tao run inference service is an open-source agent skill. Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container executi. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/NVIDIA/skills/tree/main/skills/tao-run-inference-service
- **Repository:** https://github.com/nvidia/skills
- **GitHub stars:** 4,037
- **License:** Apache-2.0
- **Skill name:** tao-run-inference-service
- **Collection:** https://github.com/NVIDIA/skills
- **Listing updated:** 2026-11-17

## About

Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.

## When your agent uses it

> Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Instructions only, no scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/tao-run-inference-service)
- [Asks for: Read, Bash, Write](https://github.com/NVIDIA/skills/blob/HEAD/skills/tao-run-inference-service/SKILL.md)
- [License: Apache-2.0](https://github.com/NVIDIA/skills/tree/HEAD/skills/tao-run-inference-service)

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/tao-run-inference-service` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.claude/skills/tao-run-inference-service &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/tao-run-inference-service` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/tao-run-inference-service` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.agents/skills/tao-run-inference-service &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/tao-run-inference-service` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/tao-run-inference-service` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.cursor/skills/tao-run-inference-service &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/tao-run-inference-service` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/NVIDIA/skills.git --path skills/tao-run-inference-service
```

Or copy the folder to `~/.gemini/skills/tao-run-inference-service` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/tao-run-inference-service`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/tao-run-inference-service &&
cp -R "$tmp/skills/tao-run-inference-service" ~/.copilot/skills/tao-run-inference-service &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/tao-run-inference-service` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/NVIDIA/skills.git
```

Then copy `skills/skills/tao-run-inference-service` into your agent's skills folder as `tao-run-inference-service`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Tao run inference service in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/tao-run-inference-service to use it in all your projects, or to .claude/skills/tao-run-inference-service in one project.

### Does Tao run inference service run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Tao run inference service?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

---
Source: https://ai-powered.com/skills/tao-run-inference-service
