# Ambient healthcare agent with nemotron voice agent

> Ambient healthcare agent with nemotron voice agent is an open-source agent skill for health and science. Guides an agent through customizing NVIDIA's Nemotron Voice Agent for healthcare intake. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/NVIDIA/skills/tree/main/skills/ambient-healthcare-agent-with-nemotron-voice-agent
- **Repository:** https://github.com/nvidia/skills
- **GitHub stars:** 4,037
- **License:** Apache-2.0
- **Skill name:** ambient-healthcare-agent-with-nemotron-voice-agent
- **Collection:** https://github.com/NVIDIA/skills
- **Categories:** [health and science](https://ai-powered.com/categories/health-and-science)
- **Listing updated:** 2026-11-18

## About

This skill walks an agent through adapting the Generic Pipecat example in an NVIDIA Nemotron Voice Agent checkout into a healthcare voice assistant. It covers two bundled presets, one for appointment booking and one for five-field patient intake, plus a guided path for a custom tool-calling workflow. Each preset is applied as an overlay with a Python script that preserves the existing LLM, ASR and TTS defaults and patches only supported insertion points, so it can be rerun safely.

Before changing anything, the agent checks that the repository layout is compatible, confirms Docker Compose access, and asks the user to choose between public NVIDIA endpoints, local NIMs or existing endpoints. It then runs static and scenario tests, replays bundled fictional conversation histories against the selected model, and requires a microphone-to-speech round trip before handoff. Appointment booking adds a SQLite schedule and deterministic greeting behavior, while patient intake enforces field-collection order and direct tool responses in code.

The skill expects a local clone of the NVA repository, Python 3.10 or later with PyYAML, Git, Docker Compose, and credentials for the chosen model, speech recognition and speech synthesis services. Live tests send fictional patient data to the configured endpoint and can incur charges, so the user must approve each run.

## When your agent uses it

> Customize NVIDIA Nemotron Voice Agent's Generic Pipecat example for healthcare appointment, five-field patient intake, or custom tool-calling workflows without a separate backend.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Runs Python scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/ambient-healthcare-agent-with-nemotron-voice-agent)
- [Asks for: Read, Grep, Glob, Edit, Write, Bash, Env, WebFetch](https://github.com/NVIDIA/skills/blob/HEAD/skills/ambient-healthcare-agent-with-nemotron-voice-agent/SKILL.md)
- [Network calls found in its scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/ambient-healthcare-agent-with-nemotron-voice-agent)
- [License: Apache-2.0](https://github.com/NVIDIA/skills/tree/HEAD/skills/ambient-healthcare-agent-with-nemotron-voice-agent)

## Features

- **Appointment booking preset:** Applies a scheduling workflow backed by a local SQLite appointment database.
- **Patient intake preset:** Collects name, date of birth, symptoms, medications and pharmacy in a fixed order.
- **Custom workflow design:** Guides the definition of fields, tool calls and expected conversations for a new use case.
- **Compatibility preflight:** Checks the NVA checkout structure and required hooks before any file is modified.
- **Idempotent overlay application:** Patches only supported insertion points and preserves existing service defaults.
- **Live conversation validation:** Replays approved fictional histories and checks tool timing and arguments.

## Good for

- Set up a voice agent that books patient appointments
- Build a voice intake form that gathers five patient fields
- Customize the Nemotron Voice Agent Generic example for a new tool-calling workflow
- Validate a healthcare voice agent with scripted fictional conversations

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/NVIDIA/skills.git --path skills/ambient-healthcare-agent-with-nemotron-voice-agent
```

Or copy the folder to `~/.gemini/skills/ambient-healthcare-agent-with-nemotron-voice-agent` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/ambient-healthcare-agent-with-nemotron-voice-agent`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.copilot/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/ambient-healthcare-agent-with-nemotron-voice-agent` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/NVIDIA/skills.git
```

Then copy `skills/skills/ambient-healthcare-agent-with-nemotron-voice-agent` into your agent's skills folder as `ambient-healthcare-agent-with-nemotron-voice-agent`. Agents that support SKILL.md read one folder per skill.

## FAQ

### Which clients can use this skill?

It follows the shared agent skills format, so it applies to all listed clients: Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

### What does it need before it runs?

A compatible NVIDIA Nemotron Voice Agent checkout, Python 3.10 or later with PyYAML, Git, Docker Compose, and credentials for the selected LLM, ASR and TTS services.

### Does it send patient data anywhere?

Only the bundled fictional patient histories are sent, and only after the user approves the preset and the destination endpoint.

### Is this a production healthcare system?

No. The bundled examples are demonstrations and are not clinical decision support or production records systems.

### Can it modify the base Compose file?

The appointment preset creates or merges a docker-compose.override.yml and does not edit the base Compose file.

### How do I install Ambient healthcare agent with nemotron voice agent in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent to use it in all your projects, or to .claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent in one project.

### Does Ambient healthcare agent with nemotron voice agent run scripts?

Yes. It runs Python scripts. Its scripts contain network calls. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Ambient healthcare agent with nemotron voice agent?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Ambient healthcare agent with nemotron voice agent?

The closest alternatives to Ambient healthcare agent with nemotron voice agent are Digital health clinical asr setup, Digital health clinical asr finetune, Nvalchemi toolkit, Nv segment ct finetune and Digital health clinical asr build.

## Where this comes from

- Description: from the skill's own SKILL.md.

## Alternatives

- [Digital health clinical asr setup](https://ai-powered.com/skills/digital-health-clinical-asr-setup): Digital health clinical asr setup is an open-source agent skill for health and science.
- [Digital health clinical asr finetune](https://ai-powered.com/skills/digital-health-clinical-asr-finetune): Digital health clinical asr finetune is an open-source agent skill for health and science.
- [Nvalchemi toolkit](https://ai-powered.com/skills/nvalchemi-toolkit): Nvalchemi toolkit is an open-source agent skill for health and science.
- [Nv segment ct finetune](https://ai-powered.com/skills/nv-segment-ct-finetune): Nv segment ct finetune is an open-source agent skill for health and science.
- [Digital health clinical asr build](https://ai-powered.com/skills/digital-health-clinical-asr-build): Digital health clinical asr build is an open-source agent skill for health and science.
- [Nv reason cxr](https://ai-powered.com/skills/nv-reason-cxr): Nv reason cxr is an open-source agent skill for health and science.
- [Nv generate ct rflow](https://ai-powered.com/skills/nv-generate-ct-rflow): Nv generate ct rflow is an open-source agent skill for health and science.
- [Nv generate vae finetune](https://ai-powered.com/skills/nv-generate-vae-finetune): Nv generate vae finetune is an open-source agent skill for health and science.

---
Source: https://ai-powered.com/skills/ambient-healthcare-agent-with-nemotron-voice-agent
