Skip to content
Skill

Ambient healthcare agent with nemotron voice agent

Guides an agent through customizing NVIDIA's Nemotron Voice Agent for healthcare intake

Install
Scripts
Python
Platforms
Claude Code, Codex, Cursor
GitHub stars
4K
Last commit
3 days ago
License
Apache-2.0
Listing updated
1 day ago

Similar skills

About Ambient healthcare agent with nemotron voice agent

Ambient healthcare agent with nemotron voice agent is an open-source agent skill for health and science. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

This skill walks an agent through adapting the Generic Pipecat example in an NVIDIA Nemotron Voice Agent checkout into a healthcare voice assistant. It covers two bundled presets, one for appointment booking and one for five-field patient intake, plus a guided path for a custom tool-calling workflow. Each preset is applied as an overlay with a Python script that preserves the existing LLM, ASR and TTS defaults and patches only supported insertion points, so it can be rerun safely.

Before changing anything, the agent checks that the repository layout is compatible, confirms Docker Compose access, and asks the user to choose between public NVIDIA endpoints, local NIMs or existing endpoints. It then runs static and scenario tests, replays bundled fictional conversation histories against the selected model, and requires a microphone-to-speech round trip before handoff. Appointment booking adds a SQLite schedule and deterministic greeting behavior, while patient intake enforces field-collection order and direct tool responses in code.

The skill expects a local clone of the NVA repository, Python 3.10 or later with PyYAML, Git, Docker Compose, and credentials for the chosen model, speech recognition and speech synthesis services. Live tests send fictional patient data to the configured endpoint and can incur charges, so the user must approve each run.

When your agent uses it

Customize NVIDIA Nemotron Voice Agent's Generic Pipecat example for healthcare appointment, five-field patient intake, or custom tool-calling workflows without a separate backend.

From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.

What it can access

From a static check of its 42 files (352 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.

Check another skill before you install it.

Install

Copy the skill folder to ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent to use it in all your projects:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"

For one project only, put the folder in .claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent inside it instead.

Claude Code docs on skills

Copy the skill folder to ~/.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent to use it in every repository:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"

For one repository only, put the folder in .agents/skills/ambient-healthcare-agent-with-nemotron-voice-agent inside it instead.

Codex docs on skills

Copy the skill folder to ~/.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent to use it in every project:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"

For one project only, put the folder in .cursor/skills/ambient-healthcare-agent-with-nemotron-voice-agent inside it instead.

Cursor docs on skills

Run in a terminal (add --scope workspace to install it for the current workspace only):

gemini skills install https://github.com/NVIDIA/skills.git --path skills/ambient-healthcare-agent-with-nemotron-voice-agent

Or copy the folder to ~/.gemini/skills/ambient-healthcare-agent-with-nemotron-voice-agent yourself.

Gemini CLI docs on skills

For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/ambient-healthcare-agent-with-nemotron-voice-agent:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
cp -R "$tmp/skills/ambient-healthcare-agent-with-nemotron-voice-agent" ~/.copilot/skills/ambient-healthcare-agent-with-nemotron-voice-agent &&
rm -rf "$tmp"

For one project only, put the folder in .github/skills/ambient-healthcare-agent-with-nemotron-voice-agent inside it instead.

VS Code docs on skills

Get the folder:

git clone --depth 1 https://github.com/NVIDIA/skills.git

Then copy skills/skills/ambient-healthcare-agent-with-nemotron-voice-agent into your agent's skills folder as ambient-healthcare-agent-with-nemotron-voice-agent. Agents that support SKILL.md read one folder per skill.

The SKILL.md format

What it does

Appointment booking preset
Applies a scheduling workflow backed by a local SQLite appointment database.
Patient intake preset
Collects name, date of birth, symptoms, medications and pharmacy in a fixed order.
Custom workflow design
Guides the definition of fields, tool calls and expected conversations for a new use case.
Compatibility preflight
Checks the NVA checkout structure and required hooks before any file is modified.
Idempotent overlay application
Patches only supported insertion points and preserves existing service defaults.
Live conversation validation
Replays approved fictional histories and checks tool timing and arguments.

Good for

  • Set up a voice agent that books patient appointments
  • Build a voice intake form that gathers five patient fields
  • Customize the Nemotron Voice Agent Generic example for a new tool-calling workflow
  • Validate a healthcare voice agent with scripted fictional conversations

Ambient healthcare agent with nemotron voice agent FAQ

Which clients can use this skill?

It follows the shared agent skills format, so it applies to all listed clients: Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

What does it need before it runs?

A compatible NVIDIA Nemotron Voice Agent checkout, Python 3.10 or later with PyYAML, Git, Docker Compose, and credentials for the selected LLM, ASR and TTS services.

Does it send patient data anywhere?

Only the bundled fictional patient histories are sent, and only after the user approves the preset and the destination endpoint.

Is this a production healthcare system?

No. The bundled examples are demonstrations and are not clinical decision support or production records systems.

Can it modify the base Compose file?

The appointment preset creates or merges a docker-compose.override.yml and does not edit the base Compose file.

How do I install Ambient healthcare agent with nemotron voice agent in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent to use it in all your projects, or to .claude/skills/ambient-healthcare-agent-with-nemotron-voice-agent in one project.

Does Ambient healthcare agent with nemotron voice agent run scripts?

Yes. It runs Python scripts. Its scripts contain network calls. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

Which AI agents can use Ambient healthcare agent with nemotron voice agent?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

What are the best alternatives to Ambient healthcare agent with nemotron voice agent?

The closest alternatives to Ambient healthcare agent with nemotron voice agent are Digital health clinical asr setup, Digital health clinical asr finetune, Nvalchemi toolkit, Nv segment ct finetune and Digital health clinical asr build.

Where this comes from

  • Description: from the skill's own SKILL.md.

More from NVIDIA/skills

  1. Adds autotuning with cached config selection to CuTile GPU kernels

    • Open source
    • 4K GitHub stars
    • Developer tools
  2. Guides an agent to write, debug and validate cuTile GPU kernels in Python

    • Open source
    • 4K GitHub stars
    • Developer tools
  3. Composes and deploys an NVIDIA VSS vision stack with captioning, detection, search

    • Open source
    • 4K GitHub stars
    • Design and media