# Digital health clinical asr finetune

> Digital health clinical asr finetune is an open-source agent skill for health and science. Fine-tunes Parakeet TDT ASR on clinical vocabulary and measures the gain offline. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/NVIDIA/skills/tree/main/skills/digital-health-clinical-asr-finetune
- **Repository:** https://github.com/nvidia/skills
- **GitHub stars:** 4,037
- **License:** Apache-2.0
- **Skill name:** digital-health-clinical-asr-finetune
- **Collection:** https://github.com/NVIDIA/skills
- **Categories:** [health and science](https://ai-powered.com/categories/health-and-science), [AI models and LLM tooling](https://ai-powered.com/categories/ai-and-llm)
- **Listing updated:** 2026-11-18

## About

This skill guides an agent through a full-model supervised fine-tune of NVIDIA's Parakeet TDT v2 speech recognition model on a clinical transcription manifest. It covers a term-aware train and validation split stratified by entity category, a stock NeMo training script run inside the NeMo container, and a cycle N+1 offline re-evaluation that compares error rates against the previous cycle.

The workflow includes gating rules: fine-tuning is only recommended when the priority category error rate is above a set threshold and the manifest has enough rows. The skill also warns against fine-tuning the streaming Nemotron base and against adapter-style training on TDT and RNNT decoders, and lists hyperparameters that were verified on a small reference manifest.

It expects a CUDA GPU host with roughly 16 to 24 GB of VRAM, the NeMo container, and an NVIDIA API key for certain evaluation and deployment steps. It can optionally hand the resulting model to a companion skill for Riva NIM deployment, and includes a cost-confirmation step before any cloud GPU is provisioned.

## When your agent uses it

> Stage 4 of the Clinical ASR Flywheel. Use when priority KER is above 0.3 to run stock NeMo SFT on Parakeet TDT v2 and offline cycle N+1 re-eval. NOT for generic word boosting (use /finetune-asr).

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Instructions only, no scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/digital-health-clinical-asr-finetune)
- [License: Apache-2.0](https://github.com/NVIDIA/skills/tree/HEAD/skills/digital-health-clinical-asr-finetune)

## Features

- **Stratified train-validation split:** Splits a transcription manifest into row-disjoint train and validation sets balanced by clinical entity category.
- **Stock NeMo fine-tuning run:** Runs NeMo's standard speech-to-text fine-tuning script in the NeMo container with recommended hyperparameters.
- **Offline cycle re-evaluation:** Transcribes audio with the fine-tuned model offline and scores error rates to compare against the previous cycle.
- **Base model guidance:** Recommends a supported Parakeet base and warns against bases whose fine-tuning path is unreliable.
- **Cloud GPU provisioning steps:** Describes renting a GPU host, with a confirmation gate and reminders to stop billing when finished.
- **Troubleshooting guidance:** Lists common failures such as precision errors, out-of-memory issues and manifest path mismatches with fixes.

## Good for

- Fine-tune a speech model on medication and condition names from clinical dictation
- Split a transcription manifest into training and validation sets by entity category
- Re-run offline transcription with a fine-tuned model and compare error rates by category
- Decide whether a fine-tuned speech model is worth keeping after a new evaluation cycle

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/digital-health-clinical-asr-finetune` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/digital-health-clinical-asr-finetune &&
cp -R "$tmp/skills/digital-health-clinical-asr-finetune" ~/.claude/skills/digital-health-clinical-asr-finetune &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/digital-health-clinical-asr-finetune` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/digital-health-clinical-asr-finetune` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/digital-health-clinical-asr-finetune &&
cp -R "$tmp/skills/digital-health-clinical-asr-finetune" ~/.agents/skills/digital-health-clinical-asr-finetune &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/digital-health-clinical-asr-finetune` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/digital-health-clinical-asr-finetune` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/digital-health-clinical-asr-finetune &&
cp -R "$tmp/skills/digital-health-clinical-asr-finetune" ~/.cursor/skills/digital-health-clinical-asr-finetune &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/digital-health-clinical-asr-finetune` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/NVIDIA/skills.git --path skills/digital-health-clinical-asr-finetune
```

Or copy the folder to `~/.gemini/skills/digital-health-clinical-asr-finetune` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/digital-health-clinical-asr-finetune`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/digital-health-clinical-asr-finetune &&
cp -R "$tmp/skills/digital-health-clinical-asr-finetune" ~/.copilot/skills/digital-health-clinical-asr-finetune &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/digital-health-clinical-asr-finetune` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/NVIDIA/skills.git
```

Then copy `skills/skills/digital-health-clinical-asr-finetune` into your agent's skills folder as `digital-health-clinical-asr-finetune`. Agents that support SKILL.md read one folder per skill.

## FAQ

### What does this skill need before it runs?

A cycle-N manifest and evaluation result, a CUDA GPU host with about 16 to 24 GB of VRAM, the NeMo container nvcr.io/nvidia/nemo:25.11.01, and the companion finetune-asr and riva-asr-custom skills installed. An NVIDIA API key is needed for the offline re-evaluation round trip and any NIM deployment.

### Which base model does it recommend for fine-tuning?

It recommends nvidia/parakeet-tdt-0.6b-v2 and says the Nemotron speech streaming base should not be fine-tuned because its training path is unreliable.

### When should the fine-tuning step be used?

Only when the priority category error rate is above 0.3 and the manifest has at least 100 rows, with at least 5 rows per priority category. Otherwise the skill routes back to the manifest build step.

### Does it deploy the model?

Deployment is optional and delegated to the riva-asr-custom skill. The core workflow covers training and offline evaluation.

### Does it provision cloud GPUs automatically?

No. It walks through renting a Brev GPU host but requires the user to type an explicit confirmation before anything is created.

### How do I install Digital health clinical asr finetune in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/digital-health-clinical-asr-finetune to use it in all your projects, or to .claude/skills/digital-health-clinical-asr-finetune in one project.

### Does Digital health clinical asr finetune run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Digital health clinical asr finetune?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Digital health clinical asr finetune?

The closest alternatives to Digital health clinical asr finetune are Nemotron asr finetune, Train sentence transformers, Huggingface LLM trainer, Digital health clinical asr build and Huggingface vision trainer.

## Where this comes from

- Description: from the skill's own SKILL.md.

## Alternatives

- [Nemotron asr finetune](https://ai-powered.com/skills/nemotron-asr-finetune): Nemotron asr finetune is an open-source agent skill for ai models and llm tooling.
- [Train sentence transformers](https://ai-powered.com/skills/train-sentence-transformers): Train sentence transformers is an open-source agent skill for knowledge and memory.
- [Huggingface LLM trainer](https://ai-powered.com/skills/huggingface-llm-trainer): Huggingface LLM trainer is an open-source agent skill for ai models and llm tooling.
- [Digital health clinical asr build](https://ai-powered.com/skills/digital-health-clinical-asr-build): Digital health clinical asr build is an open-source agent skill for health and science.
- [Huggingface vision trainer](https://ai-powered.com/skills/huggingface-vision-trainer): Huggingface vision trainer is an open-source agent skill for ai models and llm tooling.
- [Tao train rtdetr](https://ai-powered.com/skills/tao-train-rtdetr): Tao train rtdetr is an open-source agent skill for ai models and llm tooling.
- [Digital health clinical asr eval](https://ai-powered.com/skills/digital-health-clinical-asr-eval): Digital health clinical asr eval is an open-source agent skill for health and science.
- [Nemotron speech](https://ai-powered.com/skills/nemotron-speech): Nemotron speech is an open-source agent skill for design and media.

---
Source: https://ai-powered.com/skills/digital-health-clinical-asr-finetune
