# Digital health clinical asr eval

> Digital health clinical asr eval is an open-source agent skill for health and science. Scores clinical ASR transcripts with keyword-focused error metrics and a leaderboard. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/NVIDIA/skills/tree/main/skills/digital-health-clinical-asr-eval
- **Repository:** https://github.com/nvidia/skills
- **GitHub stars:** 4,037
- **License:** Apache-2.0
- **Skill name:** digital-health-clinical-asr-eval
- **Collection:** https://github.com/NVIDIA/skills
- **Categories:** [health and science](https://ai-powered.com/categories/health-and-science)
- **Listing updated:** 2026-11-18

## About

This skill takes a NeMo-format manifest of synthetic clinical audio clips, sends each clip to a hosted speech recognition model, and compares the transcripts against the reference text. It computes word, character, keyword and sentence error rates, with keyword error rate treated as the main signal because it checks whether flagged medical terms come out as contiguous, correctly spelled words.

The results are arranged into a five-section markdown leaderboard that breaks scores down by entity category, pronunciation source, noise level and individual term. A decision guide then suggests whether to expand the term list, fine-tune the model, or harden the evaluation, and it flags pronunciation-coverage gaps as a separate problem from model accuracy.

Users need an NVIDIA API key, the NeMo Riva client and soundfile installed, and audio files present on disk. The workflow discloses that each clip and its reference text are sent to an external NVIDIA service, so it should only be used with synthetic audio rather than real patient recordings. Scoring itself runs locally in pure Python.

## When your agent uses it

> Stage 3 of Clinical ASR Flywheel. Score a NeMo manifest, produce the five-section KER leaderboard (by-ipa_source diagnostic). Not for ASR auth (/riva-asr).

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Instructions only, no scripts](https://github.com/NVIDIA/skills/tree/HEAD/skills/digital-health-clinical-asr-eval)
- [License: Apache-2.0](https://github.com/NVIDIA/skills/tree/HEAD/skills/digital-health-clinical-asr-eval)

## Features

- **Keyword error rate:** Checks whether flagged clinical terms appear intact and in order in each transcript.
- **Standard error metrics:** Reports word, character and sentence error rates alongside the keyword metric.
- **Five-section leaderboard:** Produces a fixed-order markdown report covering headline scores and breakdowns.
- **Pronunciation source split:** Compares results by pronunciation source to reveal coverage gaps in the pipeline.
- **Post-eval routing:** Suggests whether to expand the term list, fine-tune the model, or stop and harden the evaluation.
- **Hosted ASR transcription:** Transcribes each manifest row through a configurable NVIDIA hosted or self-hosted speech model.

## Good for

- Score a manifest of synthetic clinical audio against reference transcripts
- Find which drug or procedure terms a speech model misrecognizes
- Compare keyword error rates across noise levels for clinical dictation
- Decide whether a speech model needs fine-tuning or more term coverage
- Generate a markdown leaderboard for a clinical ASR evaluation cycle

## Install

### Claude Code

Copy the skill folder to `~/.claude/skills/digital-health-clinical-asr-eval` to use it in all your projects:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/digital-health-clinical-asr-eval &&
cp -R "$tmp/skills/digital-health-clinical-asr-eval" ~/.claude/skills/digital-health-clinical-asr-eval &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/digital-health-clinical-asr-eval` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/digital-health-clinical-asr-eval` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/digital-health-clinical-asr-eval &&
cp -R "$tmp/skills/digital-health-clinical-asr-eval" ~/.agents/skills/digital-health-clinical-asr-eval &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/digital-health-clinical-asr-eval` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/digital-health-clinical-asr-eval` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/digital-health-clinical-asr-eval &&
cp -R "$tmp/skills/digital-health-clinical-asr-eval" ~/.cursor/skills/digital-health-clinical-asr-eval &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/digital-health-clinical-asr-eval` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/NVIDIA/skills.git --path skills/digital-health-clinical-asr-eval
```

Or copy the folder to `~/.gemini/skills/digital-health-clinical-asr-eval` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/digital-health-clinical-asr-eval`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/NVIDIA/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/digital-health-clinical-asr-eval &&
cp -R "$tmp/skills/digital-health-clinical-asr-eval" ~/.copilot/skills/digital-health-clinical-asr-eval &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/digital-health-clinical-asr-eval` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/NVIDIA/skills.git
```

Then copy `skills/skills/digital-health-clinical-asr-eval` into your agent's skills folder as `digital-health-clinical-asr-eval`. Agents that support SKILL.md read one folder per skill.

## FAQ

### What does the skill need before it runs?

A NeMo-format manifest with clinical fields, an NVIDIA_API_KEY, the nvidia-riva-client and soundfile packages, and the audio files present on disk.

### Does it send audio anywhere?

Yes. Each clip and its reference text are sent to an NVIDIA NVCF speech service for transcription. The skill recommends using only synthetic audio, not real patient data.

### Does it generate audio or manifests?

No. If the manifest is missing or empty, the skill points the user to a separate build skill for creating one.

### Which speech model does it use by default?

The default is the hosted Parakeet TDT 0.6B v2 model, and environment variables can switch to another hosted or self-hosted model.

### How do I install Digital health clinical asr eval in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/digital-health-clinical-asr-eval to use it in all your projects, or to .claude/skills/digital-health-clinical-asr-eval in one project.

### Does Digital health clinical asr eval run scripts?

No. It is instructions only, with no scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Digital health clinical asr eval?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

### What are the best alternatives to Digital health clinical asr eval?

The closest alternatives to Digital health clinical asr eval are Digital health clinical asr build, Digital health clinical asr setup, Digital health clinical asr finetune, Ambient healthcare agent with nemotron voice agent and Codonfm score.

## Where this comes from

- Description: from the skill's own SKILL.md.

## Alternatives

- [Digital health clinical asr build](https://ai-powered.com/skills/digital-health-clinical-asr-build): Digital health clinical asr build is an open-source agent skill for health and science.
- [Digital health clinical asr setup](https://ai-powered.com/skills/digital-health-clinical-asr-setup): Digital health clinical asr setup is an open-source agent skill for health and science.
- [Digital health clinical asr finetune](https://ai-powered.com/skills/digital-health-clinical-asr-finetune): Digital health clinical asr finetune is an open-source agent skill for health and science.
- [Ambient healthcare agent with nemotron voice agent](https://ai-powered.com/skills/ambient-healthcare-agent-with-nemotron-voice-agent): Ambient healthcare agent with nemotron voice agent is an open-source agent skill for health and science.
- [Codonfm score](https://ai-powered.com/skills/codonfm-score): Codonfm score is an open-source agent skill for health and science.
- [Nv segment ctmr](https://ai-powered.com/skills/nv-segment-ctmr): Nv segment ctmr is an open-source agent skill for health and science.
- [Codonfm finetune](https://ai-powered.com/skills/codonfm-finetune): Codonfm finetune is an open-source agent skill for health and science.
- [Nv generate mr brain finetune](https://ai-powered.com/skills/nv-generate-mr-brain-finetune): Nv generate mr brain finetune is an open-source agent skill for health and science.

---
Source: https://ai-powered.com/skills/digital-health-clinical-asr-eval
