
Guides choosing and configuring FSDP2, Megatron FSDP, DDP and parallelism settings in NeMo
- Open source
- 4K GitHub stars
- AI models and LLM tooling


Guides choosing and configuring FSDP2, Megatron FSDP, DDP and parallelism settings in NeMo

Guides an agent through adding new model architectures to NeMo AutoModel

Runs iterative NeMo-RL experiments with git branches and TSV logs as a research ledger

Sets up NeMo AutoModel job launches on interactive, Slurm and SkyPilot runs

Picks Megatron Bridge training recipes and resizes parallelism for your GPU allocation

Guides an agent through NVIDIA Nemotron embed and rerank retrieval recipes safely

Plans and configures chained Nemotron customization steps like SFT, RL, and evaluation

Guides an agent through enabling Megatron FSDP sharded training in Megatron-Bridge

Guides an agent through deploying and testing NVIDIA Nemotron Speech ASR, TTS and NMT

Guides an agent through improving NVIDIA Riva/NeMo speech recognition for a domain

Hardware-specific MoE training playbooks and candidate parallelism configs for Megatron

Guides choice of MoE token dispatcher (alltoall, DeepEP, HybridEP) by hardware and EP size
The closest alternatives to Nemo automodel recipe development are Nemo automodel distributed training, Nemo automodel model onboarding, Nemo rl auto research, Nemo automodel launcher config and Nemo mbridge recipe recommender.
Yes. Nemo automodel distributed training, Nemo automodel model onboarding, Nemo rl auto research have a free or open-source option.