
Guides validating and configuring CUDA graph capture in Megatron Bridge training runs
- Open source
- 4K GitHub stars
- Developer tools


Guides validating and configuring CUDA graph capture in Megatron Bridge training runs

Guides an agent through multi-node Slurm sbatch jobs and debugging their failures

Guides an agent through reducing peak GPU memory in Megatron Bridge training runs

Guides an agent through evidence-gated MoE performance tuning in Megatron Bridge

Guides enabling and verifying TP, DP and PP communication overlap in Megatron-Bridge

Guides validating and enabling MoE expert-parallel communication overlap

Guides configuring and measuring NeMo Relay adaptive plugin telemetry, hints

Practitioner runbook for training and serving large models, from GPUs to NaN loss spikes

Guides choice of MoE token dispatcher (alltoall, DeepEP, HybridEP) by hardware and EP size

Launch distributed Megatron-LM training jobs on SLURM clusters with sbatch scripts

Diagnoses NeMo Relay runtime problems like load failures, missing events and scope errors

Runs iterative NeMo-RL experiments with git branches and TSV logs as a research ledger
The closest alternatives to Nemo mbridge resiliency are Nemo mbridge perf cuda graphs, Nemo mbridge multi node slurm, Nemo mbridge perf memory tuning, Nemo mbridge perf moe optimization workflow and Nemo mbridge perf tp dp comm overlap.
Yes. Nemo mbridge perf cuda graphs, Nemo mbridge multi node slurm, Nemo mbridge perf memory tuning have a free or open-source option.