
Guides an agent through evidence-gated MoE performance tuning in Megatron Bridge
- Open source
- 4K GitHub stars
- Developer tools


Guides an agent through evidence-gated MoE performance tuning in Megatron Bridge

Configures fault tolerance, straggler detection and restarts for Megatron Bridge training

Guides an agent through reducing peak GPU memory in Megatron Bridge training runs

Guides validating and enabling MoE expert-parallel communication overlap

Guides an agent through multi-node Slurm sbatch jobs and debugging their failures

Guides enabling and verifying TP, DP and PP communication overlap in Megatron-Bridge

Guides choice of MoE token dispatcher (alltoall, DeepEP, HybridEP) by hardware and EP size

Practitioner runbook for training and serving large models, from GPUs to NaN loss spikes

Launch distributed Megatron-LM training jobs on SLURM clusters with sbatch scripts

Guides configuring and measuring NeMo Relay adaptive plugin telemetry, hints

Profiles a DeepStream pipeline with Nsight Systems and tunes its configs from the results

Guides writing and debugging GPU-accelerated RDKit cheminformatics code with nvMolKit
The closest alternatives to Nemo mbridge perf cuda graphs are Nemo mbridge perf moe optimization workflow, Nemo mbridge resiliency, Nemo mbridge perf memory tuning, Nemo mbridge perf expert parallel overlap and Nemo mbridge multi node slurm.
Yes. Nemo mbridge perf moe optimization workflow, Nemo mbridge resiliency, Nemo mbridge perf memory tuning have a free or open-source option.