
Runs Megatron-LM and Megatron Bridge training and checks their loss curves match
- Open source
- 4K GitHub stars
- AI models and LLM tooling


Runs Megatron-LM and Megatron Bridge training and checks their loss curves match

Guides choosing and combining TP, DP, PP, CP and EP degrees for Megatron Bridge training

Guides an agent through enabling Megatron FSDP sharded training in Megatron-Bridge

Guides an agent through reducing peak GPU memory in Megatron Bridge training runs

Hardware-specific MoE training playbooks and candidate parallelism configs for Megatron

Configures CPU offloading in Megatron Bridge to cut GPU memory during training

Guides selective and full activation recompute in Megatron Bridge to cut GPU memory use

Guides long-context MoE training in Megatron Bridge: CP sizing, recompute and dispatcher

Guides choosing and configuring FSDP2, Megatron FSDP, DDP and parallelism settings in NeMo

Guides an agent through building and changing NeMo AutoModel training and eval recipes

Guidance for choosing FSDP or 3D parallelism when training MoE vision-language models

Guides an agent through enabling hierarchical context parallelism in Megatron-Bridge
The closest alternatives to Nemo mbridge recipe recommender are Nemo mbridge mlm bridge training, Nemo mbridge perf parallelism strategies, Nemo mbridge perf megatron fsdp, Nemo mbridge perf memory tuning and Nemo mbridge perf moe hardware configs.
Yes. Nemo mbridge mlm bridge training, Nemo mbridge perf parallelism strategies, Nemo mbridge perf megatron fsdp have a free or open-source option.