
Picks Megatron Bridge training recipes and resizes parallelism for your GPU allocation
- Open source
- 4K GitHub stars
- AI models and LLM tooling


Picks Megatron Bridge training recipes and resizes parallelism for your GPU allocation

Runs Megatron-LM and Megatron Bridge training and checks their loss curves match

Guides choosing and configuring FSDP2, Megatron FSDP, DDP and parallelism settings in NeMo

Guides an agent through enabling hierarchical context parallelism in Megatron-Bridge

Guides choosing and combining TP, DP, PP, CP and EP degrees for Megatron Bridge training

Guides enabling and verifying TP, DP and PP communication overlap in Megatron-Bridge

Configures CPU offloading in Megatron Bridge to cut GPU memory during training

Guidance for choosing FSDP or 3D parallelism when training MoE vision-language models

Guides Megatron-Bridge sequence packing and long-context training setup and validation

Guides an agent through reducing peak GPU memory in Megatron Bridge training runs

Guides long-context MoE training in Megatron Bridge: CP sizing, recompute and dispatcher

Guides selective and full activation recompute in Megatron Bridge to cut GPU memory use
The closest alternatives to Nemo mbridge perf megatron fsdp are Nemo mbridge recipe recommender, Nemo mbridge mlm bridge training, Nemo automodel distributed training, Nemo mbridge perf hierarchical context parallel and Nemo mbridge perf parallelism strategies.
Yes. Nemo mbridge recipe recommender, Nemo mbridge mlm bridge training, Nemo automodel distributed training have a free or open-source option.