Nemo mbridge perf expert parallel overlap vs Nemo mbridge perf moe optimization workflow
Nemo mbridge perf expert parallel overlap is an open-source agent skill for developer tools. Nemo mbridge perf moe optimization workflow is an open-source agent skill for developer tools.
- Nemo mbridge perf expert parallel overlap is best for enable expert-parallel overlap for a megatron-bridge moe training run.
- Nemo mbridge perf moe optimization workflow is best for diagnose a throughput regression after a config or commit change in a moe training run.
- What it is
- Nemo mbridge perf expert parallel overlap is an open-source agent skill for developer tools.Nemo mbridge perf moe optimization workflow is an open-source agent skill for developer tools.
- Best for
- Enable expert-parallel overlap for a Megatron-Bridge MoE training runDiagnose a throughput regression after a config or commit change in a MoE training run
- Kind
- SkillSkill
- Pricing
- Open sourceOpen source
- Platforms
- Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, GooseClaude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- GitHub stars
- 4K4K
- Last commit
- Nov 2026Nov 2026
- License
- Apache-2.0Apache-2.0
- Open source
- Good for
- Enable expert-parallel overlap for a Megatron-Bridge MoE training run; Check whether an MoE config meets Megatron-Bridge overlap requirements; Diagnose an assertion error raised during comm overlap config validationDiagnose a throughput regression after a config or commit change in a MoE training run; Plan a full MoE throughput tuning sweep for a large expert-parallel model; Choose between alltoall, DeepEP and HybridEP dispatchers for a cluster
What Nemo mbridge perf expert parallel overlap does
Overlap enablement settings
Shows the config flags and Python snippets needed to turn on expert-parallel communication overlap.
Dispatcher backend selection
Explains choosing between the alltoall dispatcher and the flex dispatcher with DeepEP or HybridEP.
Compatibility constraint checklist
Lists parallelism, precision, PyTorch, Transformer Engine and GPU requirements for overlap and delayed wgrad.
Benchmark and profiling method
Describes isolating overlap changes in a performance harness and comparing interval unions in profiles.
Failure diagnosis table
Maps common assertion errors and throughput symptoms to likely causes and fixes.
What Nemo mbridge perf moe optimization workflow does
Measurement contract setup
Lists the versions, topology, batch shape and metric windows that must stay fixed for a valid comparison.
Three Walls diagnosis
Classifies throughput limits as memory, communication, host overhead or compute and maps each to fixes.
Parallel Folding guidance
Explains separate attention and MoE parallel meshes and when to prefer expert parallelism over extra tensor parallelism.
Dispatcher and overlap tuning
Compares alltoall, DeepEP and HybridEP dispatchers and the communication overlap options to test.
Lower-precision candidate matrix
Maps hardware generations to FP8, MXFP8 or NVFP4 candidates that follow a verified BF16 baseline.
Profiling and validation steps
Describes interval-union overlap analysis and the evidence bundle required before accepting a winner.
Nemo mbridge perf expert parallel overlap vs Nemo mbridge perf moe optimization workflow: questions
Is Nemo mbridge perf expert parallel overlap or Nemo mbridge perf moe optimization workflow cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between Nemo mbridge perf expert parallel overlap and Nemo mbridge perf moe optimization workflow?
Nemo mbridge perf expert parallel overlap is an open-source agent skill for developer tools. Nemo mbridge perf moe optimization workflow is an open-source agent skill for developer tools.
