
Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and veri
- Open source
- 4K GitHub stars

Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and veri

Operational guide for enabling Megatron FSDP in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.

Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activatio

MoE expert-parallel communication overlap in Megatron Bridge

Choose the right MoE token dispatcher (`alltoall`, DeepEP, or HybridEP) for the hardware, EP degree, and optimization stage

Representative, point-in-time MoE training playbooks by hardware and model family

Long-context MoE training guidance for Megatron Bridge

Evidence-gated workflow for MoE performance optimization in Megatron Bridge

Practical guidance for training MoE VLMs in Megatron Bridge

Operational guide for choosing and combining parallelism strategies in Megatron Bridge, including sizing rules, hardware topology mapping, a

Validate and use packed sequences and long-context training in Megatron-Bridge, including offline LLM packing, collate-time VLM packing, Ene

Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and

Recommend and customize Megatron Bridge library and benchmark recipes for a user's model, GPU count, hardware, sequence length, and pretrain

Resiliency features in Megatron Bridge including fault tolerance, straggler detection, in-process restart, preemption, and re-run state mach

Use this skill when NeMo Relay is installed or imported but application-side runtime behavior is missing or incorrect, including load failur

Use this skill when first-time NeMo Relay users want help selecting and following an appropriate quick-start guide or verifying their first

Use this skill when choosing or running NeMo Relay installation for an agent runtime, application language, framework integration, or plugin

Use this skill when an application owns tool or LLM/provider call sites and needs to wrap them with NeMo Relay scopes and managed execution

Use this skill when concurrent requests, async tasks, threads, workers, goroutines, or agents need independent NeMo Relay scope stacks and c

Use this skill when adding NeMo Relay typed wrappers, domain types, or provider codecs while preserving JSON middleware semantics and caller

Use this skill when baseline NeMo Relay instrumentation exists and the user wants to configure or evaluate adaptive plugin behavior, includi

Use this skill when building or packaging reusable NeMo Relay runtime behavior as an embedded configuration component or a manifest-backed `

Use this skill when choosing or configuring NeMo Relay 0.6 or 0.7 observability through the built-in plugin, subscribers, or exporters, incl

Use when searching, extracting, ingesting, or querying a document collection with the NeMo Retriever 26.8.1 CLI, including local LanceDB ind

Use when a task needs to search or add documents through NeMo Retriever MCP.

Autonomous NeMo-RL research agent workflow for directed hypothesis testing and open-ended discovery

Brev instance operating guidance for NeMo-RL agents working in /home/ubuntu/RL with limited workspace disk, a larger /ephemeral volume, and


Manage durable working-session memory for coding agents

Guides human users' AI agents to the NemoClaw docs MCP server and canonical Fern documentation in Markdown form