
Launch distributed Megatron-LM training jobs on SLURM clusters with sbatch scripts
- Open source
- 4K GitHub stars
- Developer tools

Launch distributed Megatron-LM training jobs on SLURM clusters with sbatch scripts

Splits a large PR into smaller ones that each need fewer CODEOWNERS reviewer groups

Guides building and reviewing NeMo Fabric adapters that connect agent harnesses

Guides an agent through integrating NeMo Fabric's typed Python SDK into a consumer app

Guides an agent through multi-node Slurm sbatch jobs and debugging their failures

Guides validating and configuring CUDA graph capture in Megatron Bridge training runs

Guides validating and enabling MoE expert-parallel communication overlap

Guides an agent through reducing peak GPU memory in Megatron Bridge training runs

Guides choice of MoE token dispatcher (alltoall, DeepEP, HybridEP) by hardware and EP size

Guides an agent through evidence-gated MoE performance tuning in Megatron Bridge

Guides enabling and verifying TP, DP and PP communication overlap in Megatron-Bridge

Configures fault tolerance, straggler detection and restarts for Megatron Bridge training

Diagnoses NeMo Relay runtime problems like load failures, missing events and scope errors

Guides first-time NeMo Relay users to a matching quick-start and verifies their first

Guides choosing, installing and verifying the NeMo Relay package for an agent or app

Wraps existing tool and LLM calls with NeMo Relay scopes, lifecycle events and middleware

Keeps NeMo Relay scope stacks separate across concurrent requests, tasks and agents

Guides agents in adding typed wrappers and provider codecs to NeMo Relay integrations

Guides an agent through renaming NeMo Flow code and docs to NeMo Relay across languages

Guides configuring and measuring NeMo Relay adaptive plugin telemetry, hints

Guides building reusable NeMo Relay runtime plugins with validation and rollback-safe

Guides choosing and configuring NeMo Relay 0.6/0.7 observability exporters and subscribers

Runs iterative NeMo-RL experiments with git branches and TSV logs as a research ledger

Guides agents on storage, caches, secrets and logs when running NeMo-RL jobs on Brev

Guides agents on NeMo-RL documentation: docs/index.md placement and Google-style

Keeps durable session notes so a coding agent can resume after disconnects

Points your AI coding agent at the NemoClaw docs for setup, policy and troubleshooting

Guides measuring and speeding up a working Newton physics simulation without changing

Guides an agent through setting up, building and debugging Newton physics simulations

Guides an agent through porting HPC code to GPUs, profiled with Nsight Systems
See every kind of AI for developer tools: tools, agents, MCP servers and skills.Ranked: the best AI for developer tools.