Running on CPU Upgrade 397 The Ultimate MoE Training Handbook 🧩 397 A hands-on guide to training Mixture-of-Experts models
view article Article Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP +3 ariG23498, ror, sergiopaniego, pcuenq, sayakpaul • Jun 11 • 65
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 189
Nemotron Post-Training Datasets Collection Collection of datasets used in the post-training phase of Nemotron Nano, Super, Ultra v3, Super 3.5 VL, and Lightning 3.5. • 64 items • Updated 19 days ago • 208
Running 123 Unlocking On-Policy Distillation for Any Model Family 📝 123 Explore on‑policy distillation visualizations for any model
view article Article Continuous batching from first principles +1 ror, ArthurZ, mcpotato • Nov 25, 2025 • 462
view article Article Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries +7 aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, nouamanetazi, lvwerra, sergiopaniego • Mar 10 • 198
Running 4.13k The Ultra-Scale Playbook 🌌 4.13k The ultimate guide to training LLM on large GPU Clusters