TAOT: Topology-Aware Optimal Transport for Dynamic Expert Replica Placement in MoE Training Paper • 2608.03676 • Published Aug 4 • 3
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 167
Running 4.05k The Ultra-Scale Playbook 🌌 4.05k The ultimate guide to training LLM on large GPU Clusters