Collection by 
Jan 18, 2024
Collections
Discover the best community collections!
Collections trending this week
Collection by 
Jan 27
Collection by 
Jun 12
Collection by 
Feb 27, 2024
-
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Paper • 1701.06538 • Published • 7 -
Sparse Networks from Scratch: Faster Training without Losing Performance
Paper • 1907.04840 • Published • 3 -
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
Paper • 1910.02054 • Published • 11 -
A Mixture of h-1 Heads is Better than h Heads
Paper • 2005.06537 • Published • 2
Collection by 
Jan 18, 2024
Collection by Jan 18, 2024
Collection by 
Mar 11, 2024
Collection by Jan 27
Collection by Jan 27
Collection by Jun 12
Collection by 
Jan 18, 2024
Collection by Feb 27, 2024
-
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Paper • 1701.06538 • Published • 7 -
Sparse Networks from Scratch: Faster Training without Losing Performance
Paper • 1907.04840 • Published • 3 -
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
Paper • 1910.02054 • Published • 11 -
A Mixture of h-1 Heads is Better than h Heads
Paper • 2005.06537 • Published • 2
Collection by 
Mar 14, 2024
Collection by Jan 18, 2024
Collection by 
Oct 31, 2025