Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts Paper • 2609.01100 • Published 28 days ago • 1
MobileMoE Collection a family of on-device MoE language models with sub-billion active parameters (0.3-0.9B active and 1.3-5.3B total) that establish a new Pareto frontier • 11 items • Updated 28 days ago • 27