Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts Paper • 2609.01100 • Published Sep 1 • 1
MobileMoE Collection a family of on-device MoE language models with sub-billion active parameters (0.3-0.9B active and 1.3-5.3B total) that establish a new Pareto frontier • 11 items • Updated Aug 31 • 27
UltraData Collection Ultra Scale, Ultra Quality, Ultra Coverage • 19 items • Updated 18 days ago • 113
ILSP Greek Evaluation Suite Collection A collection of test sets for evaluating base and chat LLMs (incl. VLMs) on Greek generation and understanding capabilities • 25 items • Updated 8 days ago • 7
Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention Paper • 2605.22791 • Published May 21 • 31
🤏 Smol-Data Collection Tried and tested mixes for strong pretraining. Inspired by https://huggingface.co/blog/codelion/optimal-dataset-mixing • 14 items • Updated Mar 2 • 21
Granite 4.0 Nano Language Models Collection Ultra-compact language models designed for the edge and on-device deployment. • 17 items • Updated 18 days ago • 103