Don't Drop Dropout: Optimizing Layer Sparsity for Efficient LLM Training and Inference Paper • 2609.05275 • Published Sep 4 • 26
Unlocking Lossless Speedups in LLMs via Discrete Diffusion Paper • 2609.04010 • Published Sep 3 • 114
Don't Drop Dropout: Optimizing Layer Sparsity for Efficient LLM Training and Inference Paper • 2609.05275 • Published Sep 4 • 26
Calibrating Beyond English: Language Diversity for Better Quantized Multilingual LLM Paper • 2601.18306 • Published Jan 26
Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation Paper • 2608.15062 • Published Aug 26 • 12
Llama-GENBA-10B: A Trilingual Large Language Model for German, English and Bavarian Paper • 2509.05668 • Published Sep 6, 2025 • 8
Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindi Paper • 2504.06011 • Published Apr 8, 2025 • 2
Llama-3.1-Sherkala-8B-Chat: An Open Large Language Model for Kazakh Paper • 2503.01493 • Published Mar 3, 2025 • 1
Bilingual Adaptation of Monolingual Foundation Models Paper • 2407.12869 • Published Jul 13, 2024
Cerebras REAP Collection Sparse MoE models compressed using REAP (Router-weighted Expert Activation Pruning) method • 30 items • Updated Feb 25 • 154