Running on CPU Upgrade 607 The Ultimate MoE Training Handbook 🧩 607 A hands-on guide to training Mixture-of-Experts models
Nemotron Labs Dory Collection Open looped language models with elastic depth, serving different compute budgets from a single checkpoint. • 4 items • Updated about 8 hours ago • 29
0bserverx/Qwen3.8-27B-Heretic-Abliterated-Uncensored-GGUF Text Generation • 27B • Updated Sep 20 • 1.13M • 875
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF Text Generation • 12B • Updated Jun 19 • 84k • 1.77k
view post Post 4,687 TRL now supports MOPD (Multi-Teacher On-Policy Distillation) natively❗️Many frontier open models use it. labs train one RL expert per domain and then distill them all into one modelBlog with what it is, who uses it and an experiment you can run on HF Jobs with one commandhttps://huggingface.co/blog/sergiopaniego/mopd-trl See translation 🔥 8 8 👍 4 4 + Reply