view article Article Distillation in 2026 (so far): which frontier models use it and how sergiopaniego • 26 days ago • 18
view post Post 7732 Frontier models use distillation as a step of their post-training pipelines. In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL! See translation 3 replies · 👍 14 14 🔥 7 7 ❤️ 3 3 + Reply
leonsarmiento/Ornith-1.0-35B-uncensored-heretic-5bit-XL-mlx Image-Text-to-Text • 7B • Updated 12 days ago • 1.92k • 3
llmfan46/Ornith-1.0-35B-uncensored-heretic Text Generation • 35B • Updated about 1 month ago • 1.57k • 14