Running Featured 100 Distilling 100B+ Models 40x Faster with TRL 📝 100 TRL distillation for 100B+ teachers, 40x faster
Running on CPU Upgrade 653 The Ultimate MoE Training Handbook 🧩 653 A hands-on guide to training Mixture-of-Experts models
Running on CPU Upgrade Featured 3.4k The Smol Training Playbook 📚 3.4k The secrets to building world-class LLMs
Running on Zero Agents 563 Seed Voice Conversion 🎤 563 Convert any speech or singing to a new voice instantly
view article Article Mixture of Experts Explained +4 osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq • Dec 11, 2023 • 1.21k
Running Featured 1.47k FineWeb: decanting the web for the finest text data at scale 🍷 1.47k Explore the FineWeb dataset and its creation process
Running 4.14k The Ultra-Scale Playbook 🌌 4.14k The ultimate guide to training LLM on large GPU Clusters
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 Text Generation • 8B • Updated Aug 7, 2024 • 319k • 96