Nemotron Post-Training Datasets Collection Collection of datasets used in the post-training phase of Nemotron Nano, Super, Ultra v3, Super 3.5 VL, and Lightning 3.5. • 64 items • Updated 20 days ago • 208
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale Paper • 2406.17557 • Published Jun 25, 2024 • 106
Nemotron-Pre-Training-Datasets Collection Large scale pre-training datasets used in the Nemotron family of models. • 17 items • Updated 10 days ago • 200
view article Article Streaming datasets: 100x More Efficient +3 andito, lhoestq, burtenshaw, pcuenq, merve • Oct 27, 2025 • 87
view article Article The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix codelion • Nov 3, 2025 • 67
view article Article Everything You Need to Know about Knowledge Distillation Kseniase • Mar 6, 2025 • 100
view article Article Apriel-H1: The Surprising Key to Distilling Efficient Reasoning Models ServiceNow-AI • Nov 19, 2025 • 35
view article Article Introducing smolagents: simple agents that write actions in code. +1 m-ric, merve, thomwolf • Dec 31, 2024 • 1.21k