Rethinking On-Policy Distillation of Large Language Models II: One Training Example
Paper • 2609.04172 • Published • 104
Koty KD
kotyKD
AI & ML interests
None yet
Recent Activity
liked a model about 1 hour ago
Mapika/decider-4b liked a model 6 days ago
a4lg/Qwen3.5-9B-MTP-ONLY-GGUF liked a model 6 days ago
XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9BOrganizations
None yet
upvoted a paper 20 days ago
upvoted an article about 2 months ago
Article
The Optimal Architecture for Small Language Models
codelion
• • 123 upvoted 2
collections 6 months ago
upvoted 2
articles 8 months ago
Article
We Got Claude to Build CUDA Kernels and teach open models!
- +2
burtenshaw, evalstate, merve, pcuenq
• • 158 Article
Custom Kernels for All from Codex and Claude
- +2
burtenshaw, sayakpaul, ariG23498, evalstate
• • 81 upvoted a paper 8 months ago
upvoted a collection 9 months ago
upvoted an article 9 months ago
Article
Fine-tune Llama 3.1 Ultra-Efficiently with Unsloth
mlabonne
• • 375 upvoted 2
articles 11 months ago
Article
The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix
codelion
• • 67 Article
What makes good reasoning data
MiniMax-AI
• • 45 upvoted 3
collections 11 months ago
upvoted a collection about 1 year ago
upvoted 2
articles about 1 year ago
Article
Unsupervised Model Improvement via Internal Coherence Maximization: Outperforming Human-Supervised Methods Through Self-Elicitation
codelion
• • 7 Article
SmolLM3: smol, multilingual, long-context reasoner
- +21
eliebak, cmpatino, anton-l, edbeeching, m-ric, nouamanetazi, akseljoonas, guipenedo, hynky, clefourrier, SaylorTwift, kashif, qgallouedec, hlarcher, glutamatt, Xenova, reach-vb, ngxson, craffel, lewtun, loubnabnl, lvwerra, thomwolf
• • 799 upvoted a paper over 1 year ago
upvoted an article over 1 year ago
Article
OpenEvolve: An Open Source Implementation of Google DeepMind's AlphaEvolve
codelion
• • 74 upvoted a collection over 1 year ago