Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts
Paper • 2608.20061 • Published • 47
Cheon Jaewon
snob
·
AI & ML interests
Large Language Models
Recent Activity
upvoted a paper about 1 month ago
Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts upvoted a paper 6 months ago
Grounding World Simulation Models in a Real-World Metropolis liked a model 6 months ago
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16Organizations
upvoted a paper about 1 month ago
upvoted a paper 6 months ago
liked 5
models 6 months ago
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16
Text Generation • 124B • Updated • 7.45k • 33
moonshotai/Kimi-K2-Base
Text Generation • 1T • Updated • 11.4k • 306
mistralai/Mistral-Large-3-675B-Base-2512
Updated • 78 • 47
zai-org/GLM-4.5-Base
Text Generation • 358B • Updated • 471 • 61
deepseek-ai/DeepSeek-V3.1-Base
Text Generation • 685B • Updated • 20.5k • 1.01k
liked 5
datasets 7 months ago
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 28.1k • 755
open-thoughts/OpenThoughts-114k
Viewer • Updated • 228k • 90.6k • 926
galaxyMindAiLabs/stem-reasoning-complex
Viewer • Updated • 118k • 481 • 79
nohurry/Opus-4.6-Reasoning-3000x-filtered
Viewer • Updated • 2.33k • 397 • 648
ronantakizawa/github-top-code
Viewer • Updated • 1.12M • 3.93k • 125
updated a
model about 2 years ago
updated 4
datasets over 2 years ago
updated a
model over 2 years ago
updated a
dataset over 2 years ago
updated a
model over 2 years ago