MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
Paper • 2508.05257 • Published • 13
Kanta Hayashi
KantaHayashiAI
AI & ML interests
Thinking about LLMs.
Recent Activity
liked a model about 7 hours ago
nlp-waseda/gpt2-xl-japanese liked a dataset 4 days ago
XiaomiMiMo/MiMo-V2.6-RL-oss updated a dataset 5 days ago
KantaHayashiAI/ClimbLab-JaOrganizations
upvoted a paper about 1 year ago
upvoted an article about 1 year ago
Article
Accelerate ND-Parallel: A guide to Efficient Multi-GPU Training
- +3
smohammadi, siro1, winglian, marcsun13, djsaunde
• • 101 upvoted a collection over 2 years ago