-
BlackMamba: Mixture of Experts for State-Space Models
Paper • 2402.01771 • Published • 25 -
OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
Paper • 2402.01739 • Published • 28 -
MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
Paper • 2401.15947 • Published • 54 -
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Paper • 2401.06066 • Published • 65
Collections
Discover the best community collections!
Collections trending this week
-
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs
Paper • 2402.12030 • Published • 4 -
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • 7B • Updated • 1.39M • • 3.28k -
meta-llama/Llama-2-7b-chat-hf
Text Generation • 7B • Updated • 125k • 4.96k -
EleutherAI/pythia-160m-deduped
Text Generation • 0.2B • Updated • 141k • 4
-
BlackMamba: Mixture of Experts for State-Space Models
Paper • 2402.01771 • Published • 25 -
OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models
Paper • 2402.01739 • Published • 28 -
MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
Paper • 2401.15947 • Published • 54 -
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Paper • 2401.06066 • Published • 65
-
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs
Paper • 2402.12030 • Published • 4 -
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • 7B • Updated • 1.39M • • 3.28k -
meta-llama/Llama-2-7b-chat-hf
Text Generation • 7B • Updated • 125k • 4.96k -
EleutherAI/pythia-160m-deduped
Text Generation • 0.2B • Updated • 141k • 4