MoE - a FALcon6 Collection

FALcon6 's Collections

Deployable Intelligence

MoE

updated Jun 11

Open source MoE

IEITYuan/Yuan2-M32-hf

Text Generation • Updated May 30, 2024 • 173 • 62
allenai/OLMoE-1B-7B-0924

Text Generation • 7B • Updated Oct 19, 2024 • 112k • 153
microsoft/Phi-3.5-MoE-instruct

Text Generation • 42B • Updated Dec 10, 2025 • 138k • 579
Qwen/Qwen1.5-MoE-A2.7B

Text Generation • 14B • Updated Apr 18, 2024 • 463k • 229
deepseek-ai/deepseek-moe-16b-base

Text Generation • 16B • Updated Jan 12, 2024 • 13.3k • 157
deepseek-ai/DeepSeek-V2-Lite

Text Generation • 16B • Updated Jun 25, 2024 • 233k • 190
deepseek-ai/DeepSeek-V2-Lite-Chat

Text Generation • 16B • Updated Jun 25, 2024 • 143k • 148
mistralai/Mixtral-8x7B-v0.1

47B • Updated Jul 24, 2025 • 59k • 1.83k
microsoft/Phi-mini-MoE-instruct

Text Generation • 8B • Updated Dec 10, 2025 • 31.3k • 42
microsoft/Phi-tiny-MoE-instruct

Text Generation • 4B • Updated Dec 10, 2025 • 86.2k • 43
openai/gpt-oss-20b

Text Generation • 21B • Updated Aug 26, 2025 • 6.75M • • 5.11k