Collection by 
Mar 12, 2024
Collections
Discover the best community collections!
Collections trending this week
Collection by 
Mar 12, 2024
Collection by Mar 13, 2024
-
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Paper • 1701.06538 • Published • 7 -
ST-MoE: Designing Stable and Transferable Sparse Expert Models
Paper • 2202.08906 • Published • 3 -
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Paper • 2403.07816 • Published • 44
Collection by Apr 7, 2024
Collection by 
Mar 14, 2024
-
distilbert/distilbert-base-uncased-finetuned-sst-2-english
Text Classification • 67M • Updated • 3.01M • • 1.01k -
openai/whisper-large-v3
Automatic Speech Recognition • 2B • Updated • 3.45M • • 6.81k -
FacebookAI/roberta-large-mnli
Text Classification • 0.4B • Updated • 214k • • 218 -
google-bert/bert-base-cased
Fill-Mask • 0.1B • Updated • 3.24M • • 399
Collection by Mar 12, 2024
-
LocMoE: A Low-overhead MoE for Large Language Model Training
Paper • 2401.13920 • Published • 2 -
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts
Paper • 2312.07035 • Published • 2 -
DEMix Layers: Disentangling Domains for Modular Language Modeling
Paper • 2108.05036 • Published • 3
Collection by Mar 12, 2024
Collection by Mar 12, 2024
Collection by Apr 6, 2024
-
Scaling Vision with Sparse Mixture of Experts
Paper • 2106.05974 • Published • 4 -
Routers in Vision Mixture of Experts: An Empirical Study
Paper • 2401.15969 • Published • 2 -
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
Paper • 2206.02770 • Published • 4 -
Experts Weights Averaging: A New General Training Scheme for Vision Transformers
Paper • 2308.06093 • Published • 2
Collection by Mar 12, 2024
Collection by Mar 12, 2024
Collection by Mar 12, 2024
-
LocMoE: A Low-overhead MoE for Large Language Model Training
Paper • 2401.13920 • Published • 2 -
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts
Paper • 2312.07035 • Published • 2 -
DEMix Layers: Disentangling Domains for Modular Language Modeling
Paper • 2108.05036 • Published • 3
Collection by Mar 12, 2024
Collection by Mar 12, 2024
Collection by Mar 13, 2024
-
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Paper • 1701.06538 • Published • 7 -
ST-MoE: Designing Stable and Transferable Sparse Expert Models
Paper • 2202.08906 • Published • 3 -
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Paper • 2403.07816 • Published • 44
Collection by Mar 12, 2024
Collection by Apr 7, 2024
Collection by Apr 6, 2024
-
Scaling Vision with Sparse Mixture of Experts
Paper • 2106.05974 • Published • 4 -
Routers in Vision Mixture of Experts: An Empirical Study
Paper • 2401.15969 • Published • 2 -
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
Paper • 2206.02770 • Published • 4 -
Experts Weights Averaging: A New General Training Scheme for Vision Transformers
Paper • 2308.06093 • Published • 2
Collection by Mar 14, 2024
-
distilbert/distilbert-base-uncased-finetuned-sst-2-english
Text Classification • 67M • Updated • 3.01M • • 1.01k -
openai/whisper-large-v3
Automatic Speech Recognition • 2B • Updated • 3.45M • • 6.81k -
FacebookAI/roberta-large-mnli
Text Classification • 0.4B • Updated • 214k • • 218 -
google-bert/bert-base-cased
Fill-Mask • 0.1B • Updated • 3.24M • • 399
Collection by Mar 12, 2024