view post Post 676 Posted an article about training a small MoE from scratch with the efforts of the community!Model vovaRL/NanoColibri-InstructArticle https://huggingface.co/blog/vovaRL/hybernation-models-blog See translation 1 reply · 🤗 3 3 + Reply
view post Post 676 Posted an article about training a small MoE from scratch with the efforts of the community!Model vovaRL/NanoColibri-InstructArticle https://huggingface.co/blog/vovaRL/hybernation-models-blog See translation 1 reply · 🤗 3 3 + Reply
view article Article Training a 2.7B MoE from scratch for $200, one GPU at a time vovaRL • about 17 hours ago • 1
view article Article Training a 2.7B MoE from scratch for $200, one GPU at a time vovaRL • about 17 hours ago • 1