A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.
Michael Lee
mikecovlee
·
AI & ML interests
LLM
Recent Activity
liked a model 7 days ago
mikecovlee/tinymixtral updated a model 7 days ago
mikecovlee/tinymixtral updated a collection 9 days ago
Tiny MixtralOrganizations
