mikecovlee/tinymixtral-v1.1-0.5b
Text Generation • Updated • 262 • 1
Tiny Mixtral
A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.
A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.