labqoat/squad-0.8b
Image-Text-to-Text • 0.9B • Updated • 48
A team of models on your device: qev-0.8b + a router + 2-bit LoRA experts (games, e2e). Mixture of Quantized LoRA Experts.
Note NVIDIA / CUDA: router + experts, fast engine
Note Apple silicon (MLX), bf16 and 8-bit
Note llama.cpp: CPU, Metal, CUDA, Vulkan
Note The trunk, unchanged: squad-0.8b without experts