MoE models for local inference on two 5060ti 16gb cards + 64 gb ram workstation
-
unsloth/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 35B • Updated • 1.74M • 1.81k -
huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated-MTP-GGUF
Image-Text-to-Text • 36B • Updated • 5.06M • 114 -
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF
Image-Text-to-Text • 177B • Updated • 7.16M • 1.27k -
openbmb/MiniCPM-V-4.7-35B-A3B-gguf
Image-Text-to-Text • 35B • Updated • 413k • 465