Data-free VQ of DeepSeek-V4-Flash for Apple Silicon. One rung, 3.2 bpw, 6-bit MTP head. Runs on Knurlogic (macOS). Built with VQLab.
Noah Zelezny
TheDrainFlorist
AI & ML interests
None yet
Recent Activity
updated a model about 1 month ago
TheDrainFlorist/gemma-4-e4b-it-VQ-PLE updated a model about 1 month ago
TheDrainFlorist/gemma-4-26b-a4b-it-VQ-6.2bpw updated a model about 1 month ago
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpwOrganizations
None yet
models 23
TheDrainFlorist/gemma-4-e4b-it-VQ-PLE
Image-Text-to-Text • 6B • Updated • 77
TheDrainFlorist/gemma-4-26b-a4b-it-VQ-6.2bpw
Image-Text-to-Text • 7B • Updated • 115
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-5.5bpw
Text Generation • 60B • Updated • 254
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-4.4bpw
Text Generation • 89B • Updated • 335 • 2
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-3.2bpw
Text Generation • 43B • Updated • 271 • 1
TheDrainFlorist/Qwen3.8-Flash-Next-VQ-2.1bpw
Text Generation • 24B • Updated • 610 • 5
TheDrainFlorist/Qwen3.8-27B-VQ-4.8bpw
Text Generation • 13B • Updated • 160
TheDrainFlorist/Qwen3.8-27B-VQ-4.5bpw
Text Generation • 19B • Updated • 145 • 1
TheDrainFlorist/Qwen3.8-27B-VQ-3.9bpw
Text Generation • 12B • Updated • 281
TheDrainFlorist/Qwen3.6-35B-A3B-VQ-5.4bpw
Text Generation • 8B • Updated • 229
datasets 0
None public yet