fraQtl/Qwen3.5-4B-NPU-GGUF
4B • Updated • 229
AI & ML interests
KV cache compression, inference optimization, model compression
Recent Activity
fraQtl/LFM2-1.2B-Hi-Fi-GGUF
1B • Updated • 1.28k
fraQtl/qwen3-4b-instruct-2507-kv-sidecars
Updated • 21 • 1
fraQtl/mistral-7b-instruct-v0.3-kv-sidecars
Updated • 14
fraQtl/mistral-nemo-instruct-2407-kv-sidecars
Updated
fraQtl/fraqtl-sm80-runtime
Updated • 15
fraQtl/fraqtl-membrane-llamacpp-runtime
Updated
fraQtl/Qwen3.8-27B-Hi-Fi-GGUF
Text Generation • 27B • Updated • 123 • 2
fraQtl/Qwen3.6-35B-A3B-compressed
Text Generation • 2B • Updated • 448 • 6
fraQtl/Qwen3.6-35B-A3B-Hi-Fi-MTP-runtime
Text Generation • 36B • Updated • 263 • 2
fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF
Text Generation • 35B • Updated • 128 • 4
fraQtl/Qwen3-4B-Instruct-2507-Hi-Fi-GGUF
Text Generation • 4B • Updated • 112
fraQtl/Llama-3.2-1B-Instruct-Hi-Fi-GGUF
Text Generation • 1B • Updated • 69
fraQtl/Llama-3.1-8B-Instruct-Hi-Fi-GGUF
Text Generation • 8B • Updated • 63
fraQtl/Gemma-4-E4B-it-Hi-Fi-GGUF
Text Generation • 8B • Updated • 492
fraQtl/Gemma-4-E2B-it-Hi-Fi-GGUF
Text Generation • 5B • Updated • 1.09k • 20
fraQtl/Gemma-4-26B-A4B-it-Nano-GGUF
Text Generation • 27B • Updated • 457 • 2
fraQtl/Gemma-4-26B-A4B-it-Hi-Fi-GGUF
Text Generation • 25B • Updated • 100 • 1