itlwas/YandexGPT-5-Lite-8B-pretrain-Q4_K_M-GGUF
8B • Updated • 13
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Organizations
itlwas/Vikhr-YandexGPT-5-Lite-8B-it-Q4_K_M-GGUF
8B • Updated • 36
itlwas/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_K_M-GGUF
2B • Updated • 15
itlwas/QVikhr-2.5-1.5B-Instruct-r-Q4_K_M-GGUF
2B • Updated • 50 • 2
itlwas/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 63
itlwas/QwQ-MathOct-7B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 20
itlwas/QwQ-Math-IO-500M-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 41
itlwas/QWQ-500M-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 24
itlwas/Bitnet-Mistral.0.2-47m-v0.1-Q4_K_M-GGUF
47.9M • Updated • 17
itlwas/Bitnet-Mistral.0.2-47m-v0.2-Q4_K_M-GGUF
47.9M • Updated • 17
itlwas/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF
33B • Updated • 47
itlwas/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-GGUF
15B • Updated • 37 • 1
itlwas/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF
8B • Updated • 7
itlwas/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF
8B • Updated • 106 • 1
itlwas/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF
2B • Updated • 50
itlwas/salt-116k-Q4_K_M-GGUF
1B • Updated • 5
itlwas/salt-asr_wav-uni_1_tts_wav-uni_1-12k-Q4_K_M-GGUF
3B • Updated • 17
itlwas/GWQ2b-Q4_K_M-GGUF
Text Generation • 3B • Updated • 29
itlwas/Custom-KoLLM-13B-v8-Q4_K_M-GGUF
Text Generation • 13B • Updated • 29
itlwas/Custom-KoLLM-13B-v7-Q4_K_M-GGUF
Text Generation • 13B • Updated • 15
itlwas/Custom-KoLLM-13B-v6-Q4_K_M-GGUF
Text Generation • 13B • Updated • 31
itlwas/Custom-KoLLM-13B-v5-Q4_K_M-GGUF
Text Generation • 13B • Updated • 21
itlwas/Custom-KoLLM-13B-v4-Q4_K_M-GGUF
Text Generation • 13B • Updated • 39
itlwas/Custom-KoLLM-13B-v3-Q4_K_M-GGUF
Text Generation • 13B • Updated • 24
itlwas/Custom-KoLLM-13B-v2-Q4_K_M-GGUF
Text Generation • 13B • Updated • 34
itlwas/Custom-KoLLM-13B-v1-Q4_K_M-GGUF
Text Generation • 13B • Updated • 22
itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 36 • 1
itlwas/Llama-3.2-Taiwan-3B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 22
itlwas/QwQ-0.5B-Distilled-SFT-Q4_K_M-GGUF
0.5B • Updated • 20
itlwas/QwQ-0.5B-Distilled-Q4_K_M-GGUF
0.5B • Updated • 31