itlwas/Apollo-0.5B-Q4_K_M-GGUF
0.5B • Updated • 26
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Organizations
itlwas/HuatuoGPT2-13B-Q4_K_M-GGUF
14B • Updated • 87
itlwas/HuatuoGPT2-7B-Q4_K_M-GGUF
8B • Updated • 14
itlwas/HuatuoGPT-o1-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 34
itlwas/HuatuoGPT-o1-7B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 42
itlwas/Falcon3-10B-Instruct-abliterated-Q4_K_M-GGUF
10B • Updated • 29
itlwas/Vikhr-7b-0.2-Q4_K_M-GGUF
7B • Updated • 21
itlwas/Vikhr-7b-0.1-Q4_K_M-GGUF
7B • Updated • 19
itlwas/Vikhr-7B-instruct_0.2-Q4_K_M-GGUF
7B • Updated • 29
itlwas/Vikhr-7B-instruct_0.4-Q4_K_M-GGUF
8B • Updated • 31
itlwas/Falcon3-7B-Instruct-abliterated-Q4_K_M-GGUF
7B • Updated • 19
itlwas/Falcon3-3B-Instruct-abliterated-Q4_K_M-GGUF
3B • Updated • 68
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B • Updated • 36
itlwas/LLaMA-O1-Base-1127-Q4_K_M-GGUF
8B • Updated • 49
itlwas/OpenCoder-8B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 8
itlwas/ChatYuan-7B-Q4_K_M-GGUF
Text Generation • 7B • Updated • 12
itlwas/SeaLLMs-v3-7B-Chat-Q4_K_M-GGUF
8B • Updated • 14
itlwas/SeaLLMs-v3-7B-Q4_K_M-GGUF
8B • Updated • 20
itlwas/SeaLLMs-v3-1.5B-Chat-Q4_K_M-GGUF
2B • Updated • 53
itlwas/SeaLLMs-v3-1.5B-Q4_K_M-GGUF
2B • Updated • 94
itlwas/SeaLLM-7B-v2.5-Q4_K_M-GGUF
9B • Updated • 40
itlwas/neo_7b_instruct_v0.1-Q4_K_M-GGUF
8B • Updated • 19
itlwas/neo_7b-Q4_K_M-GGUF
8B • Updated • 8
itlwas/Skywork-Critic-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 32
itlwas/Skywork-o1-Open-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 25
itlwas/internlm2_5-20b-chat-Q4_K_M-GGUF
Text Generation • 20B • Updated • 15
itlwas/internlm2_5-20b-Q4_K_M-GGUF
Text Generation • 20B • Updated • 18
itlwas/internlm2_5-7b-chat-1m-Q4_K_M-GGUF
Text Generation • 8B • Updated • 20
itlwas/internlm2_5-7b-chat-Q4_K_M-GGUF
Text Generation • 8B • Updated • 23
itlwas/internlm2_5-1_8b-chat-Q4_K_M-GGUF
Text Generation • 2B • Updated • 13