💣Qwen

GGUF-Models 's Collections

🦊Ahma

🦉Athena

🏹Apollo

updated Mar 8

Upvote

itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 54
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF

33B • Updated Dec 20, 2024 • 20
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Dec 20, 2024 • 145 • 1
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 20, 2024 • 131
itlwas/Qwen2.5-Coder-1.5B-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 20, 2024 • 250
itlwas/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 20, 2024 • 145
itlwas/Qwen2.5-Coder-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 20, 2024 • 87
itlwas/Qwen2.5-Coder-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 2.65k • 7
itlwas/Qwen2.5-Coder-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Dec 20, 2024 • 101
itlwas/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

Text Generation • 15B • Updated Dec 20, 2024 • 1.75k • 1
itlwas/Qwen2.5-Coder-32B-Q4_K_M-GGUF

Text Generation • 33B • Updated Dec 20, 2024 • 52
itlwas/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • 33B • Updated Dec 20, 2024 • 22
itlwas/Qwen1.5-0.5B-Q4_K_M-GGUF

Text Generation • 0.6B • Updated Jan 5, 2025 • 31
itlwas/Qwen1.5-0.5B-Chat-Q4_K_M-GGUF

Text Generation • 0.6B • Updated Jan 5, 2025 • 22
itlwas/Qwen1.5-1.8B-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 28
itlwas/Qwen1.5-1.8B-Chat-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 56
itlwas/Qwen1.5-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Jan 5, 2025 • 49
itlwas/Qwen1.5-4B-Chat-Q4_K_M-GGUF

Text Generation • 4B • Updated Jan 5, 2025 • 25
itlwas/Qwen1.5-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 22
itlwas/Qwen1.5-7B-Chat-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 50
itlwas/Qwen1.5-14B-Q4_K_M-GGUF

Text Generation • 14B • Updated Jan 5, 2025 • 20
itlwas/Qwen1.5-14B-Chat-Q4_K_M-GGUF

Text Generation • 14B • Updated Jan 5, 2025 • 41
itlwas/Qwen1.5-32B-Q4_K_M-GGUF

Text Generation • 33B • Updated Jan 5, 2025 • 28
itlwas/Qwen1.5-32B-Chat-Q4_K_M-GGUF

Text Generation • 33B • Updated Jan 5, 2025 • 24
itlwas/Qwen2.5-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jan 5, 2025 • 15
itlwas/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jan 5, 2025 • 45
itlwas/Qwen2.5-1.5B-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 35
itlwas/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 49
itlwas/Qwen2.5-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 47
itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 94 • 1
itlwas/Qwen2.5-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 43
itlwas/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 14
itlwas/Qwen2.5-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 33
itlwas/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • 15B • Updated Jan 5, 2025 • 20
itlwas/Qwen2.5-32B-Q4_K_M-GGUF

Text Generation • 33B • Updated Jan 5, 2025 • 26
itlwas/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • 33B • Updated Jan 5, 2025 • 27
itlwas/Qwen2-0.5B-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jan 5, 2025 • 20
itlwas/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Jan 5, 2025 • 19
itlwas/Qwen2-1.5B-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 16
itlwas/Qwen2-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 5, 2025 • 29
itlwas/Qwen2-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 29
itlwas/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 5, 2025 • 22
itlwas/Qwen2-Math-1.5B-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 6, 2025 • 20
itlwas/Qwen2-Math-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 6, 2025 • 38
itlwas/Qwen2-Math-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 31
itlwas/Qwen2-Math-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 19
itlwas/Qwen2.5-Math-1.5B-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 6, 2025 • 13
itlwas/Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Jan 6, 2025 • 23
itlwas/Qwen2.5-Math-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 55
itlwas/Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 76
matrixportalx/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 9, 2025 • 730 • 1
matrixportalx/Qwen2.5-7B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Jan 8, 2025 • 31
NikolayKozloff/Dolphin3.0-Qwen2.5-3b-Q8_0-GGUF

3B • Updated Jan 6, 2025 • 24 • 1
NikolayKozloff/FuseChat-Qwen-2.5-7B-Instruct-Q8_0-GGUF

8B • Updated Dec 13, 2024 • 14 • 1
NikolayKozloff/qwen2.5-7b-ins-v3-Q8_0-GGUF

8B • Updated Oct 10, 2024 • 23 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-32b-Q4_K_M-GGUF

33B • Updated Sep 29, 2024 • 29 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-32b-Q3_K_S-GGUF

33B • Updated Sep 29, 2024 • 73 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-32b-Q2_K-GGUF

33B • Updated Sep 29, 2024 • 31 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-14b-Q4_K_S-GGUF

15B • Updated Sep 29, 2024 • 28 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-14b-Q4_K_M-GGUF

15B • Updated Sep 29, 2024 • 25 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-14b-Q5_K_S-GGUF

15B • Updated Sep 29, 2024 • 62 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-0.5b-Q8_0-GGUF

0.6B • Updated Sep 29, 2024 • 25 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-1.5b-Q8_0-GGUF

2B • Updated Sep 29, 2024 • 27 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-3b-Q8_0-GGUF

3B • Updated Sep 29, 2024 • 29 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-14b-Q5_K_M-GGUF

15B • Updated Sep 29, 2024 • 22 • 1
NikolayKozloff/Replete-LLM-V2.5-Qwen-7b-Q8_0-GGUF

8B • Updated Sep 29, 2024 • 25 • 1
NikolayKozloff/polanka-qwen2-1.5b-v0.1-ckpt_401000-Q8_0-GGUF

2B • Updated Sep 26, 2024 • 18 • 1
NikolayKozloff/Qwen2-Math-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Aug 8, 2024 • 32 • 1
NikolayKozloff/Replete-LLM-Qwen2-7b_Beta-Preview-Q8_0-GGUF

8B • Updated Jul 26, 2024 • 65 • 2
NikolayKozloff/Einstein-v7-Qwen2-7B-Q8_0-GGUF

8B • Updated Jul 9, 2024 • 17 • 1
NikolayKozloff/Qwen2-1.5B-ITA-Instruct-Q8_0-GGUF

2B • Updated Jul 2, 2024 • 25 • 1
NikolayKozloff/Replete-Coder-Qwen2-1.5b-Q4_0-GGUF

2B • Updated Jun 24, 2024 • 29 • 1
NikolayKozloff/Replete-Coder-Qwen2-1.5b-Q5_0-GGUF

2B • Updated Jun 24, 2024 • 36 • 1
NikolayKozloff/Replete-Coder-Qwen2-1.5b-Q8_0-GGUF

2B • Updated Jun 24, 2024 • 34 • 1
NikolayKozloff/leniachat-qwen2-1.5B-v0-Q8_0-GGUF

2B • Updated Jun 19, 2024 • 20 • 1
NikolayKozloff/Qwen2-1.5B-Ita-Q8_0-GGUF

2B • Updated Jun 19, 2024 • 15 • 1
NikolayKozloff/polanka-qwen2-3b-v0.1-Q8_0-GGUF

3B • Updated Jun 19, 2024 • 24 • 1
NikolayKozloff/GermanEduScorer-Qwen2-1.5b-Q8_0-GGUF

2B • Updated Jun 19, 2024 • 21 • 1
NikolayKozloff/Ko-Qwen2-7B-Instruct-Q8_0-GGUF

8B • Updated Jun 12, 2024 • 26 • 3
NikolayKozloff/Qwen2-7B-Instruct-deccp-Q8_0-GGUF

8B • Updated Jun 10, 2024 • 18 • 1
NikolayKozloff/Qwen2-7B-Q5_0-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 45 • 1
NikolayKozloff/Qwen2-7B-Q4_0-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 38 • 1
NikolayKozloff/Qwen2-7B-Q4_K_S-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 32 • 1
NikolayKozloff/Qwen2-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 53 • 1
NikolayKozloff/Qwen2-7B-Q5_K_S-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 57 • 1
NikolayKozloff/Qwen2-7B-Q5_K_M-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 45 • 2
NikolayKozloff/Qwen2-7B-Q6_K-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 56 • 1
NikolayKozloff/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 42 • 1
NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 198 • 6
NikolayKozloff/Qwen2-7B-Q8_0-GGUF

Text Generation • 8B • Updated Jun 6, 2024 • 67 • 2
NikolayKozloff/Qwen-portuguese-luana-7b-GGUF

Text Generation • 8B • Updated Apr 17, 2024 • 31 • 1
NikolayKozloff/SauerkrautLM-Qwen-32b-Q3_K_S-GGUF

33B • Updated Apr 14, 2024 • 26 • 3
NikolayKozloff/CodeQwen1.5-7B-Q8_0-GGUF

Text Generation • 7B • Updated Apr 16, 2024 • 121 • 4
itlwas/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

2B • Updated Jan 25, 2025 • 51
itlwas/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF

8B • Updated Jan 25, 2025 • 87 • 1
itlwas/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-GGUF

15B • Updated Jan 25, 2025 • 39 • 1
itlwas/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF

33B • Updated Jan 25, 2025 • 41
itlwas/QWQ-500M-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Feb 2, 2025 • 20
itlwas/QwQ-Math-IO-500M-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Feb 2, 2025 • 37
itlwas/QwQ-MathOct-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 2, 2025 • 14
matrixportalx/Qwen2.5-Math-7B-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 39
matrixportalx/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

2B • Updated Feb 28, 2025 • 561
matrixportalx/Qwen2.5-7B-HomerCreative-Mix-GGUF

8B • Updated Jan 22, 2025 • 60
matrixportalx/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

2B • Updated Jan 21, 2025 • 56 • 1
matrixportalx/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF

8B • Updated Jan 21, 2025 • 87
matrixportalx/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 40
matrixportalx/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 32
matrixportalx/QwQ-LCoT2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 37
matrixportalx/Bio-Medical-3B-CoT-012025-GGUF

3B • Updated Jan 23, 2025 • 125 • 1
matrixportalx/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jan 23, 2025 • 26
matrixportalx/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Feb 11, 2025 • 92
matrixportalx/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Jan 23, 2025 • 42
matrixportalx/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jan 23, 2025 • 36
matrixportalx/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Feb 28, 2025 • 24
itlwas/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_K_M-GGUF

2B • Updated Feb 11, 2025 • 13
itlwas/QVikhr-2.5-1.5B-Instruct-r-Q4_K_M-GGUF

2B • Updated Feb 11, 2025 • 48 • 2
matrixportalx/DeepSeek-R1-Distill-Qwen-7B-IQ3_XXS-GGUF

8B • Updated Feb 13, 2025 • 44
matrixportalx/DeepSeek-R1-Distill-Qwen-7B-IQ3_M-GGUF

8B • Updated Feb 13, 2025 • 83
matrixportalx/Qwen2.5-7B-Instruct-IQ3_XXS-GGUF

Text Generation • 8B • Updated Feb 13, 2025 • 29
matrixportalx/Qwen2.5-7B-Instruct-IQ4_XS-GGUF

Text Generation • 8B • Updated Feb 13, 2025 • 72
matrixportalx/DeepSeek-R1-Distill-Qwen-7B-GGUF

8B • Updated Feb 13, 2025 • 502 • 1
matrixportalx/Qwen2.5-7B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Feb 13, 2025 • 27
matrixportalx/Qwen2-VL-2B-Instruct-GGUF

Image-Text-to-Text • 2B • Updated Feb 11, 2025 • 56
matrixportalx/Qwen2.5-7B-CelestialHarmony-1M-GGUF

8B • Updated Feb 3, 2025 • 41 • 1
matrixportalx/Qwen2.5-7B-MixStock-V0.1-GGUF

8B • Updated Feb 6, 2025 • 50
matrixportalx/Qwen-2.5-7b-S1k-GGUF

8B • Updated Feb 19, 2025 • 110
matrixportalx/Einstein-v7-Qwen2-7B-GGUF

8B • Updated Feb 19, 2025 • 171
itlwas/Qwen3-0.6B-Q4_K_M-GGUF

Text Generation • 0.8B • Updated Apr 29, 2025 • 67
itlwas/Qwen3-1.7B-Q4_K_M-GGUF

Text Generation • 2B • Updated Apr 29, 2025 • 44
itlwas/Qwen3-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 29, 2025 • 131
itlwas/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 60
itlwas/Qwen3-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Apr 29, 2025 • 26
itlwas/Qwen3-1.7B-Base-Q4_K_M-GGUF

2B • Updated Apr 29, 2025 • 33
itlwas/Qwen3-4B-Base-Q4_K_M-GGUF

4B • Updated Apr 29, 2025 • 57
itlwas/Qwen3-8B-Base-Q4_K_M-GGUF

8B • Updated Apr 29, 2025 • 107
itlwas/Qwen3-14B-Base-Q4_K_M-GGUF

15B • Updated Apr 29, 2025 • 19
itlwas/Qwen3-0.6B-Base-Q4_K_M-GGUF

Text Generation • 0.6B • Updated Apr 29, 2025 • 58

Upvote

Collection guide
Browse collections