CHE-72/Qwen1.5-4B-Chat-Q6_K-GGUF
Text Generation • 4B • Updated • 19
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
25,550
Active filters: llama-cpp
CHE-72/Qwen1.5-4B-Chat-Q5_K_M-GGUF
Text Generation • 4B • Updated • 35
CHE-72/Qwen1.5-4B-Chat-Q5_K_S-GGUF
Text Generation • 4B • Updated • 13
CHE-72/Qwen1.5-4B-Chat-Q5_0-GGUF
Text Generation • 4B • Updated • 17
CHE-72/Qwen1.5-4B-Chat-Q4_K_M-GGUF
Text Generation • 4B • Updated • 33
CHE-72/Qwen1.5-4B-Chat-Q4_K_S-GGUF
Text Generation • 4B • Updated • 33
CHE-72/Qwen1.5-4B-Chat-Q4_0-GGUF
Text Generation • 4B • Updated • 19
CHE-72/Qwen1.5-4B-Chat-Q3_K_L-GGUF
Text Generation • 4B • Updated • 22
CHE-72/Qwen1.5-4B-Chat-Q3_K_M-GGUF
Text Generation • 4B • Updated • 70
CHE-72/Qwen1.5-4B-Chat-Q3_K_S-GGUF
Text Generation • 4B • Updated • 17
CHE-72/Qwen1.5-4B-Chat-Q2_K-GGUF
Text Generation • 4B • Updated • 99
newsletter/buddhi-128k-chat-7b-Q6_K-GGUF
Text Generation • 7B • Updated • 11
Nokilos/suzume-llama-3-8B-multilingual-Q4_K_M-GGUF
8B • Updated • 15
Nokilos/suzume-llama-3-8B-multilingual-Q5_K_S-GGUF
8B • Updated • 16
ahsennazir/Meta-Llama-3-8B-Q2_K-GGUF
Text Generation • 8B • Updated • 21
internistai/base-7b-v0.2-Q4_K_M-GGUF
7B • Updated • 13
powermove72/SharkOgno-11b-Passthrough-Q4_K_M-GGUF
11B • Updated • 4
martintomov/Codestral-22B-v0.1-Q4_K_M-GGUF
22B • Updated • 9
martintomov/omost-llama-3-8b-Q8_0-GGUF
8B • Updated • 13
jeiku/Templar_v1_8B-Q3_K_S-GGUF
8B • Updated • 8
sugatoray/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF
16B • Updated • 657 • 3
V15h/PLLaMa-7b-instruct-Q4_K_M-GGUF
7B • Updated • 22 • 1
KnutJaegersberg/Qwen2-Deita-500m-Q8_0-GGUF
0.6B • Updated • 21
sugatoray/DeepSeek-Coder-V2-Lite-Base-Q4_K_M-GGUF
16B • Updated • 220
stardustcx/airoboros-33b-gpt4-1.4.1-PI-8192-fp16-Q4_K_M-GGUF
33B • Updated • 9 • 1
notstevensalt/L3-8B-Stheno-v3.3-32K-Q5_K_M-GGUF
8B • Updated • 35
bunnycore/Llama3-OneForAll-8B-Q4_K_M-GGUF
8B • Updated • 11
markhneedham/Mistral-7B-v0.3-IQ4_NL-GGUF
7B • Updated • 6
martintomov/Hermes-2-Pro-Llama-3-8B-Q4_K_S-GGUF
8B • Updated • 34
martintomov/Phi-3-medium-128k-instruct-Q4_K_S-GGUF
Text Generation • 14B • Updated • 33