QuantFactory/OpenCoder-8B-Instruct-GGUF
Text Generation • 8B • Updated • 802 • 6
Ollama-ready Coding Models
For inference. CPU is enough for both quantization and inference.
-
-
QuantFactory/OpenCoder-8B-Base-GGUF
Text Generation • 8B • Updated • 408 • 4 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • 16B • Updated • 542 • 5 -
QuantFactory/starcoder2-15b-GGUF
Text Generation • 16B • Updated • 1.1k • 2 -
bartowski/starcoder2-15b-instruct-v0.1-GGUF
Text Generation • 16B • Updated • 1.4k • 9 -
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation • 16B • Updated • 50k • 201 -
QuantFactory/starcoder2-7b-instruct-GGUF
Text Generation • 7B • Updated • 1.75k • 2 -
QuantFactory/starcoder2-7b-GGUF
Text Generation • 7B • Updated • 1.71k • 4 -
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF
3B • Updated • 1.79k • 1 -
QuantFactory/starcoder2-3b-instruct-GGUF
Text Generation • 3B • Updated • 1.23k • 1 -
QuantFactory/starcoder2-3b-GGUF
Text Generation • 3B • Updated • 1.34k • 3 -
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • 33B • Updated • 42.9k • 235 -
bartowski/Qwen2.5-Coder-32B-GGUF
Text Generation • 33B • Updated • 5k • 18 -
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • 15B • Updated • 178k • 265 -
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF
15B • Updated • 304 • 2 -
Qwen/Qwen2.5-7B-Instruct-GGUF
Text Generation • 8B • Updated • 632k • 203 -
QuantFactory/Qwen2.5-Coder-7B-GGUF
Text Generation • 8B • Updated • 58.3k • 10 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 376k • 188 -
QuantFactory/Qwen2.5-Coder-1.5B-GGUF
Text Generation • 2B • Updated • 2.06k • 2 -
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF
Text Generation • 16B • Updated • 1.75k • 1 -
ibm-granite/granite-34b-code-instruct-8k-GGUF
Text Generation • 34B • Updated • 163 • 8 -
ibm-granite/granite-34b-code-base-8k-GGUF
Text Generation • 34B • Updated • 149 • 3 -
ibm-granite/granite-20b-code-instruct-8k-GGUF
Text Generation • 20B • Updated • 157 • 6 -
ibm-granite/granite-20b-code-base-8k-GGUF
Text Generation • 20B • Updated • 141 • 5 -
QuantFactory/granite-8b-code-instruct-128k-GGUF
Text Generation • 8B • Updated • 418 • 3 -
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf
8B • Updated • 3.91k -
ibm-granite/granite-8b-code-instruct-4k-GGUF
Text Generation • 8B • Updated • 3.28k • 12 -
ibm-granite/granite-8b-code-base-4k-GGUF
Text Generation • 8B • Updated • 129 • 3 -
mradermacher/granite-3b-code-instruct-128k-GGUF
3B • Updated • 214 • 1 -
QuantFactory/granite-3b-code-base-128k-GGUF
Text Generation • 3B • Updated • 1.99k • 2 -
ibm-granite/granite-3b-code-instruct-2k-GGUF
Text Generation • 3B • Updated • 213 • 8 -
ibm-granite/granite-3b-code-base-2k-GGUF
Text Generation • 3B • Updated • 185 • 3