QuantFactory/OpenCoder-8B-Instruct-GGUF
Text Generation • 8B • Updated • 814 • 6
Ollama-ready Coding Models
For inference. CPU is enough for both quantization and inference.
-
-
QuantFactory/OpenCoder-8B-Base-GGUF
Text Generation • 8B • Updated • 410 • 4 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • 16B • Updated • 595 • 5 -
QuantFactory/starcoder2-15b-GGUF
Text Generation • 16B • Updated • 1.03k • 2 -
bartowski/starcoder2-15b-instruct-v0.1-GGUF
Text Generation • 16B • Updated • 1.45k • 9 -
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation • 16B • Updated • 58.4k • 203 -
QuantFactory/starcoder2-7b-instruct-GGUF
Text Generation • 7B • Updated • 1.75k • 2 -
QuantFactory/starcoder2-7b-GGUF
Text Generation • 7B • Updated • 1.65k • 4 -
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF
3B • Updated • 1.79k • 1 -
QuantFactory/starcoder2-3b-instruct-GGUF
Text Generation • 3B • Updated • 1.26k • 1 -
QuantFactory/starcoder2-3b-GGUF
Text Generation • 3B • Updated • 1.22k • 3 -
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • 33B • Updated • 41.3k • 232 -
bartowski/Qwen2.5-Coder-32B-GGUF
Text Generation • 33B • Updated • 4.8k • 18 -
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • 15B • Updated • 175k • 262 -
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF
15B • Updated • 239 • 2 -
Qwen/Qwen2.5-7B-Instruct-GGUF
Text Generation • 8B • Updated • 190k • 200 -
QuantFactory/Qwen2.5-Coder-7B-GGUF
Text Generation • 8B • Updated • 58.1k • 10 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 360k • 186 -
QuantFactory/Qwen2.5-Coder-1.5B-GGUF
Text Generation • 2B • Updated • 1.91k • 2 -
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF
Text Generation • 16B • Updated • 1.65k • 1 -
ibm-granite/granite-34b-code-instruct-8k-GGUF
Text Generation • 34B • Updated • 139 • 8 -
ibm-granite/granite-34b-code-base-8k-GGUF
Text Generation • 34B • Updated • 128 • 3 -
ibm-granite/granite-20b-code-instruct-8k-GGUF
Text Generation • 20B • Updated • 138 • 6 -
ibm-granite/granite-20b-code-base-8k-GGUF
Text Generation • 20B • Updated • 119 • 5 -
QuantFactory/granite-8b-code-instruct-128k-GGUF
Text Generation • 8B • Updated • 390 • 3 -
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf
8B • Updated • 3.98k -
ibm-granite/granite-8b-code-instruct-4k-GGUF
Text Generation • 8B • Updated • 3.15k • 12 -
ibm-granite/granite-8b-code-base-4k-GGUF
Text Generation • 8B • Updated • 103 • 3 -
mradermacher/granite-3b-code-instruct-128k-GGUF
3B • Updated • 190 • 1 -
QuantFactory/granite-3b-code-base-128k-GGUF
Text Generation • 3B • Updated • 1.89k • 2 -
ibm-granite/granite-3b-code-instruct-2k-GGUF
Text Generation • 3B • Updated • 204 • 8 -
ibm-granite/granite-3b-code-base-2k-GGUF
Text Generation • 3B • Updated • 154 • 3