Cran-May/Infinity-Instruct-7M-Gen-mistral-7B-Q4_K_M-GGUF
7B • Updated • 15
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
31,471
Active filters: imatrix
Cran-May/E5-Q5_K_M-GGUF
7B • Updated • 4
mradermacher/calme-2.1-phi3.5-4b-i1-GGUF
4B • Updated • 183 • 1
mradermacher/Athene-Phi-3.5-mini-instruct-orpo-i1-GGUF
4B • Updated • 650
mradermacher/llama3.1-airoboros3.2-QDT-8B-i1-GGUF
8B • Updated • 62
mradermacher/L3.1-Ablaze-Vulca-v0.1-8B-i1-GGUF
8B • Updated • 111 • 1
mradermacher/L3-SMB-Grand-Story-WTFrack-Instruct-18.05B-i1-GGUF
18B • Updated • 52
mradermacher/Grand-Story-V1-F32-Ultra-Quality-16_5B-i1-GGUF
17B • Updated • 40
mradermacher/L3-Jamet-12.2B-MK.V-Blackroot-Instruct-i1-GGUF
12B • Updated • 272
RachidAR/Phi-3.5-mini-instruct-Q5_K_M-GGUF
Text Generation • 4B • Updated • 20
mradermacher/Athena-codegemma-2-9b-i1-GGUF
9B • Updated • 105
mradermacher/Lyra-Gutenberg-mistral-nemo-12B-i1-GGUF
12B • Updated • 339 • 2
mradermacher/Gutensuppe-mistral-nemo-12B-i1-GGUF
12B • Updated • 54 • 1
bartowski/gemma-2-27b-it-SimPO-37K-GGUF
Text Generation • 27B • Updated • 995 • 11
mradermacher/Llama3.1-vodka-i1-GGUF
8B • Updated • 276 • 1
mradermacher/MN-magnum-v2.5-18.5B-kto-Instruct-i1-GGUF
19B • Updated • 45 • 1
mradermacher/MN-Rocinante-18.5B-v1.1-Instruct-i1-GGUF
19B • Updated • 171 • 2
bartowski/Infinity-Instruct-7M-Gen-Llama3_1-70B-GGUF
Text Generation • 71B • Updated • 450 • 3
mradermacher/Fireball-12B-v1.01a-i1-GGUF
12B • Updated • 129 • 1
mradermacher/T-III-12B-i1-GGUF
12B • Updated • 187 • 1
mradermacher/Nemo-12B-Marlin-v8-i1-GGUF
12B • Updated • 462 • 3
mradermacher/Instant-RP-Noodles-12B-i1-GGUF
12B • Updated • 28 • 1
hellork/chatglm3-6b-IQ4_NL-GGUF
6B • Updated • 23
hellork/SmolLM-1.7B-Instruct-Q5_K_M-GGUF
2B • Updated • 48
hellork/chatglm3-6b-128k-IQ4_NL-GGUF
6B • Updated • 13
Reiterate3680/Soliloquy-7B-v3-GGUF
Text Generation • 8B • Updated • 48 • 1
Reiterate3680/nemo-12b-hiwaifu-GGUF
Text Generation • 12B • Updated • 12 • 1
mradermacher/T-IIIa-12B-i1-GGUF
12B • Updated • 313 • 1
hellork/falcon-mamba-7b-instruct-IQ4_NL-GGUF
7B • Updated • 8 • 1
hellork/LongWriter-llama3.1-8b-IQ3_M-GGUF
8B • Updated • 33 • 1