Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

186,924

Base only

Active filters: llama.cpp

calcuis/lumina-gguf

Text-to-Image • 3B • Updated Sep 3, 2025 • 1.42k • 34

llmware/gemma-2-9b-instruct-gguf

9B • Updated Feb 14, 2025 • 510 • 3

vivek-dodia/Deepseek-R1-8B-MikroTik-Distilled-GGUF

8B • Updated Feb 12, 2025 • 168 • 9

mradermacher/llama-midi-v9-2-GGUF

1B • Updated Mar 13, 2025 • 204 • 3

DavidAU/Llama-3.2-8X4B-MOE-V2-Dark-Champion-Instruct-uncensored-abliterated-21B-GGUF

Text Generation • 21B • Updated Jun 12 • 11.3k • 142

city96/umt5-xxl-encoder-gguf

6B • Updated Mar 4, 2025 • 92.1k • 178

mradermacher/gemma-2-27b-it-abliterated-i1-GGUF

27B • Updated Mar 9, 2025 • 460 • 1

mradermacher/MistralSmall-Creative-24B-Realist-i1-GGUF

24B • Updated Mar 10, 2025 • 592 • 2

ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12, 2025 • 128k • 34

ggml-org/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 21, 2025 • 50.2k • 57

google/gemma-3-12b-it-qat-q4_0-gguf

Image-Text-to-Text • 12B • Updated Apr 11, 2025 • 1.61k • 288

NikolayKozloff/gemma-3-1b-it-Q8_0-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 487 • 4

mradermacher/Qwen2.5-Taiwan-7B-Instruct-i1-GGUF

8B • Updated Mar 13, 2025 • 88 • 3

mradermacher/gemma3-4b-it-abliterated-GGUF

4B • Updated Jul 31, 2025 • 777 • 7

KandirResearch/CiSiMi-v0.1

Text-to-Audio • 0.5B • Updated Mar 31, 2025 • 243 • 11

sabafallah/bge-reranker-v2-m3-Q4_K_M-GGUF

Text Ranking • 0.6B • Updated Apr 2, 2025 • 84 • 1

lex-au/Orpheus-3b-FT-Q8_0.gguf

Text-to-Speech • 4B • Updated Mar 24, 2025 • 3.54k • 30

tensorblock/Phi-4-mini-instruct-abliterated-GGUF

Text Generation • 4B • Updated Jan 27 • 406 • 9

bartowski/TheDrummer_Fallen-Gemma3-27B-v1-GGUF

Text Generation • 27B • Updated Mar 22, 2025 • 9.66k • 24

bartowski/huihui-ai_gemma-3-1b-it-abliterated-GGUF

Text Generation • 1.0B • Updated Mar 22, 2025 • 2.71k • 6

mradermacher/ArrowMint-Gemma3-4B-YUKI-v0.1-GGUF

4B • Updated Jul 31, 2025 • 1.31k • 1

mradermacher/ArrowMint-Gemma3-4B-YUKI-v0.1-i1-GGUF

4B • Updated 29 days ago • 763 • 2

mradermacher/Qwen2.5-VL-3B-Instruct-abliterated-i1-GGUF

3B • Updated Jul 10, 2025 • 571 • 1

mradermacher/Eurydice-24b-v2-i1-GGUF

24B • Updated Jul 11, 2025 • 400 • 7

Aratako/gemma-3-4b-it-RP-v0.1-GGUF

5B • Updated Apr 9, 2025 • 430 • 2

mradermacher/Aphrodite-3.2-1b-i1-GGUF

1B • Updated Jul 11, 2025 • 109 • 2

mradermacher/Qwen2.5-VL-7B-Instruct-abliterated-i1-GGUF

8B • Updated Jul 10, 2025 • 1.68k • 4

mradermacher/Video-R1-7B-GGUF

8B • Updated Jul 31, 2025 • 163 • 1

mradermacher/Video-R1-7B-i1-GGUF

8B • Updated 29 days ago • 2.23k • 1

DavidAU/Llama-3.1-128k-Dark-Planet-Uncensored-8B-GGUF

Text Generation • 8B • Updated May 28, 2025 • 2.37k • 12