Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

198,450

Base only

Active filters: llama.cpp

bartowski/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

Text Generation • 8B • Updated Aug 10, 2024 • 10.3k • 35

KimChen/bge-m3-GGUF

Sentence Similarity • 0.6B • Updated Aug 29, 2024 • 964 • 18

city96/t5-v1_1-xxl-encoder-gguf

5B • Updated Aug 20, 2024 • 121k • 539

RichardErkhov/HiroseKoichi_-_L3-8B-Lunar-Stheno-gguf

8B • Updated Aug 22, 2024 • 494 • 1

ChristianAzinn/tiny-json

0.5B • Updated Aug 22, 2024 • 135 • 8

QuantFactory/Qwen2-Boundless-GGUF

Text Generation • 2B • Updated Aug 25, 2024 • 930 • 5

RichardErkhov/cofeg_-_Finetuned-Xunzi-Qwen2-1.5B-for-ancient-text-generation-gguf

2B • Updated Aug 26, 2024 • 760 • 2

mradermacher/Flux-Prompt-Enhance-GGUF

0.2B • Updated Aug 27, 2024 • 2.11k • 7

bartowski/magnum-v2-4b-GGUF

Text Generation • 5B • Updated Aug 27, 2024 • 2.51k • 7

mradermacher/starcoder2-15b-i1-GGUF

16B • Updated Sep 3, 2024 • 4.74k • 2

bartowski/Yi-Coder-9B-Chat-GGUF

Text Generation • 9B • Updated Sep 5, 2024 • 3.98k • 20

mradermacher/Xortron7MethedUp-i1-GGUF

8B • Updated Sep 7, 2024 • 1.83k • 2

bartowski/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GGUF

Text Generation • 12B • Updated Sep 11, 2024 • 3.26k • 7

bartowski/Phi-3.5-mini-3.8B-ArliAI-RPMax-v1.1-GGUF

Text Generation • 4B • Updated Sep 11, 2024 • 4.28k • 7

Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 20, 2024 • 249k • 162

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 20, 2024 • 126k • 179

Qwen/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 27.3k • 67

lmstudio-community/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 12.6k • 15

bartowski/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 76.2k • 21

bartowski/Cydonia-22B-v1-GGUF

Text Generation • 22B • Updated Sep 18, 2024 • 1.31k • 16

israellaguan/TinyLlama_V1.1_Tree_of_thoughts-Q8_0-GGUF

1B • Updated Sep 19, 2024 • 53 • 5

QuantFactory/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 1.02k • 4

mradermacher/Qwen2.5-7B-Instruct-abliterated-GGUF

8B • Updated Apr 30, 2025 • 14.9k • 10

mradermacher/BGE_M3_Mindspore-GGUF

0.6B • Updated Sep 23, 2024 • 430 • 2

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Oct 8, 2024 • 107k • 179

mradermacher/LiquidCrystal_V3-20B-GGUF

20B • Updated Sep 27, 2024 • 195 • 1

mradermacher/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

8B • Updated Aug 1, 2025 • 4.38k • 8

anthracite-org/magnum-v4-12b-gguf

Text Generation • 12B • Updated Nov 25, 2024 • 9.97k • 53

QuantFactory/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF

12B • Updated Oct 16, 2024 • 1.73k • 11

mradermacher/magnum-v4-22b-GGUF

22B • Updated Nov 26, 2024 • 754 • 4