Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,577

Base only

Active filters: llama-cpp

matrixportalx/Huihui-gpt-oss-20b-BF16-abliterated-v2-Q4_0-GGUF

Text Generation • 21B • Updated Dec 25, 2025 • 88 • 1

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model

15B • Updated Jan 14 • 57 • 36

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 21 • 14

audarai/Audar-TTS-V1-Turbo

Text-to-Speech • 2B • Updated 19 days ago • 382 • 4

mradermacher/gpt-oss-nano-i1-GGUF

9B • Updated Jan 30 • 1.15k • 4

OddTheGreat/Luna_12B_V.3-Q6_K-GGUF

13B • Updated Jan 31 • 70 • 2

mradermacher/LocoOperator-4B-i1-GGUF

4B • Updated Feb 24 • 76 • 3

loolzrulez/Qwen3-4B-Instruct-2507-heretic-Q8_0-GGUF

Text Generation • 4B • Updated Feb 24 • 48 • 1

anthonym21/dots.ocr-GGUF

Image-to-Text • 2B • Updated Mar 23 • 1.08k • 3

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 9.24k • 322

jackcloudman/Leanstral-2603-GGUF

119B • Updated Mar 17 • 306 • 10

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 30.7k • 80

vsark/gemma-4-19b-a4b-it-REAP-GGUF

18B • Updated Apr 5 • 156 • 5

barozp/gemma-4-21b-a4b-it-REAP-GGUF

Text Generation • 21B • Updated Apr 6 • 617 • 15

Sai2002567/spacenet-ai-Q6_K-GGUF

4B • Updated Apr 6 • 5 • 1

darkc0de/XORTRON.TECH-Q6_K-GGUF

Image-Text-to-Text • 27B • Updated Apr 8 • 22 • 2

mad-lab-ai/google-gemma-4-26b-a4b-tq3_1s.gguf

25B • Updated Apr 16 • 139 • 3

darkc0de/Agent.Xortron-Q5_K_M-GGUF

27B • Updated Apr 11 • 145 • 3

Youssofal/MiniMax-M2.7-Abliterated-Heretic-GGUF

Text Generation • 229B • Updated Apr 14 • 1.14k • 47

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-Q4-K-M

8B • Updated May 5 • 150 • 2

majentik/Nemotron-3-Super-120B-A12B-TurboQuant-GGUF-Q4_K_M

Text Generation • 121B • Updated 6 days ago • 307 • 1

TheRofli/qquark-435m

Text Generation • 0.5B • Updated May 30 • 18 • 1

enginil/Qwen3.6-27B-Q3_K_S-GGUF

Image-Text-to-Text • 27B • Updated Apr 29 • 91 • 1

ATH-MaaS/Marco-DeepResearch-8B-GGUF

Text Generation • 8B • Updated May 18 • 557 • 5

ATH-MaaS/Marco-DeepResearch-8B-i1-GGUF

Text Generation • 8B • Updated May 18 • 695 • 5

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF

Text Generation • 35B • Updated 4 days ago • 730 • 4

prithivMLmods/Qwen3.5-9B-MTP-GGUF

Image-Text-to-Text • 9B • Updated Jun 1 • 2.87k • 5

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 4.16k • 19

Tivaphraen/granite-4.1-8b-Claude-Opus-4.6-Thinking-MAX-gguf

Text Generation • 9B • Updated Jun 8 • 184 • 4

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

Text Generation • 35B • Updated 23 days ago • 49.3k • 7