Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,876

Base only

Active filters: llama.cpp

LiquidAI/LFM2-350M-GGUF

Text Generation • 0.4B • Updated Jun 29 • 3.29k • 58

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Mar 30 • 5.33k • 50

Makatia/mistral-7b-instruct-v0.2.Q8_0-Q8_0.gguf

Text Generation • 7B • Updated Mar 25 • 4

Arivukkarasu/TinyLlama-1.1B-Chat-GGUF

1B • Updated Jul 15, 2025 • 35 • 1

Arivukkarasu/Mistral-7B-Instruct-v0.3-GGUF

7B • Updated Jul 15, 2025 • 2

PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M

12B • Updated Jul 23, 2025 • 7

theprint/Zeth-Gemma3-4B-GGUF

Text Generation • 5B • Updated Aug 16, 2025 • 28

HackNetAyush/smollm2-135M-instruct-gguf-q8

Text Generation • 0.1B • Updated Jul 20, 2025 • 94 • 3

sugiv/cardvaultplus-500m-gguf

Image-to-Text • 0.4B • Updated Jul 22, 2025 • 16 • 2

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.3-F16.gguf-Q5_K_M

7B • Updated Jul 23, 2025 • 26

devankit/smollm3_q4

Bastion-AI/SmolLM3-3B-GGUF

3B • Updated Jul 23, 2025 • 131 • 1

mistralai/Magistral-Small-2507-GGUF

Text Generation • 24B • Updated Jul 25, 2025 • 617 • 13

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.2-Q5_K_M

7B • Updated Jul 23, 2025 • 17

Darkhn-Quants/M3.2-24B-Animus-V6-Exp-GGUF

24B • Updated Jul 24, 2025 • 53

Darkhn-Quants/L3.3-70B-Animus-V6-Exp-GGUF

71B • Updated Aug 2, 2025 • 32

klusai/tf2-12b-gguf

Text Generation • 12B • Updated Aug 20, 2025 • 22

Darkhn-Quants/L3.3-70B-Animus-V6.1-Exp-GGUF

71B • Updated Jul 26, 2025 • 30

theprint/TiTan-Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Jul 25, 2025 • 49

theprint/TiTan-Gemma3-4B-GGUF

Text Generation • 5B • Updated Jul 30, 2025 • 75

dynomite567/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

8B • Updated Jul 26, 2025 • 21

dynomite567/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated Jul 26, 2025 • 9

Darkhn-Quants/M3.2-24B-Animus-V7.1-GGUF

24B • Updated Jul 29, 2025 • 147 • 2

Darkhn-Quants/M3.2-24B-Animus-V7.0-GGUF

24B • Updated Aug 2, 2025 • 86

theprint/Pythonified-Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Jul 26, 2025 • 3

theprint/ReasonableMath-Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Aug 16, 2025 • 21

Darkhn-Quants/L3.3-70B-Animus-V7.0-GGUF

71B • Updated Aug 21, 2025 • 91 • 1

theprint/Empathetic-Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Jul 30, 2025 • 29

CrucibleLab-TG/M3.2-24B-Loki-V1.0-GGUF

24B • Updated Aug 1, 2025 • 39

Darkhn-Quants/M3.2-36B-Animus-V8.0-GGUF

35B • Updated Sep 11, 2025 • 88