Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,539

Base only

Active filters: llama-cpp

fernandoruiz/gemma-2-27b-it-Q4_K_S-GGUF

Text Generation • 27B • Updated Jul 14, 2024 • 23

v000000/TripletBoreas-7B-t0.0001-Q5_K_S-GGUF

7B • Updated Jul 14, 2024 • 2

Tech-Meld/NuminaMath-7B-TIR-Q4_K_M-GGUF

Text Generation • 7B • Updated Jul 14, 2024 • 12

pythonplayer123/gemma-2-27b-it-Q4_K_M-GGUF

Text Generation • 27B • Updated Jul 14, 2024 • 35 • 1

fernandoruiz/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Jul 14, 2024 • 18

v000000/DupletBoreas-7B-t0.0001-Q5_K_S-GGUF

7B • Updated Jul 14, 2024 • 2

fernandoruiz/Phi-3-mini-4k-instruct-Q4_K_S-GGUF

Text Generation • 4B • Updated Jul 14, 2024 • 11

v000000/DupletBoreas-7B-t0.0001-Q8_0-GGUF

7B • Updated Jul 14, 2024 • 2

fernandoruiz/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • 14B • Updated Jul 14, 2024 • 14

fernandoruiz/Phi-3-medium-4k-instruct-Q4_K_S-GGUF

Text Generation • 14B • Updated Jul 14, 2024 • 19

v000000/TripletBoreas-7B-t0.0001-Q8_0-GGUF

7B • Updated Jul 14, 2024 • 4

faceradix/NeuralDaredevil-7B-Q4_K_M-GGUF

7B • Updated Jul 14, 2024 • 5

faceradix/Tinyllama3-Q4_K_M-GGUF

2B • Updated Jul 14, 2024 • 16

mjschock/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

1B • Updated Dec 16, 2024 • 24 • 1

ShadowKronos/L3-8B-Stheno-v3.3-32K-Q8_0-GGUF

8B • Updated Jul 14, 2024 • 10

mjschock/TinyLlama_v1.1_math_code-Q4_K_M-GGUF

1B • Updated Jul 14, 2024 • 35 • 3

zsolx2/SambaLingo-Hungarian-Chat-Q4_0-GGUF

7B • Updated Jul 14, 2024 • 26

zsolx2/SambaLingo-Hungarian-Base-Q4_0-GGUF

7B • Updated Jul 14, 2024 • 12

zsolx2/szurkemarha-samba-Q4_0-GGUF

7B • Updated Jul 15, 2024 • 24

joshnader/meditron-7b-Q4_K_M-GGUF

7B • Updated Jul 15, 2024 • 6

harangstar/Llama3-Q4_K_M-GGUF

8B • Updated Jul 15, 2024 • 9

saurabh1484/Meta-Llama-3-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 18

saurabh1484/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 10

jsfs11/L3-8B-Niitama-v1-Q5_K_M-GGUF-imatrix

8B • Updated Jul 15, 2024 • 33 • 1

Razrien/L3-8B-Tamamo-v1-Q8_0-GGUF

8B • Updated Jul 15, 2024 • 24

v000000/L3-15B-EtherealMaid-t0.0001-Q5_K_M-GGUF

15B • Updated Jul 15, 2024 • 12 • 1

jsfs11/L3-8B-Tamamo-v1-Q5_K_M-GGUF-imatrix

8B • Updated Jul 15, 2024 • 15

zsolx2/Yi-1.5-34B-Chat-16K-Q4_0-GGUF

34B • Updated Jul 15, 2024 • 19

v000000/L3-15B-MythicalMaid-t0.0001-Q5_K_M-GGUF

15B • Updated Jul 15, 2024 • 8 • 1

niancheng/gte-Qwen2-1.5B-instruct-Q4_K_M-GGUF

Sentence Similarity • 2B • Updated Jul 15, 2024 • 24