Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,543

Base only

Active filters: llama-cpp

jsfs11/L3-8B-Tamamo-v1-Q5_K_M-GGUF-imatrix

8B • Updated Jul 15, 2024 • 15

zsolx2/Yi-1.5-34B-Chat-16K-Q4_0-GGUF

34B • Updated Jul 15, 2024 • 19

v000000/L3-15B-MythicalMaid-t0.0001-Q5_K_M-GGUF

15B • Updated Jul 15, 2024 • 8 • 1

niancheng/gte-Qwen2-1.5B-instruct-Q4_K_M-GGUF

Sentence Similarity • 2B • Updated Jul 15, 2024 • 24

niancheng/gte-Qwen2-7B-instruct-Q4_K_M-GGUF

Sentence Similarity • 8B • Updated Jul 15, 2024 • 18

ichi-kom/all-MiniLM-L6-v2-Q6_K-GGUF

Sentence Similarity • 22.6M • Updated Jul 15, 2024 • 13 • 1

mxs980/b1ade-embed-Q8_0-GGUF

0.3B • Updated Jul 15, 2024 • 22

aifeifei798/Phi-3-song-lyrics-1.1-Q8_0-GGUF

Text Generation • 4B • Updated Jul 15, 2024 • 257 • 1

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 17 • 2

NikolayKozloff/h2o-danube3-4b-base-Q8_0-GGUF

Text Generation • 4B • Updated Jul 15, 2024 • 13 • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

13B • Updated Aug 28, 2024 • 35 • 3

NikolayKozloff/h2o-danube3-500m-base-Q8_0-GGUF

Text Generation • 0.5B • Updated Jul 15, 2024 • 22 • 2

PatronusAI/Llama-3-Patronus-Lynx-70B-Instruct-Q4_K_M-GGUF

71B • Updated Jul 17, 2024 • 12

clarkguilty/cosmosage-v3-Q8_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 21

clarkguilty/cosmosage-v3-Q6_K-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 12

VAIBHAV22334455/NOVA-3B.v2-Q8_0-GGUF

3B • Updated Jul 15, 2024 • 10

Lancer1408/LLaMa-3-Stheno-v3.2-15B-Q5_K_M-GGUF

15B • Updated Jul 15, 2024 • 80

plehrman24/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 8

vincentl2189/RolePlayLake-7B-Toxic-Q5_K_M-GGUF

7B • Updated Jul 15, 2024 • 39 • 1

plehrman24/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 15, 2024 • 12

Ransss/L3-15B-MythicalMaid-t0.0001-Q8_0-GGUF

15B • Updated Jul 15, 2024 • 8

Ransss/L3-15B-MythicalMaid-t0.0001-Q6_K-GGUF

15B • Updated Jul 15, 2024 • 9

Ransss/L3-8B-Tamamo-v1-Q8_0-GGUF

8B • Updated Jul 15, 2024 • 6 • 1

reach-vb/NuminaMath-7B-TIR-Q8_0-GGUF

Text Generation • 7B • Updated Jul 15, 2024 • 13 • 24

bazsalazas/Mistral-7B-v0.3-Q4_K_M-GGUF

7B • Updated Jul 15, 2024 • 5

Alex01837178373/gemma-2-9b-it-abliterated-Q4_K_M-GGUF

9B • Updated Jul 15, 2024 • 172

Aldaris/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF

16B • Updated Jul 16, 2024 • 40

Aldaris/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

16B • Updated Jul 16, 2024 • 48

qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • 9B • Updated Jul 16, 2024 • 13

KnutJaegersberg/gemma-2-9b-it-abliterated-Q8_0-GGUF

9B • Updated Jul 16, 2024 • 91 • 1