Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,551

Base only

Active filters: llama-cpp

NikolayKozloff/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • 8B • Updated May 7, 2024 • 42 • 2

NikolayKozloff/granite-20b-code-base-Q3_K_L-GGUF

Text Generation • 20B • Updated May 7, 2024 • 45 • 1

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q8_0-GGUF-PTBR

Text Generation • 8B • Updated May 7, 2024 • 33

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q4_K_M-GGUF-PTBR

Text Generation • 8B • Updated May 7, 2024 • 22 • 1

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q5_K_M-GGUF-PTBR

Text Generation • 8B • Updated May 7, 2024 • 25

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q2_K-GGUF-PTBR

Text Generation • 8B • Updated May 7, 2024 • 21

noxinc/gemma-portuguese-tom-cat-2b-it-Q5_K_M-GGUF-PTBR

Text Generation • 3B • Updated May 7, 2024 • 50

noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF-PTBR

Text Generation • 3B • Updated May 7, 2024 • 93

noxinc/Mistral-portuguese-luana-7b-chat-Q5_K_M-GGUF-PTBR

Text Generation • 7B • Updated May 7, 2024 • 15

noxinc/Mistral-portuguese-luana-7b-Mathematics-Q5_K_M-GGUF-PTBR

Text Generation • 7B • Updated May 7, 2024 • 49 • 1

noxinc/Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF-PTBR

Text Generation • 7B • Updated May 7, 2024 • 18 • 2

noxinc/Mistral-portuguese-luana-7b-Q5_K_M-GGUF-PTBR

Text Generation • 7B • Updated May 7, 2024 • 14

YorkieOH10/starcoder2-15b-instruct-v0.1-Q8_0-GGUF

Text Generation • 16B • Updated May 7, 2024 • 8

YorkieOH10/Llama-3-8B-Instruct-Coder-v2-Q8_0-GGUF

8B • Updated May 7, 2024 • 21

YorkieOH10/CodeQwen1.5-7B-Chat-Q8_0-GGUF

Text Generation • 7B • Updated May 7, 2024 • 21

YorkieOH10/GPT-NeoX-20B-Erebus-Q8_0-GGUF

21B • Updated May 7, 2024 • 40 • 4

bibidentuhanoi/BMO-7B-Instruct-Mistral-Q6_K-GGUF

7B • Updated May 7, 2024 • 5

Zetaphor/kappa-3-phi-abliterated-Q2_K-GGUF

4B • Updated May 7, 2024 • 17

aablski/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated May 7, 2024 • 2

Testasfsd/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated May 7, 2024 • 18

MoMonir/Mistroll-7B-v2.2-GGUF

Text Generation • 7B • Updated May 7, 2024 • 109

andreass123/Synatra-7B-v0.3-Translation-Q4_K_M-GGUF

7B • Updated May 8, 2024 • 21

wwe180/llama-3-neural-chat-v2.2-8B-Q6_K-GGUF

Text Generation • 8B • Updated May 8, 2024 • 23

yc/Octopus-v2-Q4_K_M-GGUF

3B • Updated May 8, 2024 • 29 • 1

yews1234/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated May 8, 2024 • 18

yews1234/llama-2-koen-13b-Q4_K_M-GGUF

Text Generation • 13B • Updated May 8, 2024 • 17

SourPineapple/Llama-3-8B-Instruct-abliterated-Q5_K_M-GGUF

8B • Updated May 8, 2024 • 131

Baidicoot/mistral-7b-helpful-only-full-Q4_K_M-GGUF

7B • Updated May 8, 2024 • 10

YorkieOH10/Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

Text Generation • 8B • Updated May 8, 2024 • 12

YorkieOH10/Mixtral-Instruct-ITR-8x7B-Q4_K_M-GGUF

47B • Updated May 8, 2024 • 8