Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,512

Base only

Active filters: llama-cpp

xddlol/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 8

xddlol/WestLake-7B-v2-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 11

jefferylovely/AiMaven-Merkaba-2.0-Q4_K_M-GGUF

7B • Updated Apr 6, 2024 • 6

teneriffa/CapyTessBorosYi-Spicyboros-LimaRPv3-34B-Q4_0-GGUF

34B • Updated Apr 6, 2024 • 7

umarigan/Hermes-7B-TR-Q5_K_M-GGUF

7B • Updated Apr 6, 2024 • 13

xddlol/WestLake-10.7B-v2-Q4_K_M-GGUF

Text Generation • 11B • Updated Apr 6, 2024 • 15

impactframes/Octopus-v2-Q4_K_M-GGUF

3B • Updated Apr 6, 2024 • 14 • 2

alexcovo/YamShadow-7B-Q4_0-GGUF

7B • Updated Apr 7, 2024 • 5

alexcovo/gemma-1.1-7b-it-Q4_0-GGUF

9B • Updated Apr 7, 2024 • 20

teneriffa/Mistral-7B-v0.2-hf-Q8_0-GGUF

7B • Updated Apr 7, 2024 • 3

alexcovo/gemma-2b-Q4_0-GGUF

3B • Updated Apr 7, 2024 • 35

bunnycore/Starling-dolphin-E26-7B-Q5_K_M-GGUF

7B • Updated Apr 7, 2024 • 24

justinj92/dolmin-0.2-Q4_K_M-GGUF

7B • Updated Apr 7, 2024 • 4

justinj92/dolmin-0.2-Q3_K_M-GGUF

7B • Updated Apr 7, 2024 • 6

bunnycore/Chimera-Apex-7B-Q5_K_M-GGUF

7B • Updated Apr 7, 2024 • 23 • 1

NikolayKozloff/BeagleCatMunin-Q8_0-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 6 • 1

NikolayKozloff/BeagleCatMunin2-Q8_0-GGUF

7B • Updated Apr 8, 2024 • 10 • 1

NikolayKozloff/Mistral-7B-v0.1-Romanian-Q8_0-GGUF

7B • Updated Apr 8, 2024 • 13 • 1

NikolayKozloff/Heidrun-Mistral-7B-chat-Q8_0-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 26 • 1

jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b-GGUF

13B • Updated Apr 8, 2024 • 37

Thanabordee/openthaigpt-1.0.0-7b-chat-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 12

Thanabordee/openthaigpt-1.0.0-13b-chat-Q4_K_M-GGUF

Text Generation • 13B • Updated Apr 8, 2024 • 6

Thanabordee/openthaigpt-1.0.0-13b-chat-Q3_K_S-GGUF

Text Generation • 13B • Updated Apr 8, 2024 • 8 • 1

Thanabordee/openthaigpt-1.0.0-7b-chat-Q5_K_M-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 7

Thanabordee/openthaigpt-1.0.0-13b-chat-Q3_K_L-GGUF

Text Generation • 13B • Updated Apr 8, 2024 • 4

Thanabordee/openthaigpt-1.0.0-7b-chat-Q6_K-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 7

fdisk/SOLAR-10.7B-Instruct-v1.0-Q4_K_M-GGUF

11B • Updated Apr 8, 2024 • 24 • 1

codegood/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 14

NikolayKozloff/Sailor-7B-Q8_0-GGUF

8B • Updated Apr 8, 2024 • 14 • 1

NikolayKozloff/llama-7b-finnish-v2-Q8_0-GGUF

Text Generation • 7B • Updated Apr 8, 2024 • 19 • 1