Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,994

Base only

Active filters: instruct

mradermacher/pandora-7b-chat-GGUF

9B • Updated Dec 24, 2024 • 149

mradermacher/pandora-7b-chat-i1-GGUF

9B • Updated Jan 26, 2025 • 461

tensorblock/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF

47B • Updated Jan 27 • 66

Model-SafeTensors/Llama3-OpenBioLLM-70B

Updated Dec 24, 2024 • 17

wolflycanorcant/Llama-3-8B-Lexi-Uncensored-Q4_K_M-GGUF

8B • Updated Dec 25, 2024 • 17

ModelCloud/QwQ-32B-Preview-gguf-vortex-v1

Text Generation • 33B • Updated Dec 26, 2024 • 29 • 2

CuckmeisterFuller/Hermes-3-Llama-3.2-3B-Q4-mlx

Text Generation • 3B • Updated Dec 27, 2024 • 31 • 1

fuzzy-mittenz/Thoth-Llama3.2-3B-IQ4_NL-GGUF

3B • Updated Feb 12, 2025 • 13 • 1

IntelligentEstate/Thoth_Warding-Llama-3B-IQ5_K_S-GGUF

3B • Updated Mar 7, 2025 • 22 • 4

tensorblock/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF

47B • Updated Jan 27 • 90

tensorblock/NeuralHermes-2.5-Mistral-7B-GGUF

7B • Updated Jan 27 • 140

mradermacher/Llama-2-7b-dolphin-open_platypus-pruned_70-GGUF

7B • Updated Apr 10, 2025 • 333

itlwas/Einstein-v4-7B-Q4_K_M-GGUF

7B • Updated Dec 29, 2024 • 23

itlwas/Einstein-v7-Qwen2-7B-Q4_K_M-GGUF

8B • Updated Dec 29, 2024 • 21

itlwas/Einstein-v6.1-Llama3-8B-Q4_K_M-GGUF

8B • Updated Dec 29, 2024 • 20

itlwas/Einstein-v4-Qwen-1.5-32B-Q4_K_M-GGUF

33B • Updated Dec 29, 2024 • 22

itlwas/Einstein-v4-phi2-Q4_K_M-GGUF

3B • Updated Dec 29, 2024 • 18

itlwas/Einstein-v6-7B-Q4_K_M-GGUF

7B • Updated Dec 29, 2024 • 12

itlwas/Einstein-v5-v0.2-7B-Q4_K_M-GGUF

7B • Updated Dec 29, 2024 • 8

Izhanjafry/Nous-Hermes-2-Mistral-7B-DPO-Q4_0-GGUF

7B • Updated Dec 29, 2024 • 47

itlwas/Llama-3-8B-Lexi-Uncensored-Q4_K_M-GGUF

8B • Updated Dec 29, 2024 • 68

mradermacher/Llama-3-8B-Lexi-Uncensored-GGUF

8B • Updated Jul 31, 2025 • 540 • 4

mradermacher/Llama-3-8B-Lexi-Uncensored-i1-GGUF

8B • Updated Dec 29, 2024 • 1.22k • 1

tensorblock/Hermes-3-Llama-3.2-3B-GGUF

3B • Updated Jan 27 • 197 • 2

tensorblock/Hermes-2-Theta-Llama-3-8B-32k-GGUF

8B • Updated Jan 27 • 54

tensorblock/Llama-3.3-70B-Instruct-ablated-GGUF

71B • Updated Jan 27 • 274

tensorblock/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Text Generation • 9B • Updated Jan 27 • 159

mradermacher/Llama-2-7b-dolphin-open_platypus-pruned_50-GGUF

7B • Updated Apr 10, 2025 • 272

tensorblock/Mistral-Small-Instruct-2409-abliterated-GGUF

Text Generation • 22B • Updated Jan 27 • 134

QuantFactory/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • 4B • Updated Jan 3, 2025 • 305 • 2