Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,995

Base only

Active filters: instruct

mradermacher/Hermes-2-Pro-Mixtral-4x7B-i1-GGUF

24B • Updated Nov 25, 2024 • 468

QuantFactory/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Text Generation • 9B • Updated Nov 25, 2024 • 313 • 1

QuantFactory/Qwen2.5-7B-HomerCreative-Mix-GGUF

8B • Updated Nov 25, 2024 • 579 • 5

mradermacher/RQwen-v0.1-GGUF

15B • Updated Nov 25, 2024 • 83 • 2

mradermacher/OpenHermes-Mixtral-8x7B-GGUF

47B • Updated Nov 26, 2024 • 224

mradermacher/OpenHermes-Mixtral-8x7B-i1-GGUF

47B • Updated Nov 27, 2024 • 394 • 1

bartowski/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • 8B • Updated Nov 26, 2024 • 2.02k • 6

QuantFactory/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • 3B • Updated Nov 27, 2024 • 252 • 2

DavidAU/L3.1-Instruct-Guru-8B-GGUF

Text Generation • 8B • Updated May 28, 2025 • 231 • 5

tensorblock/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

8B • Updated Jan 27 • 21

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1

Text Generation • 33B • Updated Dec 18, 2024 • 44 • 51

tensorblock/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Jan 27 • 211

Fluxter/OpenHermes-2.5-Mistral-7B-Q8_0-GGUF

7B • Updated Nov 29, 2024 • 23 • 1

QuantFactory/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • 8B • Updated Dec 2, 2024 • 713 • 6

QuantFactory/Qwen2.5-7B-HomerAnvita-NerdMix-GGUF

Text Generation • 8B • Updated Dec 3, 2024 • 290 • 7

tensorblock/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • 3B • Updated Jan 27 • 125

prithivMLmods/SmolLM2-Math-IIO-1.7B-Instruct

Text Generation • Updated Dec 3, 2024 • 35 • 2

NousResearch/Hermes-3-Llama-3.2-3B

Text Generation • 3B • Updated Dec 18, 2024 • 5.17k • • 186

tensorblock/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Jan 27 • 37 • 2

mradermacher/SmolLM2-Math-IIO-1.7B-Instruct-GGUF

2B • Updated Dec 4, 2024 • 352

tensorblock/Llama3-70B-ShiningValiant2-GGUF

Text Generation • 71B • Updated Jan 27 • 222

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-F32-GGUF

27.3M • Updated Dec 6, 2024 • 9

tensorblock/Llama3-70B-Fireplace-GGUF

Text Generation • 71B • Updated Jan 27 • 65

sapienzanlp/Minerva-7B-instruct-v1.0-GGUF

Text Generation • 7B • Updated Dec 7, 2024 • 346 • 6

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF

27.3M • Updated Dec 7, 2024 • 13

mradermacher/Novus-7b-tr_v1-GGUF

7B • Updated Dec 7, 2024 • 140 • 1

mradermacher/Novus-7b-tr_v1-i1-GGUF

7B • Updated Dec 7, 2024 • 585 • 1

mradermacher/Genstruct-10.7B-GGUF

11B • Updated Dec 8, 2024 • 57

Lucy-in-the-Sky/pygmalion-2-13b-Q2_K-GGUF

Text Generation • 13B • Updated Dec 8, 2024 • 32

Lucy-in-the-Sky/pygmalion-2-13b-Q8_0-GGUF

Text Generation • 13B • Updated Dec 8, 2024 • 18