Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,995

Base only

Active filters: instruct

sequelbox/gemma-2-9B-MOTH

Text Generation • 9B • Updated Sep 13, 2024 • 47

bartowski/Pantheon-RP-1.6.1-12b-Nemo-GGUF

Text Generation • 12B • Updated Sep 9, 2024 • 2.51k • 5

bartowski/Pantheon-RP-1.6.1-12b-Nemo-exl2

Text Generation • Updated Sep 9, 2024

async0x42/Pantheon-RP-1.6.1-12b-Nemo-exl2_8bpw

Updated Sep 9, 2024 • 4

adamksn/Llama3.1-8B-Cobalt-GGUF

Text Generation • 8B • Updated Sep 10, 2024 • 132

BEE-spoke-data/tFINE-900m-e16-d32-instruct

Text Generation • 0.9B • Updated Dec 29, 2025 • 50

adamksn/Llama3.1-8B-Enigma-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 205

monsterapi/gemma-2-2b-norobots

Updated Sep 13, 2024 • 10

adamksn/Llama3.1-8B-Fireplace2-GGUF

Text Generation • 8B • Updated Sep 12, 2024 • 171

meaningalignment/wise-llama

Updated Oct 11, 2024 • 8 • 1

bartowski/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • 8B • Updated Sep 17, 2024 • 5.86k • 2

stephenlzc/Llama-3-8B-Lexi-Uncensored-Q2_K-GGUF

8B • Updated Sep 19, 2024 • 75 • 1

QuantFactory/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • 4B • Updated Sep 20, 2024 • 800 • 2

v000000/Qwen2.5-Lumen-14B

Text Generation • 15B • Updated Oct 3, 2024 • 81 • • 21

v000000/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 29 • 1

Lambent/Qwen2.5-Lumen-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 27 • 2

dasChronos1/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 30

QuantFactory/Qwen2.5-Lumen-14B-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 421 • 3

mradermacher/Qwen2.5-Lumen-14B-GGUF

15B • Updated Sep 22, 2024 • 1.21k • 5

teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-context-gguf

Text Generation • 8B • Updated Sep 22, 2024 • 856 • 1

mradermacher/Qwen2.5-Lumen-14B-i1-GGUF

15B • Updated Sep 22, 2024 • 1.62k • 8

QuantFactory/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Sep 22, 2024 • 490 • 2

teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-gguf

Text Generation • 8B • Updated Sep 22, 2024 • 521 • 7

byroneverson/Mistral-Small-Instruct-2409-abliterated

Text Generation • 22B • Updated Sep 24, 2024 • 8.65k • 14

byroneverson/Mistral-Small-Instruct-2409-abliterated-gguf

Text Generation • 22B • Updated Sep 23, 2024 • 64 • 3

WSDW/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

8B • Updated Sep 23, 2024 • 93 • 1

QuantFactory/Genstruct-7B-GGUF

7B • Updated Aug 28, 2025 • 879 • 3

mradermacher/Mistral-Small-Instruct-2409-abliterated-GGUF

22B • Updated Sep 24, 2024 • 741 • 4

mradermacher/Mistral-Small-Instruct-2409-abliterated-i1-GGUF

22B • Updated Sep 24, 2024 • 1.15k • 1

QuantFactory/Mistral-Trismegistus-7B-GGUF

7B • Updated Sep 26, 2024 • 1.65k • 1