Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,602

Base only

Active filters: bfloat16

newmindai/Llama-3.1-8B-Instruct-w16a8-4nodes-bs64

Text Generation • 8B • Updated Dec 9, 2025 • 7

newmindai/Llama-3.1-8B-Instruct-w16a8-8nodes-bs64

Text Generation • 8B • Updated Dec 9, 2025 • 6

Naphula/Gemma-The-Writer-9B-abliterated

Text Generation • 10B • Updated Dec 20, 2025 • 7 • 1

varunpruthviraj/qwen3-8b-lora-merged

Text Generation • 8B • Updated Nov 23, 2025 • 3

mradermacher/Gemma-The-Writer-9B-abliterated-GGUF

9B • Updated Nov 27, 2025 • 70 • 2

lemuralabs/MiniMax-M2-Pruned-55

106B • Updated about 14 hours ago • 78 • 5

mradermacher/MiniMax-M2-THRIFT-55-GGUF

106B • Updated Apr 18 • 38 • 2

mradermacher/MiniMax-M2-THRIFT-55-i1-GGUF

106B • Updated Apr 19 • 359 • 2

DavidAU/Llama3.2-24B-A3B-II-Dark-Champion-INSTRUCT-Heretic-Abliterated-Uncensored

Text Generation • 18B • Updated Dec 2, 2025 • 100 • 8

DavidAU/Llama3.2-30B-A3B-II-Dark-Champion-INSTRUCT-Heretic-Abliterated-Uncensored

Text Generation • 30B • Updated Dec 2, 2025 • 126 • 15

mradermacher/Llama3.2-24B-A3B-II-Dark-Champion-INSTRUCT-Heretic-Abliterated-Uncensored-GGUF

18B • Updated Dec 1, 2025 • 2.55k • 1

HAD653/qwen3-1.7b-magistral-math

Text Generation • 2B • Updated Dec 4, 2025 • 11 • 1

Naphula/Psycho-9B-pretest1-sce_ties-Q6_K-GGUF

Text Generation • 9B • Updated Dec 11, 2025 • 4

mradermacher/qwen3-1.7b-magistral-math-GGUF

Text Generation • 2B • Updated Dec 4, 2025 • 102 • 1

mradermacher/qwen3-1.7b-magistral-math-i1-GGUF

Text Generation • 2B • Updated Dec 4, 2025 • 261 • 1

nightmedia/Qwen3-4B-Garak-qx86-hi-mlx

Text Generation • 1B • Updated Dec 31, 2025 • 8

DavidAU/Qwen3-4B-Hivemind-Instruct-NEO-MAX-Imatrix-GGUF

Text Generation • 4B • Updated Dec 5, 2025 • 337 • 7

DavidAU/Qwen3-4B-Hivemind-Instruct-Heretic-Abliterated-Uncensored-NEO-Imatrix-GGUF

Text Generation • 4B • Updated Dec 5, 2025 • 2.38k • 20

DavidAU/Qwen3-6B-Hivemind-Instruct-Heretic-Abliterated-Uncensored-NEO-Imatrix-GGUF

Text Generation • 6B • Updated Dec 5, 2025 • 1.63k • 8

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-8nodes

Text Generation • 8B • Updated Dec 9, 2025 • 10

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-with-gw-hp-4nodes

Text Generation • 8B • Updated Dec 9, 2025 • 7

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-with-gw-hp-8nodes

Text Generation • 8B • Updated Dec 9, 2025 • 6

newmindai/Llama-3.1-8B-Instruct-w16a8-rw-4nodes

Text Generation • 8B • Updated Dec 9, 2025 • 11

Naphula/Psycho-9B-pretest2-MiniGoblin-Q6_K-GGUF

Text Generation • 9B • Updated Dec 12, 2025 • 5

Naphula/Psycho-9B-pretest3-JungleOasis-BRF-MPOA-Q6_K-GGUF

Text Generation • 9B • Updated Dec 13, 2025 • 8

Naphula/Jungle-Oasis-BRF-MPOA-9B

Text Generation • 9B • Updated Dec 13, 2025 • 12 • • 1

mradermacher/Qwen3-48B-A4B-Deadpan-Savant-12x-Closed-Open-Source-Distill-GGUF

34B • Updated Dec 13, 2025 • 114 • 1

mradermacher/Qwen3-48B-A4B-Deadpan-Savant-12x-Closed-Open-Source-Distill-i1-GGUF

34B • Updated Dec 13, 2025 • 148 • 3

nightmedia/Qwen3-42B-A3B-Continuum-mlx

Text Generation • 42B • Updated Dec 27, 2025 • 11

nightmedia/Qwen3-42B-A3B-Quorum-mlx

Text Generation • 42B • Updated Dec 17, 2025 • 9