Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,602

Base only

Active filters: bfloat16

lopho/Wan2.2-T2V-A14B-Diffusers_bf16_transformer_2

14B • Updated Aug 9, 2025 • 70 • 1

lopho/Wan2.2-T2V-A14B-Diffusers_bf16_text_encoder

6B • Updated Aug 9, 2025 • 8 • 1

tonyzhao123/dummy_llama4_b16

Text Generation • 0.8B • Updated Aug 18, 2025 • 12

hobaratio/AbominationScience-12B-v4-mlx-4Bit

Text Generation • 12B • Updated Aug 24, 2025 • 4

sigridjineth/ctxl-rerank-v2-1b-seq-cls

Text Ranking • 1B • Updated Aug 28, 2025 • 10 • 6

mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-GGUF

9B • Updated Aug 31, 2025 • 76

mradermacher/Llama-3.2-9B-Uncensored-Brainstorm-Alpha-i1-GGUF

9B • Updated Dec 23, 2025 • 271 • 3

mlx-community/NousResearch_Hermes-4-14B-BF16-abliterated-mlx

Text Generation • 15B • Updated Sep 16, 2025 • 290 • 1

mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-GGUF

7B • Updated Sep 28, 2025 • 112 • 3

mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF

7B • Updated Dec 5, 2025 • 378

nightmedia/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-qx86-hi-mlx

Text Generation • 7B • Updated Sep 29, 2025 • 41

kutayozbay/flux-lite-8B-1024x1024-tp4

Text-to-Image • Updated Oct 2, 2025 • 1

sizzlebop/CursedMatrix-8B-v9-Q8_0-GGUF

8B • Updated Oct 5, 2025 • 3

sizzlebop/Multilingual-SaigaSuzume-8B-Q8_0-GGUF

8B • Updated Oct 5, 2025 • 3

sizzlebop/CursedMatrix-8B-v9-IQ4_NL-GGUF

8B • Updated Oct 5, 2025 • 2

FilledVaccum/jais-adapted-13b-chat-8bit-simple

Text Generation • 13B • Updated Oct 5, 2025 • 4

edwixx/qwen3-8b-triton

Text Generation • 8B • Updated 21 days ago • 395

newmindai/Llama-3.1-8B-Instruct-w16a16-tw

Text Generation • 8B • Updated Dec 9, 2025 • 10

newmindai/Llama-3.1-8B-Instruct-w16a8-1node-bs8

Text Generation • 8B • Updated Dec 9, 2025 • 11

newmindai/Llama-3.1-8B-Instruct-w16a8-8nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 4

lemuralabs/MiniMax-M2-Pruned-25

173B • Updated about 14 hours ago • 829 • 36

mradermacher/MiniMax-M2-THRIFT-GGUF

Updated Apr 28 • 2

mradermacher/MiniMax-M2-THRIFT-i1-GGUF

173B • Updated Apr 28 • 126 • 10

newmindai/Llama-3.1-8B-Instruct-w16a8-rw

Text Generation • 8B • Updated Dec 9, 2025 • 7

newmindai/Llama-3.1-8B-Instruct-w16a8-mxtw

Text Generation • 8B • Updated Dec 9, 2025 • 8

newmindai/Llama-3.1-8B-Instruct_w16a8_rw_with_gw_hp

Text Generation • 8B • Updated Dec 9, 2025 • 6

newmindai/Llama-3.1-8B-Instruct-w16a16-4nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 8

newmindai/Llama-3.1-8B-Instruct-w16a8-4nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 15

newmindai/Llama-3.1-8B-Instruct-w16a16-8nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 4

bartowski/VibeStudio_MiniMax-M2-THRIFT-GGUF

Text Generation • 173B • Updated Nov 20, 2025 • 979 • 8