Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,317

Base only

Active filters: quantization

Silicone-Moss/TheDrummer-Skyfall-31B-v4.1-Heretic-Clear-GGUF

Text Generation • 31B • Updated Feb 10 • 160

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8

Text-to-Image • 83B • Updated Feb 9 • 18 • 2

aravula7/qwen-sql-finetuning

Text Generation • Updated Feb 9

Silan10/flux-torchao-int8

Text-to-Image • Updated Feb 9 • 4

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4

Text-to-Image • 83B • Updated Feb 9 • 22 • 2

namgyu-youn/exaone-1.2b-qqq-w4a8

0.4B • Updated Feb 9 • 13

petergilani/Qwen3-Coder-Next-4bit-g128

Text Generation • 80B • Updated Feb 13 • 38

petergilani/Qwen3-Coder-Next-6bit-g128

Text Generation • 80B • Updated Feb 11 • 42

sarathi-balakrishnan/Qwen2.5-VL-7B-Medical-LoRA

Image-Text-to-Text • Updated Feb 10 • 13

YakovSava/quantized-RouWei-0.8-16ch-v0.1alpha

3B • Updated Feb 11 • 6

petergilani/Qwen3-Coder-Next-3bit-g128

Text Generation • 80B • Updated Feb 11 • 18 • 1

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W4A16

1B • Updated Feb 13 • 14

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W3A16

1B • Updated Feb 11 • 13

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W4A16-EoRA

1B • Updated Feb 11 • 14

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W3A16-EoRA

1B • Updated Feb 12 • 12

namgyu-youn/EXAONE-4.0-1.2B-GPTQ-W2A16

1B • Updated Feb 11 • 11

Akicou/Nanbeige4.1-3B-GGUF

4B • Updated Feb 12 • 271

Shifusen/Mistral-Large-Instruct-2411-NVFP4

69B • Updated Feb 12 • 15

SoybeanMilk/Breeze-ASR-25-quantized.w4a16

Automatic Speech Recognition • 2B • Updated Feb 13 • 20 • 1

ludovicoYIN/MiniMax-M2-BF16-W4A16

Text Generation • 34B • Updated Feb 13 • 22

JasperHG90/ms-marco-minilm-l12-hindsight-reranker

Text Classification • Updated Mar 22 • 30

JasperHG90/minilm-l12-v2-hindsight-embeddings

Feature Extraction • Updated Feb 13 • 30

JasperHG90/distilbert-hindsight-ner

Token Classification • Updated Feb 13 • 18

Akicou/Ministral-3-3B-Instruct-2512-BF16-Heretic-GGUF

3B • Updated Feb 13 • 582 • 1

petergilani/MiniMax-M2.5-mix3-6bit

229B • Updated Feb 14 • 28 • 1

Shifusen/Lumimaid-v0.2-123B-NVFP4

Text Generation • 69B • Updated Feb 14 • 16

namgyu-youn/Qwen3-8B-tenary

Text Generation • 8B • Updated Feb 23 • 18

namgyu-youn/Qwen3-8B-greedy

Text Generation • 8B • Updated Feb 14 • 18

OpenTransformer/unary-quantization-research

mukesh3444/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated Feb 15 • 186