Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,286

Base only

Active filters: quantization

thisisaditichouhan/Phi-2-4bit-Quantized-Model

Text Generation • Updated Jul 12 • 7 • 1

lite-infer/z-image-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 3B • Updated Jul 12 • 20

lite-infer/z-image-turbo-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 4B • Updated Jul 12 • 36

sakamakismile/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated Jul 12 • 346 • 38

SC117/Ornith-1.0-35B-Heretic-MTP

Text Generation • 665k • Updated Jul 12 • 164 • 3

adrahmana/NanoFable-1M-fp16

Text Generation • 1.38M • Updated Jul 13 • 36

adrahmana/NanoFable-6M-fp16

Text Generation • 5.87M • Updated Jul 13 • 18

adrahmana/NanoFable-16M-fp16

Text Generation • 15.7M • Updated Jul 13 • 16

developerabu/IndicF5-MNN

Text-to-Speech • Updated Jul 13

protoLabsAI/LTX-2.3-22B-distilled-NVFP4

Text-to-Video • Updated Jul 13 • 3

mradermacher/Ornith-1.0-35B-Heretic-MTP-GGUF

36B • Updated Jul 13 • 878 • 3

mradermacher/Ornith-1.0-35B-Heretic-MTP-i1-GGUF

36B • Updated Jul 14 • 1.04k • 2

Majipa/Qwen3-0.6B-GGUF-Quantized

Text Generation • 0.8B • Updated Jul 13 • 420 • 2

gvij/parakeet-tdt-0.6b-v3-onnx-static-qdq-pc

Automatic Speech Recognition • Updated Jul 15 • 33 • 2

mastersubhajit/sarvam-30b-AWQ-GPTQ-Hybrid

6B • Updated Jul 18 • 20

adrahmana/NanoFable-1M-ternary

Text Generation • 1.38M • Updated Jul 13 • 20

adrahmana/NanoFable-6M-ternary

Text Generation • 5.87M • Updated Jul 13 • 15

adrahmana/NanoFable-16M-ternary

Text Generation • 15.7M • Updated Jul 13 • 18

adrahmana/NanoFable-28M-ternary

Text Generation • 27.8M • Updated Jul 13 • 53 • 1

adrahmana/NanoFable-28M-fp16

Text Generation • 27.8M • Updated Jul 13 • 18

milo01/INT4-Convrot-Comfy-Models

Updated Jul 13 • 1

arathishree/gpt-oss-20b-NVFP4

21B • Updated Jul 14 • 22

Ares-Realm-Studios/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated Jul 14 • 166 • 1

mastersubhajit/sarvam-30b-AWQ-4bit

7B • Updated Aug 7 • 2.11k • 1

alonsopg/wmt26-layeraware-native-mlp-q4

Text Generation • Updated Jul 14 • 10

fieldsmodelorg/FM-Pochi-32B-ProofPilot

Updated 29 days ago

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-Vision-MLX

Image-Text-to-Text • 36B • Updated Jul 15 • 364 • 3

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-MLX

Text Generation • 36B • Updated Jul 15 • 133 • 1

Albertchen96/FlowDIS-int8-convrot

Image Segmentation • Updated Jul 14 • 1

mirai-community/granite-3.3-2b-instruct-int4-gram

1B • Updated Aug 6 • 7