Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,298

Base only

Active filters: quantization

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-mse

21B • Updated May 31 • 9

cookieshake/FLUX.2-klein-9B-bnb-nf4-loras-baked

Text-to-Image • 5B • Updated May 27 • 1

gsting/Qwen3.5-122B-A10B-abliterated-FP8

Text Generation • 123B • Updated May 27 • 14

VoiceScribe/qwen3-5-0.8b-dictation-corrector-mlx-mxfp4-g32

Text Generation • 0.1B • Updated May 27 • 26

VoiceScribe/qwen3-5-0.8b-dictation-corrector-mlx-mixed46-g32

Text Generation • 0.1B • Updated May 27 • 61 • 1

sjakek/Qwen3.6-35B-A3B-ATX-K3-Offload-GGUF

Text Generation • 35B • Updated May 27 • 118

mgoin/Qwen3.6-35B-A3B-2Bit-GSQ-ct

Image-Text-to-Text • 35B • Updated May 27 • 13

mlx-community/MiniCPM5-1B-OptiQ-4bit

Text Generation • 0.2B • Updated 20 days ago • 4.66k • 9

vadery/Qwen3.5-27B-W8A8

Image-Text-to-Text • 28B • Updated May 29 • 24

dariprim/yandexgpt-5-lite-finetuned-gguf

Text Generation • 8B • Updated May 28 • 493

toxzak/Qwen3.6-27B-Q1_K-GGUF

Updated Jun 9 • 262

MLXBits/huihui-qwen3-vl-30b-abliterated-4bit

Image-Text-to-Text • 5B • Updated May 28 • 142

Zenni069/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated May 28 • 10

Reza2kn/LocateAnything-3B-ONNX-WebGPU-INT4

Object Detection • Updated May 29 • 28 • 12

ZiyuZhao98/QuantADMM-bundles

w-ahmad/Qwen3.5-9B-GGUF-MoQ-MTP

Text Generation • 9B • Updated Jun 4 • 1k • 6

youthfedpycharm/memoria-mobile-vision-assets

Zero-Shot Image Classification • Updated Jun 1 • 7

TheStageAI/gemma-4-E4B-it

Image-Text-to-Text • Updated Jun 2 • 133 • 10

EvanOLeary/laguna-xs2-dense-k8-cuda-sft-int8

Text Generation • Updated May 30 • 10

EvanOLeary/laguna-xs2-dense-k8-cuda-sft-int4-hqq

Text Generation • Updated May 30 • 7

poolside-laguna-hackathon/laguna-xs2-nvfp4-attention

19B • Updated May 30 • 6

poolside-laguna-hackathon/laguna-xs2-two-hacks

Text Generation • Updated May 30 • 1

Tivaphraen/LFM2-8B-A1B-Instruct-QwenDistill

Text Generation • 8B • Updated 27 days ago • 64 • 1

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse-preview

21B • Updated May 31 • 8

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-mse-preview

20B • Updated May 31 • 10

Spaceballs/Llama-3.1-8B-Lexi-Uncensored-V2-heretic-GGUF

Text Generation • 8B • Updated Jun 5 • 581

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse

21B • Updated May 31 • 6

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-awqclip

20B • Updated May 31 • 17.9k

herooooooooo/clip-vit-l-14-laion2b-coco-w4a8-modelopt

Zero-Shot Image Classification • 0.4B • Updated May 31 • 3

theophilusowiti/Caracal_AfroLlama_int4

Text Generation • Updated Jun 28 • 2 • 2