Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,298

Base only

Active filters: quantization

ISTA-DASLab/Qwen3-8B-GGUF-GSQ

Text Generation • 8B • Updated May 18 • 51 • 3

kizuna-intelligence/Irodori-TTS-Lite-int4

Updated May 18 • 2

niranjan2777/SENTINEL-q5_k_m-GGUF

Text Generation • 8B • Updated May 19 • 23 • 1

divinesouljoy/vedic-ai

Text Generation • Updated May 18

sm-park/realworld-q-recap-ps-sweep

Robotics • Updated May 19

Sukuna404/deberta-emotion-quantized-int8

Text Classification • 0.2B • Updated May 19 • 7

arata-ae/irodori-archive

Updated 26 days ago • 1

ISTA-DASLab/Qwen3.6-35B-A3B-2Bit-GSQ

Image-Text-to-Text • 5B • Updated Jun 17 • 86

GuoShuaiGO/percentile-hif4-w4a4-wan22

Image-to-Video • Updated May 19

axelbrons/gemma-4-E4B-it-Q4_K_M-v2

Image-to-Text • 8B • Updated May 19 • 166 • 1

k0valik/Ornstein3.6-27B-MTP-NSC-ACE-SABER-IQ4_XS-13GiB-GGUF

Text Generation • 27B • Updated May 20 • 30 • 1

galqiwi/flute_kernels

FuriosaAIShareNotaAI/K-EXAONE-236B-A23B-NVFP4A16-Nota_v2

Text Generation • 137B • Updated May 19 • 2 • 1

richyvd/kvhalo

Text Generation • Updated May 24

embedl/chronos-2-quantized-trt

Time Series Forecasting • Updated 7 days ago • 1

Mathos34400/resilient-challenge-image-to-text

Image-to-Text • 8B • Updated May 21

ultranationalism/nunchaku-z-image-turbo-svdq

Text-to-Image • 4B • Updated May 24 • 1

embedl/dinov3-quantized-tensorrt

Image Classification • Updated 7 days ago • 5 • 2

AMAImedia/Qwen3-VL-2B-MAI-UI-NOESIS-NF4

Image-Text-to-Text • 2B • Updated May 21 • 4 • 1

AMAImedia/Qwen3-VL-2B-UI-Venus-NOESIS-NF4

Image-Text-to-Text • 2B • Updated May 21 • 4 • 1

Zewsic/Qwen-Image-Edit-Rapid-AIO-v19-NVFP4

Image-to-Image • Updated May 21 • 4

yunyangge/OSP-Next

Text-to-Video • Updated May 28 • 2

MPraveen/minimax-m2.5-nvfp4-experts-only-calib512

Text Generation • 116B • Updated May 21 • 7

Accuknoxtechnologies/CodeLanguage-Qwen3.5-2B-v5

Text Generation • Updated May 22 • 6

macszym/Bielik-PL-11B-v3.0-Instruct-GGUF

Text Generation • 11B • Updated May 23 • 210

k0valik/Darwin-28B-Coder-IQ4_XS12.9GiB-GGUF

Text Generation • 27B • Updated May 22 • 61 • 6

vadery/qwen36-27b-ft-grm-w8a8

Image-Text-to-Text • 28B • Updated May 22 • 22

vadery/Qwen3.5-0.8B-W8A8

Image-Text-to-Text • 0.9B • Updated May 22 • 383

tturing/Qwen3-Omni-30B-A3B-Thinking-FP8

Any-to-Any • 32B • Updated May 22 • 318 • 1

kizuna-intelligence/Command-A-Plus-Lite

Updated May 22 • 1