Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,255

Base only

Active filters: quantization

enesor0/pulsar-acoustic

Audio Classification • Updated Aug 22 • 47

enesor0/pulsar-radar

Updated Aug 22 • 21

liuwangaaaa/SPARK

Object Detection • Updated Aug 23

itamiArika/htdemucs-int8-memory

Audio-to-Audio • Updated Aug 23

eemin/Qwen3.8-27B-NVFP4-lmhead4-recipe

sleepyeldrazi/Ornith-1.5-REAP-20B-A3B-GGUF

19B • Updated Aug 24 • 1.77k • 3

kwanhee/Qwen3-30B-A3B-P48NVFP4-W4A4-GS32-GW2

31B • Updated Aug 23 • 23

KaedeTai/mlx-mtp-graft

oxfrug/chronos-2-int8-torchao

Time Series Forecasting • 0.1B • Updated Aug 23 • 16

KaedeTai/Qwen3.x-27B-mlx-mtp-graft

Oxidez/DeepSeek-V4-Flash-0731-UD-IQ3_IQ2-XS

Text Generation • 284B • Updated Aug 23 • 35

neopolita/Qwen3.6-19B-A3B-Niwaki-v2-2bit-mlx

Text Generation • 1.58k • Updated Aug 23 • 65

neopolita/Qwen3.6-19B-A3B-Niwaki-v2-4bit-mlx

Text Generation • 1.58k • Updated Aug 23 • 75

Ttimms/KAT-Coder-V2.5-Dev-REAP-50-NVFP4A16-GPTQ

Text Generation • 19B • Updated 25 days ago • 105

biMEMO/Ornith-1.5-35B-A3B-int4-AutoRound-MTP

6B • Updated Aug 24 • 3.56k • 5

agiws/Qwen3.8-27B-NQ-SVD-IQ2

Updated 4 days ago

slevinw/Muse-Glimmer-30B-Heretic-Uncensored-GGUF

Image-Text-to-Text • 28B • Updated Aug 24 • 1.17k

vcruz305/Muse-Glimmer-30B-Hermes-Agentic-NVFP4

Image-Text-to-Text • 19B • Updated Aug 24 • 229

MESHIVEAI/Qwen-3.8-27B-Q4_K_M-Imatrix

Text Generation • 27B • Updated 6 days ago • 122

casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8

36B • Updated Aug 28 • 128

mesiu650/GR00T-N1.6-LIBERO-llm-w4a4-flatquant-tf32

Updated Aug 24 • 4

LayerNorm/Qwen3-ASR-0.6B-hf-hqq-int4

Automatic Speech Recognition • 0.5B • Updated Aug 24 • 10

Kindadodgy/qwen38-256k-on-16gb

Text Generation • 27B • Updated Aug 24 • 557 • 1

matbee/LFM2.5-350M-Instruct-ONNX-Vulkan

Text Generation • Updated Aug 24

gbuzhf/ICE-quantization

Updated Aug 25 • 5

arashakb/FastWAM_UR3

Robotics • Updated Aug 25

peasantsmith/gpt-oss-120b-PS-IQ4_NL.gguf

Text Generation • 117B • Updated Aug 29 • 278 • 2

Milor123/ComfyUI-ConvRot-SenseNova-U1.5-8B-MoT-T8

Any-to-Any • Updated Aug 25 • 15

xedro98/quantization-as-a-transfer-constraint

Updated Aug 25 • 1

altaidevorg/turkish-bge-m3-model2vec-turboquant-4bit

Feature Extraction • Updated Aug 25 • 9