Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,305

Base only

Active filters: quantization

AsadIsmail/SmolVLM2-500M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/SmolVLM2-256M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/whisper-medium-ternary

Automatic Speech Recognition • Updated Apr 17 • 1

AsadIsmail/whisper-small-ternary

Automatic Speech Recognition • Updated Apr 17 • 1

AsadIsmail/Wan2.1-T2V-1.3B-ternary

Text-to-Video • 1B • Updated Jul 5 • 13 • 1

AsadIsmail/Wan2.2-TI2V-5B-ternary

Text-to-Video • 5B • Updated Jul 5 • 20 • 1

jacob9706/Qwen3.6-35B-A3B-QOR-4bit

Text Generation • 35B • Updated Apr 18 • 37

mradermacher/Nero-Qwen2.5-1.5B-Surgical-GGUF

2B • Updated Apr 18 • 223

sphaela/Qwen3.6-35B-A3B-AutoRound-GGUF

36B • Updated Jul 1 • 9.67k • 18

mradermacher/Nero-Qwen2.5-1.5B-Surgical-i1-GGUF

2B • Updated Apr 18 • 570

Venugopalan2610/OLMoE-1B-7B-0125-QTIP-2bit

7B • Updated Apr 18 • 18

catplusplus/MiniMax-M2.7-REAP-172B-A10B-NVFP4

Text Generation • 116B • Updated Apr 18 • 39 • 3

genevera/Qwen3.6-35B-A3B-Abliterated-Heretic-AWQ-4bit

Text Generation • 36B • Updated Apr 26 • 1.22k • 11

otavio-lemos/oci-copilot-jr-gguf

8B • Updated Apr 19 • 45

Sensen02/Fast_dVLM_3B_W8A8_FP8

4B • Updated Apr 19 • 20 • 2

Nishant2414/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 19 • 46 • 1

rayenhizaoui/Whisper-Rayen-Medical

Automatic Speech Recognition • 0.2B • Updated Apr 19 • 8 • 1

eschmidbauer/parakeet-unified-en-0.6b-c

Automatic Speech Recognition • Updated Apr 19 • 1

claroche1/sparse-nsnet2-checkpoints

Updated 17 days ago

brunogcp/Gemma4-26b-Super-Abliterated-TQ3_4S

Image-Text-to-Text • 25B • Updated Apr 20 • 122

SoybeanMilk/Breeze-ASR-26-quantized.w4a16

Automatic Speech Recognition • 2B • Updated Apr 20 • 12

Krasnopjorovs/gemma-4-E4B-Imatrix-IQ4_XS-GGUF

Text Generation • 8B • Updated Apr 21 • 69

Reinforce-ai/spiral-qwen2.5-coder-7b

Text Generation • 8B • Updated Apr 22 • 53 • 1

vrfai/GR00T-N1.6-bridge-INT8-Edge

Robotics • 3B • Updated Apr 21 • 20 • 1

haanjack/Solar-Open-100B-MXFP4

Text Generation • 57B • Updated Apr 22 • 29

haanjack/EXAONE-4.5-33B-MXFP4

Image-Text-to-Text • 21B • Updated Apr 22 • 10

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 159k • 129

LibertAIDAI/Qwen3.6-27B-W4A16-G128

Image-Text-to-Text • 28B • Updated Apr 22 • 148 • 8

Krasnopjorovs/gemma-4-31b-it-Imatrix-IQ4_XS-GGUF

Text Generation • 31B • Updated Apr 23 • 583 • 3

Krasnopjorovs/gemma-4-26b-a4b-it-Imatrix-IQ4_XS-GGUF

Text Generation • 25B • Updated Apr 23 • 329 • 4