Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,305

Base only

Active filters: quantization

D-Squarius-Green-Jr/Nucleus-Image-FP8

Text-to-Image • Updated Apr 15 • 32 • 4

AsadIsmail/gemma-4-31B-it-ternary

Image-Text-to-Text • Updated Apr 15 • 4

lhca521/Gemma4-26b-Super-Abliterated-TQ3_4S

Image-Text-to-Text • 25B • Updated Apr 15 • 53 • 2

MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16

Text Generation • 24B • Updated Apr 15 • 832 • 11

MLliu6/Qwen3-VL-4B-Instruct-AWQ-W4A16

Image-Text-to-Text • 5B • Updated Apr 25 • 670

MLliu6/Qwen3-VL-8B-Instruct-AWQ-W4A16

Image-Text-to-Text • 3B • Updated Apr 17 • 1.44k

Abiray/Qwen3.6-35B-A3B-Q3_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 355 • 1

Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 3.84k • 25

Abiray/Qwen3.6-35B-A3B-Q5_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 1.03k • 4

Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 939 • 3

Abiray/Qwen3.6-35B-A3B-Q8_0-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 375 • 2

Abiray/Qwen3.6-35B-A3B-Q4_K_S-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 166 • 3

Abiray/Qwen3.6-35B-A3B-heretic-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 1.28k • 17

Abiray/Qwen3.6-35B-A3B-heretic-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 17 • 842 • 8

scottgl/MiniMax-M2.7-REAP-172B-A10B-NVFP4-GB10

Text Generation • 98B • Updated Apr 16 • 165 • 6

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 587 • 82

YTan2000/Huihui-Qwen35-A35B-Ablit-Small-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 16 • 111 • 1

neroai14/Nero-Qwen2.5-1.5B-Surgical

2B • Updated Apr 18 • 13 • 1

majentik/garden

Text Generation • Updated 18 days ago

AsadIsmail/CogVideoX-2b-ternary

Text-to-Video • 2B • Updated Jul 5 • 8

AsadIsmail/CogVideoX-5b-ternary

Text-to-Video • 6B • Updated Jul 5 • 13 • 1

sphaela/gemma-4-E2B-it-AutoRound-GGUF

5B • Updated Apr 24 • 374

armanibadboy/gemma-4-31b-it-route-b-perhead-k37

sphaela/gemma-4-E4B-it-AutoRound-GGUF

8B • Updated Apr 24 • 726 • 1

armanibadboy/discrete-weight-language-gemma-4-31b-it-all-linear

Image-Text-to-Text • 31B • Updated Apr 17 • 17

sphaela/gemma-4-31B-it-AutoRound-GGUF

31B • Updated Apr 24 • 507 • 1

Infatoshi/Qwen3.6-35B-A3B-NVFP4-FP8

Image-Text-to-Text • Updated Apr 17 • 154 • 3

sphaela/gemma-4-26B-A4B-it-AutoRound-GGUF

25B • Updated Apr 24 • 426 • 8

AsadIsmail/SmolVLM2-500M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17

AsadIsmail/SmolVLM2-256M-Video-Instruct-ternary

Image-Text-to-Text • Updated Apr 17