Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,304

Base only

Active filters: quantization

youthfedpycharm/memoria-mobile-vision-assets

Zero-Shot Image Classification • Updated Jun 1 • 13

TheStageAI/gemma-4-E4B-it

Image-Text-to-Text • Updated Jun 2 • 118 • 10

EvanOLeary/laguna-xs2-dense-k8-cuda-sft-int8

Text Generation • Updated May 30 • 19

EvanOLeary/laguna-xs2-dense-k8-cuda-sft-int4-hqq

Text Generation • Updated May 30 • 8

poolside-laguna-hackathon/laguna-xs2-nvfp4-attention

19B • Updated May 30 • 23

poolside-laguna-hackathon/laguna-xs2-two-hacks

Text Generation • Updated May 30 • 1

Tivaphraen/LFM2-8B-A1B-Instruct-QwenDistill

Text Generation • 8B • Updated Jul 7 • 54 • 1

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse-preview

21B • Updated May 31 • 14

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-mse-preview

20B • Updated May 31 • 16

Spaceballs/Llama-3.1-8B-Lexi-Uncensored-V2-heretic-GGUF

Text Generation • 8B • Updated Jun 5 • 679

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse

21B • Updated May 31 • 10

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-awqclip

20B • Updated May 31 • 4.89k • 1

herooooooooo/clip-vit-l-14-laion2b-coco-w4a8-modelopt

Zero-Shot Image Classification • 0.4B • Updated May 31 • 9

theophilusowiti/Caracal_AfroLlama_int4

Text Generation • Updated Aug 8 • 23 • 2

cs2764/Step-3.7-Flash_dq4-mlx

Image-Text-to-Text • 197B • Updated Jun 1 • 15

benjiaiplayground/Cosmos3-Nano_fp8

16B • Updated Jun 1 • 22 • 2

hsng95/gemma-4-26b-a4b-nvfp4-smin-mlx

Text Generation • 26B • Updated Jun 2 • 25

hsng95/gemma-4-26b-a4b-nvfp4-qmax-mlx

Text Generation • 26B • Updated Jun 2 • 34 • 1

Reza2kn/Cosmos3-Nano-INT4-AWQ

Text-to-Image • Updated Jun 2 • 11 • 2

Reza2kn/Cosmos3-Nano-NVFP4-AWQ

Text-to-Image • Updated Jun 2 • 25 • 5

Reza2kn/Cosmos3-Nano-FP8

Text-to-Image • Updated Jun 2 • 15 • 1

saintlits/Intern-S2-Preview-oQ4-mtp

Text Generation • 6B • Updated Jun 4 • 27

AUser0/SmolLM-1.7B-SpectralQ-6bit

0.9B • Updated Jun 2 • 9

saintlits/Intern-S2-Preview-oQ6-mtp

Text Generation • 8B • Updated Jun 4 • 18

AUser0/Qwen2.5-3B-SpectralQ-6bit

1B • Updated Jun 2 • 5

AUser0/Llama-3.2-3B-SpectralQ-6bit

2B • Updated Jun 2 • 9 • 1

DuoNeural/Cosmos3-Nano-GPTQ-4bit

Text-to-Video • Updated Jun 2 • 89 • 1

DuoNeural/Cosmos3-Nano-GPTQ-4bit-Abliterated

Text-to-Video • Updated Jun 2 • 90 • 3

montevive/ALIA-40b-fc-2605-NVFP4-GGUF

Text Generation • 40B • Updated Jun 2 • 22

Reza2kn/Cosmos3-Nano-MLX-4bit

Text-to-Image • Updated Jun 2