Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,051

Base only

Active filters: speculative-decoding

jmgao/Swift1.5-Flash-Next-mixed-NInfer

Image-Text-to-Text • Updated 6 days ago • 19

pottokao/Z-Image-Engineer-V6-DFlash-b16

0.5B • Updated 3 days ago • 511

apriliacloset/Qwen3.8-27B-Uncensored-GGUF

Text Generation • 27B • Updated 5 days ago • 1.93k

benthecarman/MiMo-V2.6-Flash-MOPD-exl3

Text Generation • 46B • Updated 5 days ago • 111

matrix2596/Qwen3.8-27B-DSpark-vLLM

Text Generation • 2B • Updated 5 days ago • 203

vvsotnikov/Qwen3.8-3.6-27B-blend-Splash-v0.3

Updated 5 days ago

RASMUS/gemma-4-E4B-it-mtp-ONNX

Updated 5 days ago

inference-optimization/Qwen3-8B-DFlash-FP8-BLOCK

Text Generation • 2B • Updated 5 days ago • 31

inference-optimization/Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 5 days ago • 30

inference-optimization/Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 5 days ago • 29

inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 5 days ago • 34

inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 5 days ago • 38

JRamirez-UAB/Qwopus3.8-27B-Flash-V2-GPTQ-W4A16-embed-int4-24GB

Image-Text-to-Text • 27B • Updated about 17 hours ago • 49

JRamirez-UAB/Qwen3.8-27B-GPTQ-W4A16-embed-int4-24GB

Image-Text-to-Text • 27B • Updated about 17 hours ago • 99

nex-agi/Nex-N2.5-Pro-DFlash

Text Generation • 1B • Updated 5 days ago • 28

inference-optimization/Qwen3.8-27B-DSpark-FP8-BLOCK

Text Generation • 2B • Updated 5 days ago • 40

inference-optimization/Qwen3.8-27B-DSpark-FP8-DYNAMIC

Text Generation • 2B • Updated 5 days ago • 48

inference-optimization/Qwen3.8-27B-DSpark-Gauss-FP8-W8A8

Text Generation • 2B • Updated 5 days ago • 45

inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8

Text Generation • 2B • Updated 5 days ago • 45

inference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 5 days ago • 153

inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 5 days ago • 154

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 5 days ago • 45

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 5 days ago • 47

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 5 days ago • 47

inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 5 days ago • 50

clsx524/Qwen3.5-4B-uzu-EXL3-3bpw

Text Generation • 0.7B • Updated 5 days ago • 86

vaishaalli/stage1-kd

0.5B • Updated 5 days ago • 5

vaishaalli/tb-kd

0.5B • Updated 5 days ago • 5

vaishaalli/stage2-gkd-mixed

0.5B • Updated 5 days ago • 7

vaishaalli/stage2-gkd-tbonly

0.5B • Updated 5 days ago • 6