Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,110

Base only

Active filters: speculative-decoding

lyf/Qwen3.6-27B-uncensored-heretic-v2-NVFP4-MTP

Image-Text-to-Text • 16B • Updated May 1 • 72 • 2

abhinand/Qwen3.6-35B-A3B-DFlash-GGUF

Text Generation • 0.5B • Updated May 1 • 1.13k • 9

Youssofal/Qwen3.6-27B-MTPLX-Optimized

Text Generation • 27B • Updated 11 days ago • 569 • 9

kleybrink/Qwen3.6-35B-A3B-Hybrid-INT4-FP8-MTP

Image-Text-to-Text • 7B • Updated May 3 • 171 • 3

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 27B • Updated 18 days ago • 2.24k • 63

Youssofal/Qwen3.5-4B-MTPLX-Optimized-Speed

Text Generation • 4B • Updated 18 days ago • 1.08k • 2

Youssofal/Qwen3.5-4B-Optimized-MTPLX

Text Generation • 5B • Updated 18 days ago • 379 • 1

unieai/Qwen3.5-122B-A10B-DFlash

Text Generation • 0.5B • Updated Apr 26 • 27

unieai/Qwen3.6-35B-A3B-DFlash

Text Generation • 0.5B • Updated Apr 26 • 37

unieai/Kimi-K2.5-DFlash

Text Generation • 3B • Updated Apr 18 • 20

unieai/Qwen3.5-4B-DFlash

Text Generation • 0.5B • Updated May 4 • 19

unieai/Qwen3.5-9B-DFlash

Text Generation • 1B • Updated May 4 • 63

unieai/Qwen3.5-35B-A3B-DFlash

Text Generation • 0.5B • Updated May 4 • 17

unieai/Qwen3.5-27B-DFlash

Text Generation • 2B • Updated May 4 • 17

unieai/Qwen3-Coder-Next-DFlash

Text Generation • 0.5B • Updated May 4 • 14

unieai/gpt-oss-20b-DFlash

Text Generation • 0.8B • Updated May 4 • 17

unieai/gpt-oss-120b-DFlash

Text Generation • 0.8B • Updated May 4 • 28 • 1

unieai/Qwen3-4B-DFlash-b16

Text Generation • 0.5B • Updated May 4 • 14

unieai/Qwen3-8B-DFlash-b16

Text Generation • 1B • Updated May 4 • 19

unieai/Qwen3-Coder-30B-A3B-DFlash

Text Generation • 0.5B • Updated May 4 • 24

unieai/LLaMA3.1-8B-Instruct-DFlash-UltraChat

Text Generation • 1B • Updated May 4 • 15

KingsonHO/Qwen3.5-122B-A10B-DFlash

Text Generation • 0.5B • Updated May 4 • 11

KingsonHO/Qwen3.5-27B-DFlash

Text Generation • 2B • Updated May 4 • 15

rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm

15B • Updated Aug 24 • 136k • 44

Supbatomic/qwen3-6-27b-dflash-model

Text Generation • 2B • Updated May 5 • 17

Brian6145/Qwen3.6-27B-Claude-Opus-Sonnet-Distilled-NVFP4-MTP

Text Generation • 20B • Updated May 8 • 272 • 37

mlx-community/gemma-4-E2B-it-assistant-bf16

Text Generation • 78M • Updated May 5 • 358 • 7

mlx-community/gemma-4-E4B-it-assistant-bf16

Text Generation • 78.8M • Updated May 5 • 1.02k • 12

mlx-community/gemma-4-31B-it-assistant-bf16

Text Generation • 0.5B • Updated May 5 • 1.22k • 21

mlx-community/gemma-4-26B-A4B-it-assistant-bf16

Text Generation • 0.4B • Updated May 5 • 951 • 21