Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

tensor-parallel

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43

Base only

Active filters: tensor-parallel

Feyd89/Qwen3.8-27B-QUASAR-QAT-nvfp4-NInfer

Updated 5 days ago • 176 • 3

guruswami-ai/deepseek-v4-pro-0813-mlx-tp4-recipe

Text Generation • Updated Aug 14 • 2

tsii42/Qwen3.8-27B-W8A8-Dynamic-Ascend-310P-vLLM

Image-Text-to-Text • Updated 5 days ago • 124 • 1

TelperionAI/Qwen3.8-27B-GLA-g2

Text Generation • 27B • Updated about 20 hours ago • 134 • 1

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP1

0.4B • Updated May 4 • 11

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP2

0.4B • Updated May 4 • 8

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP4

0.4B • Updated May 4 • 8

dominant-strategies/quai-deepseek-v4-flash-igemm-fp4fp8

Text Generation • Updated Jun 19 • 15

dominant-strategies/quai-deepseek-v4-flash-igemm-w8a8

Text Generation • Updated Jun 19 • 52

Cadododoom/Qwen3.6-35B-A3B-TextOnly-FP4

18B • Updated Jul 4 • 79

Cadododoom/Agents-A1-TextOnly-FP4

18B • Updated Jul 9 • 13 • 2

mitomtuna/MiMo-V2.5-NVFP4-TP3

200B • Updated Jul 10 • 13 • 1

mitomtuna/MiMo-V2.5-DFlash-TP3

2B • Updated Jul 8 • 13 • 1

mitomtuna/MiMo-V2.5-0703-NVFP4-TP3

200B • Updated Jul 13 • 19 • 6

xbill9/gemma-4-E4B-it-inferentia2

Text Generation • Updated Jul 12 • 1

xbill9/gemma-4-12B-it-inferentia2

Text Generation • Updated Jul 12 • 1

xbill9/gemma-4-31B-it-inferentia2

Text Generation • Updated Jul 16

xbill9/gemma-4-26B-A4B-it-inferentia2

Text Generation • Updated Jul 16

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated Jul 21 • 171 • 3

marianbusoi/Hy3-NVFP4-FP8-TP3

Text Generation • 300B • Updated Jul 28 • 26

Cadododoom/agents-a1-modelopt-nvfp4

18B • Updated Jul 28 • 28

Cadododoom/qwen3.6-35b-a3b-modelopt-nvfp4

18B • Updated Jul 28 • 46

bertholomus/DeepSeek-V4-Flash-0731-DSpark-Graph8

Text Generation • Updated Aug 4 • 4

bertholomus/DeepSeek-V4-Flash-0731-DSpark-Graph8-4xGB10

Text Generation • Updated Aug 13 • 1

leoncca/Qwen3.5-122B-A10B-Heretic-Selective-AWQ

Image-Text-to-Text • 125B • Updated Aug 25 • 83

dealignai/DeepSeek-V4-Flash-0731-CRACK-NVFP4

Text Generation • 304B • Updated Aug 12 • 520 • 23

pottokao/Qwen3.8-27B-NVFP4-MTP-2x16GB

Text Generation • 19B • Updated Aug 18 • 661 • 4

eemin/Qwen3.8-27B-NVFP4-MTP-2x16GB

Text Generation • 19B • Updated Aug 19 • 103

waqasm86/kaggle-vllm-models

Text Generation • Updated about 1 month ago • 246

leoncca/Qwen3.8-27B-Huihui-AWQ

Image-Text-to-Text • 28B • Updated Aug 25 • 988 • 1