Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

192

Base only

Active filters: ModelOpt

mmangkad/Qwen3.5-35B-A3B-NVFP4

Text Generation • 22B • Updated Apr 15 • 28

Rewoin/Gemma-4-31B-IT-NVFP4

Text Generation • 21B • Updated Apr 14 • 11

mmangkad/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated Apr 15 • 13 • 1

mmangkad/Qwen3.6-35B-A3B-NVFP4

Text Generation • Updated Apr 16 • 3.86k • 9

gdubicki/Gemma-4-31B-IT-NVFP4

Text Generation • 21B • Updated Apr 17 • 17 • 1

gdubicki/Qwen3-32B-NVFP4

Text Generation • 17B • Updated Apr 17 • 21

vivien118899/Llama-3.1-8B-Instruct-NVFP4

5B • Updated Apr 18 • 9

mmangkad/Qwen3.6-27B-NVFP4

Text Generation • 20B • Updated Apr 22 • 17.4k • 8

cjrytj/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 2 • 14

lazyplay456/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 4 • 9

nvidia/Kimi-K2.6-Eagle3

Text Generation • 2B • Updated Jun 11 • 5.84k • 11

nvidia/GLM-5.1-NVFP4

Text Generation • 382B • Updated May 27 • 26.3k • 42

nvidia/Kimi-K2.6-NVFP4

Text Generation • Updated May 15 • 515k • 42

nvidia/Wan2.2-T2V-A14B-Diffusers-NVFP4

Text-to-Video • Updated May 20 • 11

nvidia/Wan2.2-T2V-A14B-Diffusers-FP8

Text-to-Video • Updated May 20 • 15

nvidia/DeepSeek-V4-Pro-NVFP4

Text Generation • 910B • Updated Jun 14 • 83.8k • 72

Kirill787/Wan2.2-T2V-A14B-Diffusers-FP8

Text-to-Video • Updated May 17

Shivlal6660/Wan2.2-T2V-A14B-Diffusers-FP8

Text-to-Video • Updated May 18

Shivlal6660/Wan2.2-T2V-A14B-Diffusers-NVFP4

Text-to-Video • Updated May 18

wdfgyuagguf/DeepSeek-V4-Pro-NVFP4-FREE

Text Generation • 910B • Updated Jun 3 • 7 • 1

sHEL1562/gemma-4-A4B-it-MoE-HERETIC-nvfp4-blackwell

Image-Text-to-Text • 10B • Updated Jun 23 • 120 • 1

hackerwasii/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Jun 7 • 15

hungtrieu07/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Jun 9 • 15

brodatech/DeepSeek-V4-Pro-NVFP4

Text Generation • 910B • Updated Jun 10 • 10

feizhai123/Wan2.2-T2V-A14B-Diffusers-NVFP4-sensitive-dynfp8

Text-to-Video • Updated Jun 11

PhysShell/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated Jun 11 • 33 • 1

iofshofhe/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated Jun 13 • 10

Shunam/Qwen3-Coder-30B-A3B-Instruct-FP4

Text Generation • 16B • Updated Jun 15 • 6

turen01/GLM-5.1-NVFP4

Text Generation • 382B • Updated Jun 16 • 7

decart-ai/Kimi-K2.7-Code-NVFP4

Text Generation • Updated Jun 19 • 62.9k • 2