Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,043

Base only

Active filters: modelopt

zhuyksir/qwen3_30b_a3b_nvfp4_baseline

16B • Updated Dec 4, 2025 • 4

zhuyksir/qwen3_30b_a3b_nvfp4_qat

16B • Updated Dec 10, 2025 • 3

alphatozeta/sglang_glm_4_6_fp4_modelopt

177B • Updated Dec 5, 2025 • 5

ericlewis/Nemotron-Orchestrator-8B-NVFP4

Text Generation • 5B • Updated Dec 9, 2025 • 15

nvidia/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Feb 9 • 12.3k • 43

trithemius/Velvet-14B-nvfp4

8B • Updated Dec 11, 2025 • 10

nvidia/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Feb 9 • 4.35k • 64

OPENZEKA/Qwen3-4B-Instruct-2507-NVFP4

2B • Updated Dec 25, 2025 • 612

Z841973620/Qwen3-30B-A3B-NVFP4

Text Generation • 16B • Updated Dec 15, 2025 • 8

Z841973620/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated Dec 15, 2025 • 7

OPENZEKA/Qwen3-Coder-30B-A3B-Instruct-NVFP4

Text Generation • 16B • Updated Jan 13 • 326

josephdowling10/Mixtral-8x7B-Instruct-v0.1-NVFP4

Text Generation • 23B • Updated Dec 16, 2025 • 28

taharmasmaliyev07/Llama-2-7b-hf-fp8

7B • Updated Dec 17, 2025 • 7

OPENZEKA/Qwen3-Coder-480B-A35B-Instruct-NVFP4

241B • Updated Dec 25, 2025 • 11

Shifusen/Llama-3.3-70B-Instruct-abliterated-NVFP4-modelopt

36B • Updated Dec 18, 2025 • 59

taharmasmaliyev07/Mistral-7B-v0.1-fp8

7B • Updated Dec 18, 2025 • 2

taharmasmaliyev07/Llama-3.1-8B-fp8

8B • Updated Dec 18, 2025 • 5

taharmasmaliyev07/gemma-2-9b-it-fp8

9B • Updated Dec 18, 2025 • 4

cybermotaz/qwen3-vl-2b-thinking-nvfp4-w4a16

Image-Text-to-Text • 2B • Updated Dec 18, 2025 • 21 • 1

cybermotaz/qwen3-vl-4b-thinking-nvfp4-w4a16

Image-Text-to-Text • 3B • Updated Dec 18, 2025 • 24 • 1

cybermotaz/qwen3-vl-8b-thinking-nvfp4-w4a16

Image-Text-to-Text • 5B • Updated Dec 18, 2025 • 361 • 2

CedricHwang/qwen2.5-0.5b-modelopt-fp8-pc-pt

Text Generation • 0.5B • Updated Dec 19, 2025 • 88

CedricHwang/qwen2.5-0.5b-modelopt-fp8-pb-wo

0.5B • Updated Dec 19, 2025 • 80

stepnoy/gpt-oss-120b-NVFP4

117B • Updated Dec 20, 2025 • 395

baseten-admin/glm-4.7-fp4

183B • Updated Dec 24, 2025 • 4.16k

Salyut1/GLM-4.7-NVFP4

Text Generation • 177B • Updated Dec 23, 2025 • 898 • 17

ericlewis/functiongemma-270m-it-nvfp4

0.2B • Updated Dec 23, 2025 • 7

nvidia/Qwen3-VL-235B-A22B-Instruct-NVFP4

119B • Updated Mar 4 • 4.09k • 7

baseten-admin/glm-4.7-fp4-fp4kv

177B • Updated Dec 25, 2025 • 2

Tengyunw/GLM-4.7-NVFP4

Text Generation • 177B • Updated May 22 • 48 • 6