Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

30

Base only

Active filters: fp8-kv-cache

diffbot/MiMo-V2.6-Flash-MOPD-FP8KV-W4A8-2x-RTX-PRO-6000

Any-to-Any • Updated 3 days ago • 13

namgyu-youn/EXAONE-4.0-1.2B-LLMC-AWQ-W4

1B • Updated Feb 18 • 9

rhoninseiei/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-ModelOpt-NVFP4

Image-Text-to-Text • 17B • Updated Mar 21 • 28 • 1

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated Jul 15 • 42.4k • 25

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated Jul 15 • 6.89k • 14

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated Jul 15 • 6.59k • 2

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated Jun 28 • 129 • 2

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated Jul 15 • 6.5k • 6

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated Jun 21 • 6.53k • 1

AEON-7/Gemma-4-E4B-it-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 6.62k • 4

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 94 • 1

AEON-7/gemma-4-31B-it-speculator.eagle3-NVFP4

Text Generation • 2B • Updated Jun 21 • 72 • 5

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated Jul 15 • 193k • 73

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated Jul 15 • 397 • 9

murilonwt/granite-4.1-8b-NVFP4

Text Generation • 5B • Updated May 19

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated Jul 15 • 6.94k • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated Jul 15 • 6.76k

amanwalksdownthestreet/Hermes-4-70B-MXFP8-KV8

Text Generation • 73B • Updated Jul 3 • 21

spellbound-eng/hy3-spellbound-simpo-step151-nvfp4-c8

170B • Updated Jul 9

Ishowbackup/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 18B • Updated Aug 13 • 33

SinclairSchneider/Apertus-v1.5-8B-W4A16-KV8-de

Text Generation • 9B • Updated Aug 19 • 77

SinclairSchneider/Apertus-v1.5-70B-FP8-KV8

Text Generation • 72B • Updated Aug 21 • 30

SinclairSchneider/Apertus-v1.5-70B-W4A16-KV8

Text Generation • 13B • Updated Aug 21 • 60

SinclairSchneider/Mistral-Medium-3.5-128B-W4A16-KV8

Text Generation • 22B • Updated Aug 21 • 257

abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV

Image-Text-to-Text • 28B • Updated Aug 27 • 53.6k • 2

abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV

Image-Text-to-Text • 28B • Updated Aug 27 • 7.19k • 2

minima-ai/mnma_qwen3.8_27b_nvfp4

Text Generation • 27B • Updated about 1 month ago • 1.22k • 11

emee-ai/mnma_qwen3.8_27b_nvfp4

Text Generation • 27B • Updated 29 days ago • 368

INCModel4/gemma-4-26B-A4B-MXFP8-FP8KV-CT-RTN-AutoRound

Text Generation • 26B • Updated 7 days ago • 41

INCModel4/gemma-4-31B-MXFP8-FP8KV-CT-AutoRound

Image-Text-to-Text • 31B • Updated 7 days ago • 21