Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

34

Base only

Active filters: quanto

jvh/whisper-base-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 24 • 2

jvh/whisper-large-v2-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 21 • 3

jvh/whisper-medium-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 22 • 2

jvh/whisper-large-v3-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 22 • 1

doreilly257/PleIAs-OCRonos_Q4_K_M

Updated Sep 2, 2024 • 10

doreilly257/PleIAs-OCRonos_Q2_K_M

Updated Sep 2, 2024 • 8

p1atdev/CogView4-6B-quanto_int8

Updated Mar 8, 2025 • 1

jhugentobler/quanto_last_hope_q8a8

0.8B • Updated Jun 7, 2025 • 7

femboysLover/z-image-turbo-quanto-int4

3B • Updated Dec 7, 2025 • 14

VincentGOURBIN/flux_qint_8bit

Text-to-Image • Updated Dec 25, 2025 • 10

tokenlabsdotrun/Llama-3.1-8B-Quanto-Int8

Text Generation • 8B • Updated Jan 8 • 10

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8

0.2B • Updated Jan 10 • 21

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8

Updated Jan 10 • 17

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 11

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 9

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 11

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 12

aydin99/FLUX.2-klein-4B-int8

Text-to-Image • 4B • Updated Jan 15 • 1.7k • 13

Hadidiz9/UI-S1-7B-Hybrid-W4-Quanto

Image-Text-to-Text • Updated Jan 20 • 12 • 1

ixim/Qwen-Image-2512-Quanto-INT8-transformer

20B • Updated Feb 2

ixim/Qwen-Image-2512-Quanto-INT8-Full

Text-to-Image • 20B • Updated Feb 2 • 14

ixim/Z-Image-INT8

Text-to-Image • 6B • Updated Feb 22 • 26 • 2

renhehuang/qwen3-1.7b-coffee-sft-quanto-int4

Text Generation • 1B • Updated Mar 16 • 19

renhehuang/qwen3-1.7b-coffee-sft-quanto-int8

Text Generation • 2B • Updated Mar 17 • 19

albex123/flux2-klein-kv-qint8-offload

Text-to-Image • Updated Apr 8 • 14 • 1

haanjack/Solar-Open-100B-MXFP4

Text Generation • 57B • Updated Apr 22 • 29

haanjack/EXAONE-4.5-33B-MXFP4

Image-Text-to-Text • 21B • Updated Apr 22 • 12

haanjack/K-EXAONE-236B-A23B-MXFP4

Text Generation • 130B • Updated Apr 23 • 50 • 1

WaveCut/Cosmos3-Super-Text2Image-Quanto-FP8-Transformer

Text-to-Image • 64B • Updated Jun 1

SLLLC/canary-qwen-2.5b-quanto-8bit-safetensors-stt

Automatic Speech Recognition • Updated Jun 5