Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

974

Base only

Active filters: compression

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-qqp-v2

Updated Jul 31, 2022 • 16

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-qqp-v2

Updated Jul 31, 2022 • 18

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • 6B • Updated Jan 10, 2025 • 37 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • 6B • Updated Dec 25, 2024 • 35 • 5

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 30

RedHatAI/sst2-distilbert-sparse-blog

Text Classification • Updated Mar 13, 2024 • 14 • 4

aoxo/kevin-token-compressor

Text Generation • Updated Sep 18, 2024 • 14

justuswill/UQDM

Updated Jun 18, 2025

kalsy/TEZip

Updated Jun 24, 2025

prompterminal/nanogpt-shakespeare-compressed

Text Generation • Updated Jul 21, 2025 • 18

prompterminal/nanogpt-enwik8-compressed

Text Generation • Updated Jul 21, 2025 • 24

prompterminal/nanogpt-enwik8-compressed-working

Text Generation • Updated Jul 21, 2025 • 43 • 1

haichaozhang/VQ-Token-llava-ov-0.5b

Video-Text-to-Text • 1B • Updated Sep 21, 2025 • 21 • 2

qep/qep-1bit-extreme

Text Generation • 23B • Updated Sep 8, 2025 • 85 • 15

swayamsingal/tencent-Hunyuan-MT-7B-light-nanoquant-light

8B • Updated Sep 3, 2025 • 15 • 1

swayamsingal/tencent-Hunyuan-MT-7B-medium-nanoquant-medium

8B • Updated Sep 3, 2025 • 7

kyne0127/Qwen3-30B-A3B-TopK4-Compressed

Text Generation • 31B • Updated Sep 22, 2025 • 17

mradermacher/Qwen3-30B-A3B-TopK4-Compressed-GGUF

31B • Updated Sep 28, 2025 • 311

mradermacher/Qwen3-30B-A3B-TopK4-Compressed-i1-GGUF

31B • Updated Dec 8, 2025 • 1.38k

ggunio/B2NL-v6.1.2

Updated Sep 26, 2025 • 10

ggunio/B2NL-IntelligentTokenizer-v6.2.1

0.2B • Updated Oct 7, 2025 • 56

cerebras/Qwen3-Coder-REAP-246B-A35B-FP8

Text Generation • 246B • Updated Oct 14, 2025 • 43 • 22

huawei-csl/Qwen3-1.7B-3bit-SINQ

Text Generation • 0.5B • Updated Feb 2 • 26 • 7

huawei-csl/Qwen3-1.7B-3bit-ASINQ

Text Generation • 0.5B • Updated Feb 2 • 22 • 7

huawei-csl/Qwen3-14B-3bit-SINQ

Text Generation • 3B • Updated Feb 2 • 23 • 5

huawei-csl/Qwen3-14B-3bit-ASINQ

Text Generation • 3B • Updated Feb 2 • 19 • 5

huawei-csl/Qwen3-32B-3bit-SINQ

Text Generation • 6B • Updated Feb 2 • 16 • 6

huawei-csl/Qwen3-32B-3bit-ASINQ

Text Generation • 6B • Updated Feb 2 • 18 • 5

huawei-csl/Qwen3-1.7B-4bit-SINQ

Text Generation • 1B • Updated Feb 2 • 25 • 5

huawei-csl/Qwen3-1.7B-4bit-ASINQ

Text Generation • 1B • Updated Feb 2 • 16 • 5