Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

kv-cache-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

134

Base only

Active filters: kv-cache-quantization

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-2bit

Text Generation • 35B • Updated Aug 20 • 761 • 10

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-8bit

Text Generation • 35B • Updated Aug 20 • 157

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 35B • Updated 22 days ago • 173

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 35B • Updated 22 days ago • 274 • 2

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 35B • Updated 22 days ago • 215

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 35B • Updated 22 days ago • 163 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 35B • Updated 22 days ago • 384 • 5

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 35B • Updated 22 days ago • 216 • 3

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-6bit

Text Generation • 35B • Updated Aug 20 • 157

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit

Text Generation • 35B • Updated Aug 20 • 290 • 1

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-3bit

Text Generation • 35B • Updated Aug 20 • 353 • 6

BananaMind/BananaMind-KV1-8M-2Bit-Experimental

Text Generation • 8.13M • Updated Jul 3 • 33 • 3

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated Jul 30 • 71 • 1

VAREQON/Nemotron-3-Nano-4B-RotorQuant-GGUF-Q2_K

Text Generation • 4B • Updated Jul 30 • 37 • 1