Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

kv-cache-compression

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

88

Base only

Active filters: kv-cache-compression

burakaydinofficial/whisper-tiny-mla-cv11

Automatic Speech Recognition • 37.2M • Updated Jul 13 • 15

burakaydinofficial/whisper-base-mla-cv11

Automatic Speech Recognition • 71.2M • Updated Jul 13 • 19 • 1

burakaydinofficial/whisper-medium-mla-cv11

Automatic Speech Recognition • 0.7B • Updated Jul 13 • 11

burakaydinofficial/whisper-large-v3-mla-cv11

Automatic Speech Recognition • 1B • Updated Jul 13 • 10

burakaydinofficial/whisper-small-mla-24lang

Automatic Speech Recognition • 0.2B • Updated Jul 13 • 13

burakaydinofficial/whisper-base-mla-24lang

Automatic Speech Recognition • 71.2M • Updated Jul 13 • 16

burakaydinofficial/whisper-tiny-mla-24lang

Automatic Speech Recognition • 37.2M • Updated Jul 13 • 19

Quazim0t0/Escarda-TriAtn-86M

Text Generation • 97.3M • Updated Jul 8 • 18 • 1

Quazim0t0/Byrne-TriAtn-86M

Text Generation • 96.9M • Updated Jul 8 • 14 • 1

sirluk/Qwen3-8B-KVpop-4x

Text Generation • 8B • Updated Jul 13 • 38 • 3

hhy13/dr75-coswarmup10-ropefree-am-cartridges

tenosra/longchat-7b-starkv-proxima

Text Generation • 7B • Updated Aug 8 • 8 • 1

higokri/RestoreKV

Text Generation • Updated Aug 4 • 1

higokri/RestoreKV-Llama-3.1-8B-Instruct

Updated Aug 6 • 79

higokri/RestoreKV-Llama-3.1-8B-Instruct_plus

Updated Aug 6 • 282

higokri/RestoreKV-Qwen3-8B

Updated Aug 6 • 151

higokri/RestoreKV-Qwen3-8B_plus

Updated Aug 6 • 248

amjd-ai/Qwen2.5-3B-KV-Compressed-50

Text Generation • 3B • Updated Aug 23 • 42

shisa-ai/Qwen3.8-27B-Q4_K_M-DMS-W8192

fraQtl/fraqtl-membrane-llamacpp-runtime

Updated 11 days ago

fraQtl/mistral-nemo-instruct-2407-kv-sidecars

Updated 11 days ago

faridlazuarda/dms-qwen3-1.7b-cr4

Updated Aug 27 • 8

faridlazuarda/dms-qwen3-1.7b-cr8

Updated Aug 26 • 6

alexz949/BasisServe-CALS

Text Generation • Updated 1 day ago

faridlazuarda/dms-qwen3-8b-cr4

Updated Aug 27 • 12

faridlazuarda/dms-qwen3-8b-cr8

Updated Aug 28 • 7

moalikhoda/compression-aware-abstention-adapters

Updated Aug 30 • 1

amd/HyLo-Llama-8MLA8GDN-8K-SFT

Text Generation • 2B • Updated Sep 11 • 51

amd/HyLo-Llama-8MLA8GDN-64K-SFT

Text Generation • 2B • Updated Sep 11 • 80 • 3

amd/HyLo-Llama-4MLA12GDN-8K-SFT

Text Generation • 2B • Updated Sep 11 • 75