Hyun9junn/Llama-2-7b-hf-W4A4KV4-FlatQuant
4B • Updated • 16
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
15
Active filters: flatquant
Hyun9junn/Meta-Llama-3-8B-W4A4KV4-FlatQuant
5B • Updated • 20
Hyun9junn/Meta-Llama-3-8B-Instruct-W4A4KV4-FlatQuant
5B • Updated • 15
Hyun9junn/Llama-3.1-8B-Instruct-W4A4KV4-FlatQuant
5B • Updated • 159
Hyun9junn/Llama-3.3-70B-Instruct-W4A4KV4-FlatQuant
36B • Updated • 12
Hyun9junn/Meta-Llama-3-70B-W4A4KV4-FlatQuant
36B • Updated • 13
Hyun9junn/Llama-3.1-8B-W4A4KV4-FlatQuant
5B • Updated • 10
Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant
36B • Updated • 6
Hyun9junn/EXAONE-4.5-33B-FlatQuant-W4A16
Image-Text-to-Text • 7B • Updated • 12
mesiu650/GR00T-N1.6-LIBERO-llm-w4a4-flatquant-tf32
Updated • 5
ewin-reg/WeMM-Embedding-2B-GGUF
Feature Extraction • 2B • Updated • 2.71k • 2
chiruan/Qwen3-4B-RECAP-W4A4KV4-Prefix12K
Text Generation • 4B • Updated • 266
chiruan/DeepSeek-R1-Distill-Qwen-1.5B-FlatQuant-Prefix12K-W4A8KV4
Text Generation • 2B • Updated • 224
chiruan/DeepSeek-R1-Distill-Qwen-1.5B-FlatQuant-W4A8KV4
Text Generation • 2B • Updated • 294
chris320211/flatquant-phi3-mini-4k-g52xlarge
Text Generation • Updated • 497