Hugging Face's logo

QuantTrio
Team
community
Activity Feed

AI & ML interests

We're a trio of AI enthusiasts who create LLM quantization models (GPTQ, WNA16) in our spare time. We bridge ModelScope and Hugging Face by porting our quantized models to make efficient AI more accessible globally.

Recent Activity
JunHowie  new activity 7 days ago
QuantTrio/gemma-4-31B-it-AWQ:Request update model to google updates of july 2026
JunHowie  updated a model 7 days ago
QuantTrio/gemma-4-31B-it-AWQ
tclf90  new activity 29 days ago
QuantTrio/GLM-5.2-Int4-Int8Mix:GLM-5.2-Int4-Int8Mix generates only "!!!!!" on H100 8×80GB with vLLM 0.23.0/0.24.0 — IndexShare sparse indexer K-cache never populated during prefill
View all activity
JunHowie 
in QuantTrio/gemma-4-31B-it-AWQ 7 days ago

Request update model to google updates of july 2026

1
#3 opened 7 days ago by
bagwani
JunHowie 
updated a model 7 days ago
tclf90 
in QuantTrio/GLM-5.2-Int4-Int8Mix 29 days ago

GLM-5.2-Int4-Int8Mix generates only "!!!!!" on H100 8×80GB with vLLM 0.23.0/0.24.0 — IndexShare sparse indexer K-cache never populated during prefill

3
#3 opened 30 days ago by
kinggenguo
JunHowie 
in QuantTrio/GLM-5.2-Int4-Int8Mix 30 days ago

GLM-5.2-Int4-Int8Mix generates only "!!!!!" on H100 8×80GB with vLLM 0.23.0/0.24.0 — IndexShare sparse indexer K-cache never populated during prefill

3
#3 opened 30 days ago by
kinggenguo
tclf90 
in QuantTrio/GLM-5.2-Int4-Int8Mix about 1 month ago

AWQ 4bit

2
#2 opened about 1 month ago by
MatthieuZ
JunHowie 
in QuantTrio/GLM-5.2-Int4-Int8Mix about 1 month ago

Any chances for A100?

5
#1 opened about 1 month ago by
traphix
JunHowie 
updated a model about 1 month ago
JunHowie 
published 2 models about 1 month ago
JunHowie 
updated a model about 1 month ago
JunHowie 
in QuantTrio/GLM-5.1-AWQ about 1 month ago

GLM-5.2-AWQ

1
#2 opened about 1 month ago by
ag1988
tclf90 
in QuantTrio/GLM-4.7-AWQ 2 months ago

Revert remplate
#8 opened 3 months ago by
s-yanev
tclf90 
in QuantTrio/GLM-4.7-AWQ 3 months ago

Support for structured output
#7 opened 3 months ago by
s-yanev
tclf90 
in QuantTrio/DeepSeek-V3.1-AWQ-Lite 3 months ago

Fix chat_template crash when assistant message omits the `content` key
#5 opened 3 months ago by
qgallouedec
tclf90 
in QuantTrio/DeepSeek-V3.2-Exp-AWQ 3 months ago

Fix chat_template crash when assistant message omits the `content` key
#4 opened 3 months ago by
qgallouedec
tclf90 
in QuantTrio/DeepSeek-V3.1-AWQ 3 months ago

Fix chat_template crash when assistant message omits the `content` key
#5 opened 3 months ago by
qgallouedec
tclf90 
updated a collection 3 months ago
JunHowie 
updated a model 3 months ago