Paul Cozzolino PRO

pastapaul's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in canada-quant/GLM-5.3-Flash-W4A16-MTP 25 days ago

KeyError on Hopper with vLLM: `layers.0.mlp.gate_up_proj.weight`

3

#2 opened 25 days ago by

yasirgunes

New activity in canada-quant/GLM-5.3-Flash-W4A16-MTP 26 days ago

2X 6K Pros

2

#1 opened about 1 month ago by

mtcl

New activity in canada-quant/GLM-5.2-W4A16-MTP 3 months ago

Loading the model

4

#1 opened 3 months ago by

madeby561

Can you run NVFP4 + Marlin?

5

#2 opened 3 months ago by

einsteiner1983

New activity in canada-quant/DeepSeek-V4-Flash-NVFP4-FP8-MTP 4 months ago

Docker Image

8

#1 opened 4 months ago by

mtcl

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 4 months ago

Compatible version with Ampere? SM8.6

1

#6 opened 4 months ago by

bullerwins

Small patch to fix MTP on current vLLM (8th of June, 26)

7

#8 opened 4 months ago by

dnhkng

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP 4 months ago

MTP BF16 draft weights may need explicit quant_config exclusion for vLLM

2

#2 opened 4 months ago by

yangsiqt2

vLLM compressed-tensors loader fails on shared_experts.gate_up_proj — missing quant target for fused shared-expert projection?

3

#1 opened 4 months ago by

ajdoosh

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 4 months ago

2026-05-26 dual-spark bench: GSM8K 94-98%, AIME 4/5, concurrency wall 12→125 tok/s

#7 opened 4 months ago by

pastapaul

New activity in canada-quant/DeepSeek-V4-Pro-NVFP4-FP8-MTP 4 months ago

Lossless?

👀 1

1

#1 opened 4 months ago by

lukealonso

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 4 months ago

Does the Redhat accuracy loss concern apply here also?

1

#5 opened 4 months ago by

1anH

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 5 months ago

dgx spark error ：torch.AcceleratorError: CUDA error: an illegal memory access was encountered ......

3

#3 opened 5 months ago by

wangweiweihw

One shot bootstrap for 2 Sparks not working

1

#4 opened 5 months ago by

easonchow0419

Can I run this model on 2x H20 141GB?

3

#1 opened 5 months ago by

CHNtentes

Need vllm-w4a16-dsv4:exp Thanks

2

#2 opened 5 months ago by

youcai666

Can I run this model on 2x H20 141GB?

3

#1 opened 5 months ago by

CHNtentes