Paul Cozzolino PRO

pastapaul's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in canada-quant/GLM-5.2-W4A16-MTP about 1 month ago

Loading the model

4

#1 opened about 1 month ago by

madeby561

Can you run NVFP4 + Marlin?

5

#2 opened about 1 month ago by

einsteiner1983

New activity in canada-quant/DeepSeek-V4-Flash-NVFP4-FP8-MTP 2 months ago

Docker Image

8

#1 opened 3 months ago by

mtcl

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 2 months ago

Compatible version with Ampere? SM8.6

1

#6 opened 3 months ago by

bullerwins

Small patch to fix MTP on current vLLM (8th of June, 26)

7

#8 opened 2 months ago by

dnhkng

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP 2 months ago

MTP BF16 draft weights may need explicit quant_config exclusion for vLLM

2

#2 opened 2 months ago by

yangsiqt2

vLLM compressed-tensors loader fails on shared_experts.gate_up_proj — missing quant target for fused shared-expert projection?

3

#1 opened 2 months ago by

ajdoosh

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 3 months ago

2026-05-26 dual-spark bench: GSM8K 94-98%, AIME 4/5, concurrency wall 12→125 tok/s

#7 opened 3 months ago by

pastapaul

New activity in canada-quant/DeepSeek-V4-Pro-NVFP4-FP8-MTP 3 months ago

Lossless?

👀 1

1

#1 opened 3 months ago by

lukealonso

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 3 months ago

Does the Redhat accuracy loss concern apply here also?

1

#5 opened 3 months ago by

1anH

dgx spark error ：torch.AcceleratorError: CUDA error: an illegal memory access was encountered ......

3

#3 opened 3 months ago by

wangweiweihw

One shot bootstrap for 2 Sparks not working

1

#4 opened 3 months ago by

easonchow0419

Can I run this model on 2x H20 141GB?

3

#1 opened 3 months ago by

CHNtentes

Need vllm-w4a16-dsv4:exp Thanks

2

#2 opened 3 months ago by

youcai666

Can I run this model on 2x H20 141GB?

3

#1 opened 3 months ago by

CHNtentes