yangsiqt

yangsiqt2's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8 4 months ago

Small patch to fix MTP on current vLLM (8th of June, 26)

7

#8 opened 4 months ago by

dnhkng

New activity in canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP 4 months ago

MTP BF16 draft weights may need explicit quant_config exclusion for vLLM

2

#2 opened 4 months ago by

yangsiqt2