Andrea Moccia

brokenlander

·

AI & ML interests

None yet

Recent Activity

new activity 5 days ago

nvidia/GLM-5.3-Flash-NVFP4:MTP layer is unquantized but missing from exclude_modules, so vLLM cannot load it for speculative decoding

upvoted a collection over 1 year ago

Unsloth 4-bit Dynamic Quants

View all activity

Organizations

None yet

New activity in nvidia/GLM-5.3-Flash-NVFP4 5 days ago

MTP layer is unquantized but missing from exclude_modules, so vLLM cannot load it for speculative decoding

#13 opened 5 days ago by