kurcontko's picture
vllm_plugin: host-side lm_head under TP, int32 id fix, --flashinfer-autotune (auto off for TP>1)
7b43c2d verified