vLLM W4A16?

#4
by hiutaky - opened

Is planned a W4A16 ?

would really appreciate Intel Autoround quant for this.

Sign up or log in to comment