lower quant versions please
#3
by ShinnAsukaYESTaylorSwiftNO - opened
Could you please add lower quant versions such as Q4_K_S and Q5_K_S?
OK
OK
Thank you
ShinnAsukaYESTaylorSwiftNO changed discussion status to closed
Could you please add lower quant versions such as Q4_K_S and Q5_K_S?
OK
OK
Thank you