Quantized LLMs made and measured with QuantPort (github.com/chris320211/QuantPort). Rankings live in its library/LIBRARY.md.
-
chris320211/flatquant-phi3-mini-4k-g52xlarge
Text Generation • Updated • 966 • 1 -
chris320211/smoothquant-granite33-2b-g52xlarge
Text Generation • Updated • 824 -
chris320211/smoothquant-qwen25-15b-g52xlarge
Text Generation • 2B • Updated • 897 • 1 -
chris320211/smoothquant-gemma2-2b-g52xlarge
Text Generation • 3B • Updated • 708