One library of quantized LLMs measured by quant-agent. Rank WikiText-2 in the GitHub library/ catalog, then download these repos.
-
chris320211/flatquant-phi3-mini-4k-g52xlarge
Text Generation • Updated • 497 -
chris320211/smoothquant-granite33-2b-g52xlarge
Text Generation • Updated • 330 -
chris320211/smoothquant-qwen25-15b-g52xlarge
Text Generation • 2B • Updated • 455 -
chris320211/smoothquant-gemma2-2b-g52xlarge
Text Generation • 3B • Updated • 182