Quantization request for https://huggingface.co/hon9kon9ize/CantoneseLLM-v2.0-8B-Thinking
#2893
by gluestick53A - opened
Please consider creating GGUF and imatrix quants for https://huggingface.co/hon9kon9ize/CantoneseLLM-v2.0-8B-Thinking
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#CantoneseLLM-v2.0-8B-Thinking-GGUF for quants to appear.