Will these quantizations not be using the mainline llama.cpp?

#1
by nonitis - opened

Support for this model has already been merged:
https://github.com/ggml-org/llama.cpp/pull/32217
But it seems that these quantizations do not work with it, only with unsloth's fork.

Sign up or log in to comment