veldierin/Qwopus3.8-27B-Flash-V2-Apostate-Uncensored
I took the apostate approach to uncensor the base qwopus3.8-27b-flash-v2 model from Jackrong, and would like to request quantizations please.
In limited testing and in my evals and benchmarking all of which are included on the model card, things seem pretty solid.
This is my first formal request, so i apologize if i need to do anything differently.
https://huggingface.co/veldierin/Qwopus3.8-27B-Flash-V2-Apostate-Uncensored
You just send a link, get a quant, as easy as that =) enjoy =)
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwopus3.8-27B-Flash-V2-Apostate-Uncensored-GGUF for quants to appear.
You just send a link, get a quant, as easy as that =) enjoy =)
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwopus3.8-27B-Flash-V2-Apostate-Uncensored-GGUF for quants to appear.
Is there a reason why the imatrix says its blocked/paused or why the static didnt quantize the vision/mmproj? did i build something wrong with the bf16?
about vision not sure, for the blocked it's because the only imatrix machine is nico1 which is paused and as soon as unpaused it will do the imatrix
Hi @RichardErkhov - i realized as part of the apostate process, it dropped the processor_config.json from the original source tree, which explains why your vision didn't trigger.
i've since added that file back into my source repo.
Is there any way you could target the mmproj now that it's fixed?
Uh I might have to recreate the whole repo for that, but first I will just try to force queue it again a bit later, since mmproj is usually separate (??) from the gguf so it will hopefully just work. I will check later
Oof. 😟 Hopefully it'll come in, otherwise next time i apostate something it'll be proper. I got a PR up in the repo to fix it, so that should not happen again.
Very sorry about that.
sorry for delay, I requeued, let's hope it works, check on it tomorrow in the evening =)