Request to make quants of my teensy models - https://huggingface.co/NILKNARFGonzo/single-floppy-346k-merged and https://huggingface.co/NILKNARFGonzo/floppyx3-MEGAmodel-merged
The model
I would like to request quantizations of my own NILKNARFGonzo/single-floppy-346k-merged model. I would like f16, Q8_0, Q4_K_S, Q2_K, Q6_K, Q3_K_M, Q3_K_S, Q3_K_L, Q4_K_M, Q5_K_S, Q5_K_M, IQ4_XS, and Q4_0_4, if possible. Thank you! (And if you can, please do IQ1)
It's so beautiful 💀
It's so beautiful 💀
is not
is stupid
Train it on 1T tokens and see what happens lol. Simonko or nico will queue later, Im busy for now so cant queue. We will queue on usual quants we provide, so you might get iq1 too lol
Train it on 1T tokens and see what happens lol. Simonko or nico will queue later, Im busy for now so cant queue. We will queue on usual quants we provide, so you might get iq1 too lol
im training it on a pi. how do i train it on 1T tokens
I had been summoned
plz let me know when u get to my model
I would also like another of my models to be quantized (with the same if not more quants):
https://huggingface.co/NILKNARFGonzo/floppyx3-MEGAmodel-merged
It's around 1.09M parameters.
why did it do that
nvm i think i know why
Train it on 1T tokens and see what happens lol. Simonko or nico will queue later, Im busy for now so cant queue. We will queue on usual quants we provide, so you might get iq1 too lol
@RichardErkhov
question: when will you get to it? (not to be rude but i'm kinda impatient)
I'm curious why you need so many quants of a model that is... not good? Not that I don't think it's great to have extra stuff, just genuinely curious, like are you using it for something that you specifically need ggufs for as a test or what :D
i dont actually need all of them, but I’m really curious how stupid an IQ1_S could be lol
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#single-floppy-346k-merged-GGUF
https://hf.tst.eu/model#floppyx3-MEGAmodel-merged-GGUF for quants to appear.
tysm!!!!!