Will you provide pruned version for bf16?
#7
by John-Wong - opened
Will you provide pruned version for bf16 that will allow it to be run on 48G VRAM or higher? Sounds great?
Thanks for your time!
Also for those of us with old hardware which cannot run int8, it would be better to have bf16 for converting to fp8 or quantizing to GGUF