Any chance we'll get an asym w4a8 quant?

by nosok12313 - opened 1 day ago

The newest ComfyUI update supports w4a8 and it looks great, but I can't figure out how to do the quantization myself. Would be awesome if an expert could handle it.

dummy9996

about 16 hours ago

try https://huggingface.co/realrebelai/Rebels_w4a8s/blob/main/Krea-2-Turbo-w4a8.safetensors ++ https://huggingface.co/dummy9996/kroma-lora-pruned/blob/main/kroma-v0.2-base-lora-r100.safetensors

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment