Load 4bit models 4x faster Collection Native bitsandbytes 4bit pre quantized models • 25 items • Updated Aug 26 • 62
Unsloth 4-bit Dynamic Quants Collection Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit • 28 items • Updated Aug 26 • 97
