Safety-aware mixed-precision compression of Tiny Aya Global: protect a few safety-critical layers, quantize the rest to 4-bit.
-
CohereLabs/tiny-aya-global
Text Generation • 3B • Updated • 34.3k • 211 -
cybertronak/safecompress-tinyaya-circuitkit-fp16prot-nf4
Text Generation • 3B • Updated • 14 -
cybertronak/safecompress-tinyaya-consensus5-fp16prot-nf4
Text Generation • 3B • Updated • 14 -
cybertronak/safecompress-tinyaya-refusaldrop-fp16prot-nf4
Text Generation • 3B • Updated • 20