SkyIsNotGreen/Scion-35B-A3B

Text Generation • 35B • Updated 3 days ago • 3.63k • 16

Note 2.61 bpw | 11.34 GB (6.3x smaller than the BF16 reference) | best PPL of the 2-bit class | task retention at Q4-class level, at about half of Q4_K_M's size.

SkyIsNotGreen/Scion-35B-A3B-mtp-drafter

25.2M • Updated 8 days ago • 101 • 1

Note 50MB drafter for Scion 35b. | Needs specific llama.cpp fork to work | Proof-of-concept for cheap drafting using a sidecar.

SkyIsNotGreen/Scion-FlashNext-176B-A6B

Text Generation • 177B • Updated 3 days ago • 2.63k • 6

Note 2.60 bpw | 57.62 GB (3.2x smaller than the FP8 release) | Smallest build of this model while remaining unpruned, last time I checked.