Zhongzhu
/

OSCAR-RotationZoo

Text Generation

Model card Files Files and versions

OSCAR-RotationZoo / MiniMax-M3 /README.md

Zhongzhu's picture

Add MiniMax-M3 OSCAR KV rotations

75a7cf3 verified 3 months ago

|

Raw History Blame Contribute Delete

177 Bytes

MiniMax-M3 OSCAR KV rotations

Data-free Hadamard, 60 layers, [128, 128]. Calibration was measured to add nothing on this model -- the shared rotation is already saturated.