18.6 GB
hkust-aaron's picture
Use BF16 state at every CUDA batch and stabilize physical-ring attention
623a14e verified