Checkpoints for Fast-weight Product Key Memory (https://arxiv.org/abs/2601.00671)