bdauzats's picture
Read up to 2048 state tokens (was 384): the adapters/pointer hold past their training length; on a long-context check (decision-bench quick-v1 in ~1.5k tokens of filler) the end of the text goes from chance to near the start-of-text accuracy
f556a69 verified