Ctrl+K
humuhumu33
Claude Fable 5
Keep multi-turn conversations fast: snapshot the conversation's KV before the follow-up-suggestion pass evicts it, and restore it before the next turn so only the new turn prefills instead of re-processing the whole thread. Measured 20x faster re-prefill on a 459-token thread (12s to 0.6s, same GPU back-to-back), byte-identical by determinism, gated to long threads on capable desktops.
a593567