PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training Paper β’ 2309.10400 β’ Published Sep 19, 2023 β’ 26
CausalLM is not optimal for in-context learning Paper β’ 2308.06912 β’ Published Aug 14, 2023 β’ 19