RetNet-0.5B - from-scratch training line Collection From-scratch 0.5B RetNet (21.6 B tokens): epoch 1-3, repair v21.1, long-context v21.2, chat v21.3-chat, 16k/8k research exports. • 16 items • Updated 3 days ago