From-scratch 0.5B RetNet (21.6 B tokens): epoch 1-3, repair v21.1, long-context v21.2, chat v21.3-chat, 16k/8k research exports.
Ayaka
Ayaka157
AI & ML interests
None yet
Recent Activity
updated a model 3 days ago
Ayaka157/RetNet-0.5B-v21.2 updated a model 3 days ago
Ayaka157/RetNet-0.5B-v21.1-chat updated a model 3 days ago
Ayaka157/RetNet-0.5B-v21.1Organizations
None yet