Retrofitting Recurrent Depth into a Pretrained Language Model: Installation, Extrapolation, Transfer, and Retention at Two Parameter Budgets
Paper • 2608.11233 • Published • 1
Paul Bouyé
paulbouuu
·
AI & ML interests
LLM, diffusion models
Recent Activity
liked a model 24 days ago
ZoneTwelve/HRM-Sudoku liked a model 24 days ago
ThomasHeim/HRM-Reproduction-CheckpointsOrganizations
upvoted a paper 3 days ago
upvoted an article 11 months ago
Article
You could have designed state of the art positional encoding
FL33TW00D-HF
• • 503