arxiv:2504.18919
Rafael Mosquera
remg1997
AI & ML interests
NLP, Speech, Diffusion
Organizations
models 22
remg1997/modernbert-small-factorized-linear-dual-babylm2026
Fill-Mask • 24.3M • Updated • 15
remg1997/modernbert-small-phase7-zipfian-centering-babylm2026
Fill-Mask • 25.3M • Updated • 24
remg1997/modernbert-small-phase6-composition-frequency-shuffled-babylm2026
Fill-Mask • 25.3M • Updated • 26
remg1997/modernbert-small-phase6-composition-babylm2026
Fill-Mask • 21.4M • Updated • 18
remg1997/modernbert-small-modernbert-small-factorized-linear-babylm2026
Fill-Mask • 35.9M • Updated • 18
remg1997/modernbert-small-phase7-zipfian-whitening-babylm2026
25.3M • Updated • 6
remg1997/modernbert-small-phase6-composition-residual-babylm2026
25.3M • Updated • 6
remg1997/modernbert-small-phase6-composition-frequency-babylm2026
25.3M • Updated • 9
remg1997/modernbert-small-muon-factorized-mlp-dual-babylm2026
24.3M • Updated • 4
remg1997/modernbert-small-muon-factorized-linear-dual-babylm2026
24.3M • Updated • 6