Beyond the Parameter Monolith: Modular Language Modeling - a E6E831728 Collection

E6E831728 's Collections

Beyond the Parameter Monolith: Modular Language Modeling

Do Language Models Need a Trainable Input Embedding Table?

Language Models Without a Trainable Input Embedding Table

Beyond the Parameter Monolith: Modular Language Modeling

updated 19 days ago

This collection is provided for reproducibility of the paper's main claim

E6E831728/fem-multi-mesh-1p7b

Text Generation • 2B • Updated 24 days ago • 558
E6E831728/modular-reasoning-0p5b-g6p5-demo

Text Generation • 0.5B • Updated 24 days ago • 594