The Evolution of Attention in Large Language Models: Mechanisms, Trade-offs, and Emerging Trends Paper • 2609.39661 • Published 2 days ago • 6
HydraHead: From Head-Level Functional Heterogeneity to Specialized Attention Hybridization Paper • 2606.20097 • Published Jun 18 • 19
Nemotron-Pre-Training-Datasets Collection Large scale pre-training datasets used in the Nemotron family of models. • 15 items • Updated Aug 11 • 195