Yao Liu

ali-shumo

·

AI & ML interests

LLM

Recent Activity

upvoted a paper 3 days ago

The Evolution of Attention in Large Language Models: Mechanisms, Trade-offs, and Emerging Trends

upvoted a paper 3 months ago

HydraHead: From Head-Level Functional Heterogeneity to Specialized Attention Hybridization

liked a dataset 10 months ago

allenai/dolma3_dolmino_mix-100B-1125

View all activity

Organizations

None yet

upvoted a paper 3 days ago

The Evolution of Attention in Large Language Models: Mechanisms, Trade-offs, and Emerging Trends

Paper • 2609.39661 • Published 5 days ago • 10

upvoted a paper 3 months ago

HydraHead: From Head-Level Functional Heterogeneity to Specialized Attention Hybridization

Paper • 2606.20097 • Published Jun 18 • 19