AlbertShi

AlbertShi's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted 2 papers about 20 hours ago

CoWindow Attention: Full Causal Coverage Is a Collective Property

Paper • 2609.32704 • Published 4 days ago • 60

MassAlloc Attention: Let Attention Allocate Its Own Compute

Paper • 2609.32712 • Published 4 days ago • 65

upvoted an article about 1 year ago

view article

Article

Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models

• 

wubingheng

•

Aug 5, 2025

• 7

upvoted a paper about 1 year ago

Trainable Dynamic Mask Sparse Attention

Paper • 2508.02124 • Published Aug 4, 2025 • 19

upvoted a collection over 1 year ago

🐕Small-Doges

Collection

Doge family of small language models! • 18 items • Updated Apr 21, 2025 • 11

upvoted a paper over 1 year ago

Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architecture

Paper • 2412.11834 • Published Dec 16, 2024 • 8

upvoted a collection over 1 year ago

Doge

Collection

Doge family of small language models. • 12 items • Updated Mar 28, 2025 • 6