Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus
Paper • 2608.12149 • Published • 16
anping
Ethan20260508
AI & ML interests
None yet
Recent Activity
upvoted a paper about 18 hours ago
Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike PlateausOrganizations
None yet
upvoted a paper about 18 hours ago