Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus
Paper • 2608.12149 • Published • 16
Tiantian Zhang
crystal-cheung
AI & ML interests
None yet
Recent Activity
upvoted a paper about 17 hours ago
Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike PlateausOrganizations
None yet
upvoted a paper about 17 hours ago