TokenButler -- Predict token importance for all heads across the transformer in the first layer itself. Enable fine-grained token sparsity!
YASH AKHAURI
akhauriyash
AI & ML interests
None yet
Recent Activity
upvoted a collection about 5 hours ago
K2 Horizon new activity 21 days ago
IFM/K2-Horizon-375B-A23B:docs: update SGLang quickstart new activity 21 days ago
IFM/K2-Horizon-MoVA-36B-A4B:docs: update SGLang quickstart