Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 80
🔄 In a Training Loop
Kuldip Patel
kp7742
AI & ML interests
GenAI, LLMs
Recent Activity
upvoted a paper about 1 month ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention updated a model 10 months ago
kp7742/YALM-80M published a model 10 months ago
kp7742/YALM-80MOrganizations
None yet
upvoted a paper about 1 month ago