mengfanxu
fxmeng
AI & ML interests
None yet
Recent Activity
upvoted a paper 22 minutes ago
On the Design of Hyper-Connections: Simplification, Stability, and Scalability updated a collection 28 days ago
LatentIndex updated a collection 28 days ago
LatentIndexOrganizations
None yet
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
https://arxiv.org/abs/2404.02948
Base Model for TransMLA
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
https://arxiv.org/abs/2404.02948
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1