RWKV-X is a family of long-context models based on RWKV-7, enhanced with Sparse Attention and capable of handling context windows up to 64K tokens.
howard-hou
howard-hou
AI & ML interests
None yet
Recent Activity
updated a model 8 days ago
howard-hou/RWKV-X updated a model 8 days ago
howard-hou/EmbeddingRWKV upvoted a collection 8 days ago
RWKV-XOrganizations
None yet