Collection by 
Oct 30, 2023
Collections
Discover the best community collections!
Collections trending this week
Collection by 
Jan 31, 2024
Collection by 
Mar 12, 2024
-
Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions
Paper • 2309.10150 • Published • 24 -
Code as Policies: Language Model Programs for Embodied Control
Paper • 2209.07753 • Published • 1 -
Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling
Paper • 2402.10211 • Published • 12
Collection by Jun 8, 2024
-
Decentralized Policy Optimization
Paper • 2211.03032 • Published • 1 -
MPCFormer: fast, performant and private Transformer inference with MPC
Paper • 2211.01452 • Published • 1 -
Distributed Pruning Towards Tiny Neural Networks in Federated Learning
Paper • 2212.01977 • Published • 1 -
FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization
Paper • 2309.06805 • Published • 1
Collection by Jun 15, 2024
-
Scaling MLPs: A Tale of Inductive Bias
Paper • 2306.13575 • Published • 17 -
Trap of Feature Diversity in the Learning of MLPs
Paper • 2112.00980 • Published • 2 -
Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics
Paper • 2301.05816 • Published • 1 -
RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality?
Paper • 2108.04384 • Published • 1
Collection by 
Oct 30, 2023
Collection by Jul 21, 2024
-
Towards General Text Embeddings with Multi-stage Contrastive Learning
Paper • 2308.03281 • Published • 3 -
NEFTune: Noisy Embeddings Improve Instruction Finetuning
Paper • 2310.05914 • Published • 14 -
EELBERT: Tiny Models through Dynamic Embeddings
Paper • 2310.20144 • Published • 3 -
Dynamic Word Embeddings for Evolving Semantic Discovery
Paper • 1703.00607 • Published • 1
Collection by 
Oct 30, 2023
Collection by May 28, 2024
-
Cure the headache of Transformers via Collinear Constrained Attention
Paper • 2309.08646 • Published • 13 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 88 -
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Paper • 2309.10400 • Published • 26 -
Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit
Paper • 2205.13522 • Published • 1
Collection by 
Mar 2
Collection by Oct 30, 2023
Collection by Oct 30, 2023
Collection by Jan 31, 2024
Collection by Jul 21, 2024
-
Towards General Text Embeddings with Multi-stage Contrastive Learning
Paper • 2308.03281 • Published • 3 -
NEFTune: Noisy Embeddings Improve Instruction Finetuning
Paper • 2310.05914 • Published • 14 -
EELBERT: Tiny Models through Dynamic Embeddings
Paper • 2310.20144 • Published • 3 -
Dynamic Word Embeddings for Evolving Semantic Discovery
Paper • 1703.00607 • Published • 1
Collection by Mar 12, 2024
-
Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions
Paper • 2309.10150 • Published • 24 -
Code as Policies: Language Model Programs for Embodied Control
Paper • 2209.07753 • Published • 1 -
Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling
Paper • 2402.10211 • Published • 12
Collection by Oct 30, 2023
Collection by Jun 8, 2024
-
Decentralized Policy Optimization
Paper • 2211.03032 • Published • 1 -
MPCFormer: fast, performant and private Transformer inference with MPC
Paper • 2211.01452 • Published • 1 -
Distributed Pruning Towards Tiny Neural Networks in Federated Learning
Paper • 2212.01977 • Published • 1 -
FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization
Paper • 2309.06805 • Published • 1
Collection by May 28, 2024
-
Cure the headache of Transformers via Collinear Constrained Attention
Paper • 2309.08646 • Published • 13 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 88 -
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Paper • 2309.10400 • Published • 26 -
Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit
Paper • 2205.13522 • Published • 1
Collection by Jun 15, 2024
-
Scaling MLPs: A Tale of Inductive Bias
Paper • 2306.13575 • Published • 17 -
Trap of Feature Diversity in the Learning of MLPs
Paper • 2112.00980 • Published • 2 -
Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics
Paper • 2301.05816 • Published • 1 -
RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality?
Paper • 2108.04384 • Published • 1
Collection by Mar 2