Concept Steerers: Leveraging K-Sparse Autoencoders for Controllable Generations
Paper • 2501.19066 • Published • 13
Lee Gao
leegao19
AI & ML interests
None yet
Organizations
upvoted 3
papers over 1 year ago
upvoted 9
papers almost 2 years ago
Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
Paper • 2501.00073 • Published • 1
Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models
Paper • 2412.07171 • Published • 1
Rethinking Addressing in Language Models via Contexualized Equivariant Positional Encoding
Paper • 2501.00712 • Published • 6
Understanding and Mitigating Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing
Paper • 2501.00658 • Published • 7
LearnLM: Improving Gemini for Learning
Paper • 2412.16429 • Published • 23
Revisiting In-Context Learning with Long Context Language Models
Paper • 2412.16926 • Published • 32
Deliberation in Latent Space via Differentiable Cache Augmentation
Paper • 2412.17747 • Published • 32
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Paper • 2412.17739 • Published • 40
Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 53
upvoted 8
papers over 2 years ago
Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference
Paper • 2403.09636 • Published • 3
Video Editing via Factorized Diffusion Distillation
Paper • 2403.09334 • Published • 22
Scattered Mixture-of-Experts Implementation
Paper • 2403.08245 • Published • 2
MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
Paper • 2401.15947 • Published • 54
Enhancing Multimodal Large Language Models with Vision Detection Models: An Empirical Study
Paper • 2401.17981 • Published • 1
In-Context Learning Creates Task Vectors
Paper • 2310.15916 • Published • 43
Function Vectors in Large Language Models
Paper • 2310.15213 • Published • 1
What Algorithms can Transformers Learn? A Study in Length Generalization
Paper • 2310.16028 • Published • 2