LLM-Drop
Collection
Model weights of paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)". ā¢ 23 items ā¢ Updated ā¢ 7
AI & ML interests
Efficient and adaptive foundation models across language and multimodal intelligence.
Recent Activity
Papers
Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?
Demystifying When Pruning Works via Representation Hierarchies
shwai-heĀ
updated a
collection about 14 hours ago
shwai-heĀ
updated a
collection about 15 hours ago
shwai-heĀ
updated a
Space 3 days ago
shwai-heĀ
updated a
collection 30 days ago
s1ghhhĀ
submitted a
paper to Daily Papers 30 days ago
shwai-heĀ
authored 11
papers 4 months ago
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
Paper ā¢ 2402.10110 ā¢ Published ā¢ 3
What Matters in Transformers? Not All Attention is Needed
Paper ā¢ 2406.15786 ā¢ Published ā¢ 33
Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts
Paper ā¢ 2503.05066 ā¢ Published ā¢ 5
SymRTLO: Enhancing RTL Code Optimization with LLMs and Neuron-Inspired Symbolic Reasoning
Paper ā¢ 2504.10369 ā¢ Published ā¢ 2
CogniPair: From LLM Chatbots to Conscious AI Agents -- GNWT-Based Multi-Agent Digital Twins for Social Pairing -- Dating & Hiring Applications
Paper ā¢ 2506.03543 ā¢ Published ā¢ 1
CoIn: Counting the Invisible Reasoning Tokens in Commercial Opaque LLM APIs
Paper ā¢ 2505.13778 ā¢ Published ā¢ 5
Dense Video Understanding with Gated Residual Tokenization
Paper ā¢ 2509.14199 ā¢ Published ā¢ 3
Understanding and Harnessing Sparsity in Unified Multimodal Models
Paper ā¢ 2512.02351 ā¢ Published ā¢ 5
Making Large Language Models Efficient Dense Retrievers
Paper ā¢ 2512.20612 ā¢ Published ā¢ 5
ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model
Paper ā¢ 2603.22281 ā¢ Published ā¢ 20
Demystifying When Pruning Works via Representation Hierarchies
Paper ā¢ 2603.24652 ā¢ Published ā¢ 20
shwai-heĀ
updated a
collection 4 months ago