Does RoPE Prevent or Degrade Retrieval Heads? A Mechanistic Analysis Across Model Families
Paper • 2606.21249 • Published • 1
👋 Open to Work
Cengizhan Bayram
Cosmobillian
AI & ML interests
None yet
Recent Activity
authored a paper about 1 month ago
Does RoPE Prevent or Degrade Retrieval Heads? A Mechanistic Analysis Across Model Families upvoted a paper about 1 month ago
Does RoPE Prevent or Degrade Retrieval Heads? A Mechanistic Analysis Across Model Families updated a model 4 months ago
Cosmobillian/TR-Llama-8B-Cosmos-Trendyol_DARE_v1Organizations
