Article
What happens when you scale a hybrid SSM-Mamba-transformer: tmax-2B → 4B → 9B → 27B
juiceb0xc0de
• Rick Holmberg PRO
juiceb0xc0de
AI & ML interests
Mechanistic interpretation
SAE weight training
Novel architecture exploration
Brain atlas builds
Recent Activity
updated a dataset 3 minutes ago
juiceb0xc0de/llama3.2-1b-instruct-atlas updated a dataset 11 minutes ago
juiceb0xc0de/llama3.2-3b-instruct-atlas updated a dataset about 1 hour ago
juiceb0xc0de/TinyMixtral-4x248M-MoE-atlasOrganizations
published an article 29 days ago
published an article 3 months ago
Article
lucky_pick_scheduler
juiceb0xc0de
• • 1 published an article 4 months ago
Article
LoRA Redundancy: A Problem Of The Past?(clickbait?)
juiceb0xc0de
• published an article 4 months ago
Article
DNA Evidence in Language Models
juiceb0xc0de
• • 1 published an article 4 months ago
Article
Signal to Noise in Language Models: The Single Voice Upgrade ML Needs
juiceb0xc0de
•