Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting
Ishaan Watts*, Catherine Li*, Sachin Goyal, Jacob Mitchell Springer, Aditi Raghunathan
Ishaan Watts
WattsIshaan
AI & ML interests
Machine Learning, NLP
Recent Activity
updated a collection 5 days ago
OLMo-2-1B Midtrained updated a model 5 days ago
WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW published a model 5 days ago
WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamWOrganizations
None yet
