A collection of Small Language Models pretrained from scratch (using only PyTorch) on Tiny Stories Dataset on a single Tesla-T4 16GB GPU.
🔄 In a Training Loop
Namrata Thakur
NamrataThakur
AI & ML interests
Small Language Model, Fine-Tuning, From Scratch
Recent Activity
liked a model 15 days ago
NamrataThakur/Small_Language_Model_MOE_127M_Pretrained updated a model 8 months ago
NamrataThakur/Small_Language_Model_MOE_127M_Pretrained updated a model 8 months ago
NamrataThakur/Small_Language_Model_GQA_48M_PretrainedOrganizations
None yet