anonym5035/swi_glu_sw_64_16_8_4_xpert_gpt
Text Generation • 56.9M • Updated • 1.34k
anonym_5035
anonym5035
AI & ML interests
None yet
Recent Activity
updated a model 18 days ago
anonym5035/swi_glu_sw_64_16_8_4_xpert_gpt updated a model 22 days ago
anonym5035/converted_gpt_2 published a model 23 days ago
anonym5035/converted_gpt_2Organizations
None yet
anonym5035/converted_gpt_2
Text Generation • Updated • 1
anonym5035/gpt_2_124M
Updated
anonym5035/gpt-2_baseline_98M
Updated
anonym5035/active_param_gpt2_31M
Updated
anonym5035/gpt2_dense_50M_same_total_param
54.5M • Updated • 69
anonym5035/ablation_5_no_experts
Text Generation • Updated
anonym5035/ablation_6_no_global_attn
Text Generation • Updated
anonym5035/temp
Text Generation • Updated
anonym5035/Xpert-GPT-50M-final
Text Generation • Updated
anonym5035/correct_small_sw_64_16_8_4_norm_residuls_xpert_strcit_small
Text Generation • 56.8M • Updated • 692
anonym5035/router_rope_16_16_4_4_ln_swiglu_residuls_xpert_strcit_small
Text Generation • 56.9M • Updated • 358
anonym5035/router_rope_64_16_8_4_ln_residuls_xpert_strcit_small
Text Generation • 56.8M • Updated • 401
anonym5035/router_rope_64_16_8_4_ln_swiglu_residuls_xpert_strcit_small
Text Generation • 56.9M • Updated • 394
anonym5035/correct_small_sw_8_8_4_4_norm_residuls_xpert_strcit_small
Text Generation • 56.8M • Updated • 351
anonym5035/correct_small_sw_16_8_4_2_norm_residuls_xpert_strcit_small
Text Generation • Updated
anonym5035/correct_small_sw_16_16_4_4_norm_residuls_xpert_strcit_small
Text Generation • Updated
anonym5035/correct_sw_None_128_64_16_norm_residuls_xpert_strcit_small
Text Generation • 56.8M • Updated • 236
anonym5035/correct_ln_residual_xpert_gpt
Text Generation • 56.8M • Updated • 267
anonym5035/XpertGPT-BabyLM2026-Strict
Text Generation • 56.8M • Updated • 63
anonym5035/babylm-strict-project-dummy
Updated
anonym5035/XpertGPT-BabyLM2026-Strict-Small
Text Generation • 56.8M • Updated • 133 • 3
anonym5035/babylm-finetune-moe-swa-run
Updated • 1
anonym5035/msit_gptbert_fresh
Updated • 3
anonym5035/moe_decreasedbatchsize_expertpicks
Updated • 8
anonym5035/moe_decreased_batch_size
Updated
anonym5035/msit-gptbert-babylm-backup
Updated
anonym5035/babylm-upload
Updated • 863
anonym5035/first_attempt
Updated
anonym5035/first-attempt
Updated