xiulinyang/dynamtic_attention_10Mf_512
11.8M • Updated • 5
Xiulin Yang
xiulinyang
AI & ML interests
Language Modeling, Interpretability, (compositional) generalization, tokenization
Organizations
None yet
xiulinyang/gpt2_xxs_baby_10Mf_32768_42_300k
Updated • 6
xiulinyang/dynamic_attention_10Mf
11.8M • Updated • 8
xiulinyang/gpt2_small_baby_50M_32768_53
Updated • 8
xiulinyang/gpt2_small_baby_50Mf_32768_76
Updated • 11
xiulinyang/gpt2_small_wiki_30M_32768_76
Updated • 9
xiulinyang/gpt2_small_baby_30M_32768_53
Updated • 12
xiulinyang/gpt2_small_baby_30Mf_32768_76
Updated • 11
xiulinyang/gpt2_mini_wiki_10M_32768_76
Updated • 10
xiulinyang/gpt2_small_wiki_50M_32768_53
Updated • 8
xiulinyang/gpt2_mini_baby_10M_32768_53
Updated • 10
xiulinyang/gpt2_mini_baby_10Mf_32768_76
Updated • 10
xiulinyang/gpt2_small_baby_50M_32768_76
Updated • 10
xiulinyang/gpt2_small_baby_50Mf_32768_53
Updated • 11
xiulinyang/gpt2_small_wiki_30M_32768_53
Updated • 10
xiulinyang/gpt2_small_baby_30M_32768_76
Updated • 9
xiulinyang/gpt2_small_baby_30Mf_32768_53
Updated • 12
xiulinyang/gpt2_mini_baby_10M_32768_76
Updated • 12
xiulinyang/gpt2_mini_wiki_10M_32768_53
Updated • 15
xiulinyang/gpt2_mini_baby_10Mf_32768_53
Updated • 15
xiulinyang/gpt2_mini_baby_100M_32768_42
Updated • 10
xiulinyang/gpt2_small_baby_30M_32768_42
Updated • 15
xiulinyang/gpt2_small_baby_100M_32768_42
Updated • 10
xiulinyang/gpt2_small_baby_50M_32768_42
Updated • 10
xiulinyang/gpt2_small_baby_50Mf_32768_42
Updated • 11
xiulinyang/gpt2_small_baby_30Mf_32768_42
Updated • 10
xiulinyang/gpt2_mini_baby_10M_32768_42
Updated • 15
xiulinyang/gpt2_mini_baby_10Mf_32768_42
Updated • 19
xiulinyang/gpt2_small_baby_100M_32768_42_c
Updated • 9
xiulinyang/gpt2_small_wiki_100M_32768_42
Updated • 12