pico-llm/transformer-small-1M-embed384-heads6-blocks6-prenorm-posabs-epochs5
49.3M • Updated • 25
AI & ML interests
None defined yet.
Recent Activity
View all activity
models 27
pico-llm/transformer-tiny-1M-embed128-heads2-blocks2-prenorm-posabs-epochs5
13.3M • Updated • 12
pico-llm/transformer-pico-1M-embed64-heads1-blocks1-postnorm-posnone-epochs5
6.48M • Updated • 24
pico-llm/gpt2-base-postnorm-absolute
0.2B • Updated • 5
pico-llm/kgram-pico-K1-L1-scaled
3.27M • Updated • 11
pico-llm/kgram-pico-K3-L1-scaled
2.16M • Updated • 9
pico-llm/kgram-small-K5-L5-onehot
77.6M • Updated • 13
pico-llm/kgram-tiny-K5-L3-onehot
19.4M • Updated • 8
pico-llm/kgram-small-K5-L5-scaled
15.9M • Updated • 7
pico-llm/kgram-tiny-K5-L3-scaled
3.89M • Updated • 13
datasets 0
None public yet