tinystories_decoder / README.md
hbudhi36's picture
Update README.md
0b505b7 verified
|
Raw History Blame Contribute Delete
245 Bytes
This is a decoder-only transformer language model trained from scratch on the TinyStories dataset. The model implements the standard transformer architecture (decoder only), with several modern enhancements for efficient training and inference.