This is a decoder-only transformer language model trained from scratch on the TinyStories dataset. The model implements the standard transformer architecture (decoder only), with several modern enhancements for efficient training and inference.
This is a decoder-only transformer language model trained from scratch on the TinyStories dataset. The model implements the standard transformer architecture (decoder only), with several modern enhancements for efficient training and inference.