-
v2: retrain with 12288-vocab BPE (was 8192), 56,902,144 params, best val 1.3837 (#4)
- v2: retrain with 12288-vocab BPE (was 8192), 56,902,144 params, best val 1.3837 (2e799a020378896a2c2680c5cb7a346f4e6d93dd)
-
Add weights (54,804,992 params, 99 tensors, float32)
-
Add BPE-8192 tokenizer
-
Add self-contained loader + TinyStoriesGPT class
-
Add architecture config (D512/L16/H8/FFN2048/SEQ512/VOCAB8192, weight-tied)
-
Add model card: 54.8M from-scratch TinyStories GPT, verified params + held-out PPL 5.24
-
initial commit
