Upload folder using huggingface_hub

README.md

@@ -12,7 +12,7 @@ on 20,000 TinyStories, as a learning project. Use case: a bedtime story starter
 - Architecture: 6 transformer blocks, 4 heads, 256-dim embeddings, 256-token context
 - Tokenizer: byte-level BPE, 4,096 tokens, trained on the same data
 - Training: 1500 steps, batch 32, AdamW, cosine schedule
-- Final validation loss 2.179 (perplexity 8.8)
+- Final validation loss 2.315 (perplexity 10.1)
 
 The full build, explained step by step, is in `tiny_llm_from_scratch.ipynb` in this repo.
 Load with plain PyTorch: `GPT(cfg).load_state_dict(torch.load("model.pt"))`.

model.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b3909dcccb7ca797e6ceff909d93358e0f3adad49081117d2b24dd22bf73fe6d
-size 23435163
+oid sha256:4355a3961c5ab8a4367ded941d3b88019d5c1feeb3d0aa569a428a741dea2540
+size 23434075