Upload folder using huggingface_hub

README.md

@@ -12,7 +12,7 @@ on 20,000 TinyStories, as a learning project. Use case: a bedtime story starter
 - Architecture: 6 transformer blocks, 4 heads, 256-dim embeddings, 256-token context
 - Tokenizer: byte-level BPE, 4,096 tokens, trained on the same data
 - Training: 1500 steps, batch 32, AdamW, cosine schedule
-- Final validation loss 2.185 (perplexity 8.9)
+- Final validation loss 2.179 (perplexity 8.8)
 
 The full build, explained step by step, is in `tiny_llm_from_scratch.ipynb` in this repo.
 Load with plain PyTorch: `GPT(cfg).load_state_dict(torch.load("model.pt"))`.

model.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:514b81b866785efaf42512b1ab7e368384987b90ec4eb83351c59d8a96a5f532
-size 23434075
+oid sha256:b3909dcccb7ca797e6ceff909d93358e0f3adad49081117d2b24dd22bf73fe6d
+size 23435163