438 kB

Ctrl+K

Fix config params to the true unique count (100,936). 106,568 is the file sum that double-counts the tied head; the README explains this.

b3bc31f verified about 23 hours ago

.gitattributes

1.52 kB
initial commit 1 day ago
README.md

4.45 kB
Correct the card: the model is now trained on the 19.2 MB TinyStories validation set (the actual #17 request). Fixes param count (100,936 unique; the earlier 106,568 double-counted the tied head) and reports the honest memorization result (ratio 1.02x, verified reproducible). about 23 hours ago
config.json

374 Bytes
Fix config params to the true unique count (100,936). 106,568 is the file sum that double-counts the tied head; the README explains this. about 23 hours ago
model.safetensors

431 kB
xet

Ship the correct Testr-100K model (trained on the 19.2 MB TinyStories validation set, as requested in #17). Replaces the wrong-data weights (191 MB web text). 100,936 unique params; memorized PPL 3.1540 vs never-seen 3.2203 (ratio 1.02x) — verified reproducible from this file. about 23 hours ago
vocab.json

1.32 kB
Add char vocabulary (128 chars + unk) (#3) 1 day ago