chkpt step 1000

README.md

@@ -34,4 +34,14 @@ Training
   Stateful truncated BPTT (k1 = k2 = 1024): gradients truncated per window, state flows forward, reset only at sweep end — truncation + statefulness + tape continuity formally proven in --check.
   AdamW, lr 4e-4, warmup 500, cosine → 4e-5, grad-clip 1.0.
   Hardware: GTX 1660 SUPER (6GB, Turing) — ~95k tok/s, ~5.5h/epoch; dataset stays on CPU memmap (measured: moving it to GPU = +0.08%).
-  Checkpoints every 1,000 steps: step, train/val loss, lr, sweep position, weights, plus 2 sampled stories — resumable.
+  Checkpoints every 1,000 steps: step, train/val loss, lr, sweep position, weights, plus 2 sampled stories — resumable.
+
+As of the first checkpoint: 
+epoch 0 step 1000: loss 0.910 | 104,813 tok/s | lr 4.00e-04
+val loss @ step 1000: 0.930
+--- sample 0 (257 ids) ---
+Once upon a time, there was a little big park. All the other key and the little girl was so glad to help with her friends for the world on his sweet. She watched their testination. She smiled and said, "Its to make you better. Ben asks."
+"Sorry, we can go
+--- sample 1 (257 ids) ---
+Once upon a time, there was a little girl named Ben. She didn't know whatch that made the store enveloes was not safe. He looked up and saw that he could hold her on the forest and jumped, on it again. The wind was very fast and he also could not want to l
+checkpoint saved: out/notio.pt @ step 1000