Before
STEP 0The first characters will appear here, before any training.
THE TINY MODEL LAB
Watch a tiny model learn to write.
One character at a time, right before your eyes.
WATCH IT LEARN
The first characters will appear here, before any training.
Start training to watch the text change with each step.
Two samples from the same model, before and after training. These are its actual outputs.
Try another prompt ↓LIVE TRAINING
Actual timings will appear during training.
YOUR TURN
The model keeps what it learned. Change the prompt to try another continuation; it can still make mistakes.
Same prompt, temperature and seed: same text. Lower temperatures usually produce less variety. Different seeds can still produce the same text.
Weights and training history stay unchanged.
Your next text will appear here.
The latest samples and the very first sample are kept here.