Card: history note states facts only
Browse files
README.md
CHANGED
|
@@ -47,7 +47,7 @@ checkpoint, on two machines, with identical bytes.
|
|
| 47 |
Measured values only (no fits, no trend lines): one checkpoint every 150 steps of both runs, same instrument.
|
| 48 |
Data: [`analysis/scores-history.csv`](analysis/scores-history.csv) (step, tokens, checkpoint sha256, scores, and which
|
| 49 |
of three GPUs computed the row; each GPU was checked against a known point before use). 1.00 at 1.26 B and 1.42 B tokens
|
| 50 |
-
is already in its learning-rate decay
|
| 51 |
|
| 52 |
## Training loss vs. windows fixed before the run
|
| 53 |
|
|
|
|
| 47 |
Measured values only (no fits, no trend lines): one checkpoint every 150 steps of both runs, same instrument.
|
| 48 |
Data: [`analysis/scores-history.csv`](analysis/scores-history.csv) (step, tokens, checkpoint sha256, scores, and which
|
| 49 |
of three GPUs computed the row; each GPU was checked against a known point before use). 1.00 at 1.26 B and 1.42 B tokens
|
| 50 |
+
is already in its learning-rate decay; 1.01 at the same token counts is not.
|
| 51 |
|
| 52 |
## Training loss vs. windows fixed before the run
|
| 53 |
|