Maggio33 commited on
Commit
95488fa
·
verified ·
1 Parent(s): 56ac718

Card: history note states facts only

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -47,7 +47,7 @@ checkpoint, on two machines, with identical bytes.
47
  Measured values only (no fits, no trend lines): one checkpoint every 150 steps of both runs, same instrument.
48
  Data: [`analysis/scores-history.csv`](analysis/scores-history.csv) (step, tokens, checkpoint sha256, scores, and which
49
  of three GPUs computed the row; each GPU was checked against a known point before use). 1.00 at 1.26 B and 1.42 B tokens
50
- is already in its learning-rate decay, 1.01 at the same token counts is not, which is why 1.00 is ahead there.
51
 
52
  ## Training loss vs. windows fixed before the run
53
 
 
47
  Measured values only (no fits, no trend lines): one checkpoint every 150 steps of both runs, same instrument.
48
  Data: [`analysis/scores-history.csv`](analysis/scores-history.csv) (step, tokens, checkpoint sha256, scores, and which
49
  of three GPUs computed the row; each GPU was checked against a known point before use). 1.00 at 1.26 B and 1.42 B tokens
50
+ is already in its learning-rate decay; 1.01 at the same token counts is not.
51
 
52
  ## Training loss vs. windows fixed before the run
53