English
n-gram
olmo-core
language-modeling
IanMagnusson commited on
Commit
e95cd16
·
verified ·
1 Parent(s): 8a081fa

Card: just point to the full configs

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -21,8 +21,7 @@ position it looks up the most frequent next tokens of the longest matching n-gra
21
  counts held in CPU RAM, averages those tokens' rows of the model's own output head (weighted by their
22
  count scores), and adds the result to the token embedding.
23
 
24
- These checkpoints were also trained with other settings that are not part of COUNT itself, such as
25
- embedding amplification. For the full configuration of each model, see the paper's appendix, the
26
  `config.json` and `release_args.json` in each step directory, and the ladder configuration in the
27
  [code](https://github.com/IanMagnusson/COUNT).
28
 
 
21
  counts held in CPU RAM, averages those tokens' rows of the model's own output head (weighted by their
22
  count scores), and adds the result to the token embedding.
23
 
24
+ For the full configuration of each model, see the paper's appendix, the
 
25
  `config.json` and `release_args.json` in each step directory, and the ladder configuration in the
26
  [code](https://github.com/IanMagnusson/COUNT).
27