Card: just point to the full configs
Browse files
README.md
CHANGED
|
@@ -21,8 +21,7 @@ position it looks up the most frequent next tokens of the longest matching n-gra
|
|
| 21 |
counts held in CPU RAM, averages those tokens' rows of the model's own output head (weighted by their
|
| 22 |
count scores), and adds the result to the token embedding.
|
| 23 |
|
| 24 |
-
|
| 25 |
-
embedding amplification. For the full configuration of each model, see the paper's appendix, the
|
| 26 |
`config.json` and `release_args.json` in each step directory, and the ladder configuration in the
|
| 27 |
[code](https://github.com/IanMagnusson/COUNT).
|
| 28 |
|
|
|
|
| 21 |
counts held in CPU RAM, averages those tokens' rows of the model's own output head (weighted by their
|
| 22 |
count scores), and adds the result to the token embedding.
|
| 23 |
|
| 24 |
+
For the full configuration of each model, see the paper's appendix, the
|
|
|
|
| 25 |
`config.json` and `release_args.json` in each step directory, and the ladder configuration in the
|
| 26 |
[code](https://github.com/IanMagnusson/COUNT).
|
| 27 |
|