Link to the code on GitHub
Browse files
README.md
CHANGED
|
@@ -11,6 +11,8 @@ license: mit
|
|
| 11 |
|
| 12 |
2-TPG is GPT-2, but fine-tuned on its own output to predict the _previous_ token rather than the next one.
|
| 13 |
|
|
|
|
|
|
|
| 14 |
## Model description
|
| 15 |
|
| 16 |
2-TPG is a transformers model based on GPT-2 (117M parameters) that has been fine-tuned to predict previous tokens instead of next tokens. While traditional language models are trained to guess the next word in a sequence, 2-TPG does the opposite - it predicts what came before.
|
|
|
|
| 11 |
|
| 12 |
2-TPG is GPT-2, but fine-tuned on its own output to predict the _previous_ token rather than the next one.
|
| 13 |
|
| 14 |
+
Training, evaluation and inference code: [danwahl/2tpg](https://github.com/danwahl/2tpg).
|
| 15 |
+
|
| 16 |
## Model description
|
| 17 |
|
| 18 |
2-TPG is a transformers model based on GPT-2 (117M parameters) that has been fine-tuned to predict previous tokens instead of next tokens. While traditional language models are trained to guess the next word in a sequence, 2-TPG does the opposite - it predicts what came before.
|