drwahl commited on
Commit
b260d5d
·
verified ·
1 Parent(s): 39cc349

Link to the code on GitHub

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -11,6 +11,8 @@ license: mit
11
 
12
  2-TPG is GPT-2, but fine-tuned on its own output to predict the _previous_ token rather than the next one.
13
 
 
 
14
  ## Model description
15
 
16
  2-TPG is a transformers model based on GPT-2 (117M parameters) that has been fine-tuned to predict previous tokens instead of next tokens. While traditional language models are trained to guess the next word in a sequence, 2-TPG does the opposite - it predicts what came before.
 
11
 
12
  2-TPG is GPT-2, but fine-tuned on its own output to predict the _previous_ token rather than the next one.
13
 
14
+ Training, evaluation and inference code: [danwahl/2tpg](https://github.com/danwahl/2tpg).
15
+
16
  ## Model description
17
 
18
  2-TPG is a transformers model based on GPT-2 (117M parameters) that has been fine-tuned to predict previous tokens instead of next tokens. While traditional language models are trained to guess the next word in a sequence, 2-TPG does the opposite - it predicts what came before.