Duplicated from GGUFGuy/hyperdex-trainer
2a49d9a
1
2
3
4
5
{ "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "pad_token": "<|pad|>" }