FonDocker
/

pigmodel

pigmodel / added_tokens.json

Upload tokenizer

49463ff verified about 1 year ago

97 Bytes

{
  "<|endoftext|>": 50265,
  "<|pad|>": 50268,
  "<|startoftext|>": 50266,
  "<|unk|>": 50267
}