ASHATHUN
/

sharkquestion

sharkquestion / added_tokens.json

Upload tokenizer

f807016 verified about 1 year ago

97 Bytes

{
  "<|endoftext|>": 50265,
  "<|pad|>": 50268,
  "<|startoftext|>": 50266,
  "<|unk|>": 50267
}