okok / tokenizer

Commit History

  1. Upload tokenizer/vocab.json with huggingface_hub

    Verified signature
    057e6b7
  2. Upload tokenizer/tokenizer_config.json with huggingface_hub

    Verified signature
    162bea3
  3. Upload tokenizer/special_tokens_map.json with huggingface_hub

    Verified signature
    fa6f6af
  4. Upload tokenizer/merges.txt with huggingface_hub

    Verified signature
    6c26a14