Hugging Face's logo

Nj-1111
/
Copernicus-Tokenizer

Transformers
tokenizer
bpe
nlp
llm
Model card Files
xet
 Community
Copernicus-Tokenizer

Commit History

  1. Upload folder using huggingface_hub

    Nj-1111
    Verified signature
    6cba08c

  2. Upload folder using huggingface_hub

    Nj-1111
    Verified signature
    54d9ade

  3. Delete vocab.json

    Nj-1111
    Verified signature
    640933a

  4. Delete tokenizer_config.json

    Nj-1111
    Verified signature
    522cdd4

  5. Delete tokenizer.json

    Nj-1111
    Verified signature
    33cfb7b

  6. Delete merges.txt

    Nj-1111
    Verified signature
    e561684

  7. Delete special_tokens_map.json

    Nj-1111
    Verified signature
    832e239

  8. Delete README.md

    Nj-1111
    Verified signature
    222926f

  1. Update README.md

    Nj-1111
    Verified signature
    9abb5c9

  1. Upload folder using huggingface_hub

    Nj-1111
    Verified signature
    1a33991

  2. Upload folder using huggingface_hub

    Nj-1111
    Verified signature
    bb95906

  1. Delete tokenizer_config.json

    Nj-1111
    Verified signature
    cbd3218

  2. Delete tokenizer.model

    Nj-1111
    Verified signature
    9c34e80

  3. Delete special_tokens_map.json

    Nj-1111
    Verified signature
    dca0e52

  4. Delete tokenizer.json

    Nj-1111
    Verified signature
    862c726

  1. Upload README.md with huggingface_hub

    Nj-1111
    Verified signature
    9b4a952

  2. Upload tokenizer.model with huggingface_hub

    Nj-1111
    Verified signature
    efc227c

  3. Upload tokenizer_config.json with huggingface_hub

    Nj-1111
    Verified signature
    9622cc1

  4. Upload tokenizer.json with huggingface_hub

    Nj-1111
    Verified signature
    a691e77

  1. Upload README.md with huggingface_hub

    Nj-1111
    Verified signature
    188d338

  2. Upload tokenizer.json with huggingface_hub

    Nj-1111
    Verified signature
    be51389

  3. Upload README.md with huggingface_hub

    Nj-1111
    Verified signature
    8b9c855

  4. Upload tokenizer.model with huggingface_hub

    Nj-1111
    Verified signature
    571146b

  5. Upload special_tokens_map.json with huggingface_hub

    Nj-1111
    Verified signature
    fd50312

  6. Upload tokenizer_config.json with huggingface_hub

    Nj-1111
    Verified signature
    0f8353a

  7. Upload tokenizer.json with huggingface_hub

    Nj-1111
    Verified signature
    749db24

  8. initial commit

    Nj-1111
    Verified signature
    c6fb462