ogbert-tokenizer-8192 / tokenizer.json

Commit History

  1. Upload OGBERT tokenizer (vocab_size=8192)

    Verified signature
    3c76971

  1. Upload OGBERT tokenizer (vocab_size=8192)

    Verified signature
    1be5751

  1. Upload folder using huggingface_hub

    Verified signature
    5f87c08