tibert-base / tokenizer.json

Commit History

  1. Update tokenizer

    Fitsum Gaim
    6be34e6

  1. Retrain with updated data

    d61c407

  1. Add BERT wordpiece tokenizer

    56b7883