Transformers
tokenizer
sentencepiece
indic
multilingual
code-mixed
romanized
unigram
bpe