sigil-ml
/

WikipediaBPETokenizer

Model card Files Files and versions

WikipediaBPETokenizer / tokenizer.json

sdwalker62's picture

Rename bpe_tokenizer.json to tokenizer.json

37b9e7d verified almost 2 years ago

Raw History Contribute Delete

842 kB

File too large to display, you can check the raw version instead.