syssec-utd
/

py311-pylingual-v1-tokenizer

Model card Files Files and versions

py311-pylingual-v1-tokenizer / tokenizer.json

lc10934's picture

Trained tokenizer using syssec-utd/segmentation-py311-pylingual-v1

3697757 verified over 1 year ago

Raw History Contribute Delete

1.25 MB

File too large to display, you can check the raw version instead.