TriusLD / NOTICE
bctnry's picture
TriusLD: 64,972-token multilingual byte-level BPE
6070dfa verified
Raw History Blame Contribute Delete
279 Bytes
TriusLD
Copyright 2026 TriusAI
This distribution contains a tokenizer: a vocabulary and a list of byte-pair
merge rules. It contains no text from the training corpus.
Training data provenance:
FineWeb (HuggingFace) ODC-By 1.0
FineWeb-2 (HuggingFace) ODC-By 1.0