picur
/

picur-tokenizer

Model card Files Files and versions

picur-tokenizer / benchmark.py

Commit History

a2C vocabulary: refit on the cleaned, budget-proportional corpus

a858237
verified

lazos commited on about 1 month ago

a2B: reproducible seed, public benchmarks, benchmark.py

4079ffe
verified

lazos commited on Aug 31