a2C vocabulary: refit on the cleaned, budget-proportional corpus a858237 verified lazos commited on 25 days ago
docs: correct the fertility delta and spell out the eviction example eb271df verified lazos commited on Aug 31
a2u: 28,000-stem seed, measured on text withheld from the fit a34a31c verified lazos commited on Aug 31
docs: the diminutive joke, as the counterexample for over-splitting f26b725 verified lazos commited on Aug 30
picur-tokenizer a2x: 49,152-piece Hungarian Unigram vocabulary a7cf8a7 verified lazos commited on Aug 30