tinysms_tokenizer / tokenizer_stats.json

Commit History

  1. byte-level BPE, vocab 8192, trained on the TinyGSM train split

    Verified signature
    3737a7c