Hugging Face's logo

bench-labs
/
GCTokenizer-v1

tokenizer
multilingual
s
m
l
xl
GCT
fast
Model card Files
xet
 Community
GCTokenizer-v1 / M /rules.json

Commit History

  1. Release GCT v1 consensus tokenizer

    wop
    Verified signature
    a6e44c6