Hugging Face's logo

TimothDevA
/
cruxtok

English
tokenizer
vector-quantization
residual-vq
Model card Files
xet
 Community
cruxtok / t0cap_seed42 /tokenizer.pt

Commit History

10 days ago

  1. CruxTok (T1) and NCM baseline tokenizers trained on XSum

    TimothDevA
    Verified signature
    16772ec