Croatian byte-level BPE tokenizers (32k, 48k, 64k), with tiktoken exports.
🏄♂️ Somewhere in Polynesia
Ivan Bizaca
ibizaca
·
AI & ML interests
None yet
Recent Activity
updated a model 1 day ago
ibizaca/cro-bpe-64k updated a model 1 day ago
ibizaca/cro-bpe-48k updated a model 1 day ago
ibizaca/cro-bpe-32kOrganizations
