Commit History
3 days ago
-
Add the tokie 0.2 tokenizer file
Verified signaturea5c5f12
-
Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)
Verified signaturef9e7b86
-
Add model card README
Verified signature34ee2b1 -
Add special_tokens_map.json from thenlper/gte-small
Verified signature9e4539d -
Add tokenizer_config.json from thenlper/gte-small
Verified signature052b0ee -
Add tokenizer.json from thenlper/gte-small
Verified signature7586c17 -
Add tokie banner
Verified signature128378e -
Update tokenizer.tkz to v11 (with pad_token_id)
Verified signature0af8996 -
initial commit
Verified signature286936e