-
Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)
-
Upload tokenizer.tkz with huggingface_hub
-
Add model card README
-
Add special_tokens_map.json from jinaai/jina-embeddings-v2-base-code
-
Add tokenizer_config.json from jinaai/jina-embeddings-v2-base-code
-
Add tokenizer.json from jinaai/jina-embeddings-v2-base-code
-
Add tokie banner
-
Update tokenizer.tkz to v11 (with pad_token_id)
-
initial commit
