Upload fly-chat.tokenizer.json with huggingface_hub
Browse files- fly-chat.tokenizer.json +1 -0
fly-chat.tokenizer.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"vocab": {"tokenizer": "gpt2-bpe", "vocab_size": 50257}, "block_size": 1024}
|