Upload RuLemmaShuffleControl/tokenizer_config.json with huggingface_hub
Browse files
RuLemmaShuffleControl/tokenizer_config.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"tokenizer_class": "PassthroughTokenizer"}
|