darkstudio009 commited on
Commit
021d117
·
verified ·
1 Parent(s): bd365f9

Upload pretok_progress.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. pretok_progress.json +1 -1
pretok_progress.json CHANGED
@@ -1 +1 @@
1
- {"next_shard_idx": 201, "next_file_idx": 28, "docs_done_in_file": 173000, "docs_done": 20072101, "tokens_so_far": 20764577179, "tokenizer_fingerprint": "4e63cc80e8c9e08b"}
 
1
+ {"next_shard_idx": 202, "next_file_idx": 28, "docs_done_in_file": 273000, "docs_done": 20172101, "tokens_so_far": 20867555535, "tokenizer_fingerprint": "4e63cc80e8c9e08b"}