darkstudio009 commited on
Commit
77e4a67
·
verified ·
1 Parent(s): 3c5562f

Upload pretok_progress.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. pretok_progress.json +1 -1
pretok_progress.json CHANGED
@@ -1 +1 @@
1
- {"next_shard_idx": 216, "next_file_idx": 30, "docs_done_in_file": 200000, "docs_done": 21572101, "tokens_so_far": 22302480273, "tokenizer_fingerprint": "4e63cc80e8c9e08b"}
 
1
+ {"next_shard_idx": 217, "next_file_idx": 30, "docs_done_in_file": 300000, "docs_done": 21672101, "tokens_so_far": 22405163922, "tokenizer_fingerprint": "4e63cc80e8c9e08b"}