darkstudio009 commited on
Commit
39fbae9
·
verified ·
1 Parent(s): eaa7cba

Upload pretok_progress.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. pretok_progress.json +1 -1
pretok_progress.json CHANGED
@@ -1 +1 @@
1
- {"next_shard_idx": 218, "next_file_idx": 30, "docs_done_in_file": 400000, "docs_done": 21772101, "tokens_so_far": 22507977694, "tokenizer_fingerprint": "4e63cc80e8c9e08b"}
 
1
+ {"next_shard_idx": 219, "next_file_idx": 30, "docs_done_in_file": 500000, "docs_done": 21872101, "tokens_so_far": 22610997976, "tokenizer_fingerprint": "4e63cc80e8c9e08b"}