Upload log_ts_e1.txt with huggingface_hub

log_ts_e1.txt

@@ -1205,18 +1205,59 @@ Consider using tensor.detach() first. (Triggered internally at /pytorch/torch/cs
 
  /tmp/ts_e1_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
 
 
  /tmp/ts_e1_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
-03:55:39 pushed ts_e1.pt
-03:55:40 push fail (Request ID: Root=1-6aa22a3c-6abc95ca37d0203c03a0722b;291f99ff-15ec-41ed-a7f6-b824660c0c89)
+
+
+
+
  /tmp/ts_e1_m.pt             :  10%|█         | 7.81MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             :  10%|█         | 7.81MB / 75.8MB            
+
+
+
  /tmp/ts_e1_m.pt             :  45%|████▌     | 34.4MB / 75.8MB            
+
+
+
  /tmp/ts_e1_m.pt             :  46%|████▌     | 34.6MB / 75.8MB            
+
+
+
  /tmp/ts_e1_m.pt             :  46%|████▌     | 34.6MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             :  71%|███████▏  | 54.0MB / 75.8MB            
+
+
+
  /tmp/ts_e1_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
+
  /tmp/ts_e1_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+
+
+
  /tmp/ts_e1_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+
+
  /tmp/ts_e1_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+04:03:23 push fail (Request ID: Root=1-6aa22c0b-69280ed20de89aa614f3426f;2f08825c-b45e-4c58-b819-2f8ab809f5fc)
+
+429 Too Many Requests: you 
+04:03:23 push fail (Request ID: Root=1-6aa22c0b-2b67769e5edb8f2374762ace;a9c0a6b2-b52f-4ad7-9fc7-9ff4bdbac1f9)
 
 429 Too Many Requests: you 
-03:55:54 step 123100 loss=3.2627 tok=2016.9M dt=6852
-03:56:08 step 123200 loss=2.9637 tok=2018.5M dt=6866
-03:56:22 step 123300 loss=3.0969 tok=2020.1M dt=6880
-03:56:37 step 123400 loss=3.1855 tok=2021.8M dt=6894
-03:56:51 step 123500 loss=3.0685 tok=2023.4M dt=6909
-03:57:05 step 123600 loss=3.2176 tok=2025.1M dt=6923
-03:57:19 step 123700 loss=3.2428 tok=2026.7M dt=6937
-03:57:32 epoch 8 start
-03:57:45 step 123800 loss=3.0793 tok=2028.3M dt=6963
-03:58:00 step 123900 loss=3.3365 tok=2030.0M dt=6978
-03:58:15 step 124000 loss=3.1498 tok=2031.6M dt=6992
+04:03:38 step 126100 loss=3.1493 tok=2066.0M dt=7315
+04:03:52 step 126200 loss=3.1600 tok=2067.7M dt=7330
+04:04:07 step 126300 loss=3.0565 tok=2069.3M dt=7344
+04:04:21 step 126400 loss=3.2061 tok=2070.9M dt=7358
+04:04:35 step 126500 loss=3.2093 tok=2072.6M dt=7372
+04:04:50 step 126600 loss=3.0648 tok=2074.2M dt=7387
+04:05:04 step 126700 loss=3.2714 tok=2075.9M dt=7402
+04:05:19 step 126800 loss=3.2709 tok=2077.5M dt=7416
+04:05:33 step 126900 loss=3.0477 tok=2079.1M dt=7431
+04:05:47 step 127000 loss=3.1841 tok=2080.8M dt=7445