Upload log_ts_e4.txt with huggingface_hub

log_ts_e4.txt

@@ -673,33 +673,41 @@ Consider using tensor.detach() first. (Triggered internally at /pytorch/torch/cs
 
  /tmp/ts_e4_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
 
 
  /tmp/ts_e4_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
-04:02:02 push fail (Request ID: Root=1-6aa22bba-4119ec5977c236fc4b229837;b3003329-a778-416d-bf02-d2d4d5aef7ee)
-
-429 Too Many Requests: you 
-04:02:02 push fail (Request ID: Root=1-6aa22bba-3b5d188c70ac62d376103ba6;960894b5-fec7-4d54-bc15-da4feb81fc7f)
-
-429 Too Many Requests: you 
-04:02:16 step 129100 loss=3.3173 tok=2115.2M dt=7234
-04:02:30 step 129200 loss=3.1983 tok=2116.8M dt=7248
-04:02:44 step 129300 loss=3.1748 tok=2118.5M dt=7262
-04:02:58 step 129400 loss=3.2453 tok=2120.1M dt=7276
-04:03:12 epoch 9 start
-04:03:22 step 129500 loss=2.9932 tok=2121.7M dt=7300
-04:03:37 step 129600 loss=3.1706 tok=2123.4M dt=7315
-04:03:51 step 129700 loss=3.2544 tok=2125.0M dt=7329
-04:04:05 step 129800 loss=3.1751 tok=2126.6M dt=7343
-04:04:19 step 129900 loss=3.2296 tok=2128.3M dt=7356
-04:04:33 step 130000 loss=3.3516 tok=2129.9M dt=7370
-04:04:33 push fail (Request ID: Root=1-6aa22c51-70f5722b17743ac9210c38ce;88a024b6-7061-4e98-9420-a48ce52e90c0)
-
-429 Too Many Requests: you 
-04:04:47 step 130100 loss=3.0100 tok=2131.6M dt=7385
-04:05:01 step 130200 loss=3.2551 tok=2133.2M dt=7398
-04:05:15 step 130300 loss=3.0637 tok=2134.8M dt=7412
-04:05:29 step 130400 loss=3.1411 tok=2136.5M dt=7427
-04:05:43 step 130500 loss=3.0515 tok=2138.1M dt=7440
-04:05:56 step 130600 loss=2.9995 tok=2139.8M dt=7454
-04:06:10 step 130700 loss=3.1420 tok=2141.4M dt=7468
-04:06:24 step 130800 loss=3.1295 tok=2143.0M dt=7482
-04:06:38 step 130900 loss=2.9958 tok=2144.7M dt=7495
-04:06:51 step 131000 loss=3.2135 tok=2146.3M dt=7509
+
+
+
+
  /tmp/ts_e4_m.pt             :  12%|█▏        | 9.13MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  12%|█▏        | 9.13MB / 75.8MB            
+
+
+
  /tmp/ts_e4_m.pt             :  44%|████▎     | 33.1MB / 75.8MB            
+
+
+
  /tmp/ts_e4_m.pt             :  88%|████████▊ | 67.0MB / 75.8MB            
+
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             :  99%|█████████▉| 75.4MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+
+
+
  /tmp/ts_e4_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+
+
  /tmp/ts_e4_m.pt             : 100%|██████████| 75.8MB / 75.8MB            
+04:09:12 pushed ts_e4.pt