{"train_windows": ["w00", "w01", "w02", "w03", "w04", "w05", "w06", "w07", "w08", "w09", "w10", "w11", "w12", "w13", "w14", "w15", "w16", "w17"], "val_windows": ["w18", "w19", "w20"], "test_windows": ["w21", "w22", "w23"], "n_train": 178954, "n_val": 30101, "n_test": 20058, "live_configs": ["ea4d660431d6"], "n_live_test": 10000, "n_live_val": 3000, "n_live_train": 46918, "live_weight": 3.0}

Loading weights:   0%|          | 0/134 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 134/134 [00:00<00:00, 15391.94it/s]
[transformers] ModernBertModel LOAD REPORT from: answerdotai/ModernBERT-base
Key               | Status     |  | 
------------------+------------+--+-
decoder.bias      | UNEXPECTED |  | 
head.norm.weight  | UNEXPECTED |  | 
head.dense.weight | UNEXPECTED |  | 

Notes:
- UNEXPECTED:	can be ignored when loading from different task/architecture; not ok if you expect identical arch.

epoch 1/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 1/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=9.408, lr=4.5e-08]
epoch 1/8:   0%|          | 7/2797 [00:02<13:23,  3.47batch/s, loss=9.408, lr=4.5e-08]
epoch 1/8:   1%|          | 17/2797 [00:04<10:49,  4.28batch/s, loss=9.408, lr=4.5e-08]
epoch 1/8:   1%|          | 17/2797 [00:05<10:49,  4.28batch/s, loss=9.215, lr=1.2e-06]
epoch 1/8:   1%|          | 27/2797 [00:06<10:02,  4.60batch/s, loss=9.215, lr=1.2e-06]
epoch 1/8:   1%|▏         | 37/2797 [00:08<09:45,  4.72batch/s, loss=9.215, lr=1.2e-06]
epoch 1/8:   2%|▏         | 49/2797 [00:10<08:55,  5.13batch/s, loss=9.215, lr=1.2e-06]
epoch 1/8:   2%|▏         | 49/2797 [00:10<08:55,  5.13batch/s, loss=9.178, lr=2.3e-06]
epoch 1/8:   2%|▏         | 60/2797 [00:12<08:50,  5.16batch/s, loss=9.178, lr=2.3e-06]
epoch 1/8:   3%|▎         | 71/2797 [00:14<09:03,  5.01batch/s, loss=9.178, lr=2.3e-06]
epoch 1/8:   3%|▎         | 71/2797 [00:15<09:03,  5.01batch/s, loss=9.105, lr=3.4e-06]
epoch 1/8:   3%|▎         | 82/2797 [00:16<08:53,  5.09batch/s, loss=9.105, lr=3.4e-06]
epoch 1/8:   3%|▎         | 93/2797 [00:18<08:44,  5.16batch/s, loss=9.105, lr=3.4e-06]
epoch 1/8:   3%|▎         | 93/2797 [00:20<08:44,  5.16batch/s, loss=9.013, lr=4.5e-06]
epoch 1/8:   4%|▎         | 104/2797 [00:20<08:37,  5.21batch/s, loss=9.013, lr=4.5e-06]
epoch 1/8:   4%|▍         | 115/2797 [00:22<08:35,  5.21batch/s, loss=9.013, lr=4.5e-06]
epoch 1/8:   4%|▍         | 115/2797 [00:25<08:35,  5.21batch/s, loss=8.891, lr=5.6e-06]
epoch 1/8:   5%|▍         | 126/2797 [00:25<08:39,  5.14batch/s, loss=8.891, lr=5.6e-06]
epoch 1/8:   5%|▍         | 137/2797 [00:27<08:38,  5.13batch/s, loss=8.891, lr=5.6e-06]
epoch 1/8:   5%|▌         | 148/2797 [00:29<08:51,  4.98batch/s, loss=8.891, lr=5.6e-06]
epoch 1/8:   5%|▌         | 148/2797 [00:30<08:51,  4.98batch/s, loss=8.774, lr=6.8e-06]
epoch 1/8:   6%|▌         | 159/2797 [00:31<08:38,  5.09batch/s, loss=8.774, lr=6.8e-06]
epoch 1/8:   6%|▌         | 170/2797 [00:33<08:31,  5.13batch/s, loss=8.774, lr=6.8e-06]
epoch 1/8:   6%|▌         | 170/2797 [00:35<08:31,  5.13batch/s, loss=8.635, lr=7.9e-06]
epoch 1/8:   6%|▋         | 181/2797 [00:36<08:41,  5.02batch/s, loss=8.635, lr=7.9e-06]
epoch 1/8:   7%|▋         | 192/2797 [00:38<08:36,  5.04batch/s, loss=8.635, lr=7.9e-06]
epoch 1/8:   7%|▋         | 192/2797 [00:39<08:36,  5.04batch/s, loss=8.486, lr=9.0e-06]
epoch 1/8:   7%|▋         | 203/2797 [00:40<08:23,  5.16batch/s, loss=8.486, lr=9.0e-06]
epoch 1/8:   8%|▊         | 214/2797 [00:42<08:33,  5.03batch/s, loss=8.486, lr=9.0e-06]
epoch 1/8:   8%|▊         | 214/2797 [00:44<08:33,  5.03batch/s, loss=8.334, lr=1.0e-05]
epoch 1/8:   8%|▊         | 226/2797 [00:44<08:14,  5.19batch/s, loss=8.334, lr=1.0e-05]
epoch 1/8:   8%|▊         | 237/2797 [00:46<08:18,  5.14batch/s, loss=8.334, lr=1.0e-05]
epoch 1/8:   9%|▉         | 249/2797 [00:49<07:59,  5.32batch/s, loss=8.334, lr=1.0e-05]
epoch 1/8:   9%|▉         | 249/2797 [00:49<07:59,  5.32batch/s, loss=8.173, lr=1.1e-05]
epoch 1/8:   9%|▉         | 260/2797 [00:51<08:01,  5.27batch/s, loss=8.173, lr=1.1e-05]
epoch 1/8:  10%|▉         | 271/2797 [00:53<08:00,  5.26batch/s, loss=8.173, lr=1.1e-05]
epoch 1/8:  10%|▉         | 271/2797 [00:54<08:00,  5.26batch/s, loss=8.035, lr=1.2e-05]
epoch 1/8:  10%|█         | 282/2797 [00:55<07:56,  5.27batch/s, loss=8.035, lr=1.2e-05]
epoch 1/8:  10%|█         | 293/2797 [00:57<08:10,  5.10batch/s, loss=8.035, lr=1.2e-05]
epoch 1/8:  10%|█         | 293/2797 [00:59<08:10,  5.10batch/s, loss=7.900, lr=1.3e-05]
epoch 1/8:  11%|█         | 304/2797 [00:59<07:58,  5.21batch/s, loss=7.900, lr=1.3e-05]
epoch 1/8:  11%|█▏        | 315/2797 [01:02<08:12,  5.04batch/s, loss=7.900, lr=1.3e-05]
epoch 1/8:  11%|█▏        | 315/2797 [01:04<08:12,  5.04batch/s, loss=7.764, lr=1.5e-05]
epoch 1/8:  12%|█▏        | 326/2797 [01:04<08:01,  5.13batch/s, loss=7.764, lr=1.5e-05]
epoch 1/8:  12%|█▏        | 337/2797 [01:06<07:50,  5.22batch/s, loss=7.764, lr=1.5e-05]
epoch 1/8:  12%|█▏        | 348/2797 [01:08<07:56,  5.13batch/s, loss=7.764, lr=1.5e-05]
epoch 1/8:  12%|█▏        | 348/2797 [01:08<07:56,  5.13batch/s, loss=7.636, lr=1.6e-05]
epoch 1/8:  13%|█▎        | 359/2797 [01:10<08:05,  5.02batch/s, loss=7.636, lr=1.6e-05]
epoch 1/8:  13%|█▎        | 370/2797 [01:12<08:00,  5.05batch/s, loss=7.636, lr=1.6e-05]
epoch 1/8:  13%|█▎        | 370/2797 [01:14<08:00,  5.05batch/s, loss=7.513, lr=1.7e-05]
epoch 1/8:  14%|█▎        | 381/2797 [01:15<08:04,  4.99batch/s, loss=7.513, lr=1.7e-05]
epoch 1/8:  14%|█▍        | 392/2797 [01:17<07:58,  5.03batch/s, loss=7.513, lr=1.7e-05]
epoch 1/8:  14%|█▍        | 392/2797 [01:18<07:58,  5.03batch/s, loss=7.387, lr=1.8e-05]
epoch 1/8:  14%|█▍        | 403/2797 [01:19<07:51,  5.08batch/s, loss=7.387, lr=1.8e-05]
epoch 1/8:  15%|█▍        | 414/2797 [01:21<07:41,  5.16batch/s, loss=7.387, lr=1.8e-05]
epoch 1/8:  15%|█▌        | 425/2797 [01:23<07:34,  5.22batch/s, loss=7.387, lr=1.8e-05]
epoch 1/8:  15%|█▌        | 425/2797 [01:23<07:34,  5.22batch/s, loss=7.269, lr=1.9e-05]
epoch 1/8:  16%|█▌        | 436/2797 [01:25<07:53,  4.98batch/s, loss=7.269, lr=1.9e-05]
epoch 1/8:  16%|█▌        | 447/2797 [01:28<07:51,  4.98batch/s, loss=7.269, lr=1.9e-05]
epoch 1/8:  16%|█▌        | 447/2797 [01:28<07:51,  4.98batch/s, loss=7.158, lr=2.0e-05]
epoch 1/8:  16%|█▋        | 459/2797 [01:30<07:33,  5.15batch/s, loss=7.158, lr=2.0e-05]
epoch 1/8:  17%|█▋        | 470/2797 [01:32<07:36,  5.10batch/s, loss=7.158, lr=2.0e-05]
epoch 1/8:  17%|█▋        | 470/2797 [01:33<07:36,  5.10batch/s, loss=7.057, lr=2.1e-05]
epoch 1/8:  17%|█▋        | 481/2797 [01:34<07:28,  5.16batch/s, loss=7.057, lr=2.1e-05]
epoch 1/8:  18%|█▊        | 493/2797 [01:36<07:28,  5.14batch/s, loss=7.057, lr=2.1e-05]
epoch 1/8:  18%|█▊        | 493/2797 [01:38<07:28,  5.14batch/s, loss=6.960, lr=2.2e-05]
epoch 1/8:  18%|█▊        | 504/2797 [01:38<07:18,  5.23batch/s, loss=6.960, lr=2.2e-05]
epoch 1/8:  18%|█▊        | 515/2797 [01:40<07:16,  5.23batch/s, loss=6.960, lr=2.2e-05]
epoch 1/8:  18%|█▊        | 515/2797 [01:42<07:16,  5.23batch/s, loss=6.864, lr=2.4e-05]
epoch 1/8:  19%|█▉        | 526/2797 [01:42<07:07,  5.31batch/s, loss=6.864, lr=2.4e-05]
epoch 1/8:  19%|█▉        | 537/2797 [01:45<07:21,  5.12batch/s, loss=6.864, lr=2.4e-05]
epoch 1/8:  20%|█▉        | 548/2797 [01:47<07:13,  5.18batch/s, loss=6.864, lr=2.4e-05]
epoch 1/8:  20%|█▉        | 548/2797 [01:48<07:13,  5.18batch/s, loss=6.765, lr=2.5e-05]
epoch 1/8:  20%|█▉        | 559/2797 [01:49<07:32,  4.95batch/s, loss=6.765, lr=2.5e-05]
epoch 1/8:  20%|██        | 569/2797 [01:52<07:44,  4.79batch/s, loss=6.765, lr=2.5e-05]
epoch 1/8:  20%|██        | 569/2797 [01:53<07:44,  4.79batch/s, loss=6.677, lr=2.6e-05]
epoch 1/8:  21%|██        | 580/2797 [01:54<07:26,  4.97batch/s, loss=6.677, lr=2.6e-05]
epoch 1/8:  21%|██        | 591/2797 [01:56<07:11,  5.11batch/s, loss=6.677, lr=2.6e-05]
epoch 1/8:  21%|██        | 591/2797 [01:57<07:11,  5.11batch/s, loss=6.587, lr=2.7e-05]
epoch 1/8:  22%|██▏       | 602/2797 [01:58<07:02,  5.20batch/s, loss=6.587, lr=2.7e-05]
epoch 1/8:  22%|██▏       | 613/2797 [02:00<07:07,  5.11batch/s, loss=6.587, lr=2.7e-05]
epoch 1/8:  22%|██▏       | 625/2797 [02:02<07:00,  5.16batch/s, loss=6.587, lr=2.7e-05]
epoch 1/8:  22%|██▏       | 625/2797 [02:02<07:00,  5.16batch/s, loss=6.505, lr=2.8e-05]
epoch 1/8:  23%|██▎       | 636/2797 [02:04<06:59,  5.15batch/s, loss=6.505, lr=2.8e-05]
epoch 1/8:  23%|██▎       | 647/2797 [02:07<07:04,  5.06batch/s, loss=6.505, lr=2.8e-05]
epoch 1/8:  23%|██▎       | 647/2797 [02:07<07:04,  5.06batch/s, loss=6.427, lr=2.9e-05]
epoch 1/8:  24%|██▎       | 658/2797 [02:09<06:58,  5.11batch/s, loss=6.427, lr=2.9e-05]
epoch 1/8:  24%|██▍       | 669/2797 [02:11<06:54,  5.14batch/s, loss=6.427, lr=2.9e-05]
epoch 1/8:  24%|██▍       | 669/2797 [02:12<06:54,  5.14batch/s, loss=6.351, lr=3.0e-05]
epoch 1/8:  24%|██▍       | 680/2797 [02:13<06:55,  5.09batch/s, loss=6.351, lr=3.0e-05]
epoch 1/8:  25%|██▍       | 691/2797 [02:15<06:58,  5.03batch/s, loss=6.351, lr=3.0e-05]
epoch 1/8:  25%|██▍       | 691/2797 [02:17<06:58,  5.03batch/s, loss=6.283, lr=3.1e-05]
epoch 1/8:  25%|██▌       | 702/2797 [02:17<06:53,  5.07batch/s, loss=6.283, lr=3.1e-05]
epoch 1/8:  25%|██▌       | 713/2797 [02:19<06:48,  5.11batch/s, loss=6.283, lr=3.1e-05]
epoch 1/8:  26%|██▌       | 724/2797 [02:22<06:38,  5.20batch/s, loss=6.283, lr=3.1e-05]
epoch 1/8:  26%|██▌       | 724/2797 [02:22<06:38,  5.20batch/s, loss=6.212, lr=3.2e-05]
epoch 1/8:  26%|██▋       | 735/2797 [02:24<06:45,  5.09batch/s, loss=6.212, lr=3.2e-05]
epoch 1/8:  27%|██▋       | 746/2797 [02:26<06:53,  4.96batch/s, loss=6.212, lr=3.2e-05]
epoch 1/8:  27%|██▋       | 746/2797 [02:27<06:53,  4.96batch/s, loss=6.144, lr=3.4e-05]
epoch 1/8:  27%|██▋       | 756/2797 [02:28<06:55,  4.91batch/s, loss=6.144, lr=3.4e-05]
epoch 1/8:  27%|██▋       | 767/2797 [02:30<06:42,  5.04batch/s, loss=6.144, lr=3.4e-05]
epoch 1/8:  27%|██▋       | 767/2797 [02:32<06:42,  5.04batch/s, loss=6.075, lr=3.5e-05]
epoch 1/8:  28%|██▊       | 778/2797 [02:32<06:41,  5.02batch/s, loss=6.075, lr=3.5e-05]
epoch 1/8:  28%|██▊       | 789/2797 [02:35<06:40,  5.02batch/s, loss=6.075, lr=3.5e-05]
epoch 1/8:  29%|██▊       | 800/2797 [02:37<06:41,  4.97batch/s, loss=6.075, lr=3.5e-05]
epoch 1/8:  29%|██▊       | 800/2797 [02:37<06:41,  4.97batch/s, loss=6.012, lr=3.6e-05]
epoch 1/8:  29%|██▉       | 811/2797 [02:39<06:37,  5.00batch/s, loss=6.012, lr=3.6e-05]
epoch 1/8:  29%|██▉       | 822/2797 [02:41<06:39,  4.95batch/s, loss=6.012, lr=3.6e-05]
epoch 1/8:  29%|██▉       | 822/2797 [02:42<06:39,  4.95batch/s, loss=5.951, lr=3.7e-05]
epoch 1/8:  30%|██▉       | 833/2797 [02:44<06:32,  5.00batch/s, loss=5.951, lr=3.7e-05]
epoch 1/8:  30%|███       | 844/2797 [02:46<06:22,  5.10batch/s, loss=5.951, lr=3.7e-05]
epoch 1/8:  30%|███       | 844/2797 [02:47<06:22,  5.10batch/s, loss=5.893, lr=3.8e-05]
epoch 1/8:  31%|███       | 855/2797 [02:48<06:18,  5.13batch/s, loss=5.893, lr=3.8e-05]
epoch 1/8:  31%|███       | 866/2797 [02:50<06:17,  5.12batch/s, loss=5.893, lr=3.8e-05]
epoch 1/8:  31%|███       | 866/2797 [02:52<06:17,  5.12batch/s, loss=5.835, lr=3.9e-05]
epoch 1/8:  31%|███▏      | 877/2797 [02:52<06:14,  5.13batch/s, loss=5.835, lr=3.9e-05]
epoch 1/8:  32%|███▏      | 889/2797 [02:54<06:05,  5.22batch/s, loss=5.835, lr=3.9e-05]
epoch 1/8:  32%|███▏      | 900/2797 [02:56<06:01,  5.24batch/s, loss=5.835, lr=3.9e-05]
epoch 1/8:  32%|███▏      | 900/2797 [02:57<06:01,  5.24batch/s, loss=5.778, lr=4.0e-05]
epoch 1/8:  33%|███▎      | 911/2797 [02:59<06:06,  5.14batch/s, loss=5.778, lr=4.0e-05]
epoch 1/8:  33%|███▎      | 922/2797 [03:01<05:59,  5.21batch/s, loss=5.778, lr=4.0e-05]
epoch 1/8:  33%|███▎      | 922/2797 [03:01<05:59,  5.21batch/s, loss=5.722, lr=4.1e-05]
epoch 1/8:  33%|███▎      | 933/2797 [03:03<05:54,  5.26batch/s, loss=5.722, lr=4.1e-05]
epoch 1/8:  34%|███▍      | 944/2797 [03:05<05:56,  5.20batch/s, loss=5.722, lr=4.1e-05]
epoch 1/8:  34%|███▍      | 944/2797 [03:06<05:56,  5.20batch/s, loss=5.672, lr=4.3e-05]
epoch 1/8:  34%|███▍      | 955/2797 [03:07<05:55,  5.18batch/s, loss=5.672, lr=4.3e-05]
epoch 1/8:  35%|███▍      | 966/2797 [03:09<05:58,  5.10batch/s, loss=5.672, lr=4.3e-05]
epoch 1/8:  35%|███▍      | 966/2797 [03:11<05:58,  5.10batch/s, loss=5.624, lr=4.4e-05]
epoch 1/8:  35%|███▌      | 979/2797 [03:11<05:38,  5.37batch/s, loss=5.624, lr=4.4e-05]
epoch 1/8:  35%|███▌      | 990/2797 [03:14<05:49,  5.16batch/s, loss=5.624, lr=4.4e-05]
epoch 1/8:  35%|███▌      | 990/2797 [03:16<05:49,  5.16batch/s, loss=5.578, lr=4.5e-05]
epoch 1/8:  36%|███▌      | 1001/2797 [03:16<05:52,  5.10batch/s, loss=5.578, lr=4.5e-05]
epoch 1/8:  36%|███▌      | 1012/2797 [03:18<05:45,  5.16batch/s, loss=5.578, lr=4.5e-05]
epoch 1/8:  37%|███▋      | 1023/2797 [03:20<05:49,  5.07batch/s, loss=5.578, lr=4.5e-05]
epoch 1/8:  37%|███▋      | 1023/2797 [03:21<05:49,  5.07batch/s, loss=5.532, lr=4.6e-05]
epoch 1/8:  37%|███▋      | 1034/2797 [03:22<05:41,  5.16batch/s, loss=5.532, lr=4.6e-05]
epoch 1/8:  37%|███▋      | 1045/2797 [03:24<05:38,  5.18batch/s, loss=5.532, lr=4.6e-05]
epoch 1/8:  37%|███▋      | 1045/2797 [03:25<05:38,  5.18batch/s, loss=5.486, lr=4.7e-05]
epoch 1/8:  38%|███▊      | 1056/2797 [03:26<05:32,  5.23batch/s, loss=5.486, lr=4.7e-05]
epoch 1/8:  38%|███▊      | 1067/2797 [03:28<05:28,  5.26batch/s, loss=5.486, lr=4.7e-05]
epoch 1/8:  38%|███▊      | 1067/2797 [03:30<05:28,  5.26batch/s, loss=5.442, lr=4.8e-05]
epoch 1/8:  39%|███▊      | 1078/2797 [03:31<05:33,  5.15batch/s, loss=5.442, lr=4.8e-05]
epoch 1/8:  39%|███▉      | 1089/2797 [03:33<05:46,  4.93batch/s, loss=5.442, lr=4.8e-05]
epoch 1/8:  39%|███▉      | 1099/2797 [03:35<05:45,  4.92batch/s, loss=5.442, lr=4.8e-05]
epoch 1/8:  39%|███▉      | 1099/2797 [03:36<05:45,  4.92batch/s, loss=5.397, lr=4.9e-05]
epoch 1/8:  40%|███▉      | 1111/2797 [03:37<05:30,  5.10batch/s, loss=5.397, lr=4.9e-05]
epoch 1/8:  40%|████      | 1122/2797 [03:40<05:31,  5.05batch/s, loss=5.397, lr=4.9e-05]
epoch 1/8:  40%|████      | 1122/2797 [03:40<05:31,  5.05batch/s, loss=5.356, lr=5.0e-05]
epoch 1/8:  41%|████      | 1133/2797 [03:42<05:30,  5.03batch/s, loss=5.356, lr=5.0e-05]
epoch 1/8:  41%|████      | 1144/2797 [03:44<05:30,  5.00batch/s, loss=5.356, lr=5.0e-05]
epoch 1/8:  41%|████      | 1144/2797 [03:45<05:30,  5.00batch/s, loss=5.316, lr=5.0e-05]
epoch 1/8:  41%|████▏     | 1155/2797 [03:46<05:24,  5.06batch/s, loss=5.316, lr=5.0e-05]
epoch 1/8:  42%|████▏     | 1166/2797 [03:48<05:29,  4.96batch/s, loss=5.316, lr=5.0e-05]
epoch 1/8:  42%|████▏     | 1166/2797 [03:50<05:29,  4.96batch/s, loss=5.276, lr=5.0e-05]
epoch 1/8:  42%|████▏     | 1177/2797 [03:51<05:26,  4.96batch/s, loss=5.276, lr=5.0e-05]
epoch 1/8:  42%|████▏     | 1187/2797 [03:53<05:27,  4.92batch/s, loss=5.276, lr=5.0e-05]
epoch 1/8:  43%|████▎     | 1198/2797 [03:55<05:18,  5.02batch/s, loss=5.276, lr=5.0e-05]
epoch 1/8:  43%|████▎     | 1198/2797 [03:56<05:18,  5.02batch/s, loss=5.238, lr=5.0e-05]
epoch 1/8:  43%|████▎     | 1209/2797 [03:57<05:09,  5.13batch/s, loss=5.238, lr=5.0e-05]
epoch 1/8:  44%|████▎     | 1220/2797 [03:59<05:13,  5.04batch/s, loss=5.238, lr=5.0e-05]
epoch 1/8:  44%|████▎     | 1220/2797 [04:00<05:13,  5.04batch/s, loss=5.201, lr=5.0e-05]
epoch 1/8:  44%|████▍     | 1231/2797 [04:01<05:11,  5.03batch/s, loss=5.201, lr=5.0e-05]
epoch 1/8:  44%|████▍     | 1243/2797 [04:04<04:59,  5.19batch/s, loss=5.201, lr=5.0e-05]
epoch 1/8:  44%|████▍     | 1243/2797 [04:05<04:59,  5.19batch/s, loss=5.164, lr=5.0e-05]
epoch 1/8:  45%|████▍     | 1254/2797 [04:06<04:52,  5.27batch/s, loss=5.164, lr=5.0e-05]
epoch 1/8:  45%|████▌     | 1265/2797 [04:08<04:47,  5.34batch/s, loss=5.164, lr=5.0e-05]
epoch 1/8:  45%|████▌     | 1265/2797 [04:10<04:47,  5.34batch/s, loss=5.129, lr=5.0e-05]
epoch 1/8:  46%|████▌     | 1276/2797 [04:10<04:48,  5.28batch/s, loss=5.129, lr=5.0e-05]
epoch 1/8:  46%|████▌     | 1287/2797 [04:12<04:58,  5.05batch/s, loss=5.129, lr=5.0e-05]
epoch 1/8:  46%|████▋     | 1298/2797 [04:14<04:54,  5.09batch/s, loss=5.129, lr=5.0e-05]
epoch 1/8:  46%|████▋     | 1298/2797 [04:15<04:54,  5.09batch/s, loss=5.094, lr=5.0e-05]
epoch 1/8:  47%|████▋     | 1309/2797 [04:16<04:52,  5.09batch/s, loss=5.094, lr=5.0e-05]
epoch 1/8:  47%|████▋     | 1320/2797 [04:19<04:50,  5.08batch/s, loss=5.094, lr=5.0e-05]
epoch 1/8:  47%|████▋     | 1320/2797 [04:20<04:50,  5.08batch/s, loss=5.059, lr=5.0e-05]
epoch 1/8:  48%|████▊     | 1331/2797 [04:21<04:49,  5.07batch/s, loss=5.059, lr=5.0e-05]
epoch 1/8:  48%|████▊     | 1344/2797 [04:23<04:30,  5.36batch/s, loss=5.059, lr=5.0e-05]
epoch 1/8:  48%|████▊     | 1344/2797 [04:24<04:30,  5.36batch/s, loss=5.025, lr=4.9e-05]
epoch 1/8:  48%|████▊     | 1355/2797 [04:25<04:35,  5.24batch/s, loss=5.025, lr=4.9e-05]
epoch 1/8:  49%|████▉     | 1366/2797 [04:27<04:41,  5.08batch/s, loss=5.025, lr=4.9e-05]
epoch 1/8:  49%|████▉     | 1366/2797 [04:30<04:41,  5.08batch/s, loss=4.994, lr=4.9e-05]
epoch 1/8:  49%|████▉     | 1377/2797 [04:30<04:47,  4.95batch/s, loss=4.994, lr=4.9e-05]
epoch 1/8:  50%|████▉     | 1388/2797 [04:32<04:43,  4.96batch/s, loss=4.994, lr=4.9e-05]
epoch 1/8:  50%|████▉     | 1398/2797 [04:34<04:42,  4.95batch/s, loss=4.994, lr=4.9e-05]
epoch 1/8:  50%|████▉     | 1398/2797 [04:35<04:42,  4.95batch/s, loss=4.961, lr=4.9e-05]
epoch 1/8:  50%|█████     | 1408/2797 [04:36<04:49,  4.80batch/s, loss=4.961, lr=4.9e-05]
epoch 1/8:  51%|█████     | 1419/2797 [04:38<04:41,  4.90batch/s, loss=4.961, lr=4.9e-05]
epoch 1/8:  51%|█████     | 1419/2797 [04:40<04:41,  4.90batch/s, loss=4.932, lr=4.9e-05]
epoch 1/8:  51%|█████     | 1430/2797 [04:41<04:35,  4.96batch/s, loss=4.932, lr=4.9e-05]
epoch 1/8:  52%|█████▏    | 1441/2797 [04:43<04:32,  4.98batch/s, loss=4.932, lr=4.9e-05]
epoch 1/8:  52%|█████▏    | 1441/2797 [04:45<04:32,  4.98batch/s, loss=4.902, lr=4.9e-05]
epoch 1/8:  52%|█████▏    | 1452/2797 [04:45<04:25,  5.07batch/s, loss=4.902, lr=4.9e-05]
epoch 1/8:  52%|█████▏    | 1463/2797 [04:47<04:26,  5.01batch/s, loss=4.902, lr=4.9e-05]
epoch 1/8:  53%|█████▎    | 1474/2797 [04:50<04:32,  4.85batch/s, loss=4.902, lr=4.9e-05]
epoch 1/8:  53%|█████▎    | 1474/2797 [04:50<04:32,  4.85batch/s, loss=4.870, lr=4.9e-05]
epoch 1/8:  53%|█████▎    | 1486/2797 [04:52<04:18,  5.07batch/s, loss=4.870, lr=4.9e-05]
epoch 1/8:  54%|█████▎    | 1497/2797 [04:54<04:19,  5.01batch/s, loss=4.870, lr=4.9e-05]
epoch 1/8:  54%|█████▎    | 1497/2797 [04:55<04:19,  5.01batch/s, loss=4.842, lr=4.9e-05]
epoch 1/8:  54%|█████▍    | 1508/2797 [04:56<04:16,  5.03batch/s, loss=4.842, lr=4.9e-05]
epoch 1/8:  54%|█████▍    | 1520/2797 [04:58<04:05,  5.21batch/s, loss=4.842, lr=4.9e-05]
epoch 1/8:  54%|█████▍    | 1520/2797 [04:59<04:05,  5.21batch/s, loss=4.813, lr=4.9e-05]
epoch 1/8:  55%|█████▍    | 1531/2797 [05:01<04:12,  5.01batch/s, loss=4.813, lr=4.9e-05]
epoch 1/8:  55%|█████▌    | 1542/2797 [05:03<04:06,  5.10batch/s, loss=4.813, lr=4.9e-05]
epoch 1/8:  55%|█████▌    | 1542/2797 [05:04<04:06,  5.10batch/s, loss=4.785, lr=4.9e-05]
epoch 1/8:  56%|█████▌    | 1553/2797 [05:05<04:02,  5.12batch/s, loss=4.785, lr=4.9e-05]
epoch 1/8:  56%|█████▌    | 1565/2797 [05:07<03:52,  5.30batch/s, loss=4.785, lr=4.9e-05]
epoch 1/8:  56%|█████▌    | 1565/2797 [05:09<03:52,  5.30batch/s, loss=4.757, lr=4.9e-05]
epoch 1/8:  56%|█████▋    | 1576/2797 [05:09<03:52,  5.25batch/s, loss=4.757, lr=4.9e-05]
epoch 1/8:  57%|█████▋    | 1587/2797 [05:11<03:49,  5.27batch/s, loss=4.757, lr=4.9e-05]
epoch 1/8:  57%|█████▋    | 1598/2797 [05:13<03:45,  5.33batch/s, loss=4.757, lr=4.9e-05]
epoch 1/8:  57%|█████▋    | 1598/2797 [05:14<03:45,  5.33batch/s, loss=4.730, lr=4.9e-05]
epoch 1/8:  58%|█████▊    | 1609/2797 [05:15<03:43,  5.32batch/s, loss=4.730, lr=4.9e-05]
epoch 1/8:  58%|█████▊    | 1620/2797 [05:17<03:43,  5.27batch/s, loss=4.730, lr=4.9e-05]
epoch 1/8:  58%|█████▊    | 1620/2797 [05:19<03:43,  5.27batch/s, loss=4.704, lr=4.9e-05]
epoch 1/8:  58%|█████▊    | 1631/2797 [05:19<03:42,  5.23batch/s, loss=4.704, lr=4.9e-05]
epoch 1/8:  59%|█████▊    | 1642/2797 [05:22<03:39,  5.26batch/s, loss=4.704, lr=4.9e-05]
epoch 1/8:  59%|█████▊    | 1642/2797 [05:23<03:39,  5.26batch/s, loss=4.679, lr=4.9e-05]
epoch 1/8:  59%|█████▉    | 1653/2797 [05:24<03:43,  5.13batch/s, loss=4.679, lr=4.9e-05]
epoch 1/8:  59%|█████▉    | 1664/2797 [05:26<03:39,  5.16batch/s, loss=4.679, lr=4.9e-05]
epoch 1/8:  59%|█████▉    | 1664/2797 [05:28<03:39,  5.16batch/s, loss=4.655, lr=4.9e-05]
epoch 1/8:  60%|█████▉    | 1676/2797 [05:28<03:32,  5.27batch/s, loss=4.655, lr=4.9e-05]
epoch 1/8:  60%|██████    | 1687/2797 [05:30<03:30,  5.27batch/s, loss=4.655, lr=4.9e-05]
epoch 1/8:  61%|██████    | 1698/2797 [05:32<03:30,  5.21batch/s, loss=4.655, lr=4.9e-05]
epoch 1/8:  61%|██████    | 1698/2797 [05:33<03:30,  5.21batch/s, loss=4.631, lr=4.9e-05]
epoch 1/8:  61%|██████    | 1709/2797 [05:34<03:30,  5.18batch/s, loss=4.631, lr=4.9e-05]
epoch 1/8:  61%|██████▏   | 1720/2797 [05:37<03:33,  5.04batch/s, loss=4.631, lr=4.9e-05]
epoch 1/8:  61%|██████▏   | 1720/2797 [05:38<03:33,  5.04batch/s, loss=4.607, lr=4.9e-05]
epoch 1/8:  62%|██████▏   | 1732/2797 [05:39<03:22,  5.25batch/s, loss=4.607, lr=4.9e-05]
epoch 1/8:  62%|██████▏   | 1743/2797 [05:41<03:18,  5.30batch/s, loss=4.607, lr=4.9e-05]
epoch 1/8:  62%|██████▏   | 1743/2797 [05:42<03:18,  5.30batch/s, loss=4.585, lr=4.9e-05]
epoch 1/8:  63%|██████▎   | 1754/2797 [05:43<03:19,  5.24batch/s, loss=4.585, lr=4.9e-05]
epoch 1/8:  63%|██████▎   | 1765/2797 [05:45<03:14,  5.31batch/s, loss=4.585, lr=4.9e-05]
epoch 1/8:  63%|██████▎   | 1765/2797 [05:47<03:14,  5.31batch/s, loss=4.562, lr=4.8e-05]
epoch 1/8:  63%|██████▎   | 1776/2797 [05:47<03:16,  5.20batch/s, loss=4.562, lr=4.8e-05]
epoch 1/8:  64%|██████▍   | 1787/2797 [05:49<03:13,  5.21batch/s, loss=4.562, lr=4.8e-05]
epoch 1/8:  64%|██████▍   | 1799/2797 [05:51<03:06,  5.34batch/s, loss=4.562, lr=4.8e-05]
epoch 1/8:  64%|██████▍   | 1799/2797 [05:52<03:06,  5.34batch/s, loss=4.541, lr=4.8e-05]
epoch 1/8:  65%|██████▍   | 1810/2797 [05:54<03:08,  5.25batch/s, loss=4.541, lr=4.8e-05]
epoch 1/8:  65%|██████▌   | 1822/2797 [05:56<03:04,  5.30batch/s, loss=4.541, lr=4.8e-05]
epoch 1/8:  65%|██████▌   | 1822/2797 [05:57<03:04,  5.30batch/s, loss=4.521, lr=4.8e-05]
epoch 1/8:  66%|██████▌   | 1833/2797 [05:58<03:05,  5.19batch/s, loss=4.521, lr=4.8e-05]
epoch 1/8:  66%|██████▌   | 1844/2797 [06:00<03:01,  5.24batch/s, loss=4.521, lr=4.8e-05]
epoch 1/8:  66%|██████▌   | 1844/2797 [06:02<03:01,  5.24batch/s, loss=4.499, lr=4.8e-05]
epoch 1/8:  66%|██████▋   | 1855/2797 [06:02<02:59,  5.26batch/s, loss=4.499, lr=4.8e-05]
epoch 1/8:  67%|██████▋   | 1866/2797 [06:04<02:57,  5.25batch/s, loss=4.499, lr=4.8e-05]
epoch 1/8:  67%|██████▋   | 1866/2797 [06:06<02:57,  5.25batch/s, loss=4.479, lr=4.8e-05]
epoch 1/8:  67%|██████▋   | 1877/2797 [06:07<02:58,  5.16batch/s, loss=4.479, lr=4.8e-05]
epoch 1/8:  68%|██████▊   | 1888/2797 [06:09<03:02,  4.99batch/s, loss=4.479, lr=4.8e-05]
epoch 1/8:  68%|██████▊   | 1899/2797 [06:11<02:59,  5.01batch/s, loss=4.479, lr=4.8e-05]
epoch 1/8:  68%|██████▊   | 1899/2797 [06:12<02:59,  5.01batch/s, loss=4.460, lr=4.8e-05]
epoch 1/8:  68%|██████▊   | 1910/2797 [06:13<03:01,  4.89batch/s, loss=4.460, lr=4.8e-05]
epoch 1/8:  69%|██████▊   | 1920/2797 [06:16<03:00,  4.86batch/s, loss=4.460, lr=4.8e-05]
epoch 1/8:  69%|██████▊   | 1920/2797 [06:17<03:00,  4.86batch/s, loss=4.440, lr=4.8e-05]
epoch 1/8:  69%|██████▉   | 1931/2797 [06:18<02:53,  4.98batch/s, loss=4.440, lr=4.8e-05]
epoch 1/8:  69%|██████▉   | 1942/2797 [06:20<02:49,  5.05batch/s, loss=4.440, lr=4.8e-05]
epoch 1/8:  69%|██████▉   | 1942/2797 [06:21<02:49,  5.05batch/s, loss=4.421, lr=4.8e-05]
epoch 1/8:  70%|██████▉   | 1953/2797 [06:22<02:45,  5.10batch/s, loss=4.421, lr=4.8e-05]
epoch 1/8:  70%|███████   | 1964/2797 [06:24<02:44,  5.08batch/s, loss=4.421, lr=4.8e-05]
epoch 1/8:  71%|███████   | 1975/2797 [06:26<02:42,  5.05batch/s, loss=4.421, lr=4.8e-05]
epoch 1/8:  71%|███████   | 1975/2797 [06:27<02:42,  5.05batch/s, loss=4.402, lr=4.8e-05]
epoch 1/8:  71%|███████   | 1986/2797 [06:29<02:45,  4.91batch/s, loss=4.402, lr=4.8e-05]
epoch 1/8:  71%|███████▏  | 1997/2797 [06:31<02:41,  4.95batch/s, loss=4.402, lr=4.8e-05]
epoch 1/8:  71%|███████▏  | 1997/2797 [06:32<02:41,  4.95batch/s, loss=4.384, lr=4.8e-05]
epoch 1/8:  72%|███████▏  | 2007/2797 [06:33<02:42,  4.85batch/s, loss=4.384, lr=4.8e-05]
epoch 1/8:  72%|███████▏  | 2018/2797 [06:35<02:35,  5.00batch/s, loss=4.384, lr=4.8e-05]
epoch 1/8:  72%|███████▏  | 2018/2797 [06:37<02:35,  5.00batch/s, loss=4.366, lr=4.8e-05]
epoch 1/8:  73%|███████▎  | 2029/2797 [06:37<02:34,  4.99batch/s, loss=4.366, lr=4.8e-05]
epoch 1/8:  73%|███████▎  | 2040/2797 [06:39<02:31,  5.00batch/s, loss=4.366, lr=4.8e-05]
epoch 1/8:  73%|███████▎  | 2040/2797 [06:41<02:31,  5.00batch/s, loss=4.347, lr=4.8e-05]
epoch 1/8:  73%|███████▎  | 2051/2797 [06:41<02:25,  5.12batch/s, loss=4.347, lr=4.8e-05]
epoch 1/8:  74%|███████▎  | 2062/2797 [06:44<02:25,  5.04batch/s, loss=4.347, lr=4.8e-05]
epoch 1/8:  74%|███████▍  | 2073/2797 [06:46<02:27,  4.92batch/s, loss=4.347, lr=4.8e-05]
epoch 1/8:  74%|███████▍  | 2073/2797 [06:47<02:27,  4.92batch/s, loss=4.330, lr=4.8e-05]
epoch 1/8:  75%|███████▍  | 2084/2797 [06:48<02:21,  5.04batch/s, loss=4.330, lr=4.8e-05]
epoch 1/8:  75%|███████▍  | 2095/2797 [06:50<02:18,  5.08batch/s, loss=4.330, lr=4.8e-05]
epoch 1/8:  75%|███████▍  | 2095/2797 [06:52<02:18,  5.08batch/s, loss=4.312, lr=4.8e-05]
epoch 1/8:  75%|███████▌  | 2106/2797 [06:52<02:15,  5.11batch/s, loss=4.312, lr=4.8e-05]
epoch 1/8:  76%|███████▌  | 2117/2797 [06:55<02:12,  5.14batch/s, loss=4.312, lr=4.8e-05]
epoch 1/8:  76%|███████▌  | 2117/2797 [06:56<02:12,  5.14batch/s, loss=4.297, lr=4.8e-05]
epoch 1/8:  76%|███████▌  | 2128/2797 [06:57<02:10,  5.11batch/s, loss=4.297, lr=4.8e-05]
epoch 1/8:  76%|███████▋  | 2139/2797 [06:59<02:11,  5.02batch/s, loss=4.297, lr=4.8e-05]
epoch 1/8:  77%|███████▋  | 2150/2797 [07:01<02:11,  4.93batch/s, loss=4.297, lr=4.8e-05]
epoch 1/8:  77%|███████▋  | 2150/2797 [07:02<02:11,  4.93batch/s, loss=4.279, lr=4.8e-05]
epoch 1/8:  77%|███████▋  | 2161/2797 [07:04<02:08,  4.95batch/s, loss=4.279, lr=4.8e-05]
epoch 1/8:  78%|███████▊  | 2171/2797 [07:06<02:06,  4.95batch/s, loss=4.279, lr=4.8e-05]
epoch 1/8:  78%|███████▊  | 2171/2797 [07:07<02:06,  4.95batch/s, loss=4.262, lr=4.8e-05]
epoch 1/8:  78%|███████▊  | 2181/2797 [07:08<02:04,  4.93batch/s, loss=4.262, lr=4.8e-05]
epoch 1/8:  78%|███████▊  | 2192/2797 [07:10<01:59,  5.04batch/s, loss=4.262, lr=4.8e-05]
epoch 1/8:  78%|███████▊  | 2192/2797 [07:11<01:59,  5.04batch/s, loss=4.245, lr=4.7e-05]
epoch 1/8:  79%|███████▉  | 2203/2797 [07:12<01:57,  5.05batch/s, loss=4.245, lr=4.7e-05]
epoch 1/8:  79%|███████▉  | 2214/2797 [07:14<01:55,  5.04batch/s, loss=4.245, lr=4.7e-05]
epoch 1/8:  79%|███████▉  | 2214/2797 [07:16<01:55,  5.04batch/s, loss=4.229, lr=4.7e-05]
epoch 1/8:  80%|███████▉  | 2226/2797 [07:16<01:49,  5.20batch/s, loss=4.229, lr=4.7e-05]
epoch 1/8:  80%|███████▉  | 2237/2797 [07:18<01:46,  5.24batch/s, loss=4.229, lr=4.7e-05]
epoch 1/8:  80%|████████  | 2248/2797 [07:20<01:46,  5.17batch/s, loss=4.229, lr=4.7e-05]
epoch 1/8:  80%|████████  | 2248/2797 [07:21<01:46,  5.17batch/s, loss=4.213, lr=4.7e-05]
epoch 1/8:  81%|████████  | 2259/2797 [07:23<01:45,  5.10batch/s, loss=4.213, lr=4.7e-05]
epoch 1/8:  81%|████████  | 2270/2797 [07:25<01:41,  5.18batch/s, loss=4.213, lr=4.7e-05]
epoch 1/8:  81%|████████  | 2270/2797 [07:26<01:41,  5.18batch/s, loss=4.199, lr=4.7e-05]
epoch 1/8:  82%|████████▏ | 2281/2797 [07:27<01:41,  5.06batch/s, loss=4.199, lr=4.7e-05]
epoch 1/8:  82%|████████▏ | 2292/2797 [07:29<01:43,  4.87batch/s, loss=4.199, lr=4.7e-05]
epoch 1/8:  82%|████████▏ | 2292/2797 [07:31<01:43,  4.87batch/s, loss=4.183, lr=4.7e-05]
epoch 1/8:  82%|████████▏ | 2303/2797 [07:32<01:40,  4.93batch/s, loss=4.183, lr=4.7e-05]
epoch 1/8:  83%|████████▎ | 2313/2797 [07:34<01:38,  4.93batch/s, loss=4.183, lr=4.7e-05]
epoch 1/8:  83%|████████▎ | 2324/2797 [07:36<01:35,  4.98batch/s, loss=4.183, lr=4.7e-05]
epoch 1/8:  83%|████████▎ | 2324/2797 [07:36<01:35,  4.98batch/s, loss=4.168, lr=4.7e-05]
epoch 1/8:  83%|████████▎ | 2335/2797 [07:38<01:32,  5.01batch/s, loss=4.168, lr=4.7e-05]
epoch 1/8:  84%|████████▍ | 2346/2797 [07:40<01:27,  5.13batch/s, loss=4.168, lr=4.7e-05]
epoch 1/8:  84%|████████▍ | 2346/2797 [07:41<01:27,  5.13batch/s, loss=4.154, lr=4.7e-05]
epoch 1/8:  84%|████████▍ | 2357/2797 [07:42<01:26,  5.10batch/s, loss=4.154, lr=4.7e-05]
epoch 1/8:  85%|████████▍ | 2368/2797 [07:44<01:23,  5.15batch/s, loss=4.154, lr=4.7e-05]
epoch 1/8:  85%|████████▍ | 2368/2797 [07:46<01:23,  5.15batch/s, loss=4.139, lr=4.7e-05]
epoch 1/8:  85%|████████▌ | 2379/2797 [07:47<01:22,  5.05batch/s, loss=4.139, lr=4.7e-05]
epoch 1/8:  85%|████████▌ | 2390/2797 [07:49<01:22,  4.94batch/s, loss=4.139, lr=4.7e-05]
epoch 1/8:  85%|████████▌ | 2390/2797 [07:51<01:22,  4.94batch/s, loss=4.125, lr=4.7e-05]
epoch 1/8:  86%|████████▌ | 2401/2797 [07:51<01:19,  4.96batch/s, loss=4.125, lr=4.7e-05]
epoch 1/8:  86%|████████▋ | 2413/2797 [07:53<01:14,  5.12batch/s, loss=4.125, lr=4.7e-05]
epoch 1/8:  87%|████████▋ | 2424/2797 [07:55<01:12,  5.15batch/s, loss=4.125, lr=4.7e-05]
epoch 1/8:  87%|████████▋ | 2424/2797 [07:56<01:12,  5.15batch/s, loss=4.112, lr=4.7e-05]
epoch 1/8:  87%|████████▋ | 2435/2797 [07:58<01:13,  4.93batch/s, loss=4.112, lr=4.7e-05]
epoch 1/8:  87%|████████▋ | 2447/2797 [08:00<01:07,  5.20batch/s, loss=4.112, lr=4.7e-05]
epoch 1/8:  87%|████████▋ | 2447/2797 [08:00<01:07,  5.20batch/s, loss=4.099, lr=4.7e-05]
epoch 1/8:  88%|████████▊ | 2459/2797 [08:02<01:04,  5.26batch/s, loss=4.099, lr=4.7e-05]
epoch 1/8:  88%|████████▊ | 2470/2797 [08:04<01:02,  5.26batch/s, loss=4.099, lr=4.7e-05]
epoch 1/8:  88%|████████▊ | 2470/2797 [08:05<01:02,  5.26batch/s, loss=4.084, lr=4.7e-05]
epoch 1/8:  89%|████████▊ | 2481/2797 [08:06<01:00,  5.18batch/s, loss=4.084, lr=4.7e-05]
epoch 1/8:  89%|████████▉ | 2492/2797 [08:09<00:59,  5.10batch/s, loss=4.084, lr=4.7e-05]
epoch 1/8:  89%|████████▉ | 2492/2797 [08:10<00:59,  5.10batch/s, loss=4.071, lr=4.7e-05]
epoch 1/8:  89%|████████▉ | 2503/2797 [08:11<00:58,  5.06batch/s, loss=4.071, lr=4.7e-05]
epoch 1/8:  90%|████████▉ | 2514/2797 [08:13<00:56,  5.01batch/s, loss=4.071, lr=4.7e-05]
epoch 1/8:  90%|█████████ | 2525/2797 [08:15<00:54,  5.00batch/s, loss=4.071, lr=4.7e-05]
epoch 1/8:  90%|█████████ | 2525/2797 [08:15<00:54,  5.00batch/s, loss=4.058, lr=4.7e-05]
epoch 1/8:  91%|█████████ | 2536/2797 [08:17<00:52,  5.01batch/s, loss=4.058, lr=4.7e-05]
epoch 1/8:  91%|█████████ | 2547/2797 [08:20<00:49,  5.02batch/s, loss=4.058, lr=4.7e-05]
epoch 1/8:  91%|█████████ | 2547/2797 [08:20<00:49,  5.02batch/s, loss=4.045, lr=4.7e-05]
epoch 1/8:  91%|█████████▏| 2558/2797 [08:22<00:47,  5.07batch/s, loss=4.045, lr=4.7e-05]
epoch 1/8:  92%|█████████▏| 2569/2797 [08:24<00:45,  5.00batch/s, loss=4.045, lr=4.7e-05]
epoch 1/8:  92%|█████████▏| 2569/2797 [08:25<00:45,  5.00batch/s, loss=4.033, lr=4.7e-05]
epoch 1/8:  92%|█████████▏| 2580/2797 [08:26<00:43,  5.01batch/s, loss=4.033, lr=4.7e-05]
epoch 1/8:  93%|█████████▎| 2592/2797 [08:28<00:39,  5.18batch/s, loss=4.033, lr=4.7e-05]
epoch 1/8:  93%|█████████▎| 2592/2797 [08:30<00:39,  5.18batch/s, loss=4.021, lr=4.7e-05]
epoch 1/8:  93%|█████████▎| 2603/2797 [08:31<00:38,  5.07batch/s, loss=4.021, lr=4.7e-05]
epoch 1/8:  93%|█████████▎| 2614/2797 [08:33<00:36,  4.99batch/s, loss=4.021, lr=4.7e-05]
epoch 1/8:  94%|█████████▍| 2624/2797 [08:35<00:34,  4.99batch/s, loss=4.021, lr=4.7e-05]
epoch 1/8:  94%|█████████▍| 2624/2797 [08:35<00:34,  4.99batch/s, loss=4.008, lr=4.6e-05]
epoch 1/8:  94%|█████████▍| 2635/2797 [08:37<00:32,  5.04batch/s, loss=4.008, lr=4.6e-05]
epoch 1/8:  95%|█████████▍| 2646/2797 [08:39<00:29,  5.08batch/s, loss=4.008, lr=4.6e-05]
epoch 1/8:  95%|█████████▍| 2646/2797 [08:40<00:29,  5.08batch/s, loss=3.996, lr=4.6e-05]
epoch 1/8:  95%|█████████▍| 2657/2797 [08:41<00:27,  5.08batch/s, loss=3.996, lr=4.6e-05]
epoch 1/8:  95%|█████████▌| 2668/2797 [08:44<00:25,  5.02batch/s, loss=3.996, lr=4.6e-05]
epoch 1/8:  95%|█████████▌| 2668/2797 [08:45<00:25,  5.02batch/s, loss=3.984, lr=4.6e-05]
epoch 1/8:  96%|█████████▌| 2679/2797 [08:46<00:24,  4.90batch/s, loss=3.984, lr=4.6e-05]
epoch 1/8:  96%|█████████▌| 2689/2797 [08:48<00:22,  4.83batch/s, loss=3.984, lr=4.6e-05]
epoch 1/8:  97%|█████████▋| 2700/2797 [08:50<00:19,  5.00batch/s, loss=3.984, lr=4.6e-05]
epoch 1/8:  97%|█████████▋| 2700/2797 [08:50<00:19,  5.00batch/s, loss=3.973, lr=4.6e-05]
epoch 1/8:  97%|█████████▋| 2711/2797 [08:52<00:17,  5.05batch/s, loss=3.973, lr=4.6e-05]
epoch 1/8:  97%|█████████▋| 2722/2797 [08:54<00:14,  5.04batch/s, loss=3.973, lr=4.6e-05]
epoch 1/8:  97%|█████████▋| 2722/2797 [08:55<00:14,  5.04batch/s, loss=3.960, lr=4.6e-05]
epoch 1/8:  98%|█████████▊| 2734/2797 [08:57<00:11,  5.26batch/s, loss=3.960, lr=4.6e-05]
epoch 1/8:  98%|█████████▊| 2745/2797 [08:59<00:09,  5.23batch/s, loss=3.960, lr=4.6e-05]
epoch 1/8:  98%|█████████▊| 2745/2797 [09:00<00:09,  5.23batch/s, loss=3.949, lr=4.6e-05]
epoch 1/8:  99%|█████████▊| 2756/2797 [09:01<00:07,  5.13batch/s, loss=3.949, lr=4.6e-05]
epoch 1/8:  99%|█████████▉| 2767/2797 [09:03<00:05,  5.21batch/s, loss=3.949, lr=4.6e-05]
epoch 1/8:  99%|█████████▉| 2767/2797 [09:05<00:05,  5.21batch/s, loss=3.938, lr=4.6e-05]
epoch 1/8:  99%|█████████▉| 2778/2797 [09:05<00:03,  5.29batch/s, loss=3.938, lr=4.6e-05]
epoch 1/8: 100%|█████████▉| 2789/2797 [09:07<00:01,  5.20batch/s, loss=3.938, lr=4.6e-05]
epoch 1/8: 100%|██████████| 2797/2797 [09:08<00:00,  5.10batch/s, loss=3.938, lr=4.6e-05]
epoch 1: train loss 3.929 · validation loss 2.476 · broad 77.8% (top-3 93.3%) · path 66.4% (top-3 85.2%, plausible or look-alike 83.2%) · 590s elapsed

epoch 2/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 2/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=2.668, lr=4.6e-05]
epoch 2/8:   0%|          | 12/2797 [00:02<07:53,  5.89batch/s, loss=2.668, lr=4.6e-05]
epoch 2/8:   1%|          | 24/2797 [00:04<08:42,  5.31batch/s, loss=2.668, lr=4.6e-05]
epoch 2/8:   1%|          | 24/2797 [00:04<08:42,  5.31batch/s, loss=2.416, lr=4.6e-05]
epoch 2/8:   1%|▏         | 35/2797 [00:06<08:32,  5.39batch/s, loss=2.416, lr=4.6e-05]
epoch 2/8:   2%|▏         | 46/2797 [00:08<08:33,  5.36batch/s, loss=2.416, lr=4.6e-05]
epoch 2/8:   2%|▏         | 46/2797 [00:09<08:33,  5.36batch/s, loss=2.420, lr=4.6e-05]
epoch 2/8:   2%|▏         | 57/2797 [00:10<08:44,  5.22batch/s, loss=2.420, lr=4.6e-05]
epoch 2/8:   2%|▏         | 69/2797 [00:12<08:27,  5.37batch/s, loss=2.420, lr=4.6e-05]
epoch 2/8:   2%|▏         | 69/2797 [00:14<08:27,  5.37batch/s, loss=2.399, lr=4.6e-05]
epoch 2/8:   3%|▎         | 80/2797 [00:15<08:37,  5.25batch/s, loss=2.399, lr=4.6e-05]
epoch 2/8:   3%|▎         | 91/2797 [00:17<08:34,  5.26batch/s, loss=2.399, lr=4.6e-05]
epoch 2/8:   3%|▎         | 91/2797 [00:19<08:34,  5.26batch/s, loss=2.401, lr=4.6e-05]
epoch 2/8:   4%|▎         | 102/2797 [00:19<08:32,  5.26batch/s, loss=2.401, lr=4.6e-05]
epoch 2/8:   4%|▍         | 113/2797 [00:21<08:30,  5.26batch/s, loss=2.401, lr=4.6e-05]
epoch 2/8:   4%|▍         | 124/2797 [00:23<08:35,  5.19batch/s, loss=2.401, lr=4.6e-05]
epoch 2/8:   4%|▍         | 124/2797 [00:23<08:35,  5.19batch/s, loss=2.404, lr=4.6e-05]
epoch 2/8:   5%|▍         | 135/2797 [00:25<08:32,  5.19batch/s, loss=2.404, lr=4.6e-05]
epoch 2/8:   5%|▌         | 146/2797 [00:27<08:47,  5.03batch/s, loss=2.404, lr=4.6e-05]
epoch 2/8:   5%|▌         | 146/2797 [00:28<08:47,  5.03batch/s, loss=2.423, lr=4.6e-05]
epoch 2/8:   6%|▌         | 158/2797 [00:30<08:33,  5.14batch/s, loss=2.423, lr=4.6e-05]
epoch 2/8:   6%|▌         | 169/2797 [00:32<08:36,  5.09batch/s, loss=2.423, lr=4.6e-05]
epoch 2/8:   6%|▌         | 169/2797 [00:33<08:36,  5.09batch/s, loss=2.414, lr=4.6e-05]
epoch 2/8:   6%|▋         | 181/2797 [00:34<08:20,  5.23batch/s, loss=2.414, lr=4.6e-05]
epoch 2/8:   7%|▋         | 192/2797 [00:36<08:15,  5.26batch/s, loss=2.414, lr=4.6e-05]
epoch 2/8:   7%|▋         | 192/2797 [00:38<08:15,  5.26batch/s, loss=2.414, lr=4.6e-05]
epoch 2/8:   7%|▋         | 203/2797 [00:38<08:21,  5.18batch/s, loss=2.414, lr=4.6e-05]
epoch 2/8:   8%|▊         | 215/2797 [00:40<08:03,  5.34batch/s, loss=2.414, lr=4.6e-05]
epoch 2/8:   8%|▊         | 215/2797 [00:43<08:03,  5.34batch/s, loss=2.409, lr=4.6e-05]
epoch 2/8:   8%|▊         | 226/2797 [00:43<08:11,  5.23batch/s, loss=2.409, lr=4.6e-05]
epoch 2/8:   8%|▊         | 237/2797 [00:45<08:23,  5.08batch/s, loss=2.409, lr=4.6e-05]
epoch 2/8:   9%|▉         | 248/2797 [00:47<08:32,  4.97batch/s, loss=2.409, lr=4.6e-05]
epoch 2/8:   9%|▉         | 248/2797 [00:48<08:32,  4.97batch/s, loss=2.414, lr=4.5e-05]
epoch 2/8:   9%|▉         | 259/2797 [00:49<08:28,  4.99batch/s, loss=2.414, lr=4.5e-05]
epoch 2/8:  10%|▉         | 270/2797 [00:52<08:16,  5.09batch/s, loss=2.414, lr=4.5e-05]
epoch 2/8:  10%|▉         | 270/2797 [00:53<08:16,  5.09batch/s, loss=2.411, lr=4.5e-05]
epoch 2/8:  10%|█         | 282/2797 [00:54<07:58,  5.25batch/s, loss=2.411, lr=4.5e-05]
epoch 2/8:  10%|█         | 293/2797 [00:56<08:02,  5.19batch/s, loss=2.411, lr=4.5e-05]
epoch 2/8:  10%|█         | 293/2797 [00:57<08:02,  5.19batch/s, loss=2.404, lr=4.5e-05]
epoch 2/8:  11%|█         | 304/2797 [00:58<08:00,  5.18batch/s, loss=2.404, lr=4.5e-05]
epoch 2/8:  11%|█▏        | 315/2797 [01:00<08:06,  5.11batch/s, loss=2.404, lr=4.5e-05]
epoch 2/8:  11%|█▏        | 315/2797 [01:02<08:06,  5.11batch/s, loss=2.412, lr=4.5e-05]
epoch 2/8:  12%|█▏        | 326/2797 [01:02<08:07,  5.06batch/s, loss=2.412, lr=4.5e-05]
epoch 2/8:  12%|█▏        | 338/2797 [01:05<07:55,  5.17batch/s, loss=2.412, lr=4.5e-05]
epoch 2/8:  13%|█▎        | 350/2797 [01:07<07:44,  5.26batch/s, loss=2.412, lr=4.5e-05]
epoch 2/8:  13%|█▎        | 350/2797 [01:07<07:44,  5.26batch/s, loss=2.418, lr=4.5e-05]
epoch 2/8:  13%|█▎        | 361/2797 [01:09<07:53,  5.14batch/s, loss=2.418, lr=4.5e-05]
epoch 2/8:  13%|█▎        | 372/2797 [01:11<07:56,  5.09batch/s, loss=2.418, lr=4.5e-05]
epoch 2/8:  13%|█▎        | 372/2797 [01:12<07:56,  5.09batch/s, loss=2.419, lr=4.5e-05]
epoch 2/8:  14%|█▎        | 383/2797 [01:14<08:01,  5.01batch/s, loss=2.419, lr=4.5e-05]
epoch 2/8:  14%|█▍        | 395/2797 [01:16<07:42,  5.19batch/s, loss=2.419, lr=4.5e-05]
epoch 2/8:  14%|█▍        | 395/2797 [01:17<07:42,  5.19batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  15%|█▍        | 406/2797 [01:18<07:48,  5.10batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  15%|█▍        | 417/2797 [01:20<07:50,  5.06batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  15%|█▍        | 417/2797 [01:22<07:50,  5.06batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  15%|█▌        | 428/2797 [01:22<07:42,  5.13batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  16%|█▌        | 439/2797 [01:24<07:34,  5.18batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  16%|█▌        | 450/2797 [01:26<07:29,  5.22batch/s, loss=2.415, lr=4.5e-05]
epoch 2/8:  16%|█▌        | 450/2797 [01:27<07:29,  5.22batch/s, loss=2.409, lr=4.5e-05]
epoch 2/8:  16%|█▋        | 461/2797 [01:29<07:45,  5.02batch/s, loss=2.409, lr=4.5e-05]
epoch 2/8:  17%|█▋        | 472/2797 [01:31<07:48,  4.96batch/s, loss=2.409, lr=4.5e-05]
epoch 2/8:  17%|█▋        | 472/2797 [01:32<07:48,  4.96batch/s, loss=2.409, lr=4.5e-05]
epoch 2/8:  17%|█▋        | 483/2797 [01:33<07:45,  4.97batch/s, loss=2.409, lr=4.5e-05]
epoch 2/8:  18%|█▊        | 494/2797 [01:35<07:41,  5.00batch/s, loss=2.409, lr=4.5e-05]
epoch 2/8:  18%|█▊        | 494/2797 [01:37<07:41,  5.00batch/s, loss=2.407, lr=4.5e-05]
epoch 2/8:  18%|█▊        | 505/2797 [01:38<07:46,  4.91batch/s, loss=2.407, lr=4.5e-05]
epoch 2/8:  18%|█▊        | 517/2797 [01:40<07:25,  5.12batch/s, loss=2.407, lr=4.5e-05]
epoch 2/8:  18%|█▊        | 517/2797 [01:42<07:25,  5.12batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  19%|█▉        | 528/2797 [01:42<07:18,  5.18batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  19%|█▉        | 539/2797 [01:44<07:26,  5.06batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  20%|█▉        | 550/2797 [01:46<07:29,  5.00batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  20%|█▉        | 550/2797 [01:47<07:29,  5.00batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  20%|██        | 561/2797 [01:49<07:32,  4.94batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  20%|██        | 571/2797 [01:51<07:44,  4.79batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  20%|██        | 571/2797 [01:52<07:44,  4.79batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  21%|██        | 583/2797 [01:53<07:23,  4.99batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  21%|██        | 594/2797 [01:55<07:21,  4.99batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  21%|██        | 594/2797 [01:57<07:21,  4.99batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  22%|██▏       | 604/2797 [01:57<07:23,  4.95batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  22%|██▏       | 614/2797 [02:00<07:30,  4.85batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  22%|██▏       | 625/2797 [02:02<07:25,  4.88batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  22%|██▏       | 625/2797 [02:02<07:25,  4.88batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  23%|██▎       | 636/2797 [02:04<07:12,  5.00batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  23%|██▎       | 647/2797 [02:06<07:11,  4.98batch/s, loss=2.405, lr=4.5e-05]
epoch 2/8:  23%|██▎       | 647/2797 [02:07<07:11,  4.98batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  23%|██▎       | 657/2797 [02:08<07:11,  4.96batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  24%|██▍       | 667/2797 [02:10<07:08,  4.97batch/s, loss=2.402, lr=4.5e-05]
epoch 2/8:  24%|██▍       | 667/2797 [02:12<07:08,  4.97batch/s, loss=2.395, lr=4.4e-05]
epoch 2/8:  24%|██▍       | 678/2797 [02:12<06:57,  5.08batch/s, loss=2.395, lr=4.4e-05]
epoch 2/8:  25%|██▍       | 689/2797 [02:14<06:49,  5.15batch/s, loss=2.395, lr=4.4e-05]
epoch 2/8:  25%|██▌       | 700/2797 [02:17<06:56,  5.04batch/s, loss=2.395, lr=4.4e-05]
epoch 2/8:  25%|██▌       | 700/2797 [02:17<06:56,  5.04batch/s, loss=2.394, lr=4.4e-05]
epoch 2/8:  25%|██▌       | 711/2797 [02:19<06:51,  5.07batch/s, loss=2.394, lr=4.4e-05]
epoch 2/8:  26%|██▌       | 722/2797 [02:21<06:44,  5.13batch/s, loss=2.394, lr=4.4e-05]
epoch 2/8:  26%|██▌       | 722/2797 [02:22<06:44,  5.13batch/s, loss=2.390, lr=4.4e-05]
epoch 2/8:  26%|██▌       | 733/2797 [02:23<06:44,  5.10batch/s, loss=2.390, lr=4.4e-05]
epoch 2/8:  27%|██▋       | 744/2797 [02:25<06:39,  5.15batch/s, loss=2.390, lr=4.4e-05]
epoch 2/8:  27%|██▋       | 744/2797 [02:27<06:39,  5.15batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  27%|██▋       | 755/2797 [02:27<06:44,  5.04batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  27%|██▋       | 766/2797 [02:30<06:42,  5.05batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  27%|██▋       | 766/2797 [02:31<06:42,  5.05batch/s, loss=2.391, lr=4.4e-05]
epoch 2/8:  28%|██▊       | 778/2797 [02:32<06:31,  5.16batch/s, loss=2.391, lr=4.4e-05]
epoch 2/8:  28%|██▊       | 790/2797 [02:34<06:23,  5.23batch/s, loss=2.391, lr=4.4e-05]
epoch 2/8:  28%|██▊       | 790/2797 [02:36<06:23,  5.23batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  29%|██▊       | 801/2797 [02:36<06:26,  5.16batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  29%|██▉       | 812/2797 [02:39<06:32,  5.06batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  29%|██▉       | 823/2797 [02:41<06:22,  5.17batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  29%|██▉       | 823/2797 [02:41<06:22,  5.17batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  30%|██▉       | 834/2797 [02:43<06:19,  5.18batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  30%|███       | 845/2797 [02:45<06:17,  5.17batch/s, loss=2.389, lr=4.4e-05]
epoch 2/8:  30%|███       | 845/2797 [02:46<06:17,  5.17batch/s, loss=2.387, lr=4.4e-05]
epoch 2/8:  31%|███       | 856/2797 [02:47<06:19,  5.12batch/s, loss=2.387, lr=4.4e-05]
epoch 2/8:  31%|███       | 867/2797 [02:49<06:10,  5.20batch/s, loss=2.387, lr=4.4e-05]
epoch 2/8:  31%|███       | 867/2797 [02:51<06:10,  5.20batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  31%|███▏      | 878/2797 [02:51<06:24,  5.00batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  32%|███▏      | 889/2797 [02:54<06:31,  4.87batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  32%|███▏      | 899/2797 [02:56<06:29,  4.87batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  32%|███▏      | 899/2797 [02:56<06:29,  4.87batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  33%|███▎      | 910/2797 [02:58<06:23,  4.92batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  33%|███▎      | 922/2797 [03:00<06:07,  5.10batch/s, loss=2.382, lr=4.4e-05]
epoch 2/8:  33%|███▎      | 922/2797 [03:01<06:07,  5.10batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  33%|███▎      | 933/2797 [03:02<06:03,  5.12batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  34%|███▍      | 944/2797 [03:05<06:07,  5.05batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  34%|███▍      | 944/2797 [03:06<06:07,  5.05batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  34%|███▍      | 955/2797 [03:07<06:08,  5.00batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  35%|███▍      | 967/2797 [03:09<05:55,  5.15batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  35%|███▍      | 967/2797 [03:11<05:55,  5.15batch/s, loss=2.379, lr=4.4e-05]
epoch 2/8:  35%|███▌      | 979/2797 [03:11<05:43,  5.29batch/s, loss=2.379, lr=4.4e-05]
epoch 2/8:  35%|███▌      | 990/2797 [03:13<05:43,  5.26batch/s, loss=2.379, lr=4.4e-05]
epoch 2/8:  35%|███▌      | 990/2797 [03:15<05:43,  5.26batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  36%|███▌      | 1002/2797 [03:15<05:33,  5.39batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  36%|███▌      | 1013/2797 [03:18<05:42,  5.20batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  37%|███▋      | 1024/2797 [03:20<05:44,  5.15batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  37%|███▋      | 1024/2797 [03:20<05:44,  5.15batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  37%|███▋      | 1035/2797 [03:22<05:42,  5.14batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  37%|███▋      | 1046/2797 [03:24<05:42,  5.12batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  37%|███▋      | 1046/2797 [03:25<05:42,  5.12batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  38%|███▊      | 1058/2797 [03:26<05:29,  5.27batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  38%|███▊      | 1069/2797 [03:28<05:28,  5.27batch/s, loss=2.378, lr=4.4e-05]
epoch 2/8:  38%|███▊      | 1069/2797 [03:30<05:28,  5.27batch/s, loss=2.375, lr=4.4e-05]
epoch 2/8:  39%|███▊      | 1080/2797 [03:31<05:29,  5.21batch/s, loss=2.375, lr=4.4e-05]
epoch 2/8:  39%|███▉      | 1091/2797 [03:33<05:30,  5.16batch/s, loss=2.375, lr=4.4e-05]
epoch 2/8:  39%|███▉      | 1091/2797 [03:35<05:30,  5.16batch/s, loss=2.374, lr=4.3e-05]
epoch 2/8:  39%|███▉      | 1102/2797 [03:35<05:27,  5.17batch/s, loss=2.374, lr=4.3e-05]
epoch 2/8:  40%|███▉      | 1114/2797 [03:37<05:12,  5.38batch/s, loss=2.374, lr=4.3e-05]
epoch 2/8:  40%|████      | 1125/2797 [03:39<05:19,  5.24batch/s, loss=2.374, lr=4.3e-05]
epoch 2/8:  40%|████      | 1125/2797 [03:39<05:19,  5.24batch/s, loss=2.372, lr=4.3e-05]
epoch 2/8:  41%|████      | 1136/2797 [03:41<05:19,  5.19batch/s, loss=2.372, lr=4.3e-05]
epoch 2/8:  41%|████      | 1147/2797 [03:44<05:24,  5.08batch/s, loss=2.372, lr=4.3e-05]
epoch 2/8:  41%|████      | 1147/2797 [03:45<05:24,  5.08batch/s, loss=2.371, lr=4.3e-05]
epoch 2/8:  41%|████▏     | 1158/2797 [03:46<05:20,  5.11batch/s, loss=2.371, lr=4.3e-05]
epoch 2/8:  42%|████▏     | 1169/2797 [03:48<05:21,  5.06batch/s, loss=2.371, lr=4.3e-05]
epoch 2/8:  42%|████▏     | 1169/2797 [03:49<05:21,  5.06batch/s, loss=2.370, lr=4.3e-05]
epoch 2/8:  42%|████▏     | 1180/2797 [03:50<05:18,  5.08batch/s, loss=2.370, lr=4.3e-05]
epoch 2/8:  43%|████▎     | 1192/2797 [03:52<05:06,  5.23batch/s, loss=2.370, lr=4.3e-05]
epoch 2/8:  43%|████▎     | 1192/2797 [03:54<05:06,  5.23batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  43%|████▎     | 1203/2797 [03:54<05:10,  5.13batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  43%|████▎     | 1214/2797 [03:56<05:02,  5.23batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  43%|████▎     | 1214/2797 [03:59<05:02,  5.23batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  44%|████▍     | 1226/2797 [03:59<04:51,  5.39batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  44%|████▍     | 1237/2797 [04:01<04:51,  5.35batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  45%|████▍     | 1248/2797 [04:03<04:53,  5.28batch/s, loss=2.368, lr=4.3e-05]
epoch 2/8:  45%|████▍     | 1248/2797 [04:03<04:53,  5.28batch/s, loss=2.366, lr=4.3e-05]
epoch 2/8:  45%|████▌     | 1259/2797 [04:05<04:52,  5.25batch/s, loss=2.366, lr=4.3e-05]
epoch 2/8:  45%|████▌     | 1270/2797 [04:07<04:54,  5.19batch/s, loss=2.366, lr=4.3e-05]
epoch 2/8:  45%|████▌     | 1270/2797 [04:08<04:54,  5.19batch/s, loss=2.365, lr=4.3e-05]
epoch 2/8:  46%|████▌     | 1281/2797 [04:09<04:59,  5.06batch/s, loss=2.365, lr=4.3e-05]
epoch 2/8:  46%|████▌     | 1292/2797 [04:12<04:54,  5.11batch/s, loss=2.365, lr=4.3e-05]
epoch 2/8:  46%|████▌     | 1292/2797 [04:13<04:54,  5.11batch/s, loss=2.364, lr=4.3e-05]
epoch 2/8:  47%|████▋     | 1303/2797 [04:14<04:59,  4.99batch/s, loss=2.364, lr=4.3e-05]
epoch 2/8:  47%|████▋     | 1314/2797 [04:16<04:54,  5.04batch/s, loss=2.364, lr=4.3e-05]
epoch 2/8:  47%|████▋     | 1325/2797 [04:18<04:51,  5.04batch/s, loss=2.364, lr=4.3e-05]
epoch 2/8:  47%|████▋     | 1325/2797 [04:18<04:51,  5.04batch/s, loss=2.363, lr=4.3e-05]
epoch 2/8:  48%|████▊     | 1336/2797 [04:20<04:46,  5.10batch/s, loss=2.363, lr=4.3e-05]
epoch 2/8:  48%|████▊     | 1347/2797 [04:22<04:43,  5.12batch/s, loss=2.363, lr=4.3e-05]
epoch 2/8:  48%|████▊     | 1347/2797 [04:23<04:43,  5.12batch/s, loss=2.362, lr=4.3e-05]
epoch 2/8:  49%|████▊     | 1358/2797 [04:25<04:44,  5.05batch/s, loss=2.362, lr=4.3e-05]
epoch 2/8:  49%|████▉     | 1369/2797 [04:27<04:41,  5.07batch/s, loss=2.362, lr=4.3e-05]
epoch 2/8:  49%|████▉     | 1369/2797 [04:28<04:41,  5.07batch/s, loss=2.362, lr=4.3e-05]
epoch 2/8:  49%|████▉     | 1380/2797 [04:29<04:34,  5.16batch/s, loss=2.362, lr=4.3e-05]
epoch 2/8:  50%|████▉     | 1391/2797 [04:31<04:33,  5.15batch/s, loss=2.362, lr=4.3e-05]
epoch 2/8:  50%|████▉     | 1391/2797 [04:33<04:33,  5.15batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  50%|█████     | 1402/2797 [04:33<04:31,  5.13batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  51%|█████     | 1413/2797 [04:35<04:27,  5.18batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  51%|█████     | 1424/2797 [04:37<04:25,  5.18batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  51%|█████     | 1424/2797 [04:38<04:25,  5.18batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  51%|█████▏    | 1435/2797 [04:40<04:27,  5.09batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  52%|█████▏    | 1446/2797 [04:42<04:23,  5.12batch/s, loss=2.361, lr=4.3e-05]
epoch 2/8:  52%|█████▏    | 1446/2797 [04:43<04:23,  5.12batch/s, loss=2.360, lr=4.3e-05]
epoch 2/8:  52%|█████▏    | 1457/2797 [04:44<04:32,  4.91batch/s, loss=2.360, lr=4.3e-05]
epoch 2/8:  52%|█████▏    | 1468/2797 [04:46<04:29,  4.93batch/s, loss=2.360, lr=4.3e-05]
epoch 2/8:  52%|█████▏    | 1468/2797 [04:48<04:29,  4.93batch/s, loss=2.359, lr=4.3e-05]
epoch 2/8:  53%|█████▎    | 1479/2797 [04:48<04:23,  5.00batch/s, loss=2.359, lr=4.3e-05]
epoch 2/8:  53%|█████▎    | 1490/2797 [04:51<04:18,  5.05batch/s, loss=2.359, lr=4.3e-05]
epoch 2/8:  53%|█████▎    | 1490/2797 [04:53<04:18,  5.05batch/s, loss=2.357, lr=4.3e-05]
epoch 2/8:  54%|█████▎    | 1501/2797 [04:53<04:13,  5.12batch/s, loss=2.357, lr=4.3e-05]
epoch 2/8:  54%|█████▍    | 1513/2797 [04:55<04:03,  5.27batch/s, loss=2.357, lr=4.3e-05]
epoch 2/8:  54%|█████▍    | 1524/2797 [04:57<04:01,  5.27batch/s, loss=2.357, lr=4.3e-05]
epoch 2/8:  54%|█████▍    | 1524/2797 [04:57<04:01,  5.27batch/s, loss=2.357, lr=4.2e-05]
epoch 2/8:  55%|█████▍    | 1535/2797 [04:59<04:00,  5.25batch/s, loss=2.357, lr=4.2e-05]
epoch 2/8:  55%|█████▌    | 1546/2797 [05:01<03:59,  5.22batch/s, loss=2.357, lr=4.2e-05]
epoch 2/8:  55%|█████▌    | 1546/2797 [05:02<03:59,  5.22batch/s, loss=2.356, lr=4.2e-05]
epoch 2/8:  56%|█████▌    | 1557/2797 [05:03<03:58,  5.21batch/s, loss=2.356, lr=4.2e-05]
epoch 2/8:  56%|█████▌    | 1568/2797 [05:05<03:53,  5.26batch/s, loss=2.356, lr=4.2e-05]
epoch 2/8:  56%|█████▌    | 1568/2797 [05:07<03:53,  5.26batch/s, loss=2.356, lr=4.2e-05]
epoch 2/8:  56%|█████▋    | 1579/2797 [05:07<03:49,  5.32batch/s, loss=2.356, lr=4.2e-05]
epoch 2/8:  57%|█████▋    | 1590/2797 [05:10<03:53,  5.16batch/s, loss=2.356, lr=4.2e-05]
epoch 2/8:  57%|█████▋    | 1590/2797 [05:12<03:53,  5.16batch/s, loss=2.355, lr=4.2e-05]
epoch 2/8:  57%|█████▋    | 1601/2797 [05:12<03:49,  5.20batch/s, loss=2.355, lr=4.2e-05]
epoch 2/8:  58%|█████▊    | 1613/2797 [05:14<03:41,  5.34batch/s, loss=2.355, lr=4.2e-05]
epoch 2/8:  58%|█████▊    | 1624/2797 [05:16<03:43,  5.25batch/s, loss=2.355, lr=4.2e-05]
epoch 2/8:  58%|█████▊    | 1624/2797 [05:16<03:43,  5.25batch/s, loss=2.354, lr=4.2e-05]
epoch 2/8:  58%|█████▊    | 1635/2797 [05:18<03:46,  5.14batch/s, loss=2.354, lr=4.2e-05]
epoch 2/8:  59%|█████▉    | 1646/2797 [05:20<03:46,  5.08batch/s, loss=2.354, lr=4.2e-05]
epoch 2/8:  59%|█████▉    | 1646/2797 [05:22<03:46,  5.08batch/s, loss=2.353, lr=4.2e-05]
epoch 2/8:  59%|█████▉    | 1657/2797 [05:23<03:45,  5.06batch/s, loss=2.353, lr=4.2e-05]
epoch 2/8:  60%|█████▉    | 1668/2797 [05:25<03:44,  5.03batch/s, loss=2.353, lr=4.2e-05]
epoch 2/8:  60%|█████▉    | 1668/2797 [05:27<03:44,  5.03batch/s, loss=2.352, lr=4.2e-05]
epoch 2/8:  60%|██████    | 1679/2797 [05:27<03:47,  4.90batch/s, loss=2.352, lr=4.2e-05]
epoch 2/8:  60%|██████    | 1690/2797 [05:29<03:42,  4.97batch/s, loss=2.352, lr=4.2e-05]
epoch 2/8:  61%|██████    | 1700/2797 [05:32<03:44,  4.88batch/s, loss=2.352, lr=4.2e-05]
epoch 2/8:  61%|██████    | 1700/2797 [05:32<03:44,  4.88batch/s, loss=2.350, lr=4.2e-05]
epoch 2/8:  61%|██████    | 1712/2797 [05:34<03:35,  5.03batch/s, loss=2.350, lr=4.2e-05]
epoch 2/8:  62%|██████▏   | 1723/2797 [05:36<03:32,  5.05batch/s, loss=2.350, lr=4.2e-05]
epoch 2/8:  62%|██████▏   | 1723/2797 [05:37<03:32,  5.05batch/s, loss=2.349, lr=4.2e-05]
epoch 2/8:  62%|██████▏   | 1734/2797 [05:38<03:32,  5.00batch/s, loss=2.349, lr=4.2e-05]
epoch 2/8:  62%|██████▏   | 1746/2797 [05:40<03:20,  5.24batch/s, loss=2.349, lr=4.2e-05]
epoch 2/8:  62%|██████▏   | 1746/2797 [05:41<03:20,  5.24batch/s, loss=2.347, lr=4.2e-05]
epoch 2/8:  63%|██████▎   | 1757/2797 [05:42<03:22,  5.13batch/s, loss=2.347, lr=4.2e-05]
epoch 2/8:  63%|██████▎   | 1768/2797 [05:45<03:21,  5.10batch/s, loss=2.347, lr=4.2e-05]
epoch 2/8:  63%|██████▎   | 1768/2797 [05:46<03:21,  5.10batch/s, loss=2.346, lr=4.2e-05]
epoch 2/8:  64%|██████▎   | 1779/2797 [05:47<03:19,  5.10batch/s, loss=2.346, lr=4.2e-05]
epoch 2/8:  64%|██████▍   | 1790/2797 [05:49<03:18,  5.07batch/s, loss=2.346, lr=4.2e-05]
epoch 2/8:  64%|██████▍   | 1790/2797 [05:51<03:18,  5.07batch/s, loss=2.345, lr=4.2e-05]
epoch 2/8:  64%|██████▍   | 1801/2797 [05:51<03:17,  5.04batch/s, loss=2.345, lr=4.2e-05]
epoch 2/8:  65%|██████▍   | 1812/2797 [05:53<03:11,  5.15batch/s, loss=2.345, lr=4.2e-05]
epoch 2/8:  65%|██████▌   | 1823/2797 [05:55<03:11,  5.08batch/s, loss=2.345, lr=4.2e-05]
epoch 2/8:  65%|██████▌   | 1823/2797 [05:56<03:11,  5.08batch/s, loss=2.344, lr=4.2e-05]
epoch 2/8:  66%|██████▌   | 1834/2797 [05:58<03:10,  5.06batch/s, loss=2.344, lr=4.2e-05]
epoch 2/8:  66%|██████▌   | 1845/2797 [06:00<03:11,  4.98batch/s, loss=2.344, lr=4.2e-05]
epoch 2/8:  66%|██████▌   | 1845/2797 [06:01<03:11,  4.98batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  66%|██████▋   | 1856/2797 [06:02<03:06,  5.04batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  67%|██████▋   | 1867/2797 [06:04<03:04,  5.04batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  67%|██████▋   | 1867/2797 [06:06<03:04,  5.04batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  67%|██████▋   | 1878/2797 [06:07<03:05,  4.95batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  68%|██████▊   | 1889/2797 [06:09<02:59,  5.05batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  68%|██████▊   | 1900/2797 [06:11<02:57,  5.04batch/s, loss=2.343, lr=4.2e-05]
epoch 2/8:  68%|██████▊   | 1900/2797 [06:11<02:57,  5.04batch/s, loss=2.342, lr=4.2e-05]
epoch 2/8:  68%|██████▊   | 1911/2797 [06:13<02:55,  5.05batch/s, loss=2.342, lr=4.2e-05]
epoch 2/8:  69%|██████▊   | 1922/2797 [06:15<02:51,  5.10batch/s, loss=2.342, lr=4.2e-05]
epoch 2/8:  69%|██████▊   | 1922/2797 [06:16<02:51,  5.10batch/s, loss=2.342, lr=4.2e-05]
epoch 2/8:  69%|██████▉   | 1933/2797 [06:17<02:48,  5.13batch/s, loss=2.342, lr=4.2e-05]
epoch 2/8:  70%|██████▉   | 1944/2797 [06:19<02:43,  5.23batch/s, loss=2.342, lr=4.2e-05]
epoch 2/8:  70%|██████▉   | 1944/2797 [06:21<02:43,  5.23batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  70%|██████▉   | 1955/2797 [06:21<02:43,  5.16batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  70%|███████   | 1967/2797 [06:24<02:38,  5.23batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  70%|███████   | 1967/2797 [06:26<02:38,  5.23batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  71%|███████   | 1978/2797 [06:26<02:39,  5.14batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  71%|███████   | 1989/2797 [06:28<02:37,  5.11batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  72%|███████▏  | 2000/2797 [06:30<02:34,  5.17batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  72%|███████▏  | 2000/2797 [06:30<02:34,  5.17batch/s, loss=2.340, lr=4.1e-05]
epoch 2/8:  72%|███████▏  | 2011/2797 [06:32<02:35,  5.06batch/s, loss=2.340, lr=4.1e-05]
epoch 2/8:  72%|███████▏  | 2022/2797 [06:35<02:31,  5.10batch/s, loss=2.340, lr=4.1e-05]
epoch 2/8:  72%|███████▏  | 2022/2797 [06:35<02:31,  5.10batch/s, loss=2.340, lr=4.1e-05]
epoch 2/8:  73%|███████▎  | 2033/2797 [06:37<02:29,  5.10batch/s, loss=2.340, lr=4.1e-05]
epoch 2/8:  73%|███████▎  | 2044/2797 [06:39<02:26,  5.13batch/s, loss=2.340, lr=4.1e-05]
epoch 2/8:  73%|███████▎  | 2044/2797 [06:40<02:26,  5.13batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  73%|███████▎  | 2055/2797 [06:41<02:24,  5.13batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  74%|███████▍  | 2066/2797 [06:43<02:23,  5.11batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  74%|███████▍  | 2066/2797 [06:45<02:23,  5.11batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  74%|███████▍  | 2077/2797 [06:45<02:23,  5.00batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  75%|███████▍  | 2088/2797 [06:48<02:25,  4.88batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  75%|███████▌  | 2099/2797 [06:50<02:20,  4.96batch/s, loss=2.341, lr=4.1e-05]
epoch 2/8:  75%|███████▌  | 2099/2797 [06:50<02:20,  4.96batch/s, loss=2.339, lr=4.1e-05]
epoch 2/8:  75%|███████▌  | 2109/2797 [06:52<02:20,  4.89batch/s, loss=2.339, lr=4.1e-05]
epoch 2/8:  76%|███████▌  | 2119/2797 [06:54<02:18,  4.91batch/s, loss=2.339, lr=4.1e-05]
epoch 2/8:  76%|███████▌  | 2119/2797 [06:55<02:18,  4.91batch/s, loss=2.337, lr=4.1e-05]
epoch 2/8:  76%|███████▌  | 2129/2797 [06:56<02:15,  4.94batch/s, loss=2.337, lr=4.1e-05]
epoch 2/8:  76%|███████▋  | 2139/2797 [06:58<02:14,  4.90batch/s, loss=2.337, lr=4.1e-05]
epoch 2/8:  77%|███████▋  | 2150/2797 [07:00<02:10,  4.97batch/s, loss=2.337, lr=4.1e-05]
epoch 2/8:  77%|███████▋  | 2150/2797 [07:01<02:10,  4.97batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  77%|███████▋  | 2161/2797 [07:02<02:05,  5.05batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  78%|███████▊  | 2173/2797 [07:05<02:00,  5.19batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  78%|███████▊  | 2173/2797 [07:05<02:00,  5.19batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  78%|███████▊  | 2184/2797 [07:07<01:59,  5.15batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  78%|███████▊  | 2195/2797 [07:09<01:59,  5.05batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  78%|███████▊  | 2195/2797 [07:10<01:59,  5.05batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  79%|███████▉  | 2206/2797 [07:11<01:58,  5.00batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  79%|███████▉  | 2216/2797 [07:14<01:59,  4.87batch/s, loss=2.336, lr=4.1e-05]
epoch 2/8:  79%|███████▉  | 2216/2797 [07:15<01:59,  4.87batch/s, loss=2.335, lr=4.1e-05]
epoch 2/8:  80%|███████▉  | 2228/2797 [07:16<01:50,  5.16batch/s, loss=2.335, lr=4.1e-05]
epoch 2/8:  80%|████████  | 2239/2797 [07:18<01:48,  5.15batch/s, loss=2.335, lr=4.1e-05]
epoch 2/8:  80%|████████  | 2250/2797 [07:20<01:45,  5.18batch/s, loss=2.335, lr=4.1e-05]
epoch 2/8:  80%|████████  | 2250/2797 [07:20<01:45,  5.18batch/s, loss=2.334, lr=4.1e-05]
epoch 2/8:  81%|████████  | 2261/2797 [07:22<01:43,  5.20batch/s, loss=2.334, lr=4.1e-05]
epoch 2/8:  81%|████████  | 2272/2797 [07:24<01:43,  5.09batch/s, loss=2.334, lr=4.1e-05]
epoch 2/8:  81%|████████  | 2272/2797 [07:25<01:43,  5.09batch/s, loss=2.332, lr=4.1e-05]
epoch 2/8:  82%|████████▏ | 2284/2797 [07:26<01:37,  5.26batch/s, loss=2.332, lr=4.1e-05]
epoch 2/8:  82%|████████▏ | 2295/2797 [07:28<01:37,  5.16batch/s, loss=2.332, lr=4.1e-05]
epoch 2/8:  82%|████████▏ | 2295/2797 [07:30<01:37,  5.16batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  82%|████████▏ | 2306/2797 [07:31<01:35,  5.13batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  83%|████████▎ | 2317/2797 [07:33<01:34,  5.09batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  83%|████████▎ | 2317/2797 [07:35<01:34,  5.09batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  83%|████████▎ | 2328/2797 [07:35<01:32,  5.08batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  84%|████████▎ | 2339/2797 [07:37<01:30,  5.05batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  84%|████████▎ | 2339/2797 [07:39<01:30,  5.05batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  84%|████████▍ | 2351/2797 [07:39<01:25,  5.23batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  84%|████████▍ | 2362/2797 [07:41<01:23,  5.23batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  85%|████████▍ | 2373/2797 [07:44<01:21,  5.22batch/s, loss=2.331, lr=4.1e-05]
epoch 2/8:  85%|████████▍ | 2373/2797 [07:44<01:21,  5.22batch/s, loss=2.330, lr=4.0e-05]
epoch 2/8:  85%|████████▌ | 2384/2797 [07:46<01:18,  5.23batch/s, loss=2.330, lr=4.0e-05]
epoch 2/8:  86%|████████▌ | 2395/2797 [07:48<01:16,  5.25batch/s, loss=2.330, lr=4.0e-05]
epoch 2/8:  86%|████████▌ | 2395/2797 [07:49<01:16,  5.25batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  86%|████████▌ | 2406/2797 [07:50<01:16,  5.09batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  86%|████████▋ | 2417/2797 [07:52<01:15,  5.01batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  86%|████████▋ | 2417/2797 [07:54<01:15,  5.01batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  87%|████████▋ | 2428/2797 [07:55<01:13,  5.02batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  87%|████████▋ | 2439/2797 [07:57<01:09,  5.14batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  88%|████████▊ | 2450/2797 [07:59<01:07,  5.17batch/s, loss=2.331, lr=4.0e-05]
epoch 2/8:  88%|████████▊ | 2450/2797 [07:59<01:07,  5.17batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  88%|████████▊ | 2461/2797 [08:01<01:04,  5.21batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  88%|████████▊ | 2472/2797 [08:03<01:03,  5.08batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  88%|████████▊ | 2472/2797 [08:04<01:03,  5.08batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  89%|████████▉ | 2483/2797 [08:05<01:01,  5.12batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  89%|████████▉ | 2494/2797 [08:07<01:00,  5.03batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  89%|████████▉ | 2494/2797 [08:09<01:00,  5.03batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  90%|████████▉ | 2505/2797 [08:10<00:57,  5.06batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  90%|████████▉ | 2517/2797 [08:12<00:53,  5.26batch/s, loss=2.329, lr=4.0e-05]
epoch 2/8:  90%|████████▉ | 2517/2797 [08:13<00:53,  5.26batch/s, loss=2.328, lr=4.0e-05]
epoch 2/8:  90%|█████████ | 2528/2797 [08:14<00:51,  5.20batch/s, loss=2.328, lr=4.0e-05]
epoch 2/8:  91%|█████████ | 2539/2797 [08:16<00:49,  5.17batch/s, loss=2.328, lr=4.0e-05]
epoch 2/8:  91%|█████████ | 2550/2797 [08:18<00:48,  5.11batch/s, loss=2.328, lr=4.0e-05]
epoch 2/8:  91%|█████████ | 2550/2797 [08:18<00:48,  5.11batch/s, loss=2.327, lr=4.0e-05]
epoch 2/8:  92%|█████████▏| 2561/2797 [08:20<00:45,  5.15batch/s, loss=2.327, lr=4.0e-05]
epoch 2/8:  92%|█████████▏| 2572/2797 [08:22<00:43,  5.22batch/s, loss=2.327, lr=4.0e-05]
epoch 2/8:  92%|█████████▏| 2572/2797 [08:23<00:43,  5.22batch/s, loss=2.326, lr=4.0e-05]
epoch 2/8:  92%|█████████▏| 2584/2797 [08:24<00:39,  5.34batch/s, loss=2.326, lr=4.0e-05]
epoch 2/8:  93%|█████████▎| 2595/2797 [08:27<00:38,  5.28batch/s, loss=2.326, lr=4.0e-05]
epoch 2/8:  93%|█████████▎| 2595/2797 [08:28<00:38,  5.28batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  93%|█████████▎| 2606/2797 [08:29<00:37,  5.03batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  94%|█████████▎| 2617/2797 [08:31<00:35,  5.01batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  94%|█████████▎| 2617/2797 [08:33<00:35,  5.01batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  94%|█████████▍| 2628/2797 [08:34<00:34,  4.94batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  94%|█████████▍| 2639/2797 [08:36<00:31,  5.02batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  95%|█████████▍| 2650/2797 [08:38<00:29,  4.98batch/s, loss=2.325, lr=4.0e-05]
epoch 2/8:  95%|█████████▍| 2650/2797 [08:38<00:29,  4.98batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  95%|█████████▌| 2661/2797 [08:40<00:26,  5.04batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  96%|█████████▌| 2672/2797 [08:42<00:25,  5.00batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  96%|█████████▌| 2672/2797 [08:43<00:25,  5.00batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  96%|█████████▌| 2683/2797 [08:44<00:22,  5.09batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  96%|█████████▋| 2694/2797 [08:47<00:20,  4.98batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  96%|█████████▋| 2694/2797 [08:48<00:20,  4.98batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  97%|█████████▋| 2704/2797 [08:49<00:18,  4.98batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  97%|█████████▋| 2714/2797 [08:51<00:16,  4.88batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  97%|█████████▋| 2725/2797 [08:53<00:14,  4.95batch/s, loss=2.324, lr=4.0e-05]
epoch 2/8:  97%|█████████▋| 2725/2797 [08:53<00:14,  4.95batch/s, loss=2.323, lr=4.0e-05]
epoch 2/8:  98%|█████████▊| 2736/2797 [08:55<00:12,  5.03batch/s, loss=2.323, lr=4.0e-05]
epoch 2/8:  98%|█████████▊| 2747/2797 [08:57<00:10,  4.97batch/s, loss=2.323, lr=4.0e-05]
epoch 2/8:  98%|█████████▊| 2747/2797 [08:58<00:10,  4.97batch/s, loss=2.322, lr=4.0e-05]
epoch 2/8:  99%|█████████▊| 2757/2797 [08:59<00:08,  4.88batch/s, loss=2.322, lr=4.0e-05]
epoch 2/8:  99%|█████████▉| 2768/2797 [09:02<00:05,  4.94batch/s, loss=2.322, lr=4.0e-05]
epoch 2/8:  99%|█████████▉| 2768/2797 [09:03<00:05,  4.94batch/s, loss=2.322, lr=4.0e-05]
epoch 2/8:  99%|█████████▉| 2779/2797 [09:04<00:03,  5.03batch/s, loss=2.322, lr=4.0e-05]
epoch 2/8: 100%|█████████▉| 2790/2797 [09:06<00:01,  5.05batch/s, loss=2.322, lr=4.0e-05]
epoch 2/8: 100%|██████████| 2797/2797 [09:07<00:00,  5.11batch/s, loss=2.322, lr=4.0e-05]
epoch 2: train loss 2.322 · validation loss 2.246 · broad 79.7% (top-3 94.5%) · path 69.9% (top-3 87.6%, plausible or look-alike 85.8%) · 1178s elapsed

epoch 3/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 3/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=1.774, lr=3.9e-05]
epoch 3/8:   0%|          | 11/2797 [00:02<09:16,  5.00batch/s, loss=1.774, lr=3.9e-05]
epoch 3/8:   1%|          | 22/2797 [00:04<09:27,  4.89batch/s, loss=1.774, lr=3.9e-05]
epoch 3/8:   1%|          | 22/2797 [00:05<09:27,  4.89batch/s, loss=1.967, lr=3.9e-05]
epoch 3/8:   1%|          | 32/2797 [00:06<09:51,  4.68batch/s, loss=1.967, lr=3.9e-05]
epoch 3/8:   2%|▏         | 44/2797 [00:08<09:07,  5.03batch/s, loss=1.967, lr=3.9e-05]
epoch 3/8:   2%|▏         | 44/2797 [00:10<09:07,  5.03batch/s, loss=1.972, lr=3.9e-05]
epoch 3/8:   2%|▏         | 55/2797 [00:10<08:54,  5.13batch/s, loss=1.972, lr=3.9e-05]
epoch 3/8:   2%|▏         | 66/2797 [00:13<08:53,  5.12batch/s, loss=1.972, lr=3.9e-05]
epoch 3/8:   2%|▏         | 66/2797 [00:15<08:53,  5.12batch/s, loss=1.980, lr=3.9e-05]
epoch 3/8:   3%|▎         | 77/2797 [00:15<08:51,  5.12batch/s, loss=1.980, lr=3.9e-05]
epoch 3/8:   3%|▎         | 88/2797 [00:17<09:02,  4.99batch/s, loss=1.980, lr=3.9e-05]
epoch 3/8:   4%|▎         | 99/2797 [00:19<08:56,  5.03batch/s, loss=1.980, lr=3.9e-05]
epoch 3/8:   4%|▎         | 99/2797 [00:20<08:56,  5.03batch/s, loss=1.979, lr=3.9e-05]
epoch 3/8:   4%|▍         | 110/2797 [00:21<08:57,  5.00batch/s, loss=1.979, lr=3.9e-05]
epoch 3/8:   4%|▍         | 121/2797 [00:24<08:53,  5.01batch/s, loss=1.979, lr=3.9e-05]
epoch 3/8:   4%|▍         | 121/2797 [00:25<08:53,  5.01batch/s, loss=1.977, lr=3.9e-05]
epoch 3/8:   5%|▍         | 132/2797 [00:26<08:46,  5.06batch/s, loss=1.977, lr=3.9e-05]
epoch 3/8:   5%|▌         | 143/2797 [00:28<08:50,  5.00batch/s, loss=1.977, lr=3.9e-05]
epoch 3/8:   5%|▌         | 143/2797 [00:30<08:50,  5.00batch/s, loss=1.967, lr=3.9e-05]
epoch 3/8:   6%|▌         | 154/2797 [00:30<08:39,  5.08batch/s, loss=1.967, lr=3.9e-05]
epoch 3/8:   6%|▌         | 165/2797 [00:32<08:25,  5.20batch/s, loss=1.967, lr=3.9e-05]
epoch 3/8:   6%|▌         | 165/2797 [00:34<08:25,  5.20batch/s, loss=1.965, lr=3.9e-05]
epoch 3/8:   6%|▋         | 176/2797 [00:34<08:25,  5.19batch/s, loss=1.965, lr=3.9e-05]
epoch 3/8:   7%|▋         | 187/2797 [00:37<08:45,  4.97batch/s, loss=1.965, lr=3.9e-05]
epoch 3/8:   7%|▋         | 199/2797 [00:39<08:25,  5.14batch/s, loss=1.965, lr=3.9e-05]
epoch 3/8:   7%|▋         | 199/2797 [00:39<08:25,  5.14batch/s, loss=1.960, lr=3.9e-05]
epoch 3/8:   8%|▊         | 210/2797 [00:41<08:19,  5.18batch/s, loss=1.960, lr=3.9e-05]
epoch 3/8:   8%|▊         | 221/2797 [00:43<08:20,  5.15batch/s, loss=1.960, lr=3.9e-05]
epoch 3/8:   8%|▊         | 221/2797 [00:44<08:20,  5.15batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:   8%|▊         | 233/2797 [00:45<08:06,  5.27batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:   9%|▊         | 244/2797 [00:47<08:12,  5.18batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:   9%|▊         | 244/2797 [00:49<08:12,  5.18batch/s, loss=1.950, lr=3.9e-05]
epoch 3/8:   9%|▉         | 255/2797 [00:50<08:18,  5.10batch/s, loss=1.950, lr=3.9e-05]
epoch 3/8:  10%|▉         | 266/2797 [00:52<08:10,  5.15batch/s, loss=1.950, lr=3.9e-05]
epoch 3/8:  10%|▉         | 266/2797 [00:54<08:10,  5.15batch/s, loss=1.952, lr=3.9e-05]
epoch 3/8:  10%|▉         | 277/2797 [00:54<08:10,  5.13batch/s, loss=1.952, lr=3.9e-05]
epoch 3/8:  10%|█         | 288/2797 [00:56<08:02,  5.20batch/s, loss=1.952, lr=3.9e-05]
epoch 3/8:  11%|█         | 299/2797 [00:58<08:10,  5.09batch/s, loss=1.952, lr=3.9e-05]
epoch 3/8:  11%|█         | 299/2797 [00:59<08:10,  5.09batch/s, loss=1.958, lr=3.9e-05]
epoch 3/8:  11%|█         | 310/2797 [01:00<08:03,  5.14batch/s, loss=1.958, lr=3.9e-05]
epoch 3/8:  12%|█▏        | 322/2797 [01:02<07:49,  5.28batch/s, loss=1.958, lr=3.9e-05]
epoch 3/8:  12%|█▏        | 322/2797 [01:03<07:49,  5.28batch/s, loss=1.957, lr=3.9e-05]
epoch 3/8:  12%|█▏        | 334/2797 [01:05<07:37,  5.38batch/s, loss=1.957, lr=3.9e-05]
epoch 3/8:  12%|█▏        | 346/2797 [01:07<07:30,  5.44batch/s, loss=1.957, lr=3.9e-05]
epoch 3/8:  12%|█▏        | 346/2797 [01:08<07:30,  5.44batch/s, loss=1.957, lr=3.9e-05]
epoch 3/8:  13%|█▎        | 357/2797 [01:09<07:32,  5.39batch/s, loss=1.957, lr=3.9e-05]
epoch 3/8:  13%|█▎        | 368/2797 [01:11<07:43,  5.24batch/s, loss=1.957, lr=3.9e-05]
epoch 3/8:  13%|█▎        | 368/2797 [01:13<07:43,  5.24batch/s, loss=1.961, lr=3.9e-05]
epoch 3/8:  14%|█▎        | 379/2797 [01:13<07:43,  5.22batch/s, loss=1.961, lr=3.9e-05]
epoch 3/8:  14%|█▍        | 390/2797 [01:16<07:59,  5.02batch/s, loss=1.961, lr=3.9e-05]
epoch 3/8:  14%|█▍        | 390/2797 [01:18<07:59,  5.02batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:  14%|█▍        | 401/2797 [01:18<07:56,  5.03batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:  15%|█▍        | 412/2797 [01:20<07:53,  5.04batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:  15%|█▌        | 423/2797 [01:22<07:41,  5.14batch/s, loss=1.959, lr=3.9e-05]
epoch 3/8:  15%|█▌        | 423/2797 [01:23<07:41,  5.14batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  16%|█▌        | 434/2797 [01:24<07:38,  5.15batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  16%|█▌        | 445/2797 [01:26<07:31,  5.21batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  16%|█▌        | 445/2797 [01:27<07:31,  5.21batch/s, loss=1.959, lr=3.8e-05]
epoch 3/8:  16%|█▋        | 456/2797 [01:28<07:39,  5.09batch/s, loss=1.959, lr=3.8e-05]
epoch 3/8:  17%|█▋        | 467/2797 [01:31<07:36,  5.11batch/s, loss=1.959, lr=3.8e-05]
epoch 3/8:  17%|█▋        | 467/2797 [01:32<07:36,  5.11batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  17%|█▋        | 478/2797 [01:33<07:29,  5.16batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  17%|█▋        | 489/2797 [01:35<07:32,  5.10batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  18%|█▊        | 500/2797 [01:37<07:28,  5.12batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  18%|█▊        | 500/2797 [01:37<07:28,  5.12batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  18%|█▊        | 511/2797 [01:39<07:27,  5.11batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  19%|█▊        | 522/2797 [01:41<07:28,  5.08batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  19%|█▊        | 522/2797 [01:42<07:28,  5.08batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  19%|█▉        | 533/2797 [01:44<07:33,  4.99batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  19%|█▉        | 544/2797 [01:46<07:24,  5.07batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  19%|█▉        | 544/2797 [01:47<07:24,  5.07batch/s, loss=1.959, lr=3.8e-05]
epoch 3/8:  20%|█▉        | 555/2797 [01:48<07:18,  5.11batch/s, loss=1.959, lr=3.8e-05]
epoch 3/8:  20%|██        | 566/2797 [01:50<07:18,  5.09batch/s, loss=1.959, lr=3.8e-05]
epoch 3/8:  20%|██        | 566/2797 [01:52<07:18,  5.09batch/s, loss=1.958, lr=3.8e-05]
epoch 3/8:  21%|██        | 577/2797 [01:53<07:35,  4.87batch/s, loss=1.958, lr=3.8e-05]
epoch 3/8:  21%|██        | 588/2797 [01:55<07:26,  4.95batch/s, loss=1.958, lr=3.8e-05]
epoch 3/8:  21%|██▏       | 599/2797 [01:57<07:15,  5.05batch/s, loss=1.958, lr=3.8e-05]
epoch 3/8:  21%|██▏       | 599/2797 [01:57<07:15,  5.05batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  22%|██▏       | 610/2797 [01:59<07:13,  5.05batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  22%|██▏       | 621/2797 [02:01<07:09,  5.07batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  22%|██▏       | 621/2797 [02:02<07:09,  5.07batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  23%|██▎       | 632/2797 [02:03<07:06,  5.07batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  23%|██▎       | 643/2797 [02:05<07:02,  5.10batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  23%|██▎       | 643/2797 [02:07<07:02,  5.10batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  23%|██▎       | 654/2797 [02:08<07:16,  4.91batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  24%|██▎       | 664/2797 [02:10<07:13,  4.92batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  24%|██▍       | 675/2797 [02:12<07:06,  4.97batch/s, loss=1.956, lr=3.8e-05]
epoch 3/8:  24%|██▍       | 675/2797 [02:12<07:06,  4.97batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  24%|██▍       | 685/2797 [02:14<07:09,  4.91batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  25%|██▍       | 695/2797 [02:16<07:16,  4.81batch/s, loss=1.957, lr=3.8e-05]
epoch 3/8:  25%|██▍       | 695/2797 [02:17<07:16,  4.81batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  25%|██▌       | 705/2797 [02:18<07:10,  4.86batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  26%|██▌       | 715/2797 [02:21<07:32,  4.60batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  26%|██▌       | 715/2797 [02:23<07:32,  4.60batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  26%|██▌       | 726/2797 [02:23<07:13,  4.78batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  26%|██▋       | 738/2797 [02:25<06:52,  4.99batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  27%|██▋       | 749/2797 [02:27<06:47,  5.03batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  27%|██▋       | 749/2797 [02:28<06:47,  5.03batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  27%|██▋       | 760/2797 [02:30<06:53,  4.93batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  28%|██▊       | 770/2797 [02:32<06:50,  4.94batch/s, loss=1.955, lr=3.8e-05]
epoch 3/8:  28%|██▊       | 770/2797 [02:33<06:50,  4.94batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  28%|██▊       | 781/2797 [02:34<06:44,  4.98batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  28%|██▊       | 791/2797 [02:36<06:42,  4.98batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  28%|██▊       | 791/2797 [02:38<06:42,  4.98batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  29%|██▊       | 801/2797 [02:38<06:45,  4.92batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  29%|██▉       | 813/2797 [02:40<06:30,  5.08batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  29%|██▉       | 824/2797 [02:42<06:29,  5.07batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  29%|██▉       | 824/2797 [02:43<06:29,  5.07batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  30%|██▉       | 835/2797 [02:44<06:28,  5.05batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  30%|███       | 846/2797 [02:47<06:24,  5.07batch/s, loss=1.953, lr=3.8e-05]
epoch 3/8:  30%|███       | 846/2797 [02:48<06:24,  5.07batch/s, loss=1.954, lr=3.7e-05]
epoch 3/8:  31%|███       | 857/2797 [02:49<06:36,  4.90batch/s, loss=1.954, lr=3.7e-05]
epoch 3/8:  31%|███       | 868/2797 [02:51<06:25,  5.00batch/s, loss=1.954, lr=3.7e-05]
epoch 3/8:  31%|███       | 868/2797 [02:53<06:25,  5.00batch/s, loss=1.954, lr=3.7e-05]
epoch 3/8:  31%|███▏      | 879/2797 [02:53<06:26,  4.97batch/s, loss=1.954, lr=3.7e-05]
epoch 3/8:  32%|███▏      | 890/2797 [02:55<06:16,  5.07batch/s, loss=1.954, lr=3.7e-05]
epoch 3/8:  32%|███▏      | 890/2797 [02:57<06:16,  5.07batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  32%|███▏      | 902/2797 [02:58<06:04,  5.19batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  33%|███▎      | 913/2797 [03:00<06:06,  5.13batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  33%|███▎      | 924/2797 [03:02<06:03,  5.15batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  33%|███▎      | 924/2797 [03:02<06:03,  5.15batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  33%|███▎      | 935/2797 [03:04<06:07,  5.06batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  34%|███▍      | 946/2797 [03:06<06:06,  5.04batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  34%|███▍      | 946/2797 [03:07<06:06,  5.04batch/s, loss=1.953, lr=3.7e-05]
epoch 3/8:  34%|███▍      | 957/2797 [03:08<05:57,  5.14batch/s, loss=1.953, lr=3.7e-05]
epoch 3/8:  35%|███▍      | 968/2797 [03:11<05:59,  5.09batch/s, loss=1.953, lr=3.7e-05]
epoch 3/8:  35%|███▍      | 968/2797 [03:12<05:59,  5.09batch/s, loss=1.953, lr=3.7e-05]
epoch 3/8:  35%|███▌      | 979/2797 [03:13<05:57,  5.09batch/s, loss=1.953, lr=3.7e-05]
epoch 3/8:  35%|███▌      | 990/2797 [03:15<05:53,  5.12batch/s, loss=1.953, lr=3.7e-05]
epoch 3/8:  35%|███▌      | 990/2797 [03:17<05:53,  5.12batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  36%|███▌      | 1001/2797 [03:17<05:55,  5.06batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  36%|███▌      | 1012/2797 [03:19<05:59,  4.97batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  37%|███▋      | 1022/2797 [03:21<05:58,  4.95batch/s, loss=1.952, lr=3.7e-05]
epoch 3/8:  37%|███▋      | 1022/2797 [03:22<05:58,  4.95batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  37%|███▋      | 1034/2797 [03:24<05:45,  5.10batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  37%|███▋      | 1045/2797 [03:26<05:40,  5.14batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  37%|███▋      | 1045/2797 [03:27<05:40,  5.14batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  38%|███▊      | 1056/2797 [03:28<05:36,  5.18batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  38%|███▊      | 1067/2797 [03:30<05:33,  5.19batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  38%|███▊      | 1067/2797 [03:32<05:33,  5.19batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  39%|███▊      | 1078/2797 [03:32<05:37,  5.10batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  39%|███▉      | 1089/2797 [03:34<05:29,  5.19batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  39%|███▉      | 1100/2797 [03:37<05:39,  5.00batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  39%|███▉      | 1100/2797 [03:37<05:39,  5.00batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  40%|███▉      | 1112/2797 [03:39<05:26,  5.16batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  40%|████      | 1123/2797 [03:41<05:27,  5.11batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  40%|████      | 1123/2797 [03:42<05:27,  5.11batch/s, loss=1.950, lr=3.7e-05]
epoch 3/8:  41%|████      | 1134/2797 [03:43<05:27,  5.08batch/s, loss=1.950, lr=3.7e-05]
epoch 3/8:  41%|████      | 1145/2797 [03:46<05:33,  4.96batch/s, loss=1.950, lr=3.7e-05]
epoch 3/8:  41%|████      | 1145/2797 [03:47<05:33,  4.96batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  41%|████▏     | 1156/2797 [03:48<05:28,  4.99batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  42%|████▏     | 1167/2797 [03:50<05:23,  5.04batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  42%|████▏     | 1167/2797 [03:52<05:23,  5.04batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  42%|████▏     | 1178/2797 [03:52<05:17,  5.10batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  43%|████▎     | 1189/2797 [03:54<05:18,  5.05batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  43%|████▎     | 1200/2797 [03:56<05:19,  5.00batch/s, loss=1.951, lr=3.7e-05]
epoch 3/8:  43%|████▎     | 1200/2797 [03:57<05:19,  5.00batch/s, loss=1.950, lr=3.7e-05]
epoch 3/8:  43%|████▎     | 1211/2797 [03:59<05:17,  4.99batch/s, loss=1.950, lr=3.7e-05]
epoch 3/8:  44%|████▎     | 1222/2797 [04:01<05:10,  5.07batch/s, loss=1.950, lr=3.7e-05]
epoch 3/8:  44%|████▎     | 1222/2797 [04:01<05:10,  5.07batch/s, loss=1.949, lr=3.7e-05]
epoch 3/8:  44%|████▍     | 1233/2797 [04:03<05:08,  5.07batch/s, loss=1.949, lr=3.7e-05]
epoch 3/8:  44%|████▍     | 1244/2797 [04:05<05:06,  5.06batch/s, loss=1.949, lr=3.7e-05]
epoch 3/8:  44%|████▍     | 1244/2797 [04:06<05:06,  5.06batch/s, loss=1.948, lr=3.7e-05]
epoch 3/8:  45%|████▍     | 1255/2797 [04:07<04:58,  5.17batch/s, loss=1.948, lr=3.7e-05]
epoch 3/8:  45%|████▌     | 1266/2797 [04:09<05:02,  5.06batch/s, loss=1.948, lr=3.7e-05]
epoch 3/8:  45%|████▌     | 1266/2797 [04:11<05:02,  5.06batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  46%|████▌     | 1277/2797 [04:12<05:06,  4.96batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  46%|████▌     | 1288/2797 [04:14<04:56,  5.09batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  46%|████▋     | 1299/2797 [04:16<04:52,  5.12batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  46%|████▋     | 1299/2797 [04:16<04:52,  5.12batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  47%|████▋     | 1310/2797 [04:18<04:57,  4.99batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  47%|████▋     | 1322/2797 [04:20<04:47,  5.13batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  47%|████▋     | 1322/2797 [04:21<04:47,  5.13batch/s, loss=1.950, lr=3.6e-05]
epoch 3/8:  48%|████▊     | 1333/2797 [04:22<04:40,  5.21batch/s, loss=1.950, lr=3.6e-05]
epoch 3/8:  48%|████▊     | 1344/2797 [04:25<04:41,  5.17batch/s, loss=1.950, lr=3.6e-05]
epoch 3/8:  48%|████▊     | 1344/2797 [04:26<04:41,  5.17batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  48%|████▊     | 1355/2797 [04:27<04:35,  5.24batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  49%|████▉     | 1366/2797 [04:29<04:37,  5.16batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  49%|████▉     | 1366/2797 [04:31<04:37,  5.16batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  49%|████▉     | 1377/2797 [04:31<04:40,  5.07batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  50%|████▉     | 1388/2797 [04:33<04:38,  5.05batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  50%|█████     | 1399/2797 [04:35<04:32,  5.13batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  50%|█████     | 1399/2797 [04:36<04:32,  5.13batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  50%|█████     | 1410/2797 [04:37<04:25,  5.23batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  51%|█████     | 1421/2797 [04:39<04:22,  5.25batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  51%|█████     | 1421/2797 [04:40<04:22,  5.25batch/s, loss=1.950, lr=3.6e-05]
epoch 3/8:  51%|█████     | 1432/2797 [04:42<04:24,  5.17batch/s, loss=1.950, lr=3.6e-05]
epoch 3/8:  52%|█████▏    | 1444/2797 [04:44<04:12,  5.37batch/s, loss=1.950, lr=3.6e-05]
epoch 3/8:  52%|█████▏    | 1444/2797 [04:45<04:12,  5.37batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  52%|█████▏    | 1455/2797 [04:46<04:21,  5.14batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  52%|█████▏    | 1466/2797 [04:48<04:24,  5.03batch/s, loss=1.949, lr=3.6e-05]
epoch 3/8:  52%|█████▏    | 1466/2797 [04:50<04:24,  5.03batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  53%|█████▎    | 1477/2797 [04:50<04:19,  5.09batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  53%|█████▎    | 1488/2797 [04:53<04:20,  5.03batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  54%|█████▎    | 1500/2797 [04:55<04:07,  5.24batch/s, loss=1.948, lr=3.6e-05]
epoch 3/8:  54%|█████▎    | 1500/2797 [04:55<04:07,  5.24batch/s, loss=1.947, lr=3.6e-05]
epoch 3/8:  54%|█████▍    | 1511/2797 [04:57<04:17,  4.99batch/s, loss=1.947, lr=3.6e-05]
epoch 3/8:  54%|█████▍    | 1522/2797 [04:59<04:13,  5.03batch/s, loss=1.947, lr=3.6e-05]
epoch 3/8:  54%|█████▍    | 1522/2797 [05:00<04:13,  5.03batch/s, loss=1.947, lr=3.6e-05]
epoch 3/8:  55%|█████▍    | 1533/2797 [05:02<04:13,  4.99batch/s, loss=1.947, lr=3.6e-05]
epoch 3/8:  55%|█████▌    | 1544/2797 [05:04<04:11,  4.98batch/s, loss=1.947, lr=3.6e-05]
epoch 3/8:  55%|█████▌    | 1544/2797 [05:05<04:11,  4.98batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  56%|█████▌    | 1555/2797 [05:06<04:06,  5.03batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  56%|█████▌    | 1566/2797 [05:08<04:02,  5.07batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  56%|█████▌    | 1566/2797 [05:10<04:02,  5.07batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  56%|█████▋    | 1578/2797 [05:10<03:51,  5.27batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  57%|█████▋    | 1589/2797 [05:12<03:51,  5.22batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  57%|█████▋    | 1600/2797 [05:14<03:49,  5.22batch/s, loss=1.946, lr=3.6e-05]
epoch 3/8:  57%|█████▋    | 1600/2797 [05:15<03:49,  5.22batch/s, loss=1.945, lr=3.6e-05]
epoch 3/8:  58%|█████▊    | 1611/2797 [05:17<03:51,  5.13batch/s, loss=1.945, lr=3.6e-05]
epoch 3/8:  58%|█████▊    | 1622/2797 [05:19<03:49,  5.13batch/s, loss=1.945, lr=3.6e-05]
epoch 3/8:  58%|█████▊    | 1622/2797 [05:20<03:49,  5.13batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  58%|█████▊    | 1633/2797 [05:21<03:55,  4.95batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  59%|█████▊    | 1643/2797 [05:23<03:52,  4.96batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  59%|█████▊    | 1643/2797 [05:25<03:52,  4.96batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  59%|█████▉    | 1653/2797 [05:25<03:57,  4.81batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  59%|█████▉    | 1663/2797 [05:28<03:55,  4.81batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  60%|█████▉    | 1674/2797 [05:30<03:47,  4.93batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  60%|█████▉    | 1674/2797 [05:30<03:47,  4.93batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  60%|██████    | 1684/2797 [05:32<03:46,  4.92batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  61%|██████    | 1694/2797 [05:34<03:43,  4.93batch/s, loss=1.944, lr=3.6e-05]
epoch 3/8:  61%|██████    | 1694/2797 [05:35<03:43,  4.93batch/s, loss=1.943, lr=3.5e-05]
epoch 3/8:  61%|██████    | 1704/2797 [05:36<03:42,  4.91batch/s, loss=1.943, lr=3.5e-05]
epoch 3/8:  61%|██████▏   | 1715/2797 [05:38<03:39,  4.93batch/s, loss=1.943, lr=3.5e-05]
epoch 3/8:  62%|██████▏   | 1725/2797 [05:40<03:39,  4.89batch/s, loss=1.943, lr=3.5e-05]
epoch 3/8:  62%|██████▏   | 1725/2797 [05:40<03:39,  4.89batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  62%|██████▏   | 1736/2797 [05:42<03:35,  4.93batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  62%|██████▏   | 1747/2797 [05:44<03:30,  4.98batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  62%|██████▏   | 1747/2797 [05:45<03:30,  4.98batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  63%|██████▎   | 1757/2797 [05:47<03:32,  4.90batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  63%|██████▎   | 1768/2797 [05:49<03:26,  4.97batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  63%|██████▎   | 1768/2797 [05:50<03:26,  4.97batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  64%|██████▎   | 1779/2797 [05:51<03:21,  5.06batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  64%|██████▍   | 1790/2797 [05:53<03:18,  5.06batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  64%|██████▍   | 1790/2797 [05:55<03:18,  5.06batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  64%|██████▍   | 1801/2797 [05:55<03:20,  4.97batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  65%|██████▍   | 1812/2797 [05:57<03:15,  5.04batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  65%|██████▌   | 1823/2797 [06:00<03:13,  5.02batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  65%|██████▌   | 1823/2797 [06:00<03:13,  5.02batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  66%|██████▌   | 1834/2797 [06:02<03:13,  4.98batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  66%|██████▌   | 1844/2797 [06:04<03:18,  4.79batch/s, loss=1.942, lr=3.5e-05]
epoch 3/8:  66%|██████▌   | 1844/2797 [06:05<03:18,  4.79batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  66%|██████▋   | 1855/2797 [06:06<03:09,  4.98batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  67%|██████▋   | 1866/2797 [06:09<03:12,  4.83batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  67%|██████▋   | 1866/2797 [06:11<03:12,  4.83batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  67%|██████▋   | 1876/2797 [06:11<03:10,  4.83batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  67%|██████▋   | 1886/2797 [06:13<03:11,  4.76batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  68%|██████▊   | 1896/2797 [06:15<03:08,  4.77batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  68%|██████▊   | 1896/2797 [06:16<03:08,  4.77batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  68%|██████▊   | 1907/2797 [06:17<02:59,  4.96batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  69%|██████▊   | 1917/2797 [06:19<03:01,  4.86batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  69%|██████▊   | 1917/2797 [06:21<03:01,  4.86batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  69%|██████▉   | 1928/2797 [06:21<02:53,  5.00batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  69%|██████▉   | 1939/2797 [06:23<02:51,  5.01batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  70%|██████▉   | 1950/2797 [06:25<02:46,  5.09batch/s, loss=1.941, lr=3.5e-05]
epoch 3/8:  70%|██████▉   | 1950/2797 [06:26<02:46,  5.09batch/s, loss=1.940, lr=3.5e-05]
epoch 3/8:  70%|███████   | 1961/2797 [06:28<02:47,  5.00batch/s, loss=1.940, lr=3.5e-05]
epoch 3/8:  71%|███████   | 1972/2797 [06:30<02:42,  5.08batch/s, loss=1.940, lr=3.5e-05]
epoch 3/8:  71%|███████   | 1972/2797 [06:31<02:42,  5.08batch/s, loss=1.939, lr=3.5e-05]
epoch 3/8:  71%|███████   | 1983/2797 [06:32<02:38,  5.12batch/s, loss=1.939, lr=3.5e-05]
epoch 3/8:  71%|███████▏  | 1994/2797 [06:34<02:36,  5.13batch/s, loss=1.939, lr=3.5e-05]
epoch 3/8:  71%|███████▏  | 1994/2797 [06:35<02:36,  5.13batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  72%|███████▏  | 2006/2797 [06:36<02:29,  5.29batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  72%|███████▏  | 2017/2797 [06:38<02:30,  5.18batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  72%|███████▏  | 2017/2797 [06:40<02:30,  5.18batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  73%|███████▎  | 2028/2797 [06:40<02:28,  5.19batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  73%|███████▎  | 2039/2797 [06:43<02:27,  5.15batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  73%|███████▎  | 2039/2797 [06:45<02:27,  5.15batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  73%|███████▎  | 2051/2797 [06:45<02:20,  5.31batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  74%|███████▎  | 2062/2797 [06:47<02:24,  5.10batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  74%|███████▍  | 2073/2797 [06:49<02:19,  5.18batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  74%|███████▍  | 2073/2797 [06:50<02:19,  5.18batch/s, loss=1.937, lr=3.5e-05]
epoch 3/8:  75%|███████▍  | 2084/2797 [06:51<02:17,  5.19batch/s, loss=1.937, lr=3.5e-05]
epoch 3/8:  75%|███████▍  | 2096/2797 [06:53<02:10,  5.38batch/s, loss=1.937, lr=3.5e-05]
epoch 3/8:  75%|███████▍  | 2096/2797 [06:54<02:10,  5.38batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  75%|███████▌  | 2107/2797 [06:56<02:15,  5.10batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  76%|███████▌  | 2118/2797 [06:58<02:13,  5.08batch/s, loss=1.938, lr=3.5e-05]
epoch 3/8:  76%|███████▌  | 2118/2797 [06:59<02:13,  5.08batch/s, loss=1.938, lr=3.4e-05]
epoch 3/8:  76%|███████▌  | 2130/2797 [07:00<02:07,  5.25batch/s, loss=1.938, lr=3.4e-05]
epoch 3/8:  77%|███████▋  | 2142/2797 [07:02<02:02,  5.33batch/s, loss=1.938, lr=3.4e-05]
epoch 3/8:  77%|███████▋  | 2142/2797 [07:04<02:02,  5.33batch/s, loss=1.938, lr=3.4e-05]
epoch 3/8:  77%|███████▋  | 2154/2797 [07:04<01:57,  5.49batch/s, loss=1.938, lr=3.4e-05]
epoch 3/8:  77%|███████▋  | 2166/2797 [07:07<01:58,  5.32batch/s, loss=1.938, lr=3.4e-05]
epoch 3/8:  77%|███████▋  | 2166/2797 [07:09<01:58,  5.32batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  78%|███████▊  | 2177/2797 [07:09<02:01,  5.10batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  78%|███████▊  | 2188/2797 [07:11<02:02,  4.96batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  79%|███████▊  | 2198/2797 [07:13<02:00,  4.95batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  79%|███████▊  | 2198/2797 [07:14<02:00,  4.95batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  79%|███████▉  | 2209/2797 [07:16<01:56,  5.04batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  79%|███████▉  | 2220/2797 [07:18<01:52,  5.15batch/s, loss=1.937, lr=3.4e-05]
epoch 3/8:  79%|███████▉  | 2220/2797 [07:19<01:52,  5.15batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  80%|███████▉  | 2231/2797 [07:20<01:48,  5.20batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  80%|████████  | 2242/2797 [07:22<01:45,  5.29batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  80%|████████  | 2242/2797 [07:24<01:45,  5.29batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  81%|████████  | 2253/2797 [07:24<01:45,  5.14batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  81%|████████  | 2264/2797 [07:26<01:44,  5.09batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  81%|████████▏ | 2275/2797 [07:28<01:40,  5.18batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  81%|████████▏ | 2275/2797 [07:28<01:40,  5.18batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  82%|████████▏ | 2287/2797 [07:30<01:36,  5.30batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  82%|████████▏ | 2298/2797 [07:33<01:38,  5.08batch/s, loss=1.936, lr=3.4e-05]
epoch 3/8:  82%|████████▏ | 2298/2797 [07:33<01:38,  5.08batch/s, loss=1.935, lr=3.4e-05]
epoch 3/8:  83%|████████▎ | 2309/2797 [07:35<01:37,  5.03batch/s, loss=1.935, lr=3.4e-05]
epoch 3/8:  83%|████████▎ | 2320/2797 [07:37<01:35,  4.98batch/s, loss=1.935, lr=3.4e-05]
epoch 3/8:  83%|████████▎ | 2320/2797 [07:38<01:35,  4.98batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  83%|████████▎ | 2330/2797 [07:39<01:34,  4.95batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  84%|████████▎ | 2341/2797 [07:41<01:30,  5.06batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  84%|████████▎ | 2341/2797 [07:43<01:30,  5.06batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  84%|████████▍ | 2352/2797 [07:43<01:26,  5.13batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  84%|████████▍ | 2363/2797 [07:46<01:25,  5.06batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  85%|████████▍ | 2375/2797 [07:48<01:21,  5.20batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  85%|████████▍ | 2375/2797 [07:48<01:21,  5.20batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  85%|████████▌ | 2386/2797 [07:50<01:19,  5.18batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  86%|████████▌ | 2399/2797 [07:52<01:12,  5.51batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  86%|████████▌ | 2399/2797 [07:52<01:12,  5.51batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  86%|████████▌ | 2411/2797 [07:54<01:11,  5.36batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  87%|████████▋ | 2422/2797 [07:57<01:11,  5.25batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  87%|████████▋ | 2422/2797 [07:57<01:11,  5.25batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  87%|████████▋ | 2433/2797 [07:59<01:11,  5.10batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  87%|████████▋ | 2444/2797 [08:01<01:08,  5.12batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  87%|████████▋ | 2444/2797 [08:02<01:08,  5.12batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  88%|████████▊ | 2455/2797 [08:03<01:07,  5.10batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  88%|████████▊ | 2466/2797 [08:05<01:04,  5.12batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  88%|████████▊ | 2466/2797 [08:07<01:04,  5.12batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  89%|████████▊ | 2477/2797 [08:08<01:02,  5.08batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  89%|████████▉ | 2488/2797 [08:10<01:03,  4.89batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  89%|████████▉ | 2498/2797 [08:12<01:00,  4.92batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  89%|████████▉ | 2498/2797 [08:12<01:00,  4.92batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  90%|████████▉ | 2510/2797 [08:14<00:55,  5.15batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  90%|█████████ | 2521/2797 [08:16<00:53,  5.12batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  90%|█████████ | 2521/2797 [08:17<00:53,  5.12batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  91%|█████████ | 2532/2797 [08:18<00:52,  5.08batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  91%|█████████ | 2543/2797 [08:21<00:49,  5.08batch/s, loss=1.934, lr=3.4e-05]
epoch 3/8:  91%|█████████ | 2543/2797 [08:22<00:49,  5.08batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  91%|█████████▏| 2555/2797 [08:23<00:46,  5.24batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  92%|█████████▏| 2566/2797 [08:25<00:44,  5.25batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  92%|█████████▏| 2566/2797 [08:27<00:44,  5.25batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  92%|█████████▏| 2577/2797 [08:27<00:41,  5.30batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  93%|█████████▎| 2588/2797 [08:29<00:39,  5.25batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  93%|█████████▎| 2599/2797 [08:31<00:37,  5.32batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  93%|█████████▎| 2599/2797 [08:31<00:37,  5.32batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  93%|█████████▎| 2610/2797 [08:33<00:35,  5.21batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  94%|█████████▎| 2621/2797 [08:35<00:34,  5.13batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  94%|█████████▎| 2621/2797 [08:36<00:34,  5.13batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  94%|█████████▍| 2632/2797 [08:38<00:31,  5.18batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  94%|█████████▍| 2643/2797 [08:40<00:30,  5.02batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  94%|█████████▍| 2643/2797 [08:41<00:30,  5.02batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  95%|█████████▍| 2655/2797 [08:42<00:27,  5.23batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  95%|█████████▌| 2666/2797 [08:44<00:25,  5.24batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  95%|█████████▌| 2666/2797 [08:46<00:25,  5.24batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  96%|█████████▌| 2677/2797 [08:46<00:22,  5.24batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  96%|█████████▌| 2688/2797 [08:48<00:20,  5.21batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  96%|█████████▋| 2699/2797 [08:51<00:19,  5.03batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  96%|█████████▋| 2699/2797 [08:51<00:19,  5.03batch/s, loss=1.935, lr=3.3e-05]
epoch 3/8:  97%|█████████▋| 2710/2797 [08:53<00:17,  5.07batch/s, loss=1.935, lr=3.3e-05]
epoch 3/8:  97%|█████████▋| 2721/2797 [08:55<00:15,  5.00batch/s, loss=1.935, lr=3.3e-05]
epoch 3/8:  97%|█████████▋| 2721/2797 [08:56<00:15,  5.00batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  98%|█████████▊| 2732/2797 [08:57<00:12,  5.08batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  98%|█████████▊| 2743/2797 [08:59<00:10,  5.10batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  98%|█████████▊| 2743/2797 [09:01<00:10,  5.10batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  98%|█████████▊| 2754/2797 [09:01<00:08,  5.10batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  99%|█████████▉| 2765/2797 [09:04<00:06,  4.95batch/s, loss=1.934, lr=3.3e-05]
epoch 3/8:  99%|█████████▉| 2765/2797 [09:06<00:06,  4.95batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8:  99%|█████████▉| 2776/2797 [09:06<00:04,  4.99batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8: 100%|█████████▉| 2788/2797 [09:08<00:01,  5.11batch/s, loss=1.933, lr=3.3e-05]
epoch 3/8: 100%|██████████| 2797/2797 [09:10<00:00,  5.08batch/s, loss=1.933, lr=3.3e-05]
epoch 3: train loss 1.933 · validation loss 2.161 · broad 80.6% (top-3 95.0%) · path 71.2% (top-3 88.6%, plausible or look-alike 87.0%) · 1769s elapsed

epoch 4/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 4/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=1.807, lr=3.3e-05]
epoch 4/8:   0%|          | 11/2797 [00:02<08:59,  5.17batch/s, loss=1.807, lr=3.3e-05]
epoch 4/8:   1%|          | 23/2797 [00:04<08:39,  5.34batch/s, loss=1.807, lr=3.3e-05]
epoch 4/8:   1%|          | 23/2797 [00:04<08:39,  5.34batch/s, loss=1.718, lr=3.3e-05]
epoch 4/8:   1%|          | 34/2797 [00:06<08:32,  5.39batch/s, loss=1.718, lr=3.3e-05]
epoch 4/8:   2%|▏         | 45/2797 [00:08<08:37,  5.32batch/s, loss=1.718, lr=3.3e-05]
epoch 4/8:   2%|▏         | 45/2797 [00:09<08:37,  5.32batch/s, loss=1.741, lr=3.3e-05]
epoch 4/8:   2%|▏         | 56/2797 [00:10<09:01,  5.06batch/s, loss=1.741, lr=3.3e-05]
epoch 4/8:   2%|▏         | 67/2797 [00:13<09:07,  4.99batch/s, loss=1.741, lr=3.3e-05]
epoch 4/8:   2%|▏         | 67/2797 [00:14<09:07,  4.99batch/s, loss=1.720, lr=3.3e-05]
epoch 4/8:   3%|▎         | 78/2797 [00:15<09:00,  5.03batch/s, loss=1.720, lr=3.3e-05]
epoch 4/8:   3%|▎         | 89/2797 [00:17<09:05,  4.96batch/s, loss=1.720, lr=3.3e-05]
epoch 4/8:   4%|▎         | 100/2797 [00:19<08:55,  5.03batch/s, loss=1.720, lr=3.3e-05]
epoch 4/8:   4%|▎         | 100/2797 [00:19<08:55,  5.03batch/s, loss=1.735, lr=3.3e-05]
epoch 4/8:   4%|▍         | 111/2797 [00:21<08:54,  5.02batch/s, loss=1.735, lr=3.3e-05]
epoch 4/8:   4%|▍         | 122/2797 [00:23<08:46,  5.08batch/s, loss=1.735, lr=3.3e-05]
epoch 4/8:   4%|▍         | 122/2797 [00:24<08:46,  5.08batch/s, loss=1.752, lr=3.3e-05]
epoch 4/8:   5%|▍         | 133/2797 [00:25<08:34,  5.18batch/s, loss=1.752, lr=3.3e-05]
epoch 4/8:   5%|▌         | 144/2797 [00:28<08:33,  5.17batch/s, loss=1.752, lr=3.3e-05]
epoch 4/8:   5%|▌         | 144/2797 [00:29<08:33,  5.17batch/s, loss=1.747, lr=3.3e-05]
epoch 4/8:   6%|▌         | 155/2797 [00:30<08:32,  5.15batch/s, loss=1.747, lr=3.3e-05]
epoch 4/8:   6%|▌         | 166/2797 [00:32<08:31,  5.14batch/s, loss=1.747, lr=3.3e-05]
epoch 4/8:   6%|▌         | 166/2797 [00:34<08:31,  5.14batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:   6%|▋         | 177/2797 [00:34<08:34,  5.09batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:   7%|▋         | 188/2797 [00:36<08:31,  5.10batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:   7%|▋         | 199/2797 [00:39<08:46,  4.94batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:   7%|▋         | 199/2797 [00:39<08:46,  4.94batch/s, loss=1.751, lr=3.2e-05]
epoch 4/8:   7%|▋         | 209/2797 [00:41<08:43,  4.95batch/s, loss=1.751, lr=3.2e-05]
epoch 4/8:   8%|▊         | 219/2797 [00:43<08:43,  4.92batch/s, loss=1.751, lr=3.2e-05]
epoch 4/8:   8%|▊         | 219/2797 [00:44<08:43,  4.92batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:   8%|▊         | 230/2797 [00:45<08:35,  4.98batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:   9%|▊         | 241/2797 [00:47<08:19,  5.12batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:   9%|▊         | 241/2797 [00:49<08:19,  5.12batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:   9%|▉         | 252/2797 [00:49<08:18,  5.10batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:   9%|▉         | 263/2797 [00:51<08:27,  4.99batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:  10%|▉         | 274/2797 [00:53<08:18,  5.06batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:  10%|▉         | 274/2797 [00:54<08:18,  5.06batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:  10%|█         | 285/2797 [00:56<08:11,  5.11batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:  11%|█         | 296/2797 [00:58<08:15,  5.05batch/s, loss=1.747, lr=3.2e-05]
epoch 4/8:  11%|█         | 296/2797 [00:59<08:15,  5.05batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:  11%|█         | 307/2797 [01:00<08:26,  4.92batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:  11%|█▏        | 318/2797 [01:02<08:16,  4.99batch/s, loss=1.754, lr=3.2e-05]
epoch 4/8:  11%|█▏        | 318/2797 [01:04<08:16,  4.99batch/s, loss=1.753, lr=3.2e-05]
epoch 4/8:  12%|█▏        | 330/2797 [01:04<07:48,  5.26batch/s, loss=1.753, lr=3.2e-05]
epoch 4/8:  12%|█▏        | 342/2797 [01:06<07:29,  5.47batch/s, loss=1.753, lr=3.2e-05]
epoch 4/8:  12%|█▏        | 342/2797 [01:08<07:29,  5.47batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  13%|█▎        | 353/2797 [01:09<07:41,  5.29batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  13%|█▎        | 364/2797 [01:11<07:45,  5.23batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  13%|█▎        | 375/2797 [01:13<07:41,  5.25batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  13%|█▎        | 375/2797 [01:13<07:41,  5.25batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  14%|█▍        | 386/2797 [01:15<07:51,  5.11batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  14%|█▍        | 397/2797 [01:17<07:54,  5.06batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  14%|█▍        | 397/2797 [01:18<07:54,  5.06batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  15%|█▍        | 408/2797 [01:19<07:49,  5.09batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  15%|█▍        | 419/2797 [01:22<07:52,  5.03batch/s, loss=1.755, lr=3.2e-05]
epoch 4/8:  15%|█▍        | 419/2797 [01:23<07:52,  5.03batch/s, loss=1.753, lr=3.2e-05]
epoch 4/8:  15%|█▌        | 430/2797 [01:24<07:40,  5.14batch/s, loss=1.753, lr=3.2e-05]
epoch 4/8:  16%|█▌        | 441/2797 [01:26<07:49,  5.01batch/s, loss=1.753, lr=3.2e-05]
epoch 4/8:  16%|█▌        | 441/2797 [01:28<07:49,  5.01batch/s, loss=1.758, lr=3.2e-05]
epoch 4/8:  16%|█▌        | 452/2797 [01:28<07:45,  5.04batch/s, loss=1.758, lr=3.2e-05]
epoch 4/8:  17%|█▋        | 463/2797 [01:31<07:58,  4.88batch/s, loss=1.758, lr=3.2e-05]
epoch 4/8:  17%|█▋        | 474/2797 [01:33<07:50,  4.94batch/s, loss=1.758, lr=3.2e-05]
epoch 4/8:  17%|█▋        | 474/2797 [01:33<07:50,  4.94batch/s, loss=1.761, lr=3.2e-05]
epoch 4/8:  17%|█▋        | 485/2797 [01:35<07:41,  5.01batch/s, loss=1.761, lr=3.2e-05]
epoch 4/8:  18%|█▊        | 496/2797 [01:37<07:47,  4.92batch/s, loss=1.761, lr=3.2e-05]
epoch 4/8:  18%|█▊        | 496/2797 [01:38<07:47,  4.92batch/s, loss=1.760, lr=3.2e-05]
epoch 4/8:  18%|█▊        | 506/2797 [01:39<07:48,  4.89batch/s, loss=1.760, lr=3.2e-05]
epoch 4/8:  19%|█▊        | 518/2797 [01:41<07:27,  5.10batch/s, loss=1.760, lr=3.2e-05]
epoch 4/8:  19%|█▊        | 518/2797 [01:43<07:27,  5.10batch/s, loss=1.762, lr=3.2e-05]
epoch 4/8:  19%|█▉        | 529/2797 [01:44<07:30,  5.03batch/s, loss=1.762, lr=3.2e-05]
epoch 4/8:  19%|█▉        | 540/2797 [01:46<07:32,  4.99batch/s, loss=1.762, lr=3.2e-05]
epoch 4/8:  20%|█▉        | 550/2797 [01:48<07:33,  4.96batch/s, loss=1.762, lr=3.2e-05]
epoch 4/8:  20%|█▉        | 550/2797 [01:48<07:33,  4.96batch/s, loss=1.759, lr=3.2e-05]
epoch 4/8:  20%|██        | 561/2797 [01:50<07:24,  5.03batch/s, loss=1.759, lr=3.2e-05]
epoch 4/8:  20%|██        | 572/2797 [01:52<07:31,  4.93batch/s, loss=1.759, lr=3.2e-05]
epoch 4/8:  20%|██        | 572/2797 [01:53<07:31,  4.93batch/s, loss=1.763, lr=3.2e-05]
epoch 4/8:  21%|██        | 583/2797 [01:55<07:17,  5.06batch/s, loss=1.763, lr=3.2e-05]
epoch 4/8:  21%|██        | 594/2797 [01:57<07:11,  5.11batch/s, loss=1.763, lr=3.2e-05]
epoch 4/8:  21%|██        | 594/2797 [01:58<07:11,  5.11batch/s, loss=1.762, lr=3.1e-05]
epoch 4/8:  22%|██▏       | 605/2797 [01:59<07:19,  4.98batch/s, loss=1.762, lr=3.1e-05]
epoch 4/8:  22%|██▏       | 615/2797 [02:01<07:20,  4.96batch/s, loss=1.762, lr=3.1e-05]
epoch 4/8:  22%|██▏       | 615/2797 [02:03<07:20,  4.96batch/s, loss=1.759, lr=3.1e-05]
epoch 4/8:  22%|██▏       | 626/2797 [02:03<07:11,  5.04batch/s, loss=1.759, lr=3.1e-05]
epoch 4/8:  23%|██▎       | 637/2797 [02:05<07:18,  4.93batch/s, loss=1.759, lr=3.1e-05]
epoch 4/8:  23%|██▎       | 648/2797 [02:08<07:07,  5.03batch/s, loss=1.759, lr=3.1e-05]
epoch 4/8:  23%|██▎       | 648/2797 [02:08<07:07,  5.03batch/s, loss=1.757, lr=3.1e-05]
epoch 4/8:  24%|██▎       | 659/2797 [02:10<06:58,  5.11batch/s, loss=1.757, lr=3.1e-05]
epoch 4/8:  24%|██▍       | 670/2797 [02:12<06:53,  5.15batch/s, loss=1.757, lr=3.1e-05]
epoch 4/8:  24%|██▍       | 670/2797 [02:13<06:53,  5.15batch/s, loss=1.756, lr=3.1e-05]
epoch 4/8:  24%|██▍       | 681/2797 [02:14<06:56,  5.08batch/s, loss=1.756, lr=3.1e-05]
epoch 4/8:  25%|██▍       | 692/2797 [02:16<06:59,  5.02batch/s, loss=1.756, lr=3.1e-05]
epoch 4/8:  25%|██▍       | 692/2797 [02:18<06:59,  5.02batch/s, loss=1.758, lr=3.1e-05]
epoch 4/8:  25%|██▌       | 703/2797 [02:19<07:04,  4.93batch/s, loss=1.758, lr=3.1e-05]
epoch 4/8:  25%|██▌       | 713/2797 [02:21<07:09,  4.85batch/s, loss=1.758, lr=3.1e-05]
epoch 4/8:  26%|██▌       | 724/2797 [02:23<06:55,  4.99batch/s, loss=1.758, lr=3.1e-05]
epoch 4/8:  26%|██▌       | 724/2797 [02:23<06:55,  4.99batch/s, loss=1.757, lr=3.1e-05]
epoch 4/8:  26%|██▋       | 736/2797 [02:25<06:36,  5.20batch/s, loss=1.757, lr=3.1e-05]
epoch 4/8:  27%|██▋       | 747/2797 [02:27<06:51,  4.99batch/s, loss=1.757, lr=3.1e-05]
epoch 4/8:  27%|██▋       | 747/2797 [02:28<06:51,  4.99batch/s, loss=1.756, lr=3.1e-05]
epoch 4/8:  27%|██▋       | 758/2797 [02:29<06:38,  5.11batch/s, loss=1.756, lr=3.1e-05]
epoch 4/8:  27%|██▋       | 769/2797 [02:31<06:37,  5.10batch/s, loss=1.756, lr=3.1e-05]
epoch 4/8:  27%|██▋       | 769/2797 [02:33<06:37,  5.10batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  28%|██▊       | 781/2797 [02:34<06:23,  5.26batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  28%|██▊       | 792/2797 [02:36<06:26,  5.18batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  28%|██▊       | 792/2797 [02:38<06:26,  5.18batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  29%|██▊       | 803/2797 [02:38<06:34,  5.06batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  29%|██▉       | 814/2797 [02:40<06:32,  5.05batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  29%|██▉       | 825/2797 [02:42<06:21,  5.16batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  29%|██▉       | 825/2797 [02:42<06:21,  5.16batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  30%|██▉       | 836/2797 [02:45<06:26,  5.07batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  30%|███       | 847/2797 [02:47<06:19,  5.14batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  30%|███       | 847/2797 [02:47<06:19,  5.14batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  31%|███       | 858/2797 [02:49<06:18,  5.12batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  31%|███       | 869/2797 [02:51<06:22,  5.04batch/s, loss=1.754, lr=3.1e-05]
epoch 4/8:  31%|███       | 869/2797 [02:52<06:22,  5.04batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  31%|███▏      | 880/2797 [02:53<06:18,  5.07batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  32%|███▏      | 891/2797 [02:56<06:24,  4.95batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  32%|███▏      | 891/2797 [02:58<06:24,  4.95batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  32%|███▏      | 902/2797 [02:58<06:20,  4.99batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  33%|███▎      | 913/2797 [03:00<06:11,  5.07batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  33%|███▎      | 925/2797 [03:02<05:58,  5.22batch/s, loss=1.755, lr=3.1e-05]
epoch 4/8:  33%|███▎      | 925/2797 [03:02<05:58,  5.22batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  33%|███▎      | 936/2797 [03:04<05:53,  5.26batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  34%|███▍      | 947/2797 [03:06<05:58,  5.16batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  34%|███▍      | 947/2797 [03:07<05:58,  5.16batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  34%|███▍      | 958/2797 [03:08<05:56,  5.16batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  35%|███▍      | 969/2797 [03:11<06:04,  5.02batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  35%|███▍      | 969/2797 [03:12<06:04,  5.02batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  35%|███▌      | 981/2797 [03:13<05:50,  5.17batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  35%|███▌      | 992/2797 [03:15<05:51,  5.13batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  35%|███▌      | 992/2797 [03:17<05:51,  5.13batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  36%|███▌      | 1003/2797 [03:17<05:57,  5.02batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  36%|███▋      | 1015/2797 [03:19<05:39,  5.25batch/s, loss=1.753, lr=3.1e-05]
epoch 4/8:  36%|███▋      | 1015/2797 [03:21<05:39,  5.25batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  37%|███▋      | 1026/2797 [03:21<05:33,  5.31batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  37%|███▋      | 1037/2797 [03:24<05:39,  5.18batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  37%|███▋      | 1048/2797 [03:26<05:34,  5.23batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  37%|███▋      | 1048/2797 [03:26<05:34,  5.23batch/s, loss=1.750, lr=3.0e-05]
epoch 4/8:  38%|███▊      | 1059/2797 [03:28<05:35,  5.19batch/s, loss=1.750, lr=3.0e-05]
epoch 4/8:  38%|███▊      | 1070/2797 [03:30<05:41,  5.05batch/s, loss=1.750, lr=3.0e-05]
epoch 4/8:  38%|███▊      | 1070/2797 [03:31<05:41,  5.05batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  39%|███▊      | 1081/2797 [03:32<05:31,  5.17batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  39%|███▉      | 1092/2797 [03:34<05:27,  5.20batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  39%|███▉      | 1092/2797 [03:36<05:27,  5.20batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  39%|███▉      | 1104/2797 [03:36<05:20,  5.28batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  40%|███▉      | 1115/2797 [03:39<05:19,  5.26batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  40%|███▉      | 1115/2797 [03:41<05:19,  5.26batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  40%|████      | 1126/2797 [03:41<05:25,  5.13batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  41%|████      | 1137/2797 [03:43<05:23,  5.14batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  41%|████      | 1148/2797 [03:45<05:18,  5.18batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  41%|████      | 1148/2797 [03:46<05:18,  5.18batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  41%|████▏     | 1159/2797 [03:47<05:24,  5.05batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  42%|████▏     | 1170/2797 [03:50<05:31,  4.91batch/s, loss=1.751, lr=3.0e-05]
epoch 4/8:  42%|████▏     | 1170/2797 [03:51<05:31,  4.91batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  42%|████▏     | 1181/2797 [03:52<05:26,  4.95batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  43%|████▎     | 1192/2797 [03:54<05:21,  4.99batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  43%|████▎     | 1192/2797 [03:56<05:21,  4.99batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  43%|████▎     | 1203/2797 [03:56<05:22,  4.94batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  43%|████▎     | 1213/2797 [03:59<05:28,  4.82batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  44%|████▍     | 1224/2797 [04:01<05:18,  4.94batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  44%|████▍     | 1224/2797 [04:01<05:18,  4.94batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  44%|████▍     | 1235/2797 [04:03<05:08,  5.06batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  45%|████▍     | 1246/2797 [04:05<05:04,  5.09batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  45%|████▍     | 1246/2797 [04:06<05:04,  5.09batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  45%|████▍     | 1257/2797 [04:07<05:05,  5.05batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  45%|████▌     | 1269/2797 [04:09<04:52,  5.22batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  45%|████▌     | 1269/2797 [04:11<04:52,  5.22batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  46%|████▌     | 1280/2797 [04:12<05:01,  5.04batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  46%|████▌     | 1291/2797 [04:14<05:01,  5.00batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  46%|████▌     | 1291/2797 [04:16<05:01,  5.00batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  47%|████▋     | 1302/2797 [04:16<05:05,  4.89batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  47%|████▋     | 1313/2797 [04:18<05:00,  4.93batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  47%|████▋     | 1325/2797 [04:20<04:45,  5.16batch/s, loss=1.754, lr=3.0e-05]
epoch 4/8:  47%|████▋     | 1325/2797 [04:21<04:45,  5.16batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  48%|████▊     | 1336/2797 [04:23<04:45,  5.11batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  48%|████▊     | 1347/2797 [04:25<04:45,  5.08batch/s, loss=1.752, lr=3.0e-05]
epoch 4/8:  48%|████▊     | 1347/2797 [04:26<04:45,  5.08batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  49%|████▊     | 1358/2797 [04:27<04:45,  5.05batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  49%|████▉     | 1370/2797 [04:29<04:33,  5.22batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  49%|████▉     | 1370/2797 [04:30<04:33,  5.22batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  49%|████▉     | 1381/2797 [04:31<04:30,  5.24batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  50%|████▉     | 1393/2797 [04:34<04:25,  5.30batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  50%|████▉     | 1393/2797 [04:35<04:25,  5.30batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  50%|█████     | 1404/2797 [04:36<04:25,  5.25batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  51%|█████     | 1415/2797 [04:38<04:32,  5.08batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  51%|█████     | 1415/2797 [04:40<04:32,  5.08batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  51%|█████     | 1426/2797 [04:40<04:29,  5.09batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  51%|█████▏    | 1437/2797 [04:42<04:30,  5.03batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  52%|█████▏    | 1449/2797 [04:45<04:22,  5.14batch/s, loss=1.753, lr=3.0e-05]
epoch 4/8:  52%|█████▏    | 1449/2797 [04:45<04:22,  5.14batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  52%|█████▏    | 1461/2797 [04:47<04:14,  5.25batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  53%|█████▎    | 1472/2797 [04:49<04:17,  5.15batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  53%|█████▎    | 1472/2797 [04:50<04:17,  5.15batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  53%|█████▎    | 1485/2797 [04:51<04:01,  5.42batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  53%|█████▎    | 1496/2797 [04:53<04:06,  5.28batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  53%|█████▎    | 1496/2797 [04:54<04:06,  5.28batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  54%|█████▍    | 1507/2797 [04:55<04:01,  5.34batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  54%|█████▍    | 1518/2797 [04:58<04:11,  5.09batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  54%|█████▍    | 1518/2797 [04:59<04:11,  5.09batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  55%|█████▍    | 1529/2797 [05:00<04:06,  5.15batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  55%|█████▌    | 1540/2797 [05:02<04:10,  5.02batch/s, loss=1.753, lr=2.9e-05]
epoch 4/8:  55%|█████▌    | 1540/2797 [05:04<04:10,  5.02batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  55%|█████▌    | 1551/2797 [05:04<04:05,  5.07batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  56%|█████▌    | 1562/2797 [05:07<04:06,  5.00batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  56%|█████▋    | 1574/2797 [05:09<03:54,  5.22batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  56%|█████▋    | 1574/2797 [05:09<03:54,  5.22batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  57%|█████▋    | 1585/2797 [05:11<03:59,  5.05batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  57%|█████▋    | 1596/2797 [05:13<03:54,  5.13batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  57%|█████▋    | 1596/2797 [05:14<03:54,  5.13batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  57%|█████▋    | 1607/2797 [05:15<03:51,  5.14batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  58%|█████▊    | 1618/2797 [05:17<03:53,  5.05batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  58%|█████▊    | 1618/2797 [05:19<03:53,  5.05batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  58%|█████▊    | 1629/2797 [05:20<03:47,  5.14batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  59%|█████▊    | 1640/2797 [05:22<03:48,  5.06batch/s, loss=1.752, lr=2.9e-05]
epoch 4/8:  59%|█████▊    | 1640/2797 [05:24<03:48,  5.06batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  59%|█████▉    | 1651/2797 [05:24<03:52,  4.93batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  59%|█████▉    | 1662/2797 [05:26<03:43,  5.07batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  60%|█████▉    | 1673/2797 [05:28<03:38,  5.14batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  60%|█████▉    | 1673/2797 [05:29<03:38,  5.14batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  60%|██████    | 1684/2797 [05:30<03:37,  5.13batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  61%|██████    | 1695/2797 [05:33<03:37,  5.06batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  61%|██████    | 1695/2797 [05:34<03:37,  5.06batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  61%|██████    | 1706/2797 [05:35<03:37,  5.01batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  61%|██████▏   | 1717/2797 [05:37<03:36,  5.00batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  61%|██████▏   | 1717/2797 [05:39<03:36,  5.00batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  62%|██████▏   | 1729/2797 [05:39<03:25,  5.20batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  62%|██████▏   | 1741/2797 [05:41<03:18,  5.32batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  62%|██████▏   | 1741/2797 [05:43<03:18,  5.32batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  63%|██████▎   | 1752/2797 [05:43<03:17,  5.29batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  63%|██████▎   | 1763/2797 [05:46<03:21,  5.13batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  63%|██████▎   | 1774/2797 [05:48<03:22,  5.06batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  63%|██████▎   | 1774/2797 [05:48<03:22,  5.06batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  64%|██████▍   | 1785/2797 [05:50<03:20,  5.05batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  64%|██████▍   | 1796/2797 [05:52<03:16,  5.10batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  64%|██████▍   | 1796/2797 [05:53<03:16,  5.10batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  65%|██████▍   | 1807/2797 [05:54<03:14,  5.10batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  65%|██████▌   | 1819/2797 [05:57<03:06,  5.23batch/s, loss=1.750, lr=2.9e-05]
epoch 4/8:  65%|██████▌   | 1819/2797 [05:58<03:06,  5.23batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  65%|██████▌   | 1830/2797 [05:59<03:06,  5.19batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  66%|██████▌   | 1841/2797 [06:01<03:06,  5.12batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  66%|██████▌   | 1841/2797 [06:03<03:06,  5.12batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  66%|██████▌   | 1852/2797 [06:03<03:10,  4.97batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  67%|██████▋   | 1862/2797 [06:05<03:08,  4.95batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  67%|██████▋   | 1872/2797 [06:07<03:06,  4.96batch/s, loss=1.751, lr=2.9e-05]
epoch 4/8:  67%|██████▋   | 1872/2797 [06:08<03:06,  4.96batch/s, loss=1.750, lr=2.8e-05]
epoch 4/8:  67%|██████▋   | 1883/2797 [06:09<03:00,  5.08batch/s, loss=1.750, lr=2.8e-05]
epoch 4/8:  68%|██████▊   | 1894/2797 [06:11<02:53,  5.20batch/s, loss=1.750, lr=2.8e-05]
epoch 4/8:  68%|██████▊   | 1894/2797 [06:13<02:53,  5.20batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  68%|██████▊   | 1905/2797 [06:14<02:54,  5.10batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  69%|██████▊   | 1916/2797 [06:16<02:50,  5.15batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  69%|██████▊   | 1916/2797 [06:18<02:50,  5.15batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  69%|██████▉   | 1927/2797 [06:18<02:51,  5.08batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  69%|██████▉   | 1939/2797 [06:20<02:44,  5.20batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  70%|██████▉   | 1950/2797 [06:22<02:42,  5.21batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  70%|██████▉   | 1950/2797 [06:22<02:42,  5.21batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  70%|███████   | 1961/2797 [06:24<02:39,  5.23batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  71%|███████   | 1972/2797 [06:26<02:37,  5.25batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  71%|███████   | 1972/2797 [06:27<02:37,  5.25batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  71%|███████   | 1983/2797 [06:29<02:41,  5.03batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  71%|███████▏  | 1994/2797 [06:31<02:40,  5.00batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  71%|███████▏  | 1994/2797 [06:32<02:40,  5.00batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  72%|███████▏  | 2005/2797 [06:33<02:39,  4.96batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  72%|███████▏  | 2015/2797 [06:35<02:37,  4.96batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  72%|███████▏  | 2015/2797 [06:37<02:37,  4.96batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  72%|███████▏  | 2027/2797 [06:38<02:29,  5.13batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  73%|███████▎  | 2038/2797 [06:40<02:27,  5.14batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  73%|███████▎  | 2049/2797 [06:42<02:25,  5.15batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  73%|███████▎  | 2049/2797 [06:42<02:25,  5.15batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  74%|███████▎  | 2060/2797 [06:44<02:26,  5.02batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  74%|███████▍  | 2072/2797 [06:46<02:20,  5.17batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  74%|███████▍  | 2072/2797 [06:47<02:20,  5.17batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  74%|███████▍  | 2083/2797 [06:48<02:18,  5.15batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  75%|███████▍  | 2094/2797 [06:51<02:20,  4.99batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  75%|███████▍  | 2094/2797 [06:52<02:20,  4.99batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  75%|███████▌  | 2105/2797 [06:53<02:21,  4.89batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  76%|███████▌  | 2117/2797 [06:55<02:12,  5.14batch/s, loss=1.753, lr=2.8e-05]
epoch 4/8:  76%|███████▌  | 2117/2797 [06:57<02:12,  5.14batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  76%|███████▌  | 2128/2797 [06:57<02:11,  5.07batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  76%|███████▋  | 2139/2797 [07:00<02:08,  5.14batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  77%|███████▋  | 2150/2797 [07:02<02:05,  5.14batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  77%|███████▋  | 2150/2797 [07:02<02:05,  5.14batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  77%|███████▋  | 2161/2797 [07:04<02:02,  5.18batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  78%|███████▊  | 2172/2797 [07:06<02:03,  5.06batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  78%|███████▊  | 2172/2797 [07:07<02:03,  5.06batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  78%|███████▊  | 2184/2797 [07:08<01:57,  5.21batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  78%|███████▊  | 2195/2797 [07:10<01:54,  5.25batch/s, loss=1.752, lr=2.8e-05]
epoch 4/8:  78%|███████▊  | 2195/2797 [07:11<01:54,  5.25batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  79%|███████▉  | 2206/2797 [07:12<01:52,  5.26batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  79%|███████▉  | 2217/2797 [07:15<01:51,  5.19batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  79%|███████▉  | 2217/2797 [07:16<01:51,  5.19batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  80%|███████▉  | 2228/2797 [07:17<01:49,  5.21batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  80%|████████  | 2239/2797 [07:19<01:49,  5.11batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  80%|████████  | 2250/2797 [07:21<01:48,  5.06batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  80%|████████  | 2250/2797 [07:21<01:48,  5.06batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  81%|████████  | 2261/2797 [07:24<01:49,  4.90batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  81%|████████  | 2271/2797 [07:26<01:47,  4.91batch/s, loss=1.751, lr=2.8e-05]
epoch 4/8:  81%|████████  | 2271/2797 [07:27<01:47,  4.91batch/s, loss=1.750, lr=2.8e-05]
epoch 4/8:  82%|████████▏ | 2282/2797 [07:28<01:43,  4.97batch/s, loss=1.750, lr=2.8e-05]
epoch 4/8:  82%|████████▏ | 2292/2797 [07:30<01:43,  4.88batch/s, loss=1.750, lr=2.8e-05]
epoch 4/8:  82%|████████▏ | 2292/2797 [07:32<01:43,  4.88batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  82%|████████▏ | 2303/2797 [07:32<01:40,  4.94batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  83%|████████▎ | 2313/2797 [07:34<01:37,  4.95batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  83%|████████▎ | 2324/2797 [07:36<01:33,  5.03batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  83%|████████▎ | 2324/2797 [07:37<01:33,  5.03batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  83%|████████▎ | 2335/2797 [07:38<01:32,  4.99batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  84%|████████▍ | 2345/2797 [07:40<01:31,  4.94batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  84%|████████▍ | 2345/2797 [07:42<01:31,  4.94batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  84%|████████▍ | 2356/2797 [07:43<01:27,  5.04batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  85%|████████▍ | 2367/2797 [07:45<01:27,  4.93batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  85%|████████▍ | 2367/2797 [07:47<01:27,  4.93batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  85%|████████▍ | 2377/2797 [07:47<01:26,  4.85batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  85%|████████▌ | 2388/2797 [07:49<01:21,  5.03batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  86%|████████▌ | 2399/2797 [07:51<01:19,  4.98batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  86%|████████▌ | 2399/2797 [07:52<01:19,  4.98batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  86%|████████▌ | 2410/2797 [07:53<01:17,  5.02batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  87%|████████▋ | 2421/2797 [07:55<01:13,  5.14batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  87%|████████▋ | 2421/2797 [07:56<01:13,  5.14batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  87%|████████▋ | 2432/2797 [07:58<01:12,  5.01batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  87%|████████▋ | 2443/2797 [08:00<01:10,  5.03batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  87%|████████▋ | 2443/2797 [08:01<01:10,  5.03batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  88%|████████▊ | 2454/2797 [08:02<01:06,  5.16batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  88%|████████▊ | 2465/2797 [08:04<01:05,  5.11batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  88%|████████▊ | 2465/2797 [08:07<01:05,  5.11batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  89%|████████▊ | 2476/2797 [08:07<01:05,  4.93batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  89%|████████▉ | 2487/2797 [08:09<01:01,  5.01batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  89%|████████▉ | 2499/2797 [08:11<00:57,  5.20batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  89%|████████▉ | 2499/2797 [08:11<00:57,  5.20batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  90%|████████▉ | 2510/2797 [08:13<00:54,  5.28batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  90%|█████████ | 2521/2797 [08:15<00:52,  5.25batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  90%|█████████ | 2521/2797 [08:16<00:52,  5.25batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  91%|█████████ | 2532/2797 [08:17<00:49,  5.32batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  91%|█████████ | 2543/2797 [08:19<00:48,  5.21batch/s, loss=1.750, lr=2.7e-05]
epoch 4/8:  91%|█████████ | 2543/2797 [08:21<00:48,  5.21batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  91%|█████████▏| 2554/2797 [08:21<00:46,  5.20batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  92%|█████████▏| 2565/2797 [08:24<00:45,  5.09batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  92%|█████████▏| 2565/2797 [08:26<00:45,  5.09batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  92%|█████████▏| 2576/2797 [08:26<00:44,  4.94batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  92%|█████████▏| 2586/2797 [08:28<00:42,  4.95batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  93%|█████████▎| 2598/2797 [08:30<00:38,  5.18batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  93%|█████████▎| 2598/2797 [08:31<00:38,  5.18batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  93%|█████████▎| 2609/2797 [08:32<00:36,  5.15batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  94%|█████████▎| 2620/2797 [08:34<00:34,  5.19batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  94%|█████████▎| 2620/2797 [08:35<00:34,  5.19batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  94%|█████████▍| 2631/2797 [08:36<00:32,  5.16batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  94%|█████████▍| 2642/2797 [08:39<00:30,  5.09batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  94%|█████████▍| 2642/2797 [08:40<00:30,  5.09batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  95%|█████████▍| 2653/2797 [08:41<00:28,  5.12batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  95%|█████████▌| 2664/2797 [08:43<00:26,  5.02batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  96%|█████████▌| 2675/2797 [08:45<00:24,  5.03batch/s, loss=1.749, lr=2.7e-05]
epoch 4/8:  96%|█████████▌| 2675/2797 [08:45<00:24,  5.03batch/s, loss=1.748, lr=2.7e-05]
epoch 4/8:  96%|█████████▌| 2687/2797 [08:47<00:21,  5.20batch/s, loss=1.748, lr=2.7e-05]
epoch 4/8:  96%|█████████▋| 2698/2797 [08:50<00:19,  5.11batch/s, loss=1.748, lr=2.7e-05]
epoch 4/8:  96%|█████████▋| 2698/2797 [08:50<00:19,  5.11batch/s, loss=1.748, lr=2.7e-05]
epoch 4/8:  97%|█████████▋| 2709/2797 [08:52<00:16,  5.21batch/s, loss=1.748, lr=2.7e-05]
epoch 4/8:  97%|█████████▋| 2720/2797 [08:54<00:14,  5.20batch/s, loss=1.748, lr=2.7e-05]
epoch 4/8:  97%|█████████▋| 2720/2797 [08:55<00:14,  5.20batch/s, loss=1.748, lr=2.6e-05]
epoch 4/8:  98%|█████████▊| 2731/2797 [08:56<00:13,  5.05batch/s, loss=1.748, lr=2.6e-05]
epoch 4/8:  98%|█████████▊| 2742/2797 [08:58<00:10,  5.09batch/s, loss=1.748, lr=2.6e-05]
epoch 4/8:  98%|█████████▊| 2742/2797 [09:00<00:10,  5.09batch/s, loss=1.749, lr=2.6e-05]
epoch 4/8:  98%|█████████▊| 2754/2797 [09:00<00:08,  5.22batch/s, loss=1.749, lr=2.6e-05]
epoch 4/8:  99%|█████████▉| 2765/2797 [09:02<00:06,  5.24batch/s, loss=1.749, lr=2.6e-05]
epoch 4/8:  99%|█████████▉| 2765/2797 [09:05<00:06,  5.24batch/s, loss=1.749, lr=2.6e-05]
epoch 4/8:  99%|█████████▉| 2776/2797 [09:05<00:04,  5.15batch/s, loss=1.749, lr=2.6e-05]
epoch 4/8: 100%|█████████▉| 2787/2797 [09:07<00:01,  5.07batch/s, loss=1.749, lr=2.6e-05]
epoch 4/8: 100%|██████████| 2797/2797 [09:09<00:00,  5.09batch/s, loss=1.749, lr=2.6e-05]
epoch 4: train loss 1.749 · validation loss 2.118 · broad 80.9% (top-3 95.1%) · path 71.9% (top-3 89.1%, plausible or look-alike 87.8%) · 2360s elapsed

epoch 5/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 5/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=1.645, lr=2.6e-05]
epoch 5/8:   0%|          | 11/2797 [00:02<09:11,  5.05batch/s, loss=1.645, lr=2.6e-05]
epoch 5/8:   1%|          | 22/2797 [00:04<09:23,  4.93batch/s, loss=1.645, lr=2.6e-05]
epoch 5/8:   1%|          | 22/2797 [00:05<09:23,  4.93batch/s, loss=1.634, lr=2.6e-05]
epoch 5/8:   1%|          | 32/2797 [00:06<09:25,  4.89batch/s, loss=1.634, lr=2.6e-05]
epoch 5/8:   2%|▏         | 42/2797 [00:08<09:25,  4.88batch/s, loss=1.634, lr=2.6e-05]
epoch 5/8:   2%|▏         | 42/2797 [00:10<09:25,  4.88batch/s, loss=1.629, lr=2.6e-05]
epoch 5/8:   2%|▏         | 53/2797 [00:10<09:14,  4.95batch/s, loss=1.629, lr=2.6e-05]
epoch 5/8:   2%|▏         | 63/2797 [00:12<09:12,  4.95batch/s, loss=1.629, lr=2.6e-05]
epoch 5/8:   3%|▎         | 74/2797 [00:14<08:59,  5.05batch/s, loss=1.629, lr=2.6e-05]
epoch 5/8:   3%|▎         | 74/2797 [00:15<08:59,  5.05batch/s, loss=1.636, lr=2.6e-05]
epoch 5/8:   3%|▎         | 85/2797 [00:17<09:06,  4.96batch/s, loss=1.636, lr=2.6e-05]
epoch 5/8:   3%|▎         | 96/2797 [00:19<09:02,  4.98batch/s, loss=1.636, lr=2.6e-05]
epoch 5/8:   3%|▎         | 96/2797 [00:20<09:02,  4.98batch/s, loss=1.631, lr=2.6e-05]
epoch 5/8:   4%|▍         | 107/2797 [00:21<08:55,  5.03batch/s, loss=1.631, lr=2.6e-05]
epoch 5/8:   4%|▍         | 119/2797 [00:23<08:30,  5.25batch/s, loss=1.631, lr=2.6e-05]
epoch 5/8:   4%|▍         | 119/2797 [00:25<08:30,  5.25batch/s, loss=1.646, lr=2.6e-05]
epoch 5/8:   5%|▍         | 130/2797 [00:25<08:44,  5.08batch/s, loss=1.646, lr=2.6e-05]
epoch 5/8:   5%|▌         | 141/2797 [00:28<08:50,  5.00batch/s, loss=1.646, lr=2.6e-05]
epoch 5/8:   5%|▌         | 141/2797 [00:30<08:50,  5.00batch/s, loss=1.647, lr=2.6e-05]
epoch 5/8:   5%|▌         | 152/2797 [00:30<08:51,  4.98batch/s, loss=1.647, lr=2.6e-05]
epoch 5/8:   6%|▌         | 162/2797 [00:32<08:48,  4.98batch/s, loss=1.647, lr=2.6e-05]
epoch 5/8:   6%|▌         | 173/2797 [00:34<08:37,  5.07batch/s, loss=1.647, lr=2.6e-05]
epoch 5/8:   6%|▌         | 173/2797 [00:35<08:37,  5.07batch/s, loss=1.643, lr=2.6e-05]
epoch 5/8:   7%|▋         | 184/2797 [00:36<08:32,  5.10batch/s, loss=1.643, lr=2.6e-05]
epoch 5/8:   7%|▋         | 195/2797 [00:38<08:43,  4.97batch/s, loss=1.643, lr=2.6e-05]
epoch 5/8:   7%|▋         | 195/2797 [00:40<08:43,  4.97batch/s, loss=1.641, lr=2.6e-05]
epoch 5/8:   7%|▋         | 206/2797 [00:41<08:36,  5.02batch/s, loss=1.641, lr=2.6e-05]
epoch 5/8:   8%|▊         | 217/2797 [00:43<08:32,  5.03batch/s, loss=1.641, lr=2.6e-05]
epoch 5/8:   8%|▊         | 217/2797 [00:45<08:32,  5.03batch/s, loss=1.642, lr=2.6e-05]
epoch 5/8:   8%|▊         | 228/2797 [00:45<08:26,  5.07batch/s, loss=1.642, lr=2.6e-05]
epoch 5/8:   9%|▊         | 239/2797 [00:47<08:31,  5.00batch/s, loss=1.642, lr=2.6e-05]
epoch 5/8:   9%|▉         | 250/2797 [00:49<08:35,  4.94batch/s, loss=1.642, lr=2.6e-05]
epoch 5/8:   9%|▉         | 250/2797 [00:50<08:35,  4.94batch/s, loss=1.650, lr=2.6e-05]
epoch 5/8:   9%|▉         | 262/2797 [00:52<08:18,  5.08batch/s, loss=1.650, lr=2.6e-05]
epoch 5/8:  10%|▉         | 273/2797 [00:54<08:10,  5.15batch/s, loss=1.650, lr=2.6e-05]
epoch 5/8:  10%|▉         | 273/2797 [00:54<08:10,  5.15batch/s, loss=1.653, lr=2.6e-05]
epoch 5/8:  10%|█         | 284/2797 [00:56<08:10,  5.12batch/s, loss=1.653, lr=2.6e-05]
epoch 5/8:  11%|█         | 295/2797 [00:58<08:16,  5.04batch/s, loss=1.653, lr=2.6e-05]
epoch 5/8:  11%|█         | 295/2797 [00:59<08:16,  5.04batch/s, loss=1.650, lr=2.6e-05]
epoch 5/8:  11%|█         | 306/2797 [01:00<08:13,  5.05batch/s, loss=1.650, lr=2.6e-05]
epoch 5/8:  11%|█▏        | 317/2797 [01:02<08:03,  5.13batch/s, loss=1.650, lr=2.6e-05]
epoch 5/8:  11%|█▏        | 317/2797 [01:04<08:03,  5.13batch/s, loss=1.648, lr=2.6e-05]
epoch 5/8:  12%|█▏        | 328/2797 [01:04<07:52,  5.23batch/s, loss=1.648, lr=2.6e-05]
epoch 5/8:  12%|█▏        | 339/2797 [01:07<08:00,  5.12batch/s, loss=1.648, lr=2.6e-05]
epoch 5/8:  13%|█▎        | 350/2797 [01:09<08:03,  5.06batch/s, loss=1.648, lr=2.6e-05]
epoch 5/8:  13%|█▎        | 350/2797 [01:09<08:03,  5.06batch/s, loss=1.644, lr=2.5e-05]
epoch 5/8:  13%|█▎        | 361/2797 [01:11<08:03,  5.04batch/s, loss=1.644, lr=2.5e-05]
epoch 5/8:  13%|█▎        | 372/2797 [01:13<08:01,  5.04batch/s, loss=1.644, lr=2.5e-05]
epoch 5/8:  13%|█▎        | 372/2797 [01:14<08:01,  5.04batch/s, loss=1.647, lr=2.5e-05]
epoch 5/8:  14%|█▎        | 383/2797 [01:15<07:59,  5.04batch/s, loss=1.647, lr=2.5e-05]
epoch 5/8:  14%|█▍        | 394/2797 [01:18<08:03,  4.97batch/s, loss=1.647, lr=2.5e-05]
epoch 5/8:  14%|█▍        | 394/2797 [01:19<08:03,  4.97batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  14%|█▍        | 405/2797 [01:20<07:49,  5.09batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  15%|█▍        | 416/2797 [01:22<07:46,  5.10batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  15%|█▍        | 416/2797 [01:24<07:46,  5.10batch/s, loss=1.650, lr=2.5e-05]
epoch 5/8:  15%|█▌        | 427/2797 [01:24<07:36,  5.19batch/s, loss=1.650, lr=2.5e-05]
epoch 5/8:  16%|█▌        | 438/2797 [01:26<07:34,  5.19batch/s, loss=1.650, lr=2.5e-05]
epoch 5/8:  16%|█▌        | 449/2797 [01:28<07:34,  5.16batch/s, loss=1.650, lr=2.5e-05]
epoch 5/8:  16%|█▌        | 449/2797 [01:29<07:34,  5.16batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  16%|█▋        | 460/2797 [01:30<07:25,  5.25batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  17%|█▋        | 471/2797 [01:32<07:23,  5.24batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  17%|█▋        | 471/2797 [01:33<07:23,  5.24batch/s, loss=1.651, lr=2.5e-05]
epoch 5/8:  17%|█▋        | 482/2797 [01:35<07:29,  5.15batch/s, loss=1.651, lr=2.5e-05]
epoch 5/8:  18%|█▊        | 494/2797 [01:37<07:15,  5.29batch/s, loss=1.651, lr=2.5e-05]
epoch 5/8:  18%|█▊        | 494/2797 [01:38<07:15,  5.29batch/s, loss=1.651, lr=2.5e-05]
epoch 5/8:  18%|█▊        | 505/2797 [01:39<07:26,  5.14batch/s, loss=1.651, lr=2.5e-05]
epoch 5/8:  18%|█▊        | 516/2797 [01:41<07:21,  5.16batch/s, loss=1.651, lr=2.5e-05]
epoch 5/8:  18%|█▊        | 516/2797 [01:43<07:21,  5.16batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  19%|█▉        | 527/2797 [01:43<07:26,  5.08batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  19%|█▉        | 538/2797 [01:45<07:17,  5.17batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  20%|█▉        | 549/2797 [01:48<07:23,  5.07batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  20%|█▉        | 549/2797 [01:48<07:23,  5.07batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  20%|██        | 560/2797 [01:50<07:22,  5.05batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  20%|██        | 571/2797 [01:52<07:20,  5.05batch/s, loss=1.648, lr=2.5e-05]
epoch 5/8:  20%|██        | 571/2797 [01:53<07:20,  5.05batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  21%|██        | 582/2797 [01:54<07:24,  4.98batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  21%|██        | 594/2797 [01:57<07:07,  5.15batch/s, loss=1.649, lr=2.5e-05]
epoch 5/8:  21%|██        | 594/2797 [01:58<07:07,  5.15batch/s, loss=1.652, lr=2.5e-05]
epoch 5/8:  22%|██▏       | 605/2797 [01:59<07:08,  5.12batch/s, loss=1.652, lr=2.5e-05]
epoch 5/8:  22%|██▏       | 616/2797 [02:01<07:09,  5.08batch/s, loss=1.652, lr=2.5e-05]
epoch 5/8:  22%|██▏       | 616/2797 [02:03<07:09,  5.08batch/s, loss=1.653, lr=2.5e-05]
epoch 5/8:  22%|██▏       | 627/2797 [02:03<07:07,  5.08batch/s, loss=1.653, lr=2.5e-05]
epoch 5/8:  23%|██▎       | 638/2797 [02:05<07:13,  4.98batch/s, loss=1.653, lr=2.5e-05]
epoch 5/8:  23%|██▎       | 648/2797 [02:07<07:13,  4.95batch/s, loss=1.653, lr=2.5e-05]
epoch 5/8:  23%|██▎       | 648/2797 [02:08<07:13,  4.95batch/s, loss=1.654, lr=2.5e-05]
epoch 5/8:  24%|██▎       | 659/2797 [02:09<07:02,  5.06batch/s, loss=1.654, lr=2.5e-05]
epoch 5/8:  24%|██▍       | 670/2797 [02:12<07:06,  4.99batch/s, loss=1.654, lr=2.5e-05]
epoch 5/8:  24%|██▍       | 670/2797 [02:13<07:06,  4.99batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  24%|██▍       | 680/2797 [02:14<07:11,  4.91batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  25%|██▍       | 691/2797 [02:16<07:03,  4.97batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  25%|██▍       | 691/2797 [02:18<07:03,  4.97batch/s, loss=1.657, lr=2.5e-05]
epoch 5/8:  25%|██▌       | 703/2797 [02:18<06:49,  5.11batch/s, loss=1.657, lr=2.5e-05]
epoch 5/8:  26%|██▌       | 714/2797 [02:20<06:51,  5.06batch/s, loss=1.657, lr=2.5e-05]
epoch 5/8:  26%|██▌       | 725/2797 [02:23<06:51,  5.03batch/s, loss=1.657, lr=2.5e-05]
epoch 5/8:  26%|██▌       | 725/2797 [02:23<06:51,  5.03batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  26%|██▋       | 736/2797 [02:25<06:50,  5.02batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  27%|██▋       | 747/2797 [02:27<06:52,  4.97batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  27%|██▋       | 747/2797 [02:28<06:52,  4.97batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  27%|██▋       | 758/2797 [02:29<06:41,  5.08batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  27%|██▋       | 769/2797 [02:31<06:45,  5.00batch/s, loss=1.656, lr=2.5e-05]
epoch 5/8:  27%|██▋       | 769/2797 [02:33<06:45,  5.00batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  28%|██▊       | 780/2797 [02:34<06:56,  4.85batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  28%|██▊       | 792/2797 [02:36<06:35,  5.07batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  28%|██▊       | 792/2797 [02:38<06:35,  5.07batch/s, loss=1.656, lr=2.4e-05]
epoch 5/8:  29%|██▊       | 803/2797 [02:38<06:34,  5.06batch/s, loss=1.656, lr=2.4e-05]
epoch 5/8:  29%|██▉       | 814/2797 [02:40<06:25,  5.14batch/s, loss=1.656, lr=2.4e-05]
epoch 5/8:  29%|██▉       | 814/2797 [02:42<06:25,  5.14batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  30%|██▉       | 826/2797 [02:42<06:13,  5.27batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  30%|██▉       | 837/2797 [02:45<06:30,  5.02batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  30%|███       | 848/2797 [02:47<06:25,  5.05batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  30%|███       | 848/2797 [02:48<06:25,  5.05batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  31%|███       | 859/2797 [02:49<06:20,  5.09batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  31%|███       | 870/2797 [02:51<06:23,  5.03batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  31%|███       | 870/2797 [02:52<06:23,  5.03batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  31%|███▏      | 881/2797 [02:53<06:14,  5.12batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  32%|███▏      | 892/2797 [02:56<06:10,  5.14batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  32%|███▏      | 892/2797 [02:57<06:10,  5.14batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  32%|███▏      | 903/2797 [02:58<06:08,  5.15batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  33%|███▎      | 915/2797 [03:00<05:52,  5.34batch/s, loss=1.655, lr=2.4e-05]
epoch 5/8:  33%|███▎      | 915/2797 [03:02<05:52,  5.34batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  33%|███▎      | 926/2797 [03:02<05:51,  5.32batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  34%|███▎      | 937/2797 [03:04<05:47,  5.35batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  34%|███▍      | 949/2797 [03:06<05:35,  5.50batch/s, loss=1.654, lr=2.4e-05]
epoch 5/8:  34%|███▍      | 949/2797 [03:06<05:35,  5.50batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  34%|███▍      | 961/2797 [03:08<05:49,  5.26batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  35%|███▍      | 972/2797 [03:10<05:43,  5.32batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  35%|███▍      | 972/2797 [03:11<05:43,  5.32batch/s, loss=1.651, lr=2.4e-05]
epoch 5/8:  35%|███▌      | 983/2797 [03:13<06:00,  5.03batch/s, loss=1.651, lr=2.4e-05]
epoch 5/8:  36%|███▌      | 994/2797 [03:15<05:57,  5.04batch/s, loss=1.651, lr=2.4e-05]
epoch 5/8:  36%|███▌      | 994/2797 [03:17<05:57,  5.04batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  36%|███▌      | 1005/2797 [03:17<05:58,  5.00batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  36%|███▋      | 1016/2797 [03:19<05:50,  5.08batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  36%|███▋      | 1016/2797 [03:22<05:50,  5.08batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  37%|███▋      | 1027/2797 [03:22<05:56,  4.97batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  37%|███▋      | 1037/2797 [03:24<05:56,  4.94batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  37%|███▋      | 1048/2797 [03:26<05:51,  4.98batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  37%|███▋      | 1048/2797 [03:27<05:51,  4.98batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  38%|███▊      | 1059/2797 [03:28<05:49,  4.97batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  38%|███▊      | 1069/2797 [03:30<05:51,  4.92batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  38%|███▊      | 1069/2797 [03:32<05:51,  4.92batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  39%|███▊      | 1079/2797 [03:32<05:48,  4.93batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  39%|███▉      | 1090/2797 [03:34<05:40,  5.02batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  39%|███▉      | 1090/2797 [03:37<05:40,  5.02batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  39%|███▉      | 1101/2797 [03:37<05:37,  5.03batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  40%|███▉      | 1112/2797 [03:39<05:36,  5.00batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  40%|████      | 1123/2797 [03:41<05:35,  5.00batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  40%|████      | 1123/2797 [03:42<05:35,  5.00batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  41%|████      | 1134/2797 [03:43<05:25,  5.12batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  41%|████      | 1145/2797 [03:45<05:21,  5.14batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  41%|████      | 1145/2797 [03:46<05:21,  5.14batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  41%|████▏     | 1156/2797 [03:47<05:13,  5.23batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  42%|████▏     | 1167/2797 [03:49<05:12,  5.22batch/s, loss=1.653, lr=2.4e-05]
epoch 5/8:  42%|████▏     | 1167/2797 [03:51<05:12,  5.22batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  42%|████▏     | 1179/2797 [03:51<05:02,  5.34batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  43%|████▎     | 1191/2797 [03:54<04:55,  5.44batch/s, loss=1.652, lr=2.4e-05]
epoch 5/8:  43%|████▎     | 1191/2797 [03:56<04:55,  5.44batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  43%|████▎     | 1202/2797 [03:56<05:06,  5.21batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  43%|████▎     | 1213/2797 [03:58<05:06,  5.17batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  44%|████▍     | 1224/2797 [04:00<05:09,  5.08batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  44%|████▍     | 1224/2797 [04:01<05:09,  5.08batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  44%|████▍     | 1235/2797 [04:03<05:11,  5.02batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  45%|████▍     | 1246/2797 [04:05<05:06,  5.06batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  45%|████▍     | 1246/2797 [04:06<05:06,  5.06batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  45%|████▍     | 1257/2797 [04:07<05:06,  5.03batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  45%|████▌     | 1268/2797 [04:09<05:05,  5.01batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  45%|████▌     | 1268/2797 [04:11<05:05,  5.01batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  46%|████▌     | 1279/2797 [04:11<05:01,  5.03batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  46%|████▌     | 1290/2797 [04:13<04:57,  5.07batch/s, loss=1.652, lr=2.3e-05]
epoch 5/8:  46%|████▌     | 1290/2797 [04:15<04:57,  5.07batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  47%|████▋     | 1302/2797 [04:16<04:49,  5.16batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  47%|████▋     | 1313/2797 [04:18<04:51,  5.09batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  47%|████▋     | 1324/2797 [04:20<04:44,  5.17batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  47%|████▋     | 1324/2797 [04:20<04:44,  5.17batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  48%|████▊     | 1335/2797 [04:22<04:44,  5.14batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  48%|████▊     | 1346/2797 [04:24<04:49,  5.00batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  48%|████▊     | 1346/2797 [04:25<04:49,  5.00batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  49%|████▊     | 1357/2797 [04:27<04:43,  5.07batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  49%|████▉     | 1369/2797 [04:29<04:30,  5.28batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  49%|████▉     | 1369/2797 [04:30<04:30,  5.28batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  49%|████▉     | 1380/2797 [04:31<04:26,  5.32batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  50%|████▉     | 1391/2797 [04:33<04:30,  5.20batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  50%|████▉     | 1391/2797 [04:35<04:30,  5.20batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  50%|█████     | 1402/2797 [04:35<04:27,  5.22batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  51%|█████     | 1414/2797 [04:37<04:21,  5.29batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  51%|█████     | 1425/2797 [04:39<04:20,  5.27batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  51%|█████     | 1425/2797 [04:39<04:20,  5.27batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  51%|█████▏    | 1436/2797 [04:41<04:23,  5.17batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  52%|█████▏    | 1447/2797 [04:44<04:22,  5.14batch/s, loss=1.651, lr=2.3e-05]
epoch 5/8:  52%|█████▏    | 1447/2797 [04:44<04:22,  5.14batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  52%|█████▏    | 1458/2797 [04:46<04:23,  5.08batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  53%|█████▎    | 1469/2797 [04:48<04:18,  5.13batch/s, loss=1.650, lr=2.3e-05]
epoch 5/8:  53%|█████▎    | 1469/2797 [04:49<04:18,  5.13batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  53%|█████▎    | 1480/2797 [04:50<04:15,  5.16batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  53%|█████▎    | 1491/2797 [04:52<04:12,  5.16batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  53%|█████▎    | 1491/2797 [04:54<04:12,  5.16batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  54%|█████▎    | 1502/2797 [04:54<04:09,  5.18batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  54%|█████▍    | 1513/2797 [04:56<04:06,  5.21batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  54%|█████▍    | 1524/2797 [04:59<04:04,  5.20batch/s, loss=1.649, lr=2.3e-05]
epoch 5/8:  54%|█████▍    | 1524/2797 [04:59<04:04,  5.20batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  55%|█████▍    | 1536/2797 [05:01<03:55,  5.34batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  55%|█████▌    | 1547/2797 [05:03<03:54,  5.32batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  55%|█████▌    | 1547/2797 [05:03<03:54,  5.32batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  56%|█████▌    | 1558/2797 [05:05<03:55,  5.27batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  56%|█████▌    | 1569/2797 [05:07<04:00,  5.11batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  56%|█████▌    | 1569/2797 [05:08<04:00,  5.11batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  56%|█████▋    | 1580/2797 [05:09<03:56,  5.16batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  57%|█████▋    | 1591/2797 [05:11<03:51,  5.20batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  57%|█████▋    | 1591/2797 [05:13<03:51,  5.20batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  57%|█████▋    | 1602/2797 [05:14<03:57,  5.03batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  58%|█████▊    | 1613/2797 [05:16<03:58,  4.97batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  58%|█████▊    | 1623/2797 [05:18<03:56,  4.96batch/s, loss=1.648, lr=2.3e-05]
epoch 5/8:  58%|█████▊    | 1623/2797 [05:19<03:56,  4.96batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  58%|█████▊    | 1634/2797 [05:20<03:53,  4.98batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  59%|█████▉    | 1644/2797 [05:22<03:55,  4.89batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  59%|█████▉    | 1644/2797 [05:24<03:55,  4.89batch/s, loss=1.650, lr=2.2e-05]
epoch 5/8:  59%|█████▉    | 1654/2797 [05:24<03:52,  4.92batch/s, loss=1.650, lr=2.2e-05]
epoch 5/8:  59%|█████▉    | 1664/2797 [05:26<03:49,  4.93batch/s, loss=1.650, lr=2.2e-05]
epoch 5/8:  60%|█████▉    | 1675/2797 [05:28<03:43,  5.03batch/s, loss=1.650, lr=2.2e-05]
epoch 5/8:  60%|█████▉    | 1675/2797 [05:29<03:43,  5.03batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  60%|██████    | 1686/2797 [05:31<03:44,  4.94batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  61%|██████    | 1696/2797 [05:33<03:42,  4.94batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  61%|██████    | 1696/2797 [05:34<03:42,  4.94batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  61%|██████    | 1706/2797 [05:35<03:43,  4.88batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  61%|██████▏   | 1717/2797 [05:37<03:36,  4.99batch/s, loss=1.649, lr=2.2e-05]
epoch 5/8:  61%|██████▏   | 1717/2797 [05:39<03:36,  4.99batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  62%|██████▏   | 1729/2797 [05:39<03:27,  5.15batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  62%|██████▏   | 1740/2797 [05:41<03:31,  5.01batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  62%|██████▏   | 1740/2797 [05:44<03:31,  5.01batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  63%|██████▎   | 1751/2797 [05:44<03:29,  4.99batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  63%|██████▎   | 1761/2797 [05:46<03:27,  4.99batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  63%|██████▎   | 1771/2797 [05:48<03:26,  4.98batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  63%|██████▎   | 1771/2797 [05:49<03:26,  4.98batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  64%|██████▎   | 1781/2797 [05:50<03:23,  4.98batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  64%|██████▍   | 1792/2797 [05:52<03:21,  4.98batch/s, loss=1.648, lr=2.2e-05]
epoch 5/8:  64%|██████▍   | 1792/2797 [05:54<03:21,  4.98batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  64%|██████▍   | 1804/2797 [05:54<03:08,  5.26batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  65%|██████▍   | 1815/2797 [05:56<03:06,  5.26batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  65%|██████▍   | 1815/2797 [05:58<03:06,  5.26batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  65%|██████▌   | 1827/2797 [05:58<02:59,  5.39batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  66%|██████▌   | 1838/2797 [06:00<02:58,  5.37batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  66%|██████▌   | 1849/2797 [06:02<02:56,  5.36batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  66%|██████▌   | 1849/2797 [06:03<02:56,  5.36batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  66%|██████▋   | 1860/2797 [06:05<03:01,  5.17batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  67%|██████▋   | 1871/2797 [06:07<02:57,  5.22batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  67%|██████▋   | 1871/2797 [06:08<02:57,  5.22batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  67%|██████▋   | 1882/2797 [06:09<02:59,  5.08batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  68%|██████▊   | 1895/2797 [06:11<02:46,  5.40batch/s, loss=1.647, lr=2.2e-05]
epoch 5/8:  68%|██████▊   | 1895/2797 [06:12<02:46,  5.40batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  68%|██████▊   | 1906/2797 [06:13<02:47,  5.31batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  69%|██████▊   | 1917/2797 [06:15<02:46,  5.29batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  69%|██████▊   | 1917/2797 [06:17<02:46,  5.29batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  69%|██████▉   | 1928/2797 [06:18<02:51,  5.06batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  69%|██████▉   | 1939/2797 [06:20<02:46,  5.14batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  70%|██████▉   | 1950/2797 [06:22<02:44,  5.16batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  70%|██████▉   | 1950/2797 [06:22<02:44,  5.16batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  70%|███████   | 1961/2797 [06:24<02:41,  5.17batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  71%|███████   | 1972/2797 [06:26<02:43,  5.06batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  71%|███████   | 1972/2797 [06:27<02:43,  5.06batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  71%|███████   | 1983/2797 [06:29<02:43,  4.99batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  71%|███████▏  | 1994/2797 [06:31<02:38,  5.07batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  71%|███████▏  | 1994/2797 [06:32<02:38,  5.07batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  72%|███████▏  | 2005/2797 [06:33<02:36,  5.07batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  72%|███████▏  | 2016/2797 [06:35<02:35,  5.03batch/s, loss=1.646, lr=2.2e-05]
epoch 5/8:  72%|███████▏  | 2016/2797 [06:37<02:35,  5.03batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  72%|███████▏  | 2027/2797 [06:37<02:33,  5.02batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  73%|███████▎  | 2038/2797 [06:39<02:27,  5.14batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  73%|███████▎  | 2049/2797 [06:41<02:22,  5.24batch/s, loss=1.645, lr=2.2e-05]
epoch 5/8:  73%|███████▎  | 2049/2797 [06:42<02:22,  5.24batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  74%|███████▎  | 2060/2797 [06:44<02:24,  5.10batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  74%|███████▍  | 2071/2797 [06:46<02:19,  5.21batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  74%|███████▍  | 2071/2797 [06:47<02:19,  5.21batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  74%|███████▍  | 2082/2797 [06:48<02:23,  4.99batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  75%|███████▍  | 2094/2797 [06:50<02:13,  5.25batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  75%|███████▍  | 2094/2797 [06:52<02:13,  5.25batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  75%|███████▌  | 2105/2797 [06:52<02:17,  5.03batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  76%|███████▌  | 2116/2797 [06:54<02:13,  5.11batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  76%|███████▌  | 2116/2797 [06:56<02:13,  5.11batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  76%|███████▌  | 2127/2797 [06:57<02:12,  5.07batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  76%|███████▋  | 2138/2797 [06:59<02:08,  5.14batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  77%|███████▋  | 2149/2797 [07:01<02:07,  5.09batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  77%|███████▋  | 2149/2797 [07:01<02:07,  5.09batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  77%|███████▋  | 2161/2797 [07:03<02:01,  5.24batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  78%|███████▊  | 2173/2797 [07:05<01:56,  5.37batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  78%|███████▊  | 2173/2797 [07:06<01:56,  5.37batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  78%|███████▊  | 2184/2797 [07:08<02:07,  4.81batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  78%|███████▊  | 2195/2797 [07:10<02:04,  4.84batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  78%|███████▊  | 2195/2797 [07:12<02:04,  4.84batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  79%|███████▉  | 2205/2797 [07:12<02:03,  4.80batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  79%|███████▉  | 2217/2797 [07:15<01:55,  5.01batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  79%|███████▉  | 2217/2797 [07:17<01:55,  5.01batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  80%|███████▉  | 2228/2797 [07:17<01:58,  4.82batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  80%|████████  | 2239/2797 [07:19<01:52,  4.95batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  80%|████████  | 2250/2797 [07:21<01:50,  4.95batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  80%|████████  | 2250/2797 [07:22<01:50,  4.95batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  81%|████████  | 2260/2797 [07:23<01:48,  4.96batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  81%|████████  | 2272/2797 [07:25<01:40,  5.22batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  81%|████████  | 2272/2797 [07:26<01:40,  5.22batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  82%|████████▏ | 2283/2797 [07:28<01:39,  5.19batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  82%|████████▏ | 2294/2797 [07:30<01:39,  5.08batch/s, loss=1.645, lr=2.1e-05]
epoch 5/8:  82%|████████▏ | 2294/2797 [07:32<01:39,  5.08batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  82%|████████▏ | 2305/2797 [07:32<01:41,  4.84batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  83%|████████▎ | 2315/2797 [07:34<01:39,  4.86batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  83%|████████▎ | 2315/2797 [07:36<01:39,  4.86batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  83%|████████▎ | 2327/2797 [07:37<01:32,  5.06batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  84%|████████▎ | 2339/2797 [07:39<01:27,  5.23batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  84%|████████▍ | 2350/2797 [07:41<01:27,  5.12batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  84%|████████▍ | 2350/2797 [07:41<01:27,  5.12batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  84%|████████▍ | 2361/2797 [07:43<01:23,  5.21batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  85%|████████▍ | 2372/2797 [07:45<01:20,  5.29batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  85%|████████▍ | 2372/2797 [07:46<01:20,  5.29batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  85%|████████▌ | 2383/2797 [07:47<01:20,  5.17batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  86%|████████▌ | 2394/2797 [07:50<01:20,  4.99batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  86%|████████▌ | 2394/2797 [07:51<01:20,  4.99batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  86%|████████▌ | 2405/2797 [07:52<01:17,  5.03batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  86%|████████▋ | 2416/2797 [07:54<01:14,  5.09batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  86%|████████▋ | 2416/2797 [07:56<01:14,  5.09batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  87%|████████▋ | 2427/2797 [07:56<01:12,  5.07batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  87%|████████▋ | 2438/2797 [07:58<01:09,  5.18batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  88%|████████▊ | 2449/2797 [08:00<01:06,  5.20batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  88%|████████▊ | 2449/2797 [08:01<01:06,  5.20batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  88%|████████▊ | 2460/2797 [08:02<01:04,  5.21batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  88%|████████▊ | 2471/2797 [08:04<01:01,  5.27batch/s, loss=1.646, lr=2.1e-05]
epoch 5/8:  88%|████████▊ | 2471/2797 [08:05<01:01,  5.27batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  89%|████████▊ | 2482/2797 [08:07<01:01,  5.12batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  89%|████████▉ | 2493/2797 [08:09<00:58,  5.16batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  89%|████████▉ | 2493/2797 [08:11<00:58,  5.16batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  90%|████████▉ | 2504/2797 [08:11<00:59,  4.95batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  90%|████████▉ | 2515/2797 [08:13<00:56,  4.96batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  90%|████████▉ | 2515/2797 [08:15<00:56,  4.96batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  90%|█████████ | 2527/2797 [08:16<00:52,  5.17batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  91%|█████████ | 2538/2797 [08:18<00:49,  5.22batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  91%|█████████ | 2549/2797 [08:20<00:48,  5.15batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  91%|█████████ | 2549/2797 [08:20<00:48,  5.15batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  92%|█████████▏| 2561/2797 [08:22<00:44,  5.32batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  92%|█████████▏| 2572/2797 [08:24<00:42,  5.35batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  92%|█████████▏| 2572/2797 [08:25<00:42,  5.35batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  92%|█████████▏| 2583/2797 [08:26<00:40,  5.25batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  93%|█████████▎| 2594/2797 [08:28<00:40,  5.04batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  93%|█████████▎| 2594/2797 [08:30<00:40,  5.04batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  93%|█████████▎| 2605/2797 [08:31<00:37,  5.11batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  94%|█████████▎| 2616/2797 [08:33<00:35,  5.08batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  94%|█████████▎| 2616/2797 [08:35<00:35,  5.08batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  94%|█████████▍| 2627/2797 [08:35<00:33,  5.09batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  94%|█████████▍| 2638/2797 [08:37<00:31,  5.08batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  95%|█████████▍| 2649/2797 [08:39<00:29,  5.07batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  95%|█████████▍| 2649/2797 [08:40<00:29,  5.07batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  95%|█████████▌| 2660/2797 [08:41<00:26,  5.08batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  95%|█████████▌| 2671/2797 [08:44<00:24,  5.11batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  95%|█████████▌| 2671/2797 [08:44<00:24,  5.11batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  96%|█████████▌| 2682/2797 [08:46<00:22,  5.21batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  96%|█████████▋| 2693/2797 [08:48<00:20,  5.12batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  96%|█████████▋| 2693/2797 [08:49<00:20,  5.12batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  97%|█████████▋| 2704/2797 [08:50<00:18,  5.14batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  97%|█████████▋| 2716/2797 [08:52<00:15,  5.26batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  97%|█████████▋| 2716/2797 [08:54<00:15,  5.26batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  97%|█████████▋| 2727/2797 [08:54<00:13,  5.24batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  98%|█████████▊| 2738/2797 [08:56<00:11,  5.27batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  98%|█████████▊| 2749/2797 [08:58<00:09,  5.27batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  98%|█████████▊| 2749/2797 [08:59<00:09,  5.27batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  99%|█████████▊| 2760/2797 [09:00<00:06,  5.29batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  99%|█████████▉| 2771/2797 [09:03<00:05,  5.14batch/s, loss=1.646, lr=2.0e-05]
epoch 5/8:  99%|█████████▉| 2771/2797 [09:04<00:05,  5.14batch/s, loss=1.645, lr=2.0e-05]
epoch 5/8:  99%|█████████▉| 2782/2797 [09:05<00:02,  5.01batch/s, loss=1.645, lr=2.0e-05]
epoch 5/8: 100%|█████████▉| 2793/2797 [09:07<00:00,  4.89batch/s, loss=1.645, lr=2.0e-05]
epoch 5/8: 100%|██████████| 2797/2797 [09:08<00:00,  5.10batch/s, loss=1.645, lr=2.0e-05]
epoch 5: train loss 1.645 · validation loss 2.096 · broad 81.3% (top-3 95.1%) · path 72.4% (top-3 89.3%, plausible or look-alike 88.1%) · 2949s elapsed

epoch 6/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 6/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=1.375, lr=2.0e-05]
epoch 6/8:   0%|          | 11/2797 [00:02<08:39,  5.36batch/s, loss=1.375, lr=2.0e-05]
epoch 6/8:   1%|          | 22/2797 [00:04<08:50,  5.23batch/s, loss=1.375, lr=2.0e-05]
epoch 6/8:   1%|          | 22/2797 [00:04<08:50,  5.23batch/s, loss=1.575, lr=2.0e-05]
epoch 6/8:   1%|          | 33/2797 [00:06<09:00,  5.12batch/s, loss=1.575, lr=2.0e-05]
epoch 6/8:   2%|▏         | 44/2797 [00:08<09:00,  5.09batch/s, loss=1.575, lr=2.0e-05]
epoch 6/8:   2%|▏         | 44/2797 [00:09<09:00,  5.09batch/s, loss=1.595, lr=2.0e-05]
epoch 6/8:   2%|▏         | 55/2797 [00:10<08:55,  5.12batch/s, loss=1.595, lr=2.0e-05]
epoch 6/8:   2%|▏         | 66/2797 [00:12<08:58,  5.07batch/s, loss=1.595, lr=2.0e-05]
epoch 6/8:   2%|▏         | 66/2797 [00:14<08:58,  5.07batch/s, loss=1.587, lr=2.0e-05]
epoch 6/8:   3%|▎         | 77/2797 [00:15<08:55,  5.08batch/s, loss=1.587, lr=2.0e-05]
epoch 6/8:   3%|▎         | 88/2797 [00:17<09:03,  4.99batch/s, loss=1.587, lr=2.0e-05]
epoch 6/8:   4%|▎         | 99/2797 [00:19<08:53,  5.05batch/s, loss=1.587, lr=2.0e-05]
epoch 6/8:   4%|▎         | 99/2797 [00:19<08:53,  5.05batch/s, loss=1.587, lr=1.9e-05]
epoch 6/8:   4%|▍         | 110/2797 [00:21<08:51,  5.06batch/s, loss=1.587, lr=1.9e-05]
epoch 6/8:   4%|▍         | 121/2797 [00:23<08:55,  4.99batch/s, loss=1.587, lr=1.9e-05]
epoch 6/8:   4%|▍         | 121/2797 [00:24<08:55,  4.99batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:   5%|▍         | 131/2797 [00:26<09:03,  4.90batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:   5%|▌         | 142/2797 [00:28<08:53,  4.97batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:   5%|▌         | 142/2797 [00:30<08:53,  4.97batch/s, loss=1.581, lr=1.9e-05]
epoch 6/8:   5%|▌         | 152/2797 [00:30<09:03,  4.87batch/s, loss=1.581, lr=1.9e-05]
epoch 6/8:   6%|▌         | 163/2797 [00:32<08:52,  4.95batch/s, loss=1.581, lr=1.9e-05]
epoch 6/8:   6%|▌         | 173/2797 [00:34<08:51,  4.94batch/s, loss=1.581, lr=1.9e-05]
epoch 6/8:   6%|▌         | 173/2797 [00:35<08:51,  4.94batch/s, loss=1.584, lr=1.9e-05]
epoch 6/8:   7%|▋         | 184/2797 [00:36<08:45,  4.98batch/s, loss=1.584, lr=1.9e-05]
epoch 6/8:   7%|▋         | 195/2797 [00:38<08:36,  5.03batch/s, loss=1.584, lr=1.9e-05]
epoch 6/8:   7%|▋         | 195/2797 [00:40<08:36,  5.03batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:   7%|▋         | 206/2797 [00:41<08:48,  4.91batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:   8%|▊         | 217/2797 [00:43<08:35,  5.01batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:   8%|▊         | 217/2797 [00:44<08:35,  5.01batch/s, loss=1.573, lr=1.9e-05]
epoch 6/8:   8%|▊         | 229/2797 [00:45<08:14,  5.19batch/s, loss=1.573, lr=1.9e-05]
epoch 6/8:   9%|▊         | 240/2797 [00:47<08:30,  5.00batch/s, loss=1.573, lr=1.9e-05]
epoch 6/8:   9%|▊         | 240/2797 [00:50<08:30,  5.00batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:   9%|▉         | 251/2797 [00:50<08:32,  4.97batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:   9%|▉         | 262/2797 [00:52<08:28,  4.98batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:  10%|▉         | 272/2797 [00:54<08:35,  4.90batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:  10%|▉         | 272/2797 [00:55<08:35,  4.90batch/s, loss=1.576, lr=1.9e-05]
epoch 6/8:  10%|█         | 283/2797 [00:56<08:22,  5.01batch/s, loss=1.576, lr=1.9e-05]
epoch 6/8:  11%|█         | 294/2797 [00:58<08:11,  5.09batch/s, loss=1.576, lr=1.9e-05]
epoch 6/8:  11%|█         | 294/2797 [00:59<08:11,  5.09batch/s, loss=1.578, lr=1.9e-05]
epoch 6/8:  11%|█         | 305/2797 [01:00<08:01,  5.18batch/s, loss=1.578, lr=1.9e-05]
epoch 6/8:  11%|█▏        | 316/2797 [01:03<08:19,  4.96batch/s, loss=1.578, lr=1.9e-05]
epoch 6/8:  11%|█▏        | 316/2797 [01:05<08:19,  4.96batch/s, loss=1.583, lr=1.9e-05]
epoch 6/8:  12%|█▏        | 326/2797 [01:05<08:19,  4.95batch/s, loss=1.583, lr=1.9e-05]
epoch 6/8:  12%|█▏        | 336/2797 [01:07<08:16,  4.96batch/s, loss=1.583, lr=1.9e-05]
epoch 6/8:  12%|█▏        | 347/2797 [01:09<08:05,  5.05batch/s, loss=1.583, lr=1.9e-05]
epoch 6/8:  12%|█▏        | 347/2797 [01:10<08:05,  5.05batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  13%|█▎        | 358/2797 [01:11<08:11,  4.96batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  13%|█▎        | 370/2797 [01:13<07:48,  5.18batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  13%|█▎        | 370/2797 [01:14<07:48,  5.18batch/s, loss=1.580, lr=1.9e-05]
epoch 6/8:  14%|█▎        | 381/2797 [01:15<07:40,  5.24batch/s, loss=1.580, lr=1.9e-05]
epoch 6/8:  14%|█▍        | 392/2797 [01:17<07:33,  5.30batch/s, loss=1.580, lr=1.9e-05]
epoch 6/8:  14%|█▍        | 392/2797 [01:19<07:33,  5.30batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  14%|█▍        | 403/2797 [01:19<07:38,  5.22batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  15%|█▍        | 414/2797 [01:21<07:37,  5.21batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  15%|█▌        | 425/2797 [01:24<07:37,  5.19batch/s, loss=1.582, lr=1.9e-05]
epoch 6/8:  15%|█▌        | 425/2797 [01:24<07:37,  5.19batch/s, loss=1.580, lr=1.9e-05]
epoch 6/8:  16%|█▌        | 436/2797 [01:26<07:29,  5.25batch/s, loss=1.580, lr=1.9e-05]
epoch 6/8:  16%|█▌        | 447/2797 [01:28<07:38,  5.12batch/s, loss=1.580, lr=1.9e-05]
epoch 6/8:  16%|█▌        | 447/2797 [01:29<07:38,  5.12batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  16%|█▋        | 458/2797 [01:30<07:50,  4.97batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  17%|█▋        | 468/2797 [01:32<08:00,  4.85batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  17%|█▋        | 468/2797 [01:34<08:00,  4.85batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  17%|█▋        | 479/2797 [01:35<07:52,  4.91batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  17%|█▋        | 489/2797 [01:37<08:03,  4.77batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  18%|█▊        | 499/2797 [01:39<07:57,  4.81batch/s, loss=1.579, lr=1.9e-05]
epoch 6/8:  18%|█▊        | 499/2797 [01:39<07:57,  4.81batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:  18%|█▊        | 511/2797 [01:41<07:30,  5.08batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:  19%|█▊        | 522/2797 [01:43<07:29,  5.06batch/s, loss=1.575, lr=1.9e-05]
epoch 6/8:  19%|█▊        | 522/2797 [01:44<07:29,  5.06batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  19%|█▉        | 533/2797 [01:45<07:17,  5.18batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  19%|█▉        | 544/2797 [01:47<07:23,  5.08batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  19%|█▉        | 544/2797 [01:49<07:23,  5.08batch/s, loss=1.576, lr=1.8e-05]
epoch 6/8:  20%|█▉        | 555/2797 [01:49<07:13,  5.17batch/s, loss=1.576, lr=1.8e-05]
epoch 6/8:  20%|██        | 566/2797 [01:52<07:12,  5.16batch/s, loss=1.576, lr=1.8e-05]
epoch 6/8:  20%|██        | 566/2797 [01:54<07:12,  5.16batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  21%|██        | 577/2797 [01:54<07:11,  5.14batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  21%|██        | 589/2797 [01:56<07:01,  5.24batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  21%|██▏       | 600/2797 [01:58<07:09,  5.11batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  21%|██▏       | 600/2797 [01:58<07:09,  5.11batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  22%|██▏       | 611/2797 [02:00<07:10,  5.08batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  22%|██▏       | 622/2797 [02:02<06:59,  5.18batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  22%|██▏       | 622/2797 [02:03<06:59,  5.18batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  23%|██▎       | 633/2797 [02:05<07:11,  5.02batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  23%|██▎       | 644/2797 [02:07<07:04,  5.07batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  23%|██▎       | 644/2797 [02:08<07:04,  5.07batch/s, loss=1.576, lr=1.8e-05]
epoch 6/8:  23%|██▎       | 655/2797 [02:09<06:54,  5.17batch/s, loss=1.576, lr=1.8e-05]
epoch 6/8:  24%|██▍       | 667/2797 [02:11<06:46,  5.24batch/s, loss=1.576, lr=1.8e-05]
epoch 6/8:  24%|██▍       | 667/2797 [02:13<06:46,  5.24batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  24%|██▍       | 679/2797 [02:13<06:36,  5.34batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  25%|██▍       | 690/2797 [02:15<06:35,  5.33batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  25%|██▍       | 690/2797 [02:18<06:35,  5.33batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  25%|██▌       | 701/2797 [02:18<06:52,  5.09batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  25%|██▌       | 712/2797 [02:20<06:58,  4.98batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  26%|██▌       | 722/2797 [02:22<07:04,  4.88batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  26%|██▌       | 722/2797 [02:23<07:04,  4.88batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  26%|██▌       | 733/2797 [02:24<06:55,  4.97batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  27%|██▋       | 743/2797 [02:26<06:57,  4.92batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  27%|██▋       | 743/2797 [02:28<06:57,  4.92batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  27%|██▋       | 753/2797 [02:29<06:59,  4.87batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  27%|██▋       | 763/2797 [02:31<06:59,  4.85batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  28%|██▊       | 774/2797 [02:33<06:50,  4.93batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  28%|██▊       | 774/2797 [02:33<06:50,  4.93batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  28%|██▊       | 785/2797 [02:35<06:37,  5.06batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  28%|██▊       | 796/2797 [02:37<06:33,  5.09batch/s, loss=1.573, lr=1.8e-05]
epoch 6/8:  28%|██▊       | 796/2797 [02:38<06:33,  5.09batch/s, loss=1.572, lr=1.8e-05]
epoch 6/8:  29%|██▉       | 807/2797 [02:39<06:35,  5.04batch/s, loss=1.572, lr=1.8e-05]
epoch 6/8:  29%|██▉       | 818/2797 [02:41<06:23,  5.17batch/s, loss=1.572, lr=1.8e-05]
epoch 6/8:  29%|██▉       | 818/2797 [02:43<06:23,  5.17batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  30%|██▉       | 829/2797 [02:43<06:24,  5.12batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  30%|███       | 840/2797 [02:46<06:30,  5.01batch/s, loss=1.575, lr=1.8e-05]
epoch 6/8:  30%|███       | 840/2797 [02:48<06:30,  5.01batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  30%|███       | 851/2797 [02:48<06:32,  4.95batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  31%|███       | 861/2797 [02:50<06:31,  4.95batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  31%|███       | 871/2797 [02:52<06:35,  4.87batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  31%|███       | 871/2797 [02:53<06:35,  4.87batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  31%|███▏      | 881/2797 [02:54<06:37,  4.81batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  32%|███▏      | 892/2797 [02:56<06:25,  4.94batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  32%|███▏      | 892/2797 [02:58<06:25,  4.94batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  32%|███▏      | 902/2797 [02:59<06:27,  4.89batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  33%|███▎      | 915/2797 [03:01<06:00,  5.22batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  33%|███▎      | 915/2797 [03:03<06:00,  5.22batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  33%|███▎      | 926/2797 [03:03<05:53,  5.29batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  34%|███▎      | 937/2797 [03:05<05:54,  5.25batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  34%|███▍      | 948/2797 [03:07<05:53,  5.22batch/s, loss=1.574, lr=1.8e-05]
epoch 6/8:  34%|███▍      | 948/2797 [03:07<05:53,  5.22batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  34%|███▍      | 959/2797 [03:09<05:49,  5.27batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  35%|███▍      | 970/2797 [03:11<05:50,  5.22batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  35%|███▍      | 970/2797 [03:12<05:50,  5.22batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  35%|███▌      | 981/2797 [03:13<05:50,  5.18batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  35%|███▌      | 992/2797 [03:16<05:59,  5.01batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  35%|███▌      | 992/2797 [03:17<05:59,  5.01batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  36%|███▌      | 1003/2797 [03:18<05:52,  5.08batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  36%|███▋      | 1014/2797 [03:20<05:45,  5.16batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  37%|███▋      | 1025/2797 [03:22<05:53,  5.01batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  37%|███▋      | 1025/2797 [03:22<05:53,  5.01batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  37%|███▋      | 1037/2797 [03:24<05:41,  5.15batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  37%|███▋      | 1048/2797 [03:27<05:44,  5.07batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  37%|███▋      | 1048/2797 [03:27<05:44,  5.07batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  38%|███▊      | 1060/2797 [03:29<05:35,  5.18batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  38%|███▊      | 1071/2797 [03:31<05:27,  5.27batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  38%|███▊      | 1071/2797 [03:32<05:27,  5.27batch/s, loss=1.577, lr=1.7e-05]
epoch 6/8:  39%|███▊      | 1082/2797 [03:33<05:33,  5.14batch/s, loss=1.577, lr=1.7e-05]
epoch 6/8:  39%|███▉      | 1093/2797 [03:35<05:32,  5.13batch/s, loss=1.577, lr=1.7e-05]
epoch 6/8:  39%|███▉      | 1093/2797 [03:37<05:32,  5.13batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  39%|███▉      | 1104/2797 [03:38<05:35,  5.05batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  40%|███▉      | 1115/2797 [03:40<05:31,  5.07batch/s, loss=1.576, lr=1.7e-05]
epoch 6/8:  40%|███▉      | 1115/2797 [03:42<05:31,  5.07batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  40%|████      | 1126/2797 [03:42<05:38,  4.94batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  41%|████      | 1137/2797 [03:44<05:30,  5.03batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  41%|████      | 1149/2797 [03:46<05:19,  5.16batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  41%|████      | 1149/2797 [03:47<05:19,  5.16batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  41%|████▏     | 1160/2797 [03:49<05:25,  5.03batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  42%|████▏     | 1171/2797 [03:51<05:28,  4.95batch/s, loss=1.575, lr=1.7e-05]
epoch 6/8:  42%|████▏     | 1171/2797 [03:52<05:28,  4.95batch/s, loss=1.574, lr=1.7e-05]
epoch 6/8:  42%|████▏     | 1182/2797 [03:53<05:21,  5.03batch/s, loss=1.574, lr=1.7e-05]
epoch 6/8:  43%|████▎     | 1193/2797 [03:55<05:22,  4.97batch/s, loss=1.574, lr=1.7e-05]
epoch 6/8:  43%|████▎     | 1193/2797 [03:57<05:22,  4.97batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  43%|████▎     | 1203/2797 [03:57<05:20,  4.97batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  43%|████▎     | 1213/2797 [03:59<05:19,  4.95batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  44%|████▎     | 1223/2797 [04:02<05:26,  4.83batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  44%|████▎     | 1223/2797 [04:02<05:26,  4.83batch/s, loss=1.574, lr=1.7e-05]
epoch 6/8:  44%|████▍     | 1234/2797 [04:04<05:15,  4.95batch/s, loss=1.574, lr=1.7e-05]
epoch 6/8:  44%|████▍     | 1244/2797 [04:06<05:18,  4.87batch/s, loss=1.574, lr=1.7e-05]
epoch 6/8:  44%|████▍     | 1244/2797 [04:07<05:18,  4.87batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  45%|████▍     | 1255/2797 [04:08<05:09,  4.98batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  45%|████▌     | 1267/2797 [04:10<04:55,  5.17batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  45%|████▌     | 1267/2797 [04:12<04:55,  5.17batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  46%|████▌     | 1278/2797 [04:12<04:49,  5.25batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  46%|████▌     | 1289/2797 [04:14<04:44,  5.30batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  46%|████▋     | 1300/2797 [04:16<04:47,  5.21batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  46%|████▋     | 1300/2797 [04:17<04:47,  5.21batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  47%|████▋     | 1311/2797 [04:18<04:48,  5.15batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  47%|████▋     | 1322/2797 [04:21<04:45,  5.16batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  47%|████▋     | 1322/2797 [04:22<04:45,  5.16batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  48%|████▊     | 1333/2797 [04:23<04:51,  5.03batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  48%|████▊     | 1344/2797 [04:25<04:46,  5.06batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  48%|████▊     | 1344/2797 [04:26<04:46,  5.06batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  48%|████▊     | 1355/2797 [04:27<04:40,  5.14batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  49%|████▉     | 1366/2797 [04:29<04:37,  5.16batch/s, loss=1.573, lr=1.7e-05]
epoch 6/8:  49%|████▉     | 1366/2797 [04:31<04:37,  5.16batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  49%|████▉     | 1377/2797 [04:32<04:42,  5.03batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  50%|████▉     | 1388/2797 [04:34<04:41,  5.00batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  50%|█████     | 1399/2797 [04:36<04:34,  5.09batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  50%|█████     | 1399/2797 [04:36<04:34,  5.09batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  50%|█████     | 1410/2797 [04:38<04:37,  5.00batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  51%|█████     | 1422/2797 [04:40<04:25,  5.18batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  51%|█████     | 1422/2797 [04:41<04:25,  5.18batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  51%|█████     | 1433/2797 [04:43<04:28,  5.09batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  52%|█████▏    | 1444/2797 [04:45<04:24,  5.11batch/s, loss=1.573, lr=1.6e-05]
epoch 6/8:  52%|█████▏    | 1444/2797 [04:46<04:24,  5.11batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  52%|█████▏    | 1455/2797 [04:47<04:22,  5.11batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  52%|█████▏    | 1467/2797 [04:49<04:13,  5.24batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  52%|█████▏    | 1467/2797 [04:51<04:13,  5.24batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  53%|█████▎    | 1478/2797 [04:51<04:15,  5.17batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  53%|█████▎    | 1489/2797 [04:53<04:13,  5.16batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  54%|█████▎    | 1500/2797 [04:55<04:07,  5.23batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  54%|█████▎    | 1500/2797 [04:55<04:07,  5.23batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  54%|█████▍    | 1511/2797 [04:58<04:07,  5.20batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  54%|█████▍    | 1522/2797 [05:00<04:12,  5.05batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  54%|█████▍    | 1522/2797 [05:01<04:12,  5.05batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  55%|█████▍    | 1533/2797 [05:02<04:08,  5.09batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  55%|█████▌    | 1544/2797 [05:04<04:11,  4.97batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  55%|█████▌    | 1544/2797 [05:06<04:11,  4.97batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  56%|█████▌    | 1554/2797 [05:07<04:18,  4.81batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  56%|█████▌    | 1564/2797 [05:09<04:13,  4.86batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  56%|█████▋    | 1575/2797 [05:11<04:08,  4.92batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  56%|█████▋    | 1575/2797 [05:11<04:08,  4.92batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  57%|█████▋    | 1585/2797 [05:13<04:13,  4.78batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  57%|█████▋    | 1596/2797 [05:15<04:05,  4.90batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  57%|█████▋    | 1596/2797 [05:16<04:05,  4.90batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  57%|█████▋    | 1606/2797 [05:17<04:03,  4.88batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  58%|█████▊    | 1617/2797 [05:19<03:54,  5.03batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  58%|█████▊    | 1617/2797 [05:21<03:54,  5.03batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  58%|█████▊    | 1628/2797 [05:21<03:50,  5.08batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  59%|█████▊    | 1639/2797 [05:23<03:48,  5.06batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  59%|█████▉    | 1650/2797 [05:26<03:47,  5.05batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  59%|█████▉    | 1650/2797 [05:26<03:47,  5.05batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  59%|█████▉    | 1661/2797 [05:28<03:43,  5.08batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  60%|█████▉    | 1672/2797 [05:30<03:45,  4.99batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  60%|█████▉    | 1672/2797 [05:31<03:45,  4.99batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  60%|██████    | 1683/2797 [05:32<03:38,  5.10batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  61%|██████    | 1694/2797 [05:34<03:40,  5.01batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  61%|██████    | 1694/2797 [05:36<03:40,  5.01batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  61%|██████    | 1705/2797 [05:37<03:37,  5.03batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  61%|██████▏   | 1716/2797 [05:39<03:30,  5.14batch/s, loss=1.576, lr=1.6e-05]
epoch 6/8:  61%|██████▏   | 1716/2797 [05:41<03:30,  5.14batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  62%|██████▏   | 1727/2797 [05:41<03:26,  5.18batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  62%|██████▏   | 1738/2797 [05:43<03:23,  5.22batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  63%|██████▎   | 1749/2797 [05:45<03:20,  5.24batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  63%|██████▎   | 1749/2797 [05:45<03:20,  5.24batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  63%|██████▎   | 1760/2797 [05:47<03:20,  5.18batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  63%|██████▎   | 1771/2797 [05:49<03:19,  5.14batch/s, loss=1.575, lr=1.6e-05]
epoch 6/8:  63%|██████▎   | 1771/2797 [05:50<03:19,  5.14batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  64%|██████▎   | 1782/2797 [05:51<03:20,  5.07batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  64%|██████▍   | 1793/2797 [05:54<03:16,  5.12batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  64%|██████▍   | 1793/2797 [05:55<03:16,  5.12batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  64%|██████▍   | 1804/2797 [05:56<03:16,  5.07batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  65%|██████▍   | 1815/2797 [05:58<03:10,  5.16batch/s, loss=1.574, lr=1.6e-05]
epoch 6/8:  65%|██████▍   | 1815/2797 [06:00<03:10,  5.16batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  65%|██████▌   | 1826/2797 [06:00<03:13,  5.01batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  66%|██████▌   | 1837/2797 [06:02<03:11,  5.01batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  66%|██████▌   | 1848/2797 [06:05<03:11,  4.96batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  66%|██████▌   | 1848/2797 [06:05<03:11,  4.96batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  66%|██████▋   | 1858/2797 [06:07<03:12,  4.88batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  67%|██████▋   | 1869/2797 [06:09<03:06,  4.99batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  67%|██████▋   | 1869/2797 [06:10<03:06,  4.99batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  67%|██████▋   | 1880/2797 [06:11<02:58,  5.13batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  68%|██████▊   | 1891/2797 [06:13<02:53,  5.22batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  68%|██████▊   | 1891/2797 [06:15<02:53,  5.22batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  68%|██████▊   | 1902/2797 [06:15<02:58,  5.00batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  68%|██████▊   | 1913/2797 [06:18<02:58,  4.96batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  69%|██████▉   | 1925/2797 [06:20<02:51,  5.09batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  69%|██████▉   | 1925/2797 [06:20<02:51,  5.09batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  69%|██████▉   | 1936/2797 [06:22<02:48,  5.12batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  70%|██████▉   | 1947/2797 [06:24<02:44,  5.17batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  70%|██████▉   | 1947/2797 [06:25<02:44,  5.17batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  70%|███████   | 1958/2797 [06:26<02:45,  5.06batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  70%|███████   | 1969/2797 [06:28<02:40,  5.15batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  70%|███████   | 1969/2797 [06:30<02:40,  5.15batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  71%|███████   | 1980/2797 [06:31<02:39,  5.12batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  71%|███████   | 1991/2797 [06:33<02:40,  5.03batch/s, loss=1.574, lr=1.5e-05]
epoch 6/8:  71%|███████   | 1991/2797 [06:35<02:40,  5.03batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  72%|███████▏  | 2002/2797 [06:35<02:37,  5.04batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  72%|███████▏  | 2013/2797 [06:37<02:34,  5.07batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  72%|███████▏  | 2024/2797 [06:39<02:34,  5.01batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  72%|███████▏  | 2024/2797 [06:40<02:34,  5.01batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  73%|███████▎  | 2035/2797 [06:42<02:31,  5.03batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  73%|███████▎  | 2046/2797 [06:44<02:30,  4.98batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  73%|███████▎  | 2046/2797 [06:45<02:30,  4.98batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  74%|███████▎  | 2057/2797 [06:46<02:25,  5.10batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  74%|███████▍  | 2068/2797 [06:48<02:24,  5.04batch/s, loss=1.573, lr=1.5e-05]
epoch 6/8:  74%|███████▍  | 2068/2797 [06:50<02:24,  5.04batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  74%|███████▍  | 2080/2797 [06:50<02:18,  5.17batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  75%|███████▍  | 2091/2797 [06:52<02:15,  5.20batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  75%|███████▍  | 2091/2797 [06:54<02:15,  5.20batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  75%|███████▌  | 2102/2797 [06:54<02:13,  5.21batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  76%|███████▌  | 2113/2797 [06:56<02:09,  5.28batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  76%|███████▌  | 2124/2797 [06:59<02:08,  5.24batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  76%|███████▌  | 2124/2797 [06:59<02:08,  5.24batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  76%|███████▋  | 2135/2797 [07:01<02:11,  5.04batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  77%|███████▋  | 2146/2797 [07:03<02:06,  5.15batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  77%|███████▋  | 2146/2797 [07:04<02:06,  5.15batch/s, loss=1.571, lr=1.5e-05]
epoch 6/8:  77%|███████▋  | 2158/2797 [07:05<02:00,  5.30batch/s, loss=1.571, lr=1.5e-05]
epoch 6/8:  78%|███████▊  | 2169/2797 [07:07<02:01,  5.18batch/s, loss=1.571, lr=1.5e-05]
epoch 6/8:  78%|███████▊  | 2169/2797 [07:09<02:01,  5.18batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  78%|███████▊  | 2180/2797 [07:09<01:58,  5.22batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  78%|███████▊  | 2191/2797 [07:12<01:58,  5.10batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  78%|███████▊  | 2191/2797 [07:13<01:58,  5.10batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  79%|███████▉  | 2203/2797 [07:14<01:52,  5.29batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  79%|███████▉  | 2214/2797 [07:16<01:51,  5.21batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  80%|███████▉  | 2225/2797 [07:18<01:51,  5.13batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  80%|███████▉  | 2225/2797 [07:18<01:51,  5.13batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  80%|███████▉  | 2236/2797 [07:20<01:47,  5.23batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  80%|████████  | 2247/2797 [07:23<01:48,  5.05batch/s, loss=1.572, lr=1.5e-05]
epoch 6/8:  80%|████████  | 2247/2797 [07:23<01:48,  5.05batch/s, loss=1.572, lr=1.4e-05]
epoch 6/8:  81%|████████  | 2258/2797 [07:25<01:45,  5.13batch/s, loss=1.572, lr=1.4e-05]
epoch 6/8:  81%|████████  | 2270/2797 [07:27<01:40,  5.24batch/s, loss=1.572, lr=1.4e-05]
epoch 6/8:  81%|████████  | 2270/2797 [07:28<01:40,  5.24batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  82%|████████▏ | 2281/2797 [07:29<01:38,  5.26batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  82%|████████▏ | 2292/2797 [07:31<01:35,  5.31batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  82%|████████▏ | 2292/2797 [07:33<01:35,  5.31batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  82%|████████▏ | 2303/2797 [07:33<01:34,  5.21batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  83%|████████▎ | 2314/2797 [07:35<01:31,  5.26batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  83%|████████▎ | 2325/2797 [07:37<01:31,  5.18batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  83%|████████▎ | 2325/2797 [07:38<01:31,  5.18batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  84%|████████▎ | 2336/2797 [07:40<01:30,  5.12batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  84%|████████▍ | 2348/2797 [07:42<01:25,  5.24batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  84%|████████▍ | 2348/2797 [07:42<01:25,  5.24batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  84%|████████▍ | 2359/2797 [07:44<01:23,  5.22batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  85%|████████▍ | 2370/2797 [07:46<01:24,  5.03batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  85%|████████▍ | 2370/2797 [07:48<01:24,  5.03batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  85%|████████▌ | 2381/2797 [07:49<01:23,  4.96batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  86%|████████▌ | 2392/2797 [07:51<01:19,  5.10batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  86%|████████▌ | 2392/2797 [07:52<01:19,  5.10batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  86%|████████▌ | 2404/2797 [07:53<01:14,  5.28batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  86%|████████▋ | 2416/2797 [07:55<01:10,  5.39batch/s, loss=1.571, lr=1.4e-05]
epoch 6/8:  86%|████████▋ | 2416/2797 [07:57<01:10,  5.39batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  87%|████████▋ | 2427/2797 [07:57<01:10,  5.24batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  87%|████████▋ | 2438/2797 [07:59<01:09,  5.18batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  88%|████████▊ | 2449/2797 [08:01<01:08,  5.05batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  88%|████████▊ | 2449/2797 [08:02<01:08,  5.05batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  88%|████████▊ | 2460/2797 [08:04<01:06,  5.09batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  88%|████████▊ | 2471/2797 [08:06<01:04,  5.04batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  88%|████████▊ | 2471/2797 [08:07<01:04,  5.04batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  89%|████████▊ | 2482/2797 [08:08<01:02,  5.08batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  89%|████████▉ | 2493/2797 [08:10<00:58,  5.17batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  89%|████████▉ | 2493/2797 [08:12<00:58,  5.17batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  90%|████████▉ | 2505/2797 [08:12<00:55,  5.25batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  90%|████████▉ | 2516/2797 [08:14<00:53,  5.29batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  90%|████████▉ | 2516/2797 [08:16<00:53,  5.29batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  90%|█████████ | 2527/2797 [08:16<00:51,  5.21batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  91%|█████████ | 2538/2797 [08:19<00:50,  5.09batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  91%|█████████ | 2550/2797 [08:21<00:46,  5.30batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  91%|█████████ | 2550/2797 [08:21<00:46,  5.30batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  92%|█████████▏| 2561/2797 [08:23<00:44,  5.30batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  92%|█████████▏| 2572/2797 [08:25<00:42,  5.31batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  92%|█████████▏| 2572/2797 [08:26<00:42,  5.31batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  92%|█████████▏| 2583/2797 [08:27<00:40,  5.25batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  93%|█████████▎| 2594/2797 [08:29<00:39,  5.15batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  93%|█████████▎| 2594/2797 [08:31<00:39,  5.15batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  93%|█████████▎| 2605/2797 [08:31<00:37,  5.14batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  94%|█████████▎| 2616/2797 [08:33<00:34,  5.23batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  94%|█████████▎| 2616/2797 [08:35<00:34,  5.23batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  94%|█████████▍| 2627/2797 [08:36<00:32,  5.21batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  94%|█████████▍| 2638/2797 [08:38<00:31,  5.01batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  95%|█████████▍| 2649/2797 [08:40<00:29,  5.05batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  95%|█████████▍| 2649/2797 [08:41<00:29,  5.05batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  95%|█████████▌| 2660/2797 [08:42<00:27,  4.98batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  95%|█████████▌| 2671/2797 [08:45<00:25,  5.02batch/s, loss=1.570, lr=1.4e-05]
epoch 6/8:  95%|█████████▌| 2671/2797 [08:46<00:25,  5.02batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  96%|█████████▌| 2682/2797 [08:47<00:22,  5.09batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  96%|█████████▋| 2693/2797 [08:49<00:20,  5.06batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  96%|█████████▋| 2693/2797 [08:50<00:20,  5.06batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  97%|█████████▋| 2704/2797 [08:51<00:18,  5.10batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  97%|█████████▋| 2715/2797 [08:53<00:15,  5.14batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  97%|█████████▋| 2715/2797 [08:55<00:15,  5.14batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  97%|█████████▋| 2726/2797 [08:55<00:13,  5.13batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  98%|█████████▊| 2737/2797 [08:58<00:12,  4.98batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  98%|█████████▊| 2747/2797 [09:00<00:10,  4.84batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  98%|█████████▊| 2747/2797 [09:01<00:10,  4.84batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  99%|█████████▊| 2757/2797 [09:02<00:08,  4.83batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  99%|█████████▉| 2767/2797 [09:04<00:06,  4.80batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  99%|█████████▉| 2767/2797 [09:06<00:06,  4.80batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8:  99%|█████████▉| 2778/2797 [09:06<00:03,  4.95batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8: 100%|█████████▉| 2788/2797 [09:08<00:01,  4.95batch/s, loss=1.571, lr=1.3e-05]
epoch 6/8: 100%|██████████| 2797/2797 [09:10<00:00,  5.08batch/s, loss=1.571, lr=1.3e-05]
epoch 6: train loss 1.571 · validation loss 2.078 · broad 81.5% (top-3 95.3%) · path 72.8% (top-3 89.5%, plausible or look-alike 88.2%) · 3540s elapsed

epoch 7/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 7/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=1.668, lr=1.3e-05]
epoch 7/8:   0%|          | 12/2797 [00:02<08:01,  5.78batch/s, loss=1.668, lr=1.3e-05]
epoch 7/8:   1%|          | 24/2797 [00:04<09:04,  5.09batch/s, loss=1.668, lr=1.3e-05]
epoch 7/8:   1%|          | 24/2797 [00:05<09:04,  5.09batch/s, loss=1.529, lr=1.3e-05]
epoch 7/8:   1%|▏         | 35/2797 [00:06<08:52,  5.19batch/s, loss=1.529, lr=1.3e-05]
epoch 7/8:   2%|▏         | 46/2797 [00:08<09:03,  5.06batch/s, loss=1.529, lr=1.3e-05]
epoch 7/8:   2%|▏         | 46/2797 [00:09<09:03,  5.06batch/s, loss=1.498, lr=1.3e-05]
epoch 7/8:   2%|▏         | 57/2797 [00:11<09:00,  5.07batch/s, loss=1.498, lr=1.3e-05]
epoch 7/8:   2%|▏         | 68/2797 [00:13<08:59,  5.06batch/s, loss=1.498, lr=1.3e-05]
epoch 7/8:   2%|▏         | 68/2797 [00:14<08:59,  5.06batch/s, loss=1.520, lr=1.3e-05]
epoch 7/8:   3%|▎         | 80/2797 [00:15<08:44,  5.18batch/s, loss=1.520, lr=1.3e-05]
epoch 7/8:   3%|▎         | 93/2797 [00:17<08:15,  5.46batch/s, loss=1.520, lr=1.3e-05]
epoch 7/8:   3%|▎         | 93/2797 [00:19<08:15,  5.46batch/s, loss=1.510, lr=1.3e-05]
epoch 7/8:   4%|▎         | 104/2797 [00:19<08:21,  5.37batch/s, loss=1.510, lr=1.3e-05]
epoch 7/8:   4%|▍         | 115/2797 [00:22<08:34,  5.21batch/s, loss=1.510, lr=1.3e-05]
epoch 7/8:   4%|▍         | 115/2797 [00:24<08:34,  5.21batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   5%|▍         | 126/2797 [00:24<08:40,  5.13batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   5%|▍         | 137/2797 [00:26<08:38,  5.13batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   5%|▌         | 148/2797 [00:28<08:54,  4.96batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   5%|▌         | 148/2797 [00:29<08:54,  4.96batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   6%|▌         | 158/2797 [00:31<09:06,  4.83batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   6%|▌         | 169/2797 [00:33<08:45,  5.00batch/s, loss=1.507, lr=1.3e-05]
epoch 7/8:   6%|▌         | 169/2797 [00:34<08:45,  5.00batch/s, loss=1.506, lr=1.3e-05]
epoch 7/8:   6%|▋         | 180/2797 [00:35<08:29,  5.14batch/s, loss=1.506, lr=1.3e-05]
epoch 7/8:   7%|▋         | 191/2797 [00:37<08:37,  5.03batch/s, loss=1.506, lr=1.3e-05]
epoch 7/8:   7%|▋         | 191/2797 [00:39<08:37,  5.03batch/s, loss=1.513, lr=1.3e-05]
epoch 7/8:   7%|▋         | 202/2797 [00:39<08:36,  5.03batch/s, loss=1.513, lr=1.3e-05]
epoch 7/8:   8%|▊         | 213/2797 [00:41<08:45,  4.92batch/s, loss=1.513, lr=1.3e-05]
epoch 7/8:   8%|▊         | 224/2797 [00:43<08:33,  5.01batch/s, loss=1.513, lr=1.3e-05]
epoch 7/8:   8%|▊         | 224/2797 [00:44<08:33,  5.01batch/s, loss=1.514, lr=1.3e-05]
epoch 7/8:   8%|▊         | 235/2797 [00:46<08:35,  4.97batch/s, loss=1.514, lr=1.3e-05]
epoch 7/8:   9%|▉         | 245/2797 [00:48<08:35,  4.95batch/s, loss=1.514, lr=1.3e-05]
epoch 7/8:   9%|▉         | 245/2797 [00:49<08:35,  4.95batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:   9%|▉         | 256/2797 [00:50<08:33,  4.95batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:  10%|▉         | 267/2797 [00:52<08:18,  5.08batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:  10%|▉         | 267/2797 [00:54<08:18,  5.08batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:  10%|▉         | 278/2797 [00:54<08:09,  5.14batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:  10%|█         | 289/2797 [00:56<08:05,  5.17batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:  11%|█         | 300/2797 [00:58<08:05,  5.14batch/s, loss=1.512, lr=1.3e-05]
epoch 7/8:  11%|█         | 300/2797 [00:59<08:05,  5.14batch/s, loss=1.507, lr=1.2e-05]
epoch 7/8:  11%|█         | 311/2797 [01:00<08:00,  5.18batch/s, loss=1.507, lr=1.2e-05]
epoch 7/8:  12%|█▏        | 322/2797 [01:03<08:05,  5.10batch/s, loss=1.507, lr=1.2e-05]
epoch 7/8:  12%|█▏        | 322/2797 [01:03<08:05,  5.10batch/s, loss=1.510, lr=1.2e-05]
epoch 7/8:  12%|█▏        | 333/2797 [01:05<08:03,  5.09batch/s, loss=1.510, lr=1.2e-05]
epoch 7/8:  12%|█▏        | 344/2797 [01:07<08:23,  4.88batch/s, loss=1.510, lr=1.2e-05]
epoch 7/8:  12%|█▏        | 344/2797 [01:09<08:23,  4.88batch/s, loss=1.511, lr=1.2e-05]
epoch 7/8:  13%|█▎        | 357/2797 [01:10<07:52,  5.16batch/s, loss=1.511, lr=1.2e-05]
epoch 7/8:  13%|█▎        | 368/2797 [01:12<07:50,  5.16batch/s, loss=1.511, lr=1.2e-05]
epoch 7/8:  13%|█▎        | 368/2797 [01:13<07:50,  5.16batch/s, loss=1.513, lr=1.2e-05]
epoch 7/8:  14%|█▎        | 379/2797 [01:14<08:00,  5.04batch/s, loss=1.513, lr=1.2e-05]
epoch 7/8:  14%|█▍        | 390/2797 [01:16<07:51,  5.10batch/s, loss=1.513, lr=1.2e-05]
epoch 7/8:  14%|█▍        | 390/2797 [01:18<07:51,  5.10batch/s, loss=1.514, lr=1.2e-05]
epoch 7/8:  14%|█▍        | 401/2797 [01:18<07:56,  5.03batch/s, loss=1.514, lr=1.2e-05]
epoch 7/8:  15%|█▍        | 413/2797 [01:20<07:36,  5.22batch/s, loss=1.514, lr=1.2e-05]
epoch 7/8:  15%|█▌        | 424/2797 [01:23<07:46,  5.08batch/s, loss=1.514, lr=1.2e-05]
epoch 7/8:  15%|█▌        | 424/2797 [01:23<07:46,  5.08batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  16%|█▌        | 435/2797 [01:25<07:39,  5.14batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  16%|█▌        | 446/2797 [01:27<07:45,  5.05batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  16%|█▌        | 446/2797 [01:28<07:45,  5.05batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  16%|█▋        | 457/2797 [01:29<07:36,  5.13batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  17%|█▋        | 468/2797 [01:31<07:38,  5.08batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  17%|█▋        | 468/2797 [01:33<07:38,  5.08batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  17%|█▋        | 479/2797 [01:34<07:42,  5.01batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  18%|█▊        | 490/2797 [01:36<07:42,  4.99batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  18%|█▊        | 500/2797 [01:38<07:50,  4.88batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  18%|█▊        | 500/2797 [01:38<07:50,  4.88batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  18%|█▊        | 512/2797 [01:40<07:20,  5.19batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  19%|█▊        | 523/2797 [01:42<07:27,  5.08batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  19%|█▊        | 523/2797 [01:43<07:27,  5.08batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  19%|█▉        | 534/2797 [01:45<07:33,  4.99batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  19%|█▉        | 545/2797 [01:47<07:31,  4.99batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  19%|█▉        | 545/2797 [01:48<07:31,  4.99batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  20%|█▉        | 555/2797 [01:49<07:35,  4.92batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  20%|██        | 567/2797 [01:51<07:18,  5.08batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  20%|██        | 567/2797 [01:53<07:18,  5.08batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  21%|██        | 578/2797 [01:53<07:15,  5.10batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  21%|██        | 589/2797 [01:56<07:21,  5.00batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  21%|██▏       | 600/2797 [01:58<07:22,  4.97batch/s, loss=1.516, lr=1.2e-05]
epoch 7/8:  21%|██▏       | 600/2797 [01:58<07:22,  4.97batch/s, loss=1.517, lr=1.2e-05]
epoch 7/8:  22%|██▏       | 611/2797 [02:00<07:18,  4.99batch/s, loss=1.517, lr=1.2e-05]
epoch 7/8:  22%|██▏       | 622/2797 [02:02<07:13,  5.02batch/s, loss=1.517, lr=1.2e-05]
epoch 7/8:  22%|██▏       | 622/2797 [02:03<07:13,  5.02batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  23%|██▎       | 633/2797 [02:04<07:05,  5.09batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  23%|██▎       | 644/2797 [02:07<07:08,  5.03batch/s, loss=1.518, lr=1.2e-05]
epoch 7/8:  23%|██▎       | 644/2797 [02:08<07:08,  5.03batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  23%|██▎       | 655/2797 [02:09<07:09,  4.98batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  24%|██▍       | 666/2797 [02:11<07:05,  5.01batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  24%|██▍       | 666/2797 [02:13<07:05,  5.01batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  24%|██▍       | 678/2797 [02:13<06:53,  5.12batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  25%|██▍       | 689/2797 [02:15<06:56,  5.06batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  25%|██▌       | 700/2797 [02:17<06:46,  5.16batch/s, loss=1.519, lr=1.2e-05]
epoch 7/8:  25%|██▌       | 700/2797 [02:18<06:46,  5.16batch/s, loss=1.520, lr=1.2e-05]
epoch 7/8:  25%|██▌       | 711/2797 [02:20<06:50,  5.09batch/s, loss=1.520, lr=1.2e-05]
epoch 7/8:  26%|██▌       | 722/2797 [02:22<06:42,  5.16batch/s, loss=1.520, lr=1.2e-05]
epoch 7/8:  26%|██▌       | 722/2797 [02:23<06:42,  5.16batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  26%|██▌       | 733/2797 [02:24<06:51,  5.02batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  27%|██▋       | 744/2797 [02:26<06:40,  5.13batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  27%|██▋       | 744/2797 [02:28<06:40,  5.13batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  27%|██▋       | 755/2797 [02:28<06:46,  5.02batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  27%|██▋       | 767/2797 [02:30<06:27,  5.23batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  27%|██▋       | 767/2797 [02:32<06:27,  5.23batch/s, loss=1.522, lr=1.1e-05]
epoch 7/8:  28%|██▊       | 778/2797 [02:33<06:30,  5.17batch/s, loss=1.522, lr=1.1e-05]
epoch 7/8:  28%|██▊       | 789/2797 [02:35<06:35,  5.07batch/s, loss=1.522, lr=1.1e-05]
epoch 7/8:  28%|██▊       | 789/2797 [02:37<06:35,  5.07batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  29%|██▊       | 801/2797 [02:37<06:23,  5.21batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  29%|██▉       | 812/2797 [02:39<06:29,  5.10batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  29%|██▉       | 823/2797 [02:41<06:24,  5.14batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  29%|██▉       | 823/2797 [02:42<06:24,  5.14batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  30%|██▉       | 834/2797 [02:44<06:17,  5.19batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  30%|███       | 846/2797 [02:46<06:11,  5.26batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  30%|███       | 846/2797 [02:47<06:11,  5.26batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  31%|███       | 857/2797 [02:48<06:23,  5.06batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  31%|███       | 868/2797 [02:50<06:20,  5.07batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  31%|███       | 868/2797 [02:52<06:20,  5.07batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  31%|███▏      | 879/2797 [02:53<06:26,  4.96batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  32%|███▏      | 890/2797 [02:55<06:17,  5.05batch/s, loss=1.521, lr=1.1e-05]
epoch 7/8:  32%|███▏      | 890/2797 [02:57<06:17,  5.05batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  32%|███▏      | 902/2797 [02:57<06:00,  5.26batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  33%|███▎      | 914/2797 [02:59<05:52,  5.34batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  33%|███▎      | 925/2797 [03:01<05:57,  5.23batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  33%|███▎      | 925/2797 [03:01<05:57,  5.23batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  33%|███▎      | 936/2797 [03:03<05:56,  5.22batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  34%|███▍      | 947/2797 [03:06<06:00,  5.13batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  34%|███▍      | 947/2797 [03:06<06:00,  5.13batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  34%|███▍      | 958/2797 [03:08<06:08,  4.99batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  35%|███▍      | 969/2797 [03:10<06:10,  4.93batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  35%|███▍      | 969/2797 [03:12<06:10,  4.93batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  35%|███▌      | 979/2797 [03:12<06:09,  4.92batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  35%|███▌      | 990/2797 [03:14<06:05,  4.95batch/s, loss=1.520, lr=1.1e-05]
epoch 7/8:  35%|███▌      | 990/2797 [03:17<06:05,  4.95batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  36%|███▌      | 1001/2797 [03:17<05:59,  4.99batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  36%|███▌      | 1012/2797 [03:19<05:56,  5.01batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  37%|███▋      | 1023/2797 [03:21<05:56,  4.97batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  37%|███▋      | 1023/2797 [03:22<05:56,  4.97batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  37%|███▋      | 1034/2797 [03:23<05:51,  5.01batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  37%|███▋      | 1045/2797 [03:25<05:51,  4.99batch/s, loss=1.519, lr=1.1e-05]
epoch 7/8:  37%|███▋      | 1045/2797 [03:27<05:51,  4.99batch/s, loss=1.518, lr=1.1e-05]
epoch 7/8:  38%|███▊      | 1055/2797 [03:27<05:54,  4.92batch/s, loss=1.518, lr=1.1e-05]
epoch 7/8:  38%|███▊      | 1065/2797 [03:29<05:51,  4.93batch/s, loss=1.518, lr=1.1e-05]
epoch 7/8:  38%|███▊      | 1065/2797 [03:32<05:51,  4.93batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  38%|███▊      | 1076/2797 [03:32<05:39,  5.07batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  39%|███▉      | 1087/2797 [03:34<05:42,  5.00batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  39%|███▉      | 1098/2797 [03:36<05:39,  5.00batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  39%|███▉      | 1098/2797 [03:37<05:39,  5.00batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  40%|███▉      | 1109/2797 [03:38<05:33,  5.06batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  40%|████      | 1120/2797 [03:40<05:24,  5.17batch/s, loss=1.517, lr=1.1e-05]
epoch 7/8:  40%|████      | 1120/2797 [03:41<05:24,  5.17batch/s, loss=1.516, lr=1.1e-05]
epoch 7/8:  40%|████      | 1131/2797 [03:42<05:22,  5.17batch/s, loss=1.516, lr=1.1e-05]
epoch 7/8:  41%|████      | 1142/2797 [03:45<05:30,  5.01batch/s, loss=1.516, lr=1.1e-05]
epoch 7/8:  41%|████      | 1142/2797 [03:46<05:30,  5.01batch/s, loss=1.517, lr=1.0e-05]
epoch 7/8:  41%|████      | 1153/2797 [03:47<05:31,  4.96batch/s, loss=1.517, lr=1.0e-05]
epoch 7/8:  42%|████▏     | 1163/2797 [03:49<05:31,  4.93batch/s, loss=1.517, lr=1.0e-05]
epoch 7/8:  42%|████▏     | 1174/2797 [03:51<05:22,  5.04batch/s, loss=1.517, lr=1.0e-05]
epoch 7/8:  42%|████▏     | 1174/2797 [03:51<05:22,  5.04batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  42%|████▏     | 1185/2797 [03:53<05:16,  5.09batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  43%|████▎     | 1196/2797 [03:55<05:12,  5.13batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  43%|████▎     | 1196/2797 [03:56<05:12,  5.13batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  43%|████▎     | 1208/2797 [03:57<05:00,  5.28batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  44%|████▎     | 1219/2797 [04:00<05:04,  5.18batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  44%|████▎     | 1219/2797 [04:01<05:04,  5.18batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  44%|████▍     | 1230/2797 [04:02<05:07,  5.09batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  44%|████▍     | 1241/2797 [04:04<05:03,  5.12batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  44%|████▍     | 1241/2797 [04:06<05:03,  5.12batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  45%|████▍     | 1252/2797 [04:06<04:56,  5.21batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  45%|████▌     | 1263/2797 [04:08<05:02,  5.07batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  46%|████▌     | 1274/2797 [04:10<04:57,  5.12batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  46%|████▌     | 1274/2797 [04:11<04:57,  5.12batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  46%|████▌     | 1285/2797 [04:13<05:05,  4.95batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  46%|████▋     | 1297/2797 [04:15<04:49,  5.18batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  46%|████▋     | 1297/2797 [04:16<04:49,  5.18batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  47%|████▋     | 1308/2797 [04:17<04:51,  5.11batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  47%|████▋     | 1320/2797 [04:19<04:39,  5.28batch/s, loss=1.515, lr=1.0e-05]
epoch 7/8:  47%|████▋     | 1320/2797 [04:20<04:39,  5.28batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  48%|████▊     | 1331/2797 [04:21<04:44,  5.15batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  48%|████▊     | 1342/2797 [04:24<04:47,  5.07batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  48%|████▊     | 1342/2797 [04:25<04:47,  5.07batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  48%|████▊     | 1353/2797 [04:26<04:45,  5.05batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  49%|████▉     | 1364/2797 [04:28<04:44,  5.03batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  49%|████▉     | 1375/2797 [04:31<04:53,  4.85batch/s, loss=1.516, lr=1.0e-05]
epoch 7/8:  49%|████▉     | 1375/2797 [04:31<04:53,  4.85batch/s, loss=1.517, lr=9.9e-06]
epoch 7/8:  50%|████▉     | 1386/2797 [04:33<04:45,  4.94batch/s, loss=1.517, lr=9.9e-06]
epoch 7/8:  50%|████▉     | 1397/2797 [04:35<04:38,  5.02batch/s, loss=1.517, lr=9.9e-06]
epoch 7/8:  50%|████▉     | 1397/2797 [04:36<04:38,  5.02batch/s, loss=1.518, lr=9.9e-06]
epoch 7/8:  50%|█████     | 1408/2797 [04:37<04:29,  5.15batch/s, loss=1.518, lr=9.9e-06]
epoch 7/8:  51%|█████     | 1419/2797 [04:39<04:26,  5.18batch/s, loss=1.518, lr=9.9e-06]
epoch 7/8:  51%|█████     | 1419/2797 [04:40<04:26,  5.18batch/s, loss=1.518, lr=9.8e-06]
epoch 7/8:  51%|█████     | 1430/2797 [04:41<04:27,  5.11batch/s, loss=1.518, lr=9.8e-06]
epoch 7/8:  52%|█████▏    | 1441/2797 [04:43<04:26,  5.08batch/s, loss=1.518, lr=9.8e-06]
epoch 7/8:  52%|█████▏    | 1441/2797 [04:45<04:26,  5.08batch/s, loss=1.517, lr=9.7e-06]
epoch 7/8:  52%|█████▏    | 1452/2797 [04:45<04:21,  5.14batch/s, loss=1.517, lr=9.7e-06]
epoch 7/8:  52%|█████▏    | 1463/2797 [04:48<04:25,  5.03batch/s, loss=1.517, lr=9.7e-06]
epoch 7/8:  53%|█████▎    | 1474/2797 [04:50<04:18,  5.12batch/s, loss=1.517, lr=9.7e-06]
epoch 7/8:  53%|█████▎    | 1474/2797 [04:50<04:18,  5.12batch/s, loss=1.518, lr=9.7e-06]
epoch 7/8:  53%|█████▎    | 1486/2797 [04:52<04:09,  5.26batch/s, loss=1.518, lr=9.7e-06]
epoch 7/8:  54%|█████▎    | 1497/2797 [04:54<04:09,  5.21batch/s, loss=1.518, lr=9.7e-06]
epoch 7/8:  54%|█████▎    | 1497/2797 [04:55<04:09,  5.21batch/s, loss=1.517, lr=9.6e-06]
epoch 7/8:  54%|█████▍    | 1509/2797 [04:56<04:04,  5.27batch/s, loss=1.517, lr=9.6e-06]
epoch 7/8:  54%|█████▍    | 1520/2797 [04:58<04:01,  5.30batch/s, loss=1.517, lr=9.6e-06]
epoch 7/8:  54%|█████▍    | 1520/2797 [04:59<04:01,  5.30batch/s, loss=1.517, lr=9.6e-06]
epoch 7/8:  55%|█████▍    | 1532/2797 [05:00<03:51,  5.46batch/s, loss=1.517, lr=9.6e-06]
epoch 7/8:  55%|█████▌    | 1543/2797 [05:03<03:54,  5.34batch/s, loss=1.517, lr=9.6e-06]
epoch 7/8:  55%|█████▌    | 1543/2797 [05:04<03:54,  5.34batch/s, loss=1.518, lr=9.5e-06]
epoch 7/8:  56%|█████▌    | 1556/2797 [05:05<03:40,  5.63batch/s, loss=1.518, lr=9.5e-06]
epoch 7/8:  56%|█████▌    | 1568/2797 [05:07<03:51,  5.30batch/s, loss=1.518, lr=9.5e-06]
epoch 7/8:  56%|█████▌    | 1568/2797 [05:09<03:51,  5.30batch/s, loss=1.518, lr=9.5e-06]
epoch 7/8:  56%|█████▋    | 1579/2797 [05:09<03:50,  5.28batch/s, loss=1.518, lr=9.5e-06]
epoch 7/8:  57%|█████▋    | 1590/2797 [05:11<03:47,  5.31batch/s, loss=1.518, lr=9.5e-06]
epoch 7/8:  57%|█████▋    | 1590/2797 [05:14<03:47,  5.31batch/s, loss=1.518, lr=9.4e-06]
epoch 7/8:  57%|█████▋    | 1601/2797 [05:14<03:51,  5.18batch/s, loss=1.518, lr=9.4e-06]
epoch 7/8:  58%|█████▊    | 1612/2797 [05:16<03:48,  5.20batch/s, loss=1.518, lr=9.4e-06]
epoch 7/8:  58%|█████▊    | 1623/2797 [05:18<03:43,  5.26batch/s, loss=1.518, lr=9.4e-06]
epoch 7/8:  58%|█████▊    | 1623/2797 [05:18<03:43,  5.26batch/s, loss=1.518, lr=9.3e-06]
epoch 7/8:  58%|█████▊    | 1634/2797 [05:20<03:42,  5.23batch/s, loss=1.518, lr=9.3e-06]
epoch 7/8:  59%|█████▉    | 1645/2797 [05:22<03:43,  5.16batch/s, loss=1.518, lr=9.3e-06]
epoch 7/8:  59%|█████▉    | 1645/2797 [05:23<03:43,  5.16batch/s, loss=1.517, lr=9.3e-06]
epoch 7/8:  59%|█████▉    | 1656/2797 [05:24<03:42,  5.12batch/s, loss=1.517, lr=9.3e-06]
epoch 7/8:  60%|█████▉    | 1667/2797 [05:27<03:46,  4.98batch/s, loss=1.517, lr=9.3e-06]
epoch 7/8:  60%|█████▉    | 1667/2797 [05:28<03:46,  4.98batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  60%|█████▉    | 1678/2797 [05:29<03:43,  5.01batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  60%|██████    | 1689/2797 [05:31<03:49,  4.82batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  61%|██████    | 1699/2797 [05:33<03:47,  4.82batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  61%|██████    | 1699/2797 [05:34<03:47,  4.82batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  61%|██████    | 1709/2797 [05:35<03:46,  4.81batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  61%|██████▏   | 1720/2797 [05:37<03:36,  4.97batch/s, loss=1.517, lr=9.2e-06]
epoch 7/8:  61%|██████▏   | 1720/2797 [05:39<03:36,  4.97batch/s, loss=1.517, lr=9.1e-06]
epoch 7/8:  62%|██████▏   | 1731/2797 [05:40<03:34,  4.98batch/s, loss=1.517, lr=9.1e-06]
epoch 7/8:  62%|██████▏   | 1741/2797 [05:42<03:31,  4.98batch/s, loss=1.517, lr=9.1e-06]
epoch 7/8:  62%|██████▏   | 1741/2797 [05:44<03:31,  4.98batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  63%|██████▎   | 1751/2797 [05:44<03:31,  4.94batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  63%|██████▎   | 1761/2797 [05:46<03:30,  4.92batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  63%|██████▎   | 1772/2797 [05:48<03:21,  5.08batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  63%|██████▎   | 1772/2797 [05:48<03:21,  5.08batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  64%|██████▍   | 1784/2797 [05:50<03:12,  5.26batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  64%|██████▍   | 1795/2797 [05:52<03:15,  5.14batch/s, loss=1.517, lr=9.0e-06]
epoch 7/8:  64%|██████▍   | 1795/2797 [05:53<03:15,  5.14batch/s, loss=1.517, lr=8.9e-06]
epoch 7/8:  65%|██████▍   | 1806/2797 [05:54<03:11,  5.17batch/s, loss=1.517, lr=8.9e-06]
epoch 7/8:  65%|██████▍   | 1817/2797 [05:56<03:07,  5.24batch/s, loss=1.517, lr=8.9e-06]
epoch 7/8:  65%|██████▍   | 1817/2797 [05:58<03:07,  5.24batch/s, loss=1.516, lr=8.9e-06]
epoch 7/8:  65%|██████▌   | 1829/2797 [05:58<03:02,  5.31batch/s, loss=1.516, lr=8.9e-06]
epoch 7/8:  66%|██████▌   | 1840/2797 [06:01<03:08,  5.08batch/s, loss=1.516, lr=8.9e-06]
epoch 7/8:  66%|██████▌   | 1840/2797 [06:03<03:08,  5.08batch/s, loss=1.516, lr=8.8e-06]
epoch 7/8:  66%|██████▌   | 1851/2797 [06:03<03:09,  5.00batch/s, loss=1.516, lr=8.8e-06]
epoch 7/8:  67%|██████▋   | 1862/2797 [06:05<03:02,  5.11batch/s, loss=1.516, lr=8.8e-06]
epoch 7/8:  67%|██████▋   | 1873/2797 [06:07<02:57,  5.22batch/s, loss=1.516, lr=8.8e-06]
epoch 7/8:  67%|██████▋   | 1873/2797 [06:08<02:57,  5.22batch/s, loss=1.517, lr=8.7e-06]
epoch 7/8:  67%|██████▋   | 1884/2797 [06:09<02:54,  5.24batch/s, loss=1.517, lr=8.7e-06]
epoch 7/8:  68%|██████▊   | 1896/2797 [06:11<02:48,  5.33batch/s, loss=1.517, lr=8.7e-06]
epoch 7/8:  68%|██████▊   | 1896/2797 [06:12<02:48,  5.33batch/s, loss=1.516, lr=8.7e-06]
epoch 7/8:  68%|██████▊   | 1907/2797 [06:13<02:46,  5.35batch/s, loss=1.516, lr=8.7e-06]
epoch 7/8:  69%|██████▊   | 1918/2797 [06:16<02:48,  5.23batch/s, loss=1.516, lr=8.7e-06]
epoch 7/8:  69%|██████▊   | 1918/2797 [06:17<02:48,  5.23batch/s, loss=1.516, lr=8.6e-06]
epoch 7/8:  69%|██████▉   | 1929/2797 [06:18<02:47,  5.19batch/s, loss=1.516, lr=8.6e-06]
epoch 7/8:  69%|██████▉   | 1940/2797 [06:20<02:48,  5.07batch/s, loss=1.516, lr=8.6e-06]
epoch 7/8:  69%|██████▉   | 1940/2797 [06:22<02:48,  5.07batch/s, loss=1.517, lr=8.6e-06]
epoch 7/8:  70%|██████▉   | 1951/2797 [06:22<02:44,  5.14batch/s, loss=1.517, lr=8.6e-06]
epoch 7/8:  70%|███████   | 1963/2797 [06:24<02:39,  5.22batch/s, loss=1.517, lr=8.6e-06]
epoch 7/8:  71%|███████   | 1974/2797 [06:27<02:37,  5.22batch/s, loss=1.517, lr=8.6e-06]
epoch 7/8:  71%|███████   | 1974/2797 [06:27<02:37,  5.22batch/s, loss=1.516, lr=8.5e-06]
epoch 7/8:  71%|███████   | 1985/2797 [06:29<02:35,  5.22batch/s, loss=1.516, lr=8.5e-06]
epoch 7/8:  71%|███████▏  | 1996/2797 [06:31<02:36,  5.11batch/s, loss=1.516, lr=8.5e-06]
epoch 7/8:  71%|███████▏  | 1996/2797 [06:32<02:36,  5.11batch/s, loss=1.516, lr=8.5e-06]
epoch 7/8:  72%|███████▏  | 2007/2797 [06:33<02:36,  5.06batch/s, loss=1.516, lr=8.5e-06]
epoch 7/8:  72%|███████▏  | 2018/2797 [06:35<02:33,  5.09batch/s, loss=1.516, lr=8.5e-06]
epoch 7/8:  72%|███████▏  | 2018/2797 [06:37<02:33,  5.09batch/s, loss=1.516, lr=8.4e-06]
epoch 7/8:  73%|███████▎  | 2029/2797 [06:37<02:31,  5.05batch/s, loss=1.516, lr=8.4e-06]
epoch 7/8:  73%|███████▎  | 2040/2797 [06:40<02:30,  5.04batch/s, loss=1.516, lr=8.4e-06]
epoch 7/8:  73%|███████▎  | 2040/2797 [06:42<02:30,  5.04batch/s, loss=1.516, lr=8.3e-06]
epoch 7/8:  73%|███████▎  | 2051/2797 [06:42<02:25,  5.14batch/s, loss=1.516, lr=8.3e-06]
epoch 7/8:  74%|███████▍  | 2063/2797 [06:44<02:18,  5.29batch/s, loss=1.516, lr=8.3e-06]
epoch 7/8:  74%|███████▍  | 2074/2797 [06:46<02:18,  5.23batch/s, loss=1.516, lr=8.3e-06]
epoch 7/8:  74%|███████▍  | 2074/2797 [06:46<02:18,  5.23batch/s, loss=1.517, lr=8.3e-06]
epoch 7/8:  75%|███████▍  | 2085/2797 [06:48<02:23,  4.97batch/s, loss=1.517, lr=8.3e-06]
epoch 7/8:  75%|███████▍  | 2095/2797 [06:50<02:21,  4.97batch/s, loss=1.517, lr=8.3e-06]
epoch 7/8:  75%|███████▍  | 2095/2797 [06:52<02:21,  4.97batch/s, loss=1.517, lr=8.2e-06]
epoch 7/8:  75%|███████▌  | 2106/2797 [06:53<02:16,  5.07batch/s, loss=1.517, lr=8.2e-06]
epoch 7/8:  76%|███████▌  | 2117/2797 [06:55<02:13,  5.09batch/s, loss=1.517, lr=8.2e-06]
epoch 7/8:  76%|███████▌  | 2117/2797 [06:57<02:13,  5.09batch/s, loss=1.516, lr=8.2e-06]
epoch 7/8:  76%|███████▌  | 2128/2797 [06:57<02:11,  5.10batch/s, loss=1.516, lr=8.2e-06]
epoch 7/8:  76%|███████▋  | 2139/2797 [06:59<02:09,  5.07batch/s, loss=1.516, lr=8.2e-06]
epoch 7/8:  77%|███████▋  | 2150/2797 [07:01<02:05,  5.14batch/s, loss=1.516, lr=8.2e-06]
epoch 7/8:  77%|███████▋  | 2150/2797 [07:01<02:05,  5.14batch/s, loss=1.516, lr=8.1e-06]
epoch 7/8:  77%|███████▋  | 2161/2797 [07:03<02:06,  5.05batch/s, loss=1.516, lr=8.1e-06]
epoch 7/8:  78%|███████▊  | 2172/2797 [07:05<02:02,  5.10batch/s, loss=1.516, lr=8.1e-06]
epoch 7/8:  78%|███████▊  | 2172/2797 [07:06<02:02,  5.10batch/s, loss=1.516, lr=8.0e-06]
epoch 7/8:  78%|███████▊  | 2183/2797 [07:08<01:58,  5.18batch/s, loss=1.516, lr=8.0e-06]
epoch 7/8:  78%|███████▊  | 2194/2797 [07:10<01:56,  5.19batch/s, loss=1.516, lr=8.0e-06]
epoch 7/8:  78%|███████▊  | 2194/2797 [07:11<01:56,  5.19batch/s, loss=1.517, lr=8.0e-06]
epoch 7/8:  79%|███████▉  | 2205/2797 [07:12<01:56,  5.07batch/s, loss=1.517, lr=8.0e-06]
epoch 7/8:  79%|███████▉  | 2217/2797 [07:14<01:51,  5.20batch/s, loss=1.517, lr=8.0e-06]
epoch 7/8:  79%|███████▉  | 2217/2797 [07:16<01:51,  5.20batch/s, loss=1.516, lr=7.9e-06]
epoch 7/8:  80%|███████▉  | 2228/2797 [07:16<01:52,  5.07batch/s, loss=1.516, lr=7.9e-06]
epoch 7/8:  80%|████████  | 2239/2797 [07:19<01:50,  5.06batch/s, loss=1.516, lr=7.9e-06]
epoch 7/8:  80%|████████  | 2250/2797 [07:21<01:49,  5.00batch/s, loss=1.516, lr=7.9e-06]
epoch 7/8:  80%|████████  | 2250/2797 [07:21<01:49,  5.00batch/s, loss=1.517, lr=7.9e-06]
epoch 7/8:  81%|████████  | 2262/2797 [07:23<01:41,  5.25batch/s, loss=1.517, lr=7.9e-06]
epoch 7/8:  81%|████████▏ | 2273/2797 [07:25<01:42,  5.10batch/s, loss=1.517, lr=7.9e-06]
epoch 7/8:  81%|████████▏ | 2273/2797 [07:26<01:42,  5.10batch/s, loss=1.517, lr=7.8e-06]
epoch 7/8:  82%|████████▏ | 2284/2797 [07:27<01:41,  5.05batch/s, loss=1.517, lr=7.8e-06]
epoch 7/8:  82%|████████▏ | 2295/2797 [07:30<01:38,  5.11batch/s, loss=1.517, lr=7.8e-06]
epoch 7/8:  82%|████████▏ | 2295/2797 [07:31<01:38,  5.11batch/s, loss=1.517, lr=7.7e-06]
epoch 7/8:  82%|████████▏ | 2306/2797 [07:32<01:34,  5.19batch/s, loss=1.517, lr=7.7e-06]
epoch 7/8:  83%|████████▎ | 2317/2797 [07:34<01:31,  5.24batch/s, loss=1.517, lr=7.7e-06]
epoch 7/8:  83%|████████▎ | 2317/2797 [07:35<01:31,  5.24batch/s, loss=1.517, lr=7.7e-06]
epoch 7/8:  83%|████████▎ | 2329/2797 [07:36<01:28,  5.31batch/s, loss=1.517, lr=7.7e-06]
epoch 7/8:  84%|████████▎ | 2340/2797 [07:38<01:27,  5.23batch/s, loss=1.517, lr=7.7e-06]
epoch 7/8:  84%|████████▎ | 2340/2797 [07:40<01:27,  5.23batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  84%|████████▍ | 2351/2797 [07:40<01:27,  5.11batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  84%|████████▍ | 2362/2797 [07:43<01:27,  4.97batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  85%|████████▍ | 2373/2797 [07:45<01:24,  5.04batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  85%|████████▍ | 2373/2797 [07:45<01:24,  5.04batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  85%|████████▌ | 2384/2797 [07:47<01:21,  5.04batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  86%|████████▌ | 2396/2797 [07:49<01:16,  5.21batch/s, loss=1.517, lr=7.6e-06]
epoch 7/8:  86%|████████▌ | 2396/2797 [07:50<01:16,  5.21batch/s, loss=1.517, lr=7.5e-06]
epoch 7/8:  86%|████████▌ | 2407/2797 [07:51<01:15,  5.16batch/s, loss=1.517, lr=7.5e-06]
epoch 7/8:  86%|████████▋ | 2418/2797 [07:53<01:14,  5.09batch/s, loss=1.517, lr=7.5e-06]
epoch 7/8:  86%|████████▋ | 2418/2797 [07:55<01:14,  5.09batch/s, loss=1.517, lr=7.5e-06]
epoch 7/8:  87%|████████▋ | 2429/2797 [07:56<01:12,  5.09batch/s, loss=1.517, lr=7.5e-06]
epoch 7/8:  87%|████████▋ | 2441/2797 [07:58<01:07,  5.24batch/s, loss=1.517, lr=7.5e-06]
epoch 7/8:  87%|████████▋ | 2441/2797 [08:00<01:07,  5.24batch/s, loss=1.517, lr=7.4e-06]
epoch 7/8:  88%|████████▊ | 2452/2797 [08:00<01:06,  5.18batch/s, loss=1.517, lr=7.4e-06]
epoch 7/8:  88%|████████▊ | 2463/2797 [08:02<01:04,  5.17batch/s, loss=1.517, lr=7.4e-06]
epoch 7/8:  88%|████████▊ | 2474/2797 [08:04<01:02,  5.19batch/s, loss=1.517, lr=7.4e-06]
epoch 7/8:  88%|████████▊ | 2474/2797 [08:05<01:02,  5.19batch/s, loss=1.517, lr=7.3e-06]
epoch 7/8:  89%|████████▉ | 2485/2797 [08:06<00:59,  5.22batch/s, loss=1.517, lr=7.3e-06]
epoch 7/8:  89%|████████▉ | 2496/2797 [08:09<00:59,  5.09batch/s, loss=1.517, lr=7.3e-06]
epoch 7/8:  89%|████████▉ | 2496/2797 [08:09<00:59,  5.09batch/s, loss=1.517, lr=7.3e-06]
epoch 7/8:  90%|████████▉ | 2507/2797 [08:11<00:56,  5.09batch/s, loss=1.517, lr=7.3e-06]
epoch 7/8:  90%|█████████ | 2518/2797 [08:13<00:56,  4.93batch/s, loss=1.517, lr=7.3e-06]
epoch 7/8:  90%|█████████ | 2518/2797 [08:15<00:56,  4.93batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  90%|█████████ | 2528/2797 [08:15<00:56,  4.75batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  91%|█████████ | 2539/2797 [08:18<00:53,  4.87batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  91%|█████████ | 2549/2797 [08:20<00:50,  4.89batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  91%|█████████ | 2549/2797 [08:20<00:50,  4.89batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  92%|█████████▏| 2560/2797 [08:22<00:48,  4.92batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  92%|█████████▏| 2570/2797 [08:24<00:46,  4.88batch/s, loss=1.517, lr=7.2e-06]
epoch 7/8:  92%|█████████▏| 2570/2797 [08:25<00:46,  4.88batch/s, loss=1.517, lr=7.1e-06]
epoch 7/8:  92%|█████████▏| 2580/2797 [08:26<00:44,  4.86batch/s, loss=1.517, lr=7.1e-06]
epoch 7/8:  93%|█████████▎| 2591/2797 [08:28<00:41,  5.01batch/s, loss=1.517, lr=7.1e-06]
epoch 7/8:  93%|█████████▎| 2591/2797 [08:30<00:41,  5.01batch/s, loss=1.518, lr=7.0e-06]
epoch 7/8:  93%|█████████▎| 2602/2797 [08:30<00:38,  5.09batch/s, loss=1.518, lr=7.0e-06]
epoch 7/8:  93%|█████████▎| 2613/2797 [08:32<00:36,  5.01batch/s, loss=1.518, lr=7.0e-06]
epoch 7/8:  94%|█████████▍| 2624/2797 [08:35<00:35,  4.89batch/s, loss=1.518, lr=7.0e-06]
epoch 7/8:  94%|█████████▍| 2624/2797 [08:35<00:35,  4.89batch/s, loss=1.517, lr=7.0e-06]
epoch 7/8:  94%|█████████▍| 2634/2797 [08:37<00:33,  4.90batch/s, loss=1.517, lr=7.0e-06]
epoch 7/8:  95%|█████████▍| 2645/2797 [08:39<00:30,  5.05batch/s, loss=1.517, lr=7.0e-06]
epoch 7/8:  95%|█████████▍| 2645/2797 [08:40<00:30,  5.05batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  95%|█████████▍| 2656/2797 [08:41<00:27,  5.15batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  95%|█████████▌| 2667/2797 [08:43<00:24,  5.22batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  95%|█████████▌| 2667/2797 [08:45<00:24,  5.22batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  96%|█████████▌| 2678/2797 [08:45<00:23,  5.05batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  96%|█████████▌| 2689/2797 [08:48<00:22,  4.89batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  96%|█████████▋| 2699/2797 [08:50<00:20,  4.89batch/s, loss=1.517, lr=6.9e-06]
epoch 7/8:  96%|█████████▋| 2699/2797 [08:50<00:20,  4.89batch/s, loss=1.517, lr=6.8e-06]
epoch 7/8:  97%|█████████▋| 2711/2797 [08:52<00:16,  5.13batch/s, loss=1.517, lr=6.8e-06]
epoch 7/8:  97%|█████████▋| 2722/2797 [08:54<00:14,  5.21batch/s, loss=1.517, lr=6.8e-06]
epoch 7/8:  97%|█████████▋| 2722/2797 [08:55<00:14,  5.21batch/s, loss=1.517, lr=6.7e-06]
epoch 7/8:  98%|█████████▊| 2733/2797 [08:56<00:12,  5.17batch/s, loss=1.517, lr=6.7e-06]
epoch 7/8:  98%|█████████▊| 2744/2797 [08:58<00:10,  5.05batch/s, loss=1.517, lr=6.7e-06]
epoch 7/8:  98%|█████████▊| 2744/2797 [09:00<00:10,  5.05batch/s, loss=1.516, lr=6.7e-06]
epoch 7/8:  98%|█████████▊| 2755/2797 [09:00<00:08,  5.03batch/s, loss=1.516, lr=6.7e-06]
epoch 7/8:  99%|█████████▉| 2766/2797 [09:02<00:06,  5.13batch/s, loss=1.516, lr=6.7e-06]
epoch 7/8:  99%|█████████▉| 2766/2797 [09:05<00:06,  5.13batch/s, loss=1.516, lr=6.6e-06]
epoch 7/8:  99%|█████████▉| 2777/2797 [09:05<00:03,  5.02batch/s, loss=1.516, lr=6.6e-06]
epoch 7/8: 100%|█████████▉| 2788/2797 [09:07<00:01,  5.08batch/s, loss=1.516, lr=6.6e-06]
epoch 7/8: 100%|██████████| 2797/2797 [09:09<00:00,  5.09batch/s, loss=1.516, lr=6.6e-06]
epoch 7: train loss 1.516 · validation loss 2.075 · broad 81.7% (top-3 95.3%) · path 72.9% (top-3 89.6%, plausible or look-alike 88.5%) · 4131s elapsed

epoch 8/8:   0%|          | 0/2797 [00:00<?, ?batch/s]
epoch 8/8:   0%|          | 0/2797 [00:00<?, ?batch/s, loss=1.658, lr=6.6e-06]
epoch 8/8:   0%|          | 11/2797 [00:02<09:00,  5.16batch/s, loss=1.658, lr=6.6e-06]
epoch 8/8:   1%|          | 22/2797 [00:04<09:19,  4.96batch/s, loss=1.658, lr=6.6e-06]
epoch 8/8:   1%|          | 22/2797 [00:05<09:19,  4.96batch/s, loss=1.411, lr=6.5e-06]
epoch 8/8:   1%|          | 33/2797 [00:06<09:17,  4.96batch/s, loss=1.411, lr=6.5e-06]
epoch 8/8:   2%|▏         | 44/2797 [00:08<09:07,  5.02batch/s, loss=1.411, lr=6.5e-06]
epoch 8/8:   2%|▏         | 44/2797 [00:10<09:07,  5.02batch/s, loss=1.422, lr=6.5e-06]
epoch 8/8:   2%|▏         | 55/2797 [00:10<08:54,  5.13batch/s, loss=1.422, lr=6.5e-06]
epoch 8/8:   2%|▏         | 66/2797 [00:12<08:53,  5.12batch/s, loss=1.422, lr=6.5e-06]
epoch 8/8:   2%|▏         | 66/2797 [00:14<08:53,  5.12batch/s, loss=1.437, lr=6.4e-06]
epoch 8/8:   3%|▎         | 77/2797 [00:15<08:49,  5.14batch/s, loss=1.437, lr=6.4e-06]
epoch 8/8:   3%|▎         | 88/2797 [00:17<08:59,  5.02batch/s, loss=1.437, lr=6.4e-06]
epoch 8/8:   4%|▎         | 99/2797 [00:19<09:00,  4.99batch/s, loss=1.437, lr=6.4e-06]
epoch 8/8:   4%|▎         | 99/2797 [00:20<09:00,  4.99batch/s, loss=1.438, lr=6.3e-06]
epoch 8/8:   4%|▍         | 109/2797 [00:21<09:04,  4.94batch/s, loss=1.438, lr=6.3e-06]
epoch 8/8:   4%|▍         | 120/2797 [00:23<08:48,  5.07batch/s, loss=1.438, lr=6.3e-06]
epoch 8/8:   4%|▍         | 120/2797 [00:24<08:48,  5.07batch/s, loss=1.441, lr=6.3e-06]
epoch 8/8:   5%|▍         | 131/2797 [00:25<08:36,  5.16batch/s, loss=1.441, lr=6.3e-06]
epoch 8/8:   5%|▌         | 142/2797 [00:27<08:30,  5.20batch/s, loss=1.441, lr=6.3e-06]
epoch 8/8:   5%|▌         | 142/2797 [00:29<08:30,  5.20batch/s, loss=1.449, lr=6.2e-06]
epoch 8/8:   5%|▌         | 153/2797 [00:30<08:35,  5.13batch/s, loss=1.449, lr=6.2e-06]
epoch 8/8:   6%|▌         | 164/2797 [00:32<08:40,  5.06batch/s, loss=1.449, lr=6.2e-06]
epoch 8/8:   6%|▋         | 175/2797 [00:34<08:35,  5.09batch/s, loss=1.449, lr=6.2e-06]
epoch 8/8:   6%|▋         | 175/2797 [00:34<08:35,  5.09batch/s, loss=1.457, lr=6.2e-06]
epoch 8/8:   7%|▋         | 186/2797 [00:36<08:29,  5.12batch/s, loss=1.457, lr=6.2e-06]
epoch 8/8:   7%|▋         | 197/2797 [00:38<08:18,  5.22batch/s, loss=1.457, lr=6.2e-06]
epoch 8/8:   7%|▋         | 197/2797 [00:39<08:18,  5.22batch/s, loss=1.463, lr=6.1e-06]
epoch 8/8:   7%|▋         | 208/2797 [00:40<08:29,  5.08batch/s, loss=1.463, lr=6.1e-06]
epoch 8/8:   8%|▊         | 219/2797 [00:43<08:27,  5.08batch/s, loss=1.463, lr=6.1e-06]
epoch 8/8:   8%|▊         | 219/2797 [00:44<08:27,  5.08batch/s, loss=1.462, lr=6.0e-06]
epoch 8/8:   8%|▊         | 230/2797 [00:45<08:20,  5.13batch/s, loss=1.462, lr=6.0e-06]
epoch 8/8:   9%|▊         | 241/2797 [00:47<08:08,  5.23batch/s, loss=1.462, lr=6.0e-06]
epoch 8/8:   9%|▊         | 241/2797 [00:49<08:08,  5.23batch/s, loss=1.463, lr=6.0e-06]
epoch 8/8:   9%|▉         | 252/2797 [00:49<08:10,  5.19batch/s, loss=1.463, lr=6.0e-06]
epoch 8/8:   9%|▉         | 263/2797 [00:51<08:18,  5.09batch/s, loss=1.463, lr=6.0e-06]
epoch 8/8:  10%|▉         | 274/2797 [00:53<08:24,  5.01batch/s, loss=1.463, lr=6.0e-06]
epoch 8/8:  10%|▉         | 274/2797 [00:54<08:24,  5.01batch/s, loss=1.469, lr=5.9e-06]
epoch 8/8:  10%|█         | 285/2797 [00:56<08:26,  4.96batch/s, loss=1.469, lr=5.9e-06]
epoch 8/8:  11%|█         | 296/2797 [00:58<08:20,  4.99batch/s, loss=1.469, lr=5.9e-06]
epoch 8/8:  11%|█         | 296/2797 [00:59<08:20,  4.99batch/s, loss=1.472, lr=5.9e-06]
epoch 8/8:  11%|█         | 307/2797 [01:00<08:24,  4.94batch/s, loss=1.472, lr=5.9e-06]
epoch 8/8:  11%|█▏        | 317/2797 [01:02<08:28,  4.88batch/s, loss=1.472, lr=5.9e-06]
epoch 8/8:  11%|█▏        | 317/2797 [01:04<08:28,  4.88batch/s, loss=1.473, lr=5.8e-06]
epoch 8/8:  12%|█▏        | 328/2797 [01:04<08:12,  5.01batch/s, loss=1.473, lr=5.8e-06]
epoch 8/8:  12%|█▏        | 340/2797 [01:06<07:45,  5.28batch/s, loss=1.473, lr=5.8e-06]
epoch 8/8:  12%|█▏        | 340/2797 [01:08<07:45,  5.28batch/s, loss=1.471, lr=5.8e-06]
epoch 8/8:  13%|█▎        | 352/2797 [01:08<07:38,  5.34batch/s, loss=1.471, lr=5.8e-06]
epoch 8/8:  13%|█▎        | 363/2797 [01:11<07:59,  5.08batch/s, loss=1.471, lr=5.8e-06]
epoch 8/8:  13%|█▎        | 374/2797 [01:13<08:07,  4.97batch/s, loss=1.471, lr=5.8e-06]
epoch 8/8:  13%|█▎        | 374/2797 [01:14<08:07,  4.97batch/s, loss=1.475, lr=5.7e-06]
epoch 8/8:  14%|█▎        | 384/2797 [01:15<08:14,  4.88batch/s, loss=1.475, lr=5.7e-06]
epoch 8/8:  14%|█▍        | 395/2797 [01:18<08:09,  4.91batch/s, loss=1.475, lr=5.7e-06]
epoch 8/8:  14%|█▍        | 395/2797 [01:19<08:09,  4.91batch/s, loss=1.473, lr=5.6e-06]
epoch 8/8:  15%|█▍        | 406/2797 [01:20<07:59,  4.99batch/s, loss=1.473, lr=5.6e-06]
epoch 8/8:  15%|█▍        | 417/2797 [01:22<07:45,  5.11batch/s, loss=1.473, lr=5.6e-06]
epoch 8/8:  15%|█▍        | 417/2797 [01:23<07:45,  5.11batch/s, loss=1.472, lr=5.6e-06]
epoch 8/8:  15%|█▌        | 428/2797 [01:24<07:44,  5.10batch/s, loss=1.472, lr=5.6e-06]
epoch 8/8:  16%|█▌        | 439/2797 [01:26<08:05,  4.86batch/s, loss=1.472, lr=5.6e-06]
epoch 8/8:  16%|█▌        | 450/2797 [01:28<07:46,  5.03batch/s, loss=1.472, lr=5.6e-06]
epoch 8/8:  16%|█▌        | 450/2797 [01:29<07:46,  5.03batch/s, loss=1.472, lr=5.5e-06]
epoch 8/8:  16%|█▋        | 461/2797 [01:30<07:36,  5.12batch/s, loss=1.472, lr=5.5e-06]
epoch 8/8:  17%|█▋        | 472/2797 [01:33<07:40,  5.05batch/s, loss=1.472, lr=5.5e-06]
epoch 8/8:  17%|█▋        | 472/2797 [01:34<07:40,  5.05batch/s, loss=1.472, lr=5.5e-06]
epoch 8/8:  17%|█▋        | 483/2797 [01:35<07:48,  4.94batch/s, loss=1.472, lr=5.5e-06]
epoch 8/8:  18%|█▊        | 494/2797 [01:37<07:41,  4.99batch/s, loss=1.472, lr=5.5e-06]
epoch 8/8:  18%|█▊        | 494/2797 [01:39<07:41,  4.99batch/s, loss=1.471, lr=5.4e-06]
epoch 8/8:  18%|█▊        | 505/2797 [01:39<07:37,  5.01batch/s, loss=1.471, lr=5.4e-06]
epoch 8/8:  18%|█▊        | 516/2797 [01:42<07:31,  5.06batch/s, loss=1.471, lr=5.4e-06]
epoch 8/8:  18%|█▊        | 516/2797 [01:44<07:31,  5.06batch/s, loss=1.472, lr=5.3e-06]
epoch 8/8:  19%|█▉        | 527/2797 [01:44<07:44,  4.89batch/s, loss=1.472, lr=5.3e-06]
epoch 8/8:  19%|█▉        | 538/2797 [01:46<07:35,  4.96batch/s, loss=1.472, lr=5.3e-06]
epoch 8/8:  20%|█▉        | 548/2797 [01:48<07:42,  4.86batch/s, loss=1.472, lr=5.3e-06]
epoch 8/8:  20%|█▉        | 548/2797 [01:49<07:42,  4.86batch/s, loss=1.474, lr=5.3e-06]
epoch 8/8:  20%|█▉        | 559/2797 [01:50<07:30,  4.96batch/s, loss=1.474, lr=5.3e-06]
epoch 8/8:  20%|██        | 569/2797 [01:53<07:43,  4.80batch/s, loss=1.474, lr=5.3e-06]
epoch 8/8:  20%|██        | 569/2797 [01:54<07:43,  4.80batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  21%|██        | 580/2797 [01:55<07:29,  4.94batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  21%|██        | 591/2797 [01:57<07:20,  5.01batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  21%|██        | 591/2797 [01:59<07:20,  5.01batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  22%|██▏       | 603/2797 [01:59<06:54,  5.29batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  22%|██▏       | 614/2797 [02:01<06:52,  5.29batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  22%|██▏       | 625/2797 [02:03<06:58,  5.19batch/s, loss=1.475, lr=5.2e-06]
epoch 8/8:  22%|██▏       | 625/2797 [02:03<06:58,  5.19batch/s, loss=1.476, lr=5.1e-06]
epoch 8/8:  23%|██▎       | 636/2797 [02:05<06:58,  5.16batch/s, loss=1.476, lr=5.1e-06]
epoch 8/8:  23%|██▎       | 647/2797 [02:07<06:58,  5.14batch/s, loss=1.476, lr=5.1e-06]
epoch 8/8:  23%|██▎       | 647/2797 [02:08<06:58,  5.14batch/s, loss=1.473, lr=5.0e-06]
epoch 8/8:  24%|██▎       | 658/2797 [02:10<07:09,  4.98batch/s, loss=1.473, lr=5.0e-06]
epoch 8/8:  24%|██▍       | 669/2797 [02:12<06:59,  5.07batch/s, loss=1.473, lr=5.0e-06]
epoch 8/8:  24%|██▍       | 669/2797 [02:13<06:59,  5.07batch/s, loss=1.473, lr=5.0e-06]
epoch 8/8:  24%|██▍       | 680/2797 [02:14<07:01,  5.03batch/s, loss=1.473, lr=5.0e-06]
epoch 8/8:  25%|██▍       | 691/2797 [02:16<07:06,  4.94batch/s, loss=1.473, lr=5.0e-06]
epoch 8/8:  25%|██▍       | 691/2797 [02:19<07:06,  4.94batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  25%|██▌       | 701/2797 [02:19<07:17,  4.79batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  25%|██▌       | 712/2797 [02:21<07:04,  4.91batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  26%|██▌       | 722/2797 [02:23<07:01,  4.93batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  26%|██▌       | 722/2797 [02:24<07:01,  4.93batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  26%|██▌       | 733/2797 [02:25<06:52,  5.01batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  27%|██▋       | 744/2797 [02:27<07:03,  4.85batch/s, loss=1.473, lr=4.9e-06]
epoch 8/8:  27%|██▋       | 744/2797 [02:29<07:03,  4.85batch/s, loss=1.472, lr=4.8e-06]
epoch 8/8:  27%|██▋       | 755/2797 [02:29<06:52,  4.95batch/s, loss=1.472, lr=4.8e-06]
epoch 8/8:  27%|██▋       | 766/2797 [02:32<06:45,  5.01batch/s, loss=1.472, lr=4.8e-06]
epoch 8/8:  27%|██▋       | 766/2797 [02:34<06:45,  5.01batch/s, loss=1.473, lr=4.8e-06]
epoch 8/8:  28%|██▊       | 777/2797 [02:34<06:33,  5.13batch/s, loss=1.473, lr=4.8e-06]
epoch 8/8:  28%|██▊       | 788/2797 [02:36<06:27,  5.19batch/s, loss=1.473, lr=4.8e-06]
epoch 8/8:  29%|██▊       | 800/2797 [02:38<06:12,  5.36batch/s, loss=1.473, lr=4.8e-06]
epoch 8/8:  29%|██▊       | 800/2797 [02:38<06:12,  5.36batch/s, loss=1.473, lr=4.7e-06]
epoch 8/8:  29%|██▉       | 811/2797 [02:40<06:15,  5.29batch/s, loss=1.473, lr=4.7e-06]
epoch 8/8:  29%|██▉       | 822/2797 [02:42<06:32,  5.03batch/s, loss=1.473, lr=4.7e-06]
epoch 8/8:  29%|██▉       | 822/2797 [02:43<06:32,  5.03batch/s, loss=1.472, lr=4.6e-06]
epoch 8/8:  30%|██▉       | 833/2797 [02:45<06:28,  5.06batch/s, loss=1.472, lr=4.6e-06]
epoch 8/8:  30%|███       | 844/2797 [02:47<06:21,  5.12batch/s, loss=1.472, lr=4.6e-06]
epoch 8/8:  30%|███       | 844/2797 [02:48<06:21,  5.12batch/s, loss=1.473, lr=4.6e-06]
epoch 8/8:  31%|███       | 855/2797 [02:49<06:24,  5.04batch/s, loss=1.473, lr=4.6e-06]
epoch 8/8:  31%|███       | 866/2797 [02:51<06:21,  5.06batch/s, loss=1.473, lr=4.6e-06]
epoch 8/8:  31%|███       | 866/2797 [02:53<06:21,  5.06batch/s, loss=1.473, lr=4.5e-06]
epoch 8/8:  31%|███▏      | 877/2797 [02:53<06:21,  5.03batch/s, loss=1.473, lr=4.5e-06]
epoch 8/8:  32%|███▏      | 888/2797 [02:55<06:17,  5.06batch/s, loss=1.473, lr=4.5e-06]
epoch 8/8:  32%|███▏      | 899/2797 [02:57<06:12,  5.09batch/s, loss=1.473, lr=4.5e-06]
epoch 8/8:  32%|███▏      | 899/2797 [02:58<06:12,  5.09batch/s, loss=1.475, lr=4.5e-06]
epoch 8/8:  33%|███▎      | 910/2797 [03:00<06:17,  5.00batch/s, loss=1.475, lr=4.5e-06]
epoch 8/8:  33%|███▎      | 922/2797 [03:02<06:02,  5.17batch/s, loss=1.475, lr=4.5e-06]
epoch 8/8:  33%|███▎      | 922/2797 [03:03<06:02,  5.17batch/s, loss=1.475, lr=4.4e-06]
epoch 8/8:  33%|███▎      | 933/2797 [03:04<06:03,  5.12batch/s, loss=1.475, lr=4.4e-06]
epoch 8/8:  34%|███▍      | 944/2797 [03:06<06:01,  5.13batch/s, loss=1.475, lr=4.4e-06]
epoch 8/8:  34%|███▍      | 944/2797 [03:08<06:01,  5.13batch/s, loss=1.475, lr=4.3e-06]
epoch 8/8:  34%|███▍      | 955/2797 [03:08<05:57,  5.15batch/s, loss=1.475, lr=4.3e-06]
epoch 8/8:  35%|███▍      | 966/2797 [03:10<05:51,  5.21batch/s, loss=1.475, lr=4.3e-06]
epoch 8/8:  35%|███▍      | 966/2797 [03:12<05:51,  5.21batch/s, loss=1.475, lr=4.3e-06]
epoch 8/8:  35%|███▍      | 978/2797 [03:13<05:44,  5.28batch/s, loss=1.475, lr=4.3e-06]
epoch 8/8:  35%|███▌      | 989/2797 [03:15<05:55,  5.08batch/s, loss=1.475, lr=4.3e-06]
epoch 8/8:  35%|███▌      | 989/2797 [03:17<05:55,  5.08batch/s, loss=1.475, lr=4.2e-06]
epoch 8/8:  36%|███▌      | 1001/2797 [03:17<05:43,  5.23batch/s, loss=1.475, lr=4.2e-06]
epoch 8/8:  36%|███▌      | 1012/2797 [03:19<05:45,  5.17batch/s, loss=1.475, lr=4.2e-06]
epoch 8/8:  37%|███▋      | 1023/2797 [03:22<05:52,  5.03batch/s, loss=1.475, lr=4.2e-06]
epoch 8/8:  37%|███▋      | 1023/2797 [03:22<05:52,  5.03batch/s, loss=1.474, lr=4.2e-06]
epoch 8/8:  37%|███▋      | 1034/2797 [03:24<05:52,  5.00batch/s, loss=1.474, lr=4.2e-06]
epoch 8/8:  37%|███▋      | 1045/2797 [03:26<05:45,  5.07batch/s, loss=1.474, lr=4.2e-06]
epoch 8/8:  37%|███▋      | 1045/2797 [03:27<05:45,  5.07batch/s, loss=1.473, lr=4.1e-06]
epoch 8/8:  38%|███▊      | 1056/2797 [03:28<05:42,  5.08batch/s, loss=1.473, lr=4.1e-06]
epoch 8/8:  38%|███▊      | 1067/2797 [03:30<05:39,  5.10batch/s, loss=1.473, lr=4.1e-06]
epoch 8/8:  38%|███▊      | 1067/2797 [03:32<05:39,  5.10batch/s, loss=1.474, lr=4.0e-06]
epoch 8/8:  39%|███▊      | 1078/2797 [03:33<05:49,  4.92batch/s, loss=1.474, lr=4.0e-06]
epoch 8/8:  39%|███▉      | 1089/2797 [03:35<05:46,  4.93batch/s, loss=1.474, lr=4.0e-06]
epoch 8/8:  39%|███▉      | 1100/2797 [03:37<05:37,  5.02batch/s, loss=1.474, lr=4.0e-06]
epoch 8/8:  39%|███▉      | 1100/2797 [03:37<05:37,  5.02batch/s, loss=1.472, lr=4.0e-06]
epoch 8/8:  40%|███▉      | 1111/2797 [03:39<05:36,  5.01batch/s, loss=1.472, lr=4.0e-06]
epoch 8/8:  40%|████      | 1122/2797 [03:42<05:40,  4.91batch/s, loss=1.472, lr=4.0e-06]
epoch 8/8:  40%|████      | 1122/2797 [03:42<05:40,  4.91batch/s, loss=1.473, lr=3.9e-06]
epoch 8/8:  40%|████      | 1132/2797 [03:44<05:38,  4.92batch/s, loss=1.473, lr=3.9e-06]
epoch 8/8:  41%|████      | 1143/2797 [03:46<05:29,  5.02batch/s, loss=1.473, lr=3.9e-06]
epoch 8/8:  41%|████      | 1143/2797 [03:47<05:29,  5.02batch/s, loss=1.472, lr=3.9e-06]
epoch 8/8:  41%|████▏     | 1154/2797 [03:48<05:33,  4.93batch/s, loss=1.472, lr=3.9e-06]
epoch 8/8:  42%|████▏     | 1166/2797 [03:50<05:13,  5.20batch/s, loss=1.472, lr=3.9e-06]
epoch 8/8:  42%|████▏     | 1166/2797 [03:52<05:13,  5.20batch/s, loss=1.473, lr=3.8e-06]
epoch 8/8:  42%|████▏     | 1177/2797 [03:52<05:13,  5.18batch/s, loss=1.473, lr=3.8e-06]
epoch 8/8:  42%|████▏     | 1188/2797 [03:54<05:15,  5.10batch/s, loss=1.473, lr=3.8e-06]
epoch 8/8:  43%|████▎     | 1199/2797 [03:57<05:20,  4.98batch/s, loss=1.473, lr=3.8e-06]
epoch 8/8:  43%|████▎     | 1199/2797 [03:57<05:20,  4.98batch/s, loss=1.472, lr=3.8e-06]
epoch 8/8:  43%|████▎     | 1210/2797 [03:59<05:12,  5.08batch/s, loss=1.472, lr=3.8e-06]
epoch 8/8:  44%|████▎     | 1222/2797 [04:01<05:00,  5.24batch/s, loss=1.472, lr=3.8e-06]
epoch 8/8:  44%|████▎     | 1222/2797 [04:02<05:00,  5.24batch/s, loss=1.473, lr=3.7e-06]
epoch 8/8:  44%|████▍     | 1233/2797 [04:03<04:57,  5.26batch/s, loss=1.473, lr=3.7e-06]
epoch 8/8:  44%|████▍     | 1244/2797 [04:05<04:58,  5.21batch/s, loss=1.473, lr=3.7e-06]
epoch 8/8:  44%|████▍     | 1244/2797 [04:07<04:58,  5.21batch/s, loss=1.473, lr=3.6e-06]
epoch 8/8:  45%|████▍     | 1255/2797 [04:08<05:07,  5.01batch/s, loss=1.473, lr=3.6e-06]
epoch 8/8:  45%|████▌     | 1266/2797 [04:10<05:00,  5.09batch/s, loss=1.473, lr=3.6e-06]
epoch 8/8:  45%|████▌     | 1266/2797 [04:12<05:00,  5.09batch/s, loss=1.474, lr=3.6e-06]
epoch 8/8:  46%|████▌     | 1277/2797 [04:12<04:59,  5.07batch/s, loss=1.474, lr=3.6e-06]
epoch 8/8:  46%|████▌     | 1288/2797 [04:14<04:58,  5.06batch/s, loss=1.474, lr=3.6e-06]
epoch 8/8:  46%|████▋     | 1299/2797 [04:16<04:59,  5.00batch/s, loss=1.474, lr=3.6e-06]
epoch 8/8:  46%|████▋     | 1299/2797 [04:17<04:59,  5.00batch/s, loss=1.475, lr=3.5e-06]
epoch 8/8:  47%|████▋     | 1310/2797 [04:18<04:53,  5.06batch/s, loss=1.475, lr=3.5e-06]
epoch 8/8:  47%|████▋     | 1321/2797 [04:21<04:59,  4.93batch/s, loss=1.475, lr=3.5e-06]
epoch 8/8:  47%|████▋     | 1321/2797 [04:22<04:59,  4.93batch/s, loss=1.476, lr=3.5e-06]
epoch 8/8:  48%|████▊     | 1332/2797 [04:23<04:53,  5.00batch/s, loss=1.476, lr=3.5e-06]
epoch 8/8:  48%|████▊     | 1343/2797 [04:25<04:44,  5.11batch/s, loss=1.476, lr=3.5e-06]
epoch 8/8:  48%|████▊     | 1343/2797 [04:27<04:44,  5.11batch/s, loss=1.476, lr=3.4e-06]
epoch 8/8:  48%|████▊     | 1354/2797 [04:27<04:45,  5.05batch/s, loss=1.476, lr=3.4e-06]
epoch 8/8:  49%|████▉     | 1366/2797 [04:29<04:30,  5.29batch/s, loss=1.476, lr=3.4e-06]
epoch 8/8:  49%|████▉     | 1366/2797 [04:31<04:30,  5.29batch/s, loss=1.476, lr=3.3e-06]
epoch 8/8:  49%|████▉     | 1377/2797 [04:31<04:29,  5.27batch/s, loss=1.476, lr=3.3e-06]
epoch 8/8:  50%|████▉     | 1388/2797 [04:34<04:39,  5.03batch/s, loss=1.476, lr=3.3e-06]
epoch 8/8:  50%|█████     | 1399/2797 [04:36<04:48,  4.85batch/s, loss=1.476, lr=3.3e-06]
epoch 8/8:  50%|█████     | 1399/2797 [04:37<04:48,  4.85batch/s, loss=1.477, lr=3.3e-06]
epoch 8/8:  50%|█████     | 1410/2797 [04:38<04:39,  4.97batch/s, loss=1.477, lr=3.3e-06]
epoch 8/8:  51%|█████     | 1421/2797 [04:40<04:35,  4.99batch/s, loss=1.477, lr=3.3e-06]
epoch 8/8:  51%|█████     | 1421/2797 [04:42<04:35,  4.99batch/s, loss=1.477, lr=3.2e-06]
epoch 8/8:  51%|█████     | 1432/2797 [04:43<04:36,  4.94batch/s, loss=1.477, lr=3.2e-06]
epoch 8/8:  52%|█████▏    | 1443/2797 [04:45<04:26,  5.08batch/s, loss=1.477, lr=3.2e-06]
epoch 8/8:  52%|█████▏    | 1443/2797 [04:46<04:26,  5.08batch/s, loss=1.478, lr=3.2e-06]
epoch 8/8:  52%|█████▏    | 1454/2797 [04:47<04:27,  5.03batch/s, loss=1.478, lr=3.2e-06]
epoch 8/8:  52%|█████▏    | 1465/2797 [04:49<04:22,  5.08batch/s, loss=1.478, lr=3.2e-06]
epoch 8/8:  52%|█████▏    | 1465/2797 [04:51<04:22,  5.08batch/s, loss=1.477, lr=3.1e-06]
epoch 8/8:  53%|█████▎    | 1476/2797 [04:51<04:19,  5.09batch/s, loss=1.477, lr=3.1e-06]
epoch 8/8:  53%|█████▎    | 1488/2797 [04:53<04:07,  5.29batch/s, loss=1.477, lr=3.1e-06]
epoch 8/8:  54%|█████▎    | 1499/2797 [04:56<04:08,  5.22batch/s, loss=1.477, lr=3.1e-06]
epoch 8/8:  54%|█████▎    | 1499/2797 [04:56<04:08,  5.22batch/s, loss=1.476, lr=3.0e-06]
epoch 8/8:  54%|█████▍    | 1510/2797 [04:58<04:04,  5.25batch/s, loss=1.476, lr=3.0e-06]
epoch 8/8:  54%|█████▍    | 1521/2797 [05:00<04:06,  5.18batch/s, loss=1.476, lr=3.0e-06]
epoch 8/8:  54%|█████▍    | 1521/2797 [05:01<04:06,  5.18batch/s, loss=1.476, lr=3.0e-06]
epoch 8/8:  55%|█████▍    | 1532/2797 [05:02<04:08,  5.09batch/s, loss=1.476, lr=3.0e-06]
epoch 8/8:  55%|█████▌    | 1543/2797 [05:04<04:04,  5.13batch/s, loss=1.476, lr=3.0e-06]
epoch 8/8:  55%|█████▌    | 1543/2797 [05:06<04:04,  5.13batch/s, loss=1.476, lr=2.9e-06]
epoch 8/8:  56%|█████▌    | 1554/2797 [05:06<04:01,  5.15batch/s, loss=1.476, lr=2.9e-06]
epoch 8/8:  56%|█████▌    | 1565/2797 [05:08<04:02,  5.09batch/s, loss=1.476, lr=2.9e-06]
epoch 8/8:  56%|█████▌    | 1565/2797 [05:11<04:02,  5.09batch/s, loss=1.477, lr=2.9e-06]
epoch 8/8:  56%|█████▋    | 1576/2797 [05:11<04:02,  5.04batch/s, loss=1.477, lr=2.9e-06]
epoch 8/8:  57%|█████▋    | 1587/2797 [05:13<03:58,  5.07batch/s, loss=1.477, lr=2.9e-06]
epoch 8/8:  57%|█████▋    | 1598/2797 [05:15<03:52,  5.16batch/s, loss=1.477, lr=2.9e-06]
epoch 8/8:  57%|█████▋    | 1598/2797 [05:15<03:52,  5.16batch/s, loss=1.478, lr=2.8e-06]
epoch 8/8:  58%|█████▊    | 1609/2797 [05:17<03:55,  5.05batch/s, loss=1.478, lr=2.8e-06]
epoch 8/8:  58%|█████▊    | 1620/2797 [05:19<03:54,  5.02batch/s, loss=1.478, lr=2.8e-06]
epoch 8/8:  58%|█████▊    | 1620/2797 [05:21<03:54,  5.02batch/s, loss=1.478, lr=2.8e-06]
epoch 8/8:  58%|█████▊    | 1631/2797 [05:22<03:49,  5.08batch/s, loss=1.478, lr=2.8e-06]
epoch 8/8:  59%|█████▊    | 1642/2797 [05:24<03:47,  5.07batch/s, loss=1.478, lr=2.8e-06]
epoch 8/8:  59%|█████▊    | 1642/2797 [05:26<03:47,  5.07batch/s, loss=1.477, lr=2.7e-06]
epoch 8/8:  59%|█████▉    | 1653/2797 [05:26<03:49,  4.99batch/s, loss=1.477, lr=2.7e-06]
epoch 8/8:  59%|█████▉    | 1664/2797 [05:28<03:43,  5.07batch/s, loss=1.477, lr=2.7e-06]
epoch 8/8:  60%|█████▉    | 1675/2797 [05:30<03:44,  4.99batch/s, loss=1.477, lr=2.7e-06]
epoch 8/8:  60%|█████▉    | 1675/2797 [05:31<03:44,  4.99batch/s, loss=1.476, lr=2.6e-06]
epoch 8/8:  60%|██████    | 1686/2797 [05:33<03:48,  4.86batch/s, loss=1.476, lr=2.6e-06]
epoch 8/8:  61%|██████    | 1696/2797 [05:35<03:48,  4.82batch/s, loss=1.476, lr=2.6e-06]
epoch 8/8:  61%|██████    | 1696/2797 [05:36<03:48,  4.82batch/s, loss=1.477, lr=2.6e-06]
epoch 8/8:  61%|██████    | 1706/2797 [05:37<03:51,  4.71batch/s, loss=1.477, lr=2.6e-06]
epoch 8/8:  61%|██████▏   | 1717/2797 [05:39<03:44,  4.81batch/s, loss=1.477, lr=2.6e-06]
epoch 8/8:  61%|██████▏   | 1717/2797 [05:41<03:44,  4.81batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  62%|██████▏   | 1728/2797 [05:41<03:39,  4.87batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  62%|██████▏   | 1739/2797 [05:44<03:34,  4.93batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  63%|██████▎   | 1749/2797 [05:46<03:34,  4.89batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  63%|██████▎   | 1749/2797 [05:46<03:34,  4.89batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  63%|██████▎   | 1760/2797 [05:48<03:28,  4.97batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  63%|██████▎   | 1771/2797 [05:50<03:22,  5.06batch/s, loss=1.476, lr=2.5e-06]
epoch 8/8:  63%|██████▎   | 1771/2797 [05:51<03:22,  5.06batch/s, loss=1.477, lr=2.4e-06]
epoch 8/8:  64%|██████▎   | 1782/2797 [05:52<03:19,  5.09batch/s, loss=1.477, lr=2.4e-06]
epoch 8/8:  64%|██████▍   | 1793/2797 [05:54<03:15,  5.13batch/s, loss=1.477, lr=2.4e-06]
epoch 8/8:  64%|██████▍   | 1793/2797 [05:56<03:15,  5.13batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  64%|██████▍   | 1804/2797 [05:56<03:14,  5.10batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  65%|██████▍   | 1815/2797 [05:59<03:16,  5.00batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  65%|██████▍   | 1815/2797 [06:01<03:16,  5.00batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  65%|██████▌   | 1826/2797 [06:01<03:12,  5.04batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  66%|██████▌   | 1837/2797 [06:03<03:06,  5.15batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  66%|██████▌   | 1848/2797 [06:05<03:03,  5.16batch/s, loss=1.477, lr=2.3e-06]
epoch 8/8:  66%|██████▌   | 1848/2797 [06:06<03:03,  5.16batch/s, loss=1.477, lr=2.2e-06]
epoch 8/8:  66%|██████▋   | 1859/2797 [06:07<02:59,  5.21batch/s, loss=1.477, lr=2.2e-06]
epoch 8/8:  67%|██████▋   | 1870/2797 [06:09<02:57,  5.22batch/s, loss=1.477, lr=2.2e-06]
epoch 8/8:  67%|██████▋   | 1870/2797 [06:10<02:57,  5.22batch/s, loss=1.478, lr=2.2e-06]
epoch 8/8:  67%|██████▋   | 1881/2797 [06:11<02:54,  5.24batch/s, loss=1.478, lr=2.2e-06]
epoch 8/8:  68%|██████▊   | 1892/2797 [06:13<02:51,  5.28batch/s, loss=1.478, lr=2.2e-06]
epoch 8/8:  68%|██████▊   | 1892/2797 [06:15<02:51,  5.28batch/s, loss=1.478, lr=2.1e-06]
epoch 8/8:  68%|██████▊   | 1904/2797 [06:15<02:45,  5.39batch/s, loss=1.478, lr=2.1e-06]
epoch 8/8:  68%|██████▊   | 1915/2797 [06:18<02:46,  5.30batch/s, loss=1.478, lr=2.1e-06]
epoch 8/8:  68%|██████▊   | 1915/2797 [06:20<02:46,  5.30batch/s, loss=1.477, lr=2.0e-06]
epoch 8/8:  69%|██████▉   | 1926/2797 [06:20<02:48,  5.18batch/s, loss=1.477, lr=2.0e-06]
epoch 8/8:  69%|██████▉   | 1937/2797 [06:22<02:48,  5.10batch/s, loss=1.477, lr=2.0e-06]
epoch 8/8:  70%|██████▉   | 1948/2797 [06:24<02:49,  5.00batch/s, loss=1.477, lr=2.0e-06]
epoch 8/8:  70%|██████▉   | 1948/2797 [06:25<02:49,  5.00batch/s, loss=1.478, lr=2.0e-06]
epoch 8/8:  70%|███████   | 1960/2797 [06:26<02:39,  5.26batch/s, loss=1.478, lr=2.0e-06]
epoch 8/8:  70%|███████   | 1971/2797 [06:29<02:38,  5.21batch/s, loss=1.478, lr=2.0e-06]
epoch 8/8:  70%|███████   | 1971/2797 [06:29<02:38,  5.21batch/s, loss=1.478, lr=1.9e-06]
epoch 8/8:  71%|███████   | 1982/2797 [06:31<02:36,  5.19batch/s, loss=1.478, lr=1.9e-06]
epoch 8/8:  71%|███████▏  | 1993/2797 [06:33<02:33,  5.23batch/s, loss=1.478, lr=1.9e-06]
epoch 8/8:  71%|███████▏  | 1993/2797 [06:34<02:33,  5.23batch/s, loss=1.477, lr=1.9e-06]
epoch 8/8:  72%|███████▏  | 2004/2797 [06:35<02:35,  5.09batch/s, loss=1.477, lr=1.9e-06]
epoch 8/8:  72%|███████▏  | 2015/2797 [06:37<02:32,  5.13batch/s, loss=1.477, lr=1.9e-06]
epoch 8/8:  72%|███████▏  | 2015/2797 [06:39<02:32,  5.13batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  72%|███████▏  | 2026/2797 [06:39<02:31,  5.10batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  73%|███████▎  | 2037/2797 [06:41<02:27,  5.14batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  73%|███████▎  | 2048/2797 [06:44<02:28,  5.06batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  73%|███████▎  | 2048/2797 [06:44<02:28,  5.06batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  74%|███████▎  | 2059/2797 [06:46<02:27,  4.99batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  74%|███████▍  | 2070/2797 [06:48<02:22,  5.09batch/s, loss=1.478, lr=1.8e-06]
epoch 8/8:  74%|███████▍  | 2070/2797 [06:49<02:22,  5.09batch/s, loss=1.478, lr=1.7e-06]
epoch 8/8:  74%|███████▍  | 2081/2797 [06:50<02:20,  5.10batch/s, loss=1.478, lr=1.7e-06]
epoch 8/8:  75%|███████▍  | 2092/2797 [06:53<02:25,  4.83batch/s, loss=1.478, lr=1.7e-06]
epoch 8/8:  75%|███████▍  | 2092/2797 [06:54<02:25,  4.83batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  75%|███████▌  | 2104/2797 [06:55<02:17,  5.05batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  76%|███████▌  | 2116/2797 [06:57<02:08,  5.28batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  76%|███████▌  | 2116/2797 [06:59<02:08,  5.28batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  76%|███████▌  | 2128/2797 [06:59<02:02,  5.46batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  76%|███████▋  | 2139/2797 [07:01<02:02,  5.35batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  77%|███████▋  | 2150/2797 [07:03<02:02,  5.27batch/s, loss=1.478, lr=1.6e-06]
epoch 8/8:  77%|███████▋  | 2150/2797 [07:03<02:02,  5.27batch/s, loss=1.478, lr=1.5e-06]
epoch 8/8:  77%|███████▋  | 2161/2797 [07:05<02:00,  5.27batch/s, loss=1.478, lr=1.5e-06]
epoch 8/8:  78%|███████▊  | 2172/2797 [07:08<02:02,  5.11batch/s, loss=1.478, lr=1.5e-06]
epoch 8/8:  78%|███████▊  | 2172/2797 [07:08<02:02,  5.11batch/s, loss=1.478, lr=1.5e-06]
epoch 8/8:  78%|███████▊  | 2183/2797 [07:10<02:01,  5.05batch/s, loss=1.478, lr=1.5e-06]
epoch 8/8:  78%|███████▊  | 2194/2797 [07:12<02:03,  4.87batch/s, loss=1.478, lr=1.5e-06]
epoch 8/8:  78%|███████▊  | 2194/2797 [07:14<02:03,  4.87batch/s, loss=1.478, lr=1.4e-06]
epoch 8/8:  79%|███████▉  | 2205/2797 [07:14<01:59,  4.95batch/s, loss=1.478, lr=1.4e-06]
epoch 8/8:  79%|███████▉  | 2216/2797 [07:17<01:55,  5.03batch/s, loss=1.478, lr=1.4e-06]
epoch 8/8:  79%|███████▉  | 2216/2797 [07:19<01:55,  5.03batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  80%|███████▉  | 2227/2797 [07:19<01:54,  4.99batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  80%|████████  | 2238/2797 [07:21<01:49,  5.10batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  80%|████████  | 2250/2797 [07:23<01:43,  5.30batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  80%|████████  | 2250/2797 [07:23<01:43,  5.30batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  81%|████████  | 2261/2797 [07:25<01:42,  5.22batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  81%|████████▏ | 2273/2797 [07:27<01:38,  5.34batch/s, loss=1.478, lr=1.3e-06]
epoch 8/8:  81%|████████▏ | 2273/2797 [07:28<01:38,  5.34batch/s, loss=1.478, lr=1.2e-06]
epoch 8/8:  82%|████████▏ | 2284/2797 [07:30<01:39,  5.15batch/s, loss=1.478, lr=1.2e-06]
epoch 8/8:  82%|████████▏ | 2295/2797 [07:32<01:40,  5.00batch/s, loss=1.478, lr=1.2e-06]
epoch 8/8:  82%|████████▏ | 2295/2797 [07:33<01:40,  5.00batch/s, loss=1.479, lr=1.2e-06]
epoch 8/8:  82%|████████▏ | 2306/2797 [07:34<01:39,  4.95batch/s, loss=1.479, lr=1.2e-06]
epoch 8/8:  83%|████████▎ | 2317/2797 [07:36<01:35,  5.03batch/s, loss=1.479, lr=1.2e-06]
epoch 8/8:  83%|████████▎ | 2317/2797 [07:38<01:35,  5.03batch/s, loss=1.479, lr=1.1e-06]
epoch 8/8:  83%|████████▎ | 2330/2797 [07:38<01:27,  5.36batch/s, loss=1.479, lr=1.1e-06]
epoch 8/8:  84%|████████▎ | 2341/2797 [07:41<01:26,  5.29batch/s, loss=1.479, lr=1.1e-06]
epoch 8/8:  84%|████████▎ | 2341/2797 [07:43<01:26,  5.29batch/s, loss=1.479, lr=1.0e-06]
epoch 8/8:  84%|████████▍ | 2352/2797 [07:43<01:27,  5.11batch/s, loss=1.479, lr=1.0e-06]
epoch 8/8:  84%|████████▍ | 2363/2797 [07:45<01:23,  5.20batch/s, loss=1.479, lr=1.0e-06]
epoch 8/8:  85%|████████▍ | 2374/2797 [07:47<01:22,  5.14batch/s, loss=1.479, lr=1.0e-06]
epoch 8/8:  85%|████████▍ | 2374/2797 [07:47<01:22,  5.14batch/s, loss=1.479, lr=9.9e-07]
epoch 8/8:  85%|████████▌ | 2386/2797 [07:49<01:18,  5.24batch/s, loss=1.479, lr=9.9e-07]
epoch 8/8:  86%|████████▌ | 2397/2797 [07:52<01:18,  5.10batch/s, loss=1.479, lr=9.9e-07]
epoch 8/8:  86%|████████▌ | 2397/2797 [07:52<01:18,  5.10batch/s, loss=1.478, lr=9.3e-07]
epoch 8/8:  86%|████████▌ | 2408/2797 [07:54<01:15,  5.15batch/s, loss=1.478, lr=9.3e-07]
epoch 8/8:  86%|████████▋ | 2419/2797 [07:56<01:13,  5.11batch/s, loss=1.478, lr=9.3e-07]
epoch 8/8:  86%|████████▋ | 2419/2797 [07:57<01:13,  5.11batch/s, loss=1.479, lr=8.7e-07]
epoch 8/8:  87%|████████▋ | 2431/2797 [07:58<01:10,  5.21batch/s, loss=1.479, lr=8.7e-07]
epoch 8/8:  87%|████████▋ | 2443/2797 [08:00<01:06,  5.33batch/s, loss=1.479, lr=8.7e-07]
epoch 8/8:  87%|████████▋ | 2443/2797 [08:02<01:06,  5.33batch/s, loss=1.479, lr=8.1e-07]
epoch 8/8:  88%|████████▊ | 2454/2797 [08:02<01:06,  5.18batch/s, loss=1.479, lr=8.1e-07]
epoch 8/8:  88%|████████▊ | 2465/2797 [08:05<01:03,  5.21batch/s, loss=1.479, lr=8.1e-07]
epoch 8/8:  88%|████████▊ | 2465/2797 [08:07<01:03,  5.21batch/s, loss=1.478, lr=7.6e-07]
epoch 8/8:  89%|████████▊ | 2476/2797 [08:07<01:01,  5.19batch/s, loss=1.478, lr=7.6e-07]
epoch 8/8:  89%|████████▉ | 2487/2797 [08:09<01:00,  5.12batch/s, loss=1.478, lr=7.6e-07]
epoch 8/8:  89%|████████▉ | 2498/2797 [08:11<00:59,  5.05batch/s, loss=1.478, lr=7.6e-07]
epoch 8/8:  89%|████████▉ | 2498/2797 [08:12<00:59,  5.05batch/s, loss=1.479, lr=7.0e-07]
epoch 8/8:  90%|████████▉ | 2510/2797 [08:13<00:54,  5.22batch/s, loss=1.479, lr=7.0e-07]
epoch 8/8:  90%|█████████ | 2521/2797 [08:15<00:53,  5.15batch/s, loss=1.479, lr=7.0e-07]
epoch 8/8:  90%|█████████ | 2521/2797 [08:17<00:53,  5.15batch/s, loss=1.478, lr=6.4e-07]
epoch 8/8:  91%|█████████ | 2532/2797 [08:18<00:51,  5.14batch/s, loss=1.478, lr=6.4e-07]
epoch 8/8:  91%|█████████ | 2543/2797 [08:20<00:50,  5.02batch/s, loss=1.478, lr=6.4e-07]
epoch 8/8:  91%|█████████ | 2543/2797 [08:21<00:50,  5.02batch/s, loss=1.478, lr=5.8e-07]
epoch 8/8:  91%|█████████▏| 2554/2797 [08:22<00:47,  5.11batch/s, loss=1.478, lr=5.8e-07]
epoch 8/8:  92%|█████████▏| 2565/2797 [08:24<00:44,  5.16batch/s, loss=1.478, lr=5.8e-07]
epoch 8/8:  92%|█████████▏| 2565/2797 [08:26<00:44,  5.16batch/s, loss=1.478, lr=5.2e-07]
epoch 8/8:  92%|█████████▏| 2576/2797 [08:26<00:43,  5.10batch/s, loss=1.478, lr=5.2e-07]
epoch 8/8:  92%|█████████▏| 2587/2797 [08:29<00:41,  5.05batch/s, loss=1.478, lr=5.2e-07]
epoch 8/8:  93%|█████████▎| 2599/2797 [08:31<00:37,  5.29batch/s, loss=1.478, lr=5.2e-07]
epoch 8/8:  93%|█████████▎| 2599/2797 [08:31<00:37,  5.29batch/s, loss=1.478, lr=4.6e-07]
epoch 8/8:  93%|█████████▎| 2610/2797 [08:33<00:35,  5.32batch/s, loss=1.478, lr=4.6e-07]
epoch 8/8:  94%|█████████▎| 2621/2797 [08:35<00:33,  5.32batch/s, loss=1.478, lr=4.6e-07]
epoch 8/8:  94%|█████████▎| 2621/2797 [08:36<00:33,  5.32batch/s, loss=1.478, lr=4.0e-07]
epoch 8/8:  94%|█████████▍| 2632/2797 [08:37<00:31,  5.31batch/s, loss=1.478, lr=4.0e-07]
epoch 8/8:  94%|█████████▍| 2643/2797 [08:39<00:28,  5.32batch/s, loss=1.478, lr=4.0e-07]
epoch 8/8:  94%|█████████▍| 2643/2797 [08:40<00:28,  5.32batch/s, loss=1.478, lr=3.4e-07]
epoch 8/8:  95%|█████████▍| 2654/2797 [08:41<00:26,  5.32batch/s, loss=1.478, lr=3.4e-07]
epoch 8/8:  95%|█████████▌| 2665/2797 [08:43<00:25,  5.16batch/s, loss=1.478, lr=3.4e-07]
epoch 8/8:  95%|█████████▌| 2665/2797 [08:45<00:25,  5.16batch/s, loss=1.478, lr=2.8e-07]
epoch 8/8:  96%|█████████▌| 2676/2797 [08:45<00:23,  5.18batch/s, loss=1.478, lr=2.8e-07]
epoch 8/8:  96%|█████████▌| 2687/2797 [08:48<00:21,  5.09batch/s, loss=1.478, lr=2.8e-07]
epoch 8/8:  96%|█████████▋| 2698/2797 [08:50<00:19,  5.18batch/s, loss=1.478, lr=2.8e-07]
epoch 8/8:  96%|█████████▋| 2698/2797 [08:50<00:19,  5.18batch/s, loss=1.478, lr=2.3e-07]
epoch 8/8:  97%|█████████▋| 2709/2797 [08:52<00:17,  5.06batch/s, loss=1.478, lr=2.3e-07]
epoch 8/8:  97%|█████████▋| 2720/2797 [08:54<00:15,  5.02batch/s, loss=1.478, lr=2.3e-07]
epoch 8/8:  97%|█████████▋| 2720/2797 [08:55<00:15,  5.02batch/s, loss=1.478, lr=1.7e-07]
epoch 8/8:  98%|█████████▊| 2731/2797 [08:56<00:13,  5.06batch/s, loss=1.478, lr=1.7e-07]
epoch 8/8:  98%|█████████▊| 2742/2797 [08:58<00:10,  5.02batch/s, loss=1.478, lr=1.7e-07]
epoch 8/8:  98%|█████████▊| 2742/2797 [09:00<00:10,  5.02batch/s, loss=1.477, lr=1.1e-07]
epoch 8/8:  98%|█████████▊| 2753/2797 [09:00<00:08,  5.13batch/s, loss=1.477, lr=1.1e-07]
epoch 8/8:  99%|█████████▉| 2764/2797 [09:03<00:06,  5.22batch/s, loss=1.477, lr=1.1e-07]
epoch 8/8:  99%|█████████▉| 2764/2797 [09:05<00:06,  5.22batch/s, loss=1.477, lr=4.9e-08]
epoch 8/8:  99%|█████████▉| 2776/2797 [09:05<00:03,  5.37batch/s, loss=1.477, lr=4.9e-08]
epoch 8/8: 100%|█████████▉| 2787/2797 [09:07<00:01,  5.37batch/s, loss=1.477, lr=4.9e-08]
epoch 8/8: 100%|██████████| 2797/2797 [09:08<00:00,  5.10batch/s, loss=1.477, lr=4.9e-08]
epoch 8: train loss 1.477 · validation loss 2.079 · broad 81.6% (top-3 95.2%) · path 73.0% (top-3 89.5%, plausible or look-alike 88.5%) · 4720s elapsed
LIVE TEST (10000 held-out live posts): broad 83.8% (top-3 96.3%) · path 75.7% (plausible or look-alike 90.4%)

writing the final TensorBoard report ...
  final_val: 30101 posts, path plausible or look-alike 88.5%
  final_test: 20058 posts, path plausible or look-alike 87.0%
  final_test_common: 20153 posts, path plausible or look-alike 88.0%
  human: {'posts': 93, 'accepted': 59, 'rejected': 17, 'unjudged': 17, 'accepted_share': 0.6344086021505376, 'accepted_share_of_judged': 0.7763157894736842}

TEST (windows w21, w22, w23, 20058 posts, best epoch 7): broad 80.6% (top-3 94.5%) · path 71.9% (top-3 88.3%, one of Jev's plausible answers 87.0%) · GPU 770 posts/s · saved to /data/models/v4