Hugging Face's logo

haileyok
/
microblog-topic-classifier-v4

Text Classification
Transformers
TensorBoard
Safetensors
English
topic-classification
sentiment
spam-detection
social-media
modernbert
multi-head
Model card Files
xet
 Metrics Community
microblog-topic-classifier-v4 / train.log
haileyok's picture
haileyok
v4: image text, attachments, and labels in the input; sentiment, critical, ad, engagement bait, spam, and self-promotion signals; trained on recent posts too
cc94070 verified
Raw History Blame Contribute Delete
297 kB
{"train_windows": ["w00", "w01", "w02", "w03", "w04", "w05", "w06", "w07", "w08", "w09", "w10", "w11", "w12", "w13", "w14", "w15", "w16", "w17"], "val_windows": ["w18", "w19", "w20"], "test_windows": ["w21", "w22", "w23"], "n_train": 178954, "n_val": 30101, "n_test": 20058, "live_configs": ["ea4d660431d6"], "n_live_test": 10000, "n_live_val": 3000, "n_live_train": 46918, "live_weight": 3.0}
Loading weights: 0%| | 0/134 [00:00<?, ?it/s] Loading weights: 100%|██████████| 134/134 [00:00<00:00, 15391.94it/s]
[transformers] ModernBertModel LOAD REPORT from: answerdotai/ModernBERT-base
Key | Status | |
------------------+------------+--+-
decoder.bias | UNEXPECTED | |
head.norm.weight | UNEXPECTED | |
head.dense.weight | UNEXPECTED | |
Notes:
- UNEXPECTED: can be ignored when loading from different task/architecture; not ok if you expect identical arch.
epoch 1/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 1/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=9.408, lr=4.5e-08] epoch 1/8: 0%| | 7/2797 [00:02<13:23, 3.47batch/s, loss=9.408, lr=4.5e-08] epoch 1/8: 1%| | 17/2797 [00:04<10:49, 4.28batch/s, loss=9.408, lr=4.5e-08] epoch 1/8: 1%| | 17/2797 [00:05<10:49, 4.28batch/s, loss=9.215, lr=1.2e-06] epoch 1/8: 1%| | 27/2797 [00:06<10:02, 4.60batch/s, loss=9.215, lr=1.2e-06] epoch 1/8: 1%|▏ | 37/2797 [00:08<09:45, 4.72batch/s, loss=9.215, lr=1.2e-06] epoch 1/8: 2%|▏ | 49/2797 [00:10<08:55, 5.13batch/s, loss=9.215, lr=1.2e-06] epoch 1/8: 2%|▏ | 49/2797 [00:10<08:55, 5.13batch/s, loss=9.178, lr=2.3e-06] epoch 1/8: 2%|▏ | 60/2797 [00:12<08:50, 5.16batch/s, loss=9.178, lr=2.3e-06] epoch 1/8: 3%|▎ | 71/2797 [00:14<09:03, 5.01batch/s, loss=9.178, lr=2.3e-06] epoch 1/8: 3%|▎ | 71/2797 [00:15<09:03, 5.01batch/s, loss=9.105, lr=3.4e-06] epoch 1/8: 3%|▎ | 82/2797 [00:16<08:53, 5.09batch/s, loss=9.105, lr=3.4e-06] epoch 1/8: 3%|▎ | 93/2797 [00:18<08:44, 5.16batch/s, loss=9.105, lr=3.4e-06] epoch 1/8: 3%|▎ | 93/2797 [00:20<08:44, 5.16batch/s, loss=9.013, lr=4.5e-06] epoch 1/8: 4%|▎ | 104/2797 [00:20<08:37, 5.21batch/s, loss=9.013, lr=4.5e-06] epoch 1/8: 4%|▍ | 115/2797 [00:22<08:35, 5.21batch/s, loss=9.013, lr=4.5e-06] epoch 1/8: 4%|▍ | 115/2797 [00:25<08:35, 5.21batch/s, loss=8.891, lr=5.6e-06] epoch 1/8: 5%|▍ | 126/2797 [00:25<08:39, 5.14batch/s, loss=8.891, lr=5.6e-06] epoch 1/8: 5%|▍ | 137/2797 [00:27<08:38, 5.13batch/s, loss=8.891, lr=5.6e-06] epoch 1/8: 5%|▌ | 148/2797 [00:29<08:51, 4.98batch/s, loss=8.891, lr=5.6e-06] epoch 1/8: 5%|▌ | 148/2797 [00:30<08:51, 4.98batch/s, loss=8.774, lr=6.8e-06] epoch 1/8: 6%|▌ | 159/2797 [00:31<08:38, 5.09batch/s, loss=8.774, lr=6.8e-06] epoch 1/8: 6%|▌ | 170/2797 [00:33<08:31, 5.13batch/s, loss=8.774, lr=6.8e-06] epoch 1/8: 6%|▌ | 170/2797 [00:35<08:31, 5.13batch/s, loss=8.635, lr=7.9e-06] epoch 1/8: 6%|▋ | 181/2797 [00:36<08:41, 5.02batch/s, loss=8.635, lr=7.9e-06] epoch 1/8: 7%|▋ | 192/2797 [00:38<08:36, 5.04batch/s, loss=8.635, lr=7.9e-06] epoch 1/8: 7%|▋ | 192/2797 [00:39<08:36, 5.04batch/s, loss=8.486, lr=9.0e-06] epoch 1/8: 7%|▋ | 203/2797 [00:40<08:23, 5.16batch/s, loss=8.486, lr=9.0e-06] epoch 1/8: 8%|▊ | 214/2797 [00:42<08:33, 5.03batch/s, loss=8.486, lr=9.0e-06] epoch 1/8: 8%|▊ | 214/2797 [00:44<08:33, 5.03batch/s, loss=8.334, lr=1.0e-05] epoch 1/8: 8%|▊ | 226/2797 [00:44<08:14, 5.19batch/s, loss=8.334, lr=1.0e-05] epoch 1/8: 8%|▊ | 237/2797 [00:46<08:18, 5.14batch/s, loss=8.334, lr=1.0e-05] epoch 1/8: 9%|▉ | 249/2797 [00:49<07:59, 5.32batch/s, loss=8.334, lr=1.0e-05] epoch 1/8: 9%|▉ | 249/2797 [00:49<07:59, 5.32batch/s, loss=8.173, lr=1.1e-05] epoch 1/8: 9%|▉ | 260/2797 [00:51<08:01, 5.27batch/s, loss=8.173, lr=1.1e-05] epoch 1/8: 10%|▉ | 271/2797 [00:53<08:00, 5.26batch/s, loss=8.173, lr=1.1e-05] epoch 1/8: 10%|▉ | 271/2797 [00:54<08:00, 5.26batch/s, loss=8.035, lr=1.2e-05] epoch 1/8: 10%|█ | 282/2797 [00:55<07:56, 5.27batch/s, loss=8.035, lr=1.2e-05] epoch 1/8: 10%|█ | 293/2797 [00:57<08:10, 5.10batch/s, loss=8.035, lr=1.2e-05] epoch 1/8: 10%|█ | 293/2797 [00:59<08:10, 5.10batch/s, loss=7.900, lr=1.3e-05] epoch 1/8: 11%|█ | 304/2797 [00:59<07:58, 5.21batch/s, loss=7.900, lr=1.3e-05] epoch 1/8: 11%|█▏ | 315/2797 [01:02<08:12, 5.04batch/s, loss=7.900, lr=1.3e-05] epoch 1/8: 11%|█▏ | 315/2797 [01:04<08:12, 5.04batch/s, loss=7.764, lr=1.5e-05] epoch 1/8: 12%|█▏ | 326/2797 [01:04<08:01, 5.13batch/s, loss=7.764, lr=1.5e-05] epoch 1/8: 12%|█▏ | 337/2797 [01:06<07:50, 5.22batch/s, loss=7.764, lr=1.5e-05] epoch 1/8: 12%|█▏ | 348/2797 [01:08<07:56, 5.13batch/s, loss=7.764, lr=1.5e-05] epoch 1/8: 12%|█▏ | 348/2797 [01:08<07:56, 5.13batch/s, loss=7.636, lr=1.6e-05] epoch 1/8: 13%|█▎ | 359/2797 [01:10<08:05, 5.02batch/s, loss=7.636, lr=1.6e-05] epoch 1/8: 13%|█▎ | 370/2797 [01:12<08:00, 5.05batch/s, loss=7.636, lr=1.6e-05] epoch 1/8: 13%|█▎ | 370/2797 [01:14<08:00, 5.05batch/s, loss=7.513, lr=1.7e-05] epoch 1/8: 14%|█▎ | 381/2797 [01:15<08:04, 4.99batch/s, loss=7.513, lr=1.7e-05] epoch 1/8: 14%|█▍ | 392/2797 [01:17<07:58, 5.03batch/s, loss=7.513, lr=1.7e-05] epoch 1/8: 14%|█▍ | 392/2797 [01:18<07:58, 5.03batch/s, loss=7.387, lr=1.8e-05] epoch 1/8: 14%|█▍ | 403/2797 [01:19<07:51, 5.08batch/s, loss=7.387, lr=1.8e-05] epoch 1/8: 15%|█▍ | 414/2797 [01:21<07:41, 5.16batch/s, loss=7.387, lr=1.8e-05] epoch 1/8: 15%|█▌ | 425/2797 [01:23<07:34, 5.22batch/s, loss=7.387, lr=1.8e-05] epoch 1/8: 15%|█▌ | 425/2797 [01:23<07:34, 5.22batch/s, loss=7.269, lr=1.9e-05] epoch 1/8: 16%|█▌ | 436/2797 [01:25<07:53, 4.98batch/s, loss=7.269, lr=1.9e-05] epoch 1/8: 16%|█▌ | 447/2797 [01:28<07:51, 4.98batch/s, loss=7.269, lr=1.9e-05] epoch 1/8: 16%|█▌ | 447/2797 [01:28<07:51, 4.98batch/s, loss=7.158, lr=2.0e-05] epoch 1/8: 16%|█▋ | 459/2797 [01:30<07:33, 5.15batch/s, loss=7.158, lr=2.0e-05] epoch 1/8: 17%|█▋ | 470/2797 [01:32<07:36, 5.10batch/s, loss=7.158, lr=2.0e-05] epoch 1/8: 17%|█▋ | 470/2797 [01:33<07:36, 5.10batch/s, loss=7.057, lr=2.1e-05] epoch 1/8: 17%|█▋ | 481/2797 [01:34<07:28, 5.16batch/s, loss=7.057, lr=2.1e-05] epoch 1/8: 18%|█▊ | 493/2797 [01:36<07:28, 5.14batch/s, loss=7.057, lr=2.1e-05] epoch 1/8: 18%|█▊ | 493/2797 [01:38<07:28, 5.14batch/s, loss=6.960, lr=2.2e-05] epoch 1/8: 18%|█▊ | 504/2797 [01:38<07:18, 5.23batch/s, loss=6.960, lr=2.2e-05] epoch 1/8: 18%|█▊ | 515/2797 [01:40<07:16, 5.23batch/s, loss=6.960, lr=2.2e-05] epoch 1/8: 18%|█▊ | 515/2797 [01:42<07:16, 5.23batch/s, loss=6.864, lr=2.4e-05] epoch 1/8: 19%|█▉ | 526/2797 [01:42<07:07, 5.31batch/s, loss=6.864, lr=2.4e-05] epoch 1/8: 19%|█▉ | 537/2797 [01:45<07:21, 5.12batch/s, loss=6.864, lr=2.4e-05] epoch 1/8: 20%|█▉ | 548/2797 [01:47<07:13, 5.18batch/s, loss=6.864, lr=2.4e-05] epoch 1/8: 20%|█▉ | 548/2797 [01:48<07:13, 5.18batch/s, loss=6.765, lr=2.5e-05] epoch 1/8: 20%|█▉ | 559/2797 [01:49<07:32, 4.95batch/s, loss=6.765, lr=2.5e-05] epoch 1/8: 20%|██ | 569/2797 [01:52<07:44, 4.79batch/s, loss=6.765, lr=2.5e-05] epoch 1/8: 20%|██ | 569/2797 [01:53<07:44, 4.79batch/s, loss=6.677, lr=2.6e-05] epoch 1/8: 21%|██ | 580/2797 [01:54<07:26, 4.97batch/s, loss=6.677, lr=2.6e-05] epoch 1/8: 21%|██ | 591/2797 [01:56<07:11, 5.11batch/s, loss=6.677, lr=2.6e-05] epoch 1/8: 21%|██ | 591/2797 [01:57<07:11, 5.11batch/s, loss=6.587, lr=2.7e-05] epoch 1/8: 22%|██▏ | 602/2797 [01:58<07:02, 5.20batch/s, loss=6.587, lr=2.7e-05] epoch 1/8: 22%|██▏ | 613/2797 [02:00<07:07, 5.11batch/s, loss=6.587, lr=2.7e-05] epoch 1/8: 22%|██▏ | 625/2797 [02:02<07:00, 5.16batch/s, loss=6.587, lr=2.7e-05] epoch 1/8: 22%|██▏ | 625/2797 [02:02<07:00, 5.16batch/s, loss=6.505, lr=2.8e-05] epoch 1/8: 23%|██▎ | 636/2797 [02:04<06:59, 5.15batch/s, loss=6.505, lr=2.8e-05] epoch 1/8: 23%|██▎ | 647/2797 [02:07<07:04, 5.06batch/s, loss=6.505, lr=2.8e-05] epoch 1/8: 23%|██▎ | 647/2797 [02:07<07:04, 5.06batch/s, loss=6.427, lr=2.9e-05] epoch 1/8: 24%|██▎ | 658/2797 [02:09<06:58, 5.11batch/s, loss=6.427, lr=2.9e-05] epoch 1/8: 24%|██▍ | 669/2797 [02:11<06:54, 5.14batch/s, loss=6.427, lr=2.9e-05] epoch 1/8: 24%|██▍ | 669/2797 [02:12<06:54, 5.14batch/s, loss=6.351, lr=3.0e-05] epoch 1/8: 24%|██▍ | 680/2797 [02:13<06:55, 5.09batch/s, loss=6.351, lr=3.0e-05] epoch 1/8: 25%|██▍ | 691/2797 [02:15<06:58, 5.03batch/s, loss=6.351, lr=3.0e-05] epoch 1/8: 25%|██▍ | 691/2797 [02:17<06:58, 5.03batch/s, loss=6.283, lr=3.1e-05] epoch 1/8: 25%|██▌ | 702/2797 [02:17<06:53, 5.07batch/s, loss=6.283, lr=3.1e-05] epoch 1/8: 25%|██▌ | 713/2797 [02:19<06:48, 5.11batch/s, loss=6.283, lr=3.1e-05] epoch 1/8: 26%|██▌ | 724/2797 [02:22<06:38, 5.20batch/s, loss=6.283, lr=3.1e-05] epoch 1/8: 26%|██▌ | 724/2797 [02:22<06:38, 5.20batch/s, loss=6.212, lr=3.2e-05] epoch 1/8: 26%|██▋ | 735/2797 [02:24<06:45, 5.09batch/s, loss=6.212, lr=3.2e-05] epoch 1/8: 27%|██▋ | 746/2797 [02:26<06:53, 4.96batch/s, loss=6.212, lr=3.2e-05] epoch 1/8: 27%|██▋ | 746/2797 [02:27<06:53, 4.96batch/s, loss=6.144, lr=3.4e-05] epoch 1/8: 27%|██▋ | 756/2797 [02:28<06:55, 4.91batch/s, loss=6.144, lr=3.4e-05] epoch 1/8: 27%|██▋ | 767/2797 [02:30<06:42, 5.04batch/s, loss=6.144, lr=3.4e-05] epoch 1/8: 27%|██▋ | 767/2797 [02:32<06:42, 5.04batch/s, loss=6.075, lr=3.5e-05] epoch 1/8: 28%|██▊ | 778/2797 [02:32<06:41, 5.02batch/s, loss=6.075, lr=3.5e-05] epoch 1/8: 28%|██▊ | 789/2797 [02:35<06:40, 5.02batch/s, loss=6.075, lr=3.5e-05] epoch 1/8: 29%|██▊ | 800/2797 [02:37<06:41, 4.97batch/s, loss=6.075, lr=3.5e-05] epoch 1/8: 29%|██▊ | 800/2797 [02:37<06:41, 4.97batch/s, loss=6.012, lr=3.6e-05] epoch 1/8: 29%|██▉ | 811/2797 [02:39<06:37, 5.00batch/s, loss=6.012, lr=3.6e-05] epoch 1/8: 29%|██▉ | 822/2797 [02:41<06:39, 4.95batch/s, loss=6.012, lr=3.6e-05] epoch 1/8: 29%|██▉ | 822/2797 [02:42<06:39, 4.95batch/s, loss=5.951, lr=3.7e-05] epoch 1/8: 30%|██▉ | 833/2797 [02:44<06:32, 5.00batch/s, loss=5.951, lr=3.7e-05] epoch 1/8: 30%|███ | 844/2797 [02:46<06:22, 5.10batch/s, loss=5.951, lr=3.7e-05] epoch 1/8: 30%|███ | 844/2797 [02:47<06:22, 5.10batch/s, loss=5.893, lr=3.8e-05] epoch 1/8: 31%|███ | 855/2797 [02:48<06:18, 5.13batch/s, loss=5.893, lr=3.8e-05] epoch 1/8: 31%|███ | 866/2797 [02:50<06:17, 5.12batch/s, loss=5.893, lr=3.8e-05] epoch 1/8: 31%|███ | 866/2797 [02:52<06:17, 5.12batch/s, loss=5.835, lr=3.9e-05] epoch 1/8: 31%|███▏ | 877/2797 [02:52<06:14, 5.13batch/s, loss=5.835, lr=3.9e-05] epoch 1/8: 32%|███▏ | 889/2797 [02:54<06:05, 5.22batch/s, loss=5.835, lr=3.9e-05] epoch 1/8: 32%|███▏ | 900/2797 [02:56<06:01, 5.24batch/s, loss=5.835, lr=3.9e-05] epoch 1/8: 32%|███▏ | 900/2797 [02:57<06:01, 5.24batch/s, loss=5.778, lr=4.0e-05] epoch 1/8: 33%|███▎ | 911/2797 [02:59<06:06, 5.14batch/s, loss=5.778, lr=4.0e-05] epoch 1/8: 33%|███▎ | 922/2797 [03:01<05:59, 5.21batch/s, loss=5.778, lr=4.0e-05] epoch 1/8: 33%|███▎ | 922/2797 [03:01<05:59, 5.21batch/s, loss=5.722, lr=4.1e-05] epoch 1/8: 33%|███▎ | 933/2797 [03:03<05:54, 5.26batch/s, loss=5.722, lr=4.1e-05] epoch 1/8: 34%|███▍ | 944/2797 [03:05<05:56, 5.20batch/s, loss=5.722, lr=4.1e-05] epoch 1/8: 34%|███▍ | 944/2797 [03:06<05:56, 5.20batch/s, loss=5.672, lr=4.3e-05] epoch 1/8: 34%|███▍ | 955/2797 [03:07<05:55, 5.18batch/s, loss=5.672, lr=4.3e-05] epoch 1/8: 35%|███▍ | 966/2797 [03:09<05:58, 5.10batch/s, loss=5.672, lr=4.3e-05] epoch 1/8: 35%|███▍ | 966/2797 [03:11<05:58, 5.10batch/s, loss=5.624, lr=4.4e-05] epoch 1/8: 35%|███▌ | 979/2797 [03:11<05:38, 5.37batch/s, loss=5.624, lr=4.4e-05] epoch 1/8: 35%|███▌ | 990/2797 [03:14<05:49, 5.16batch/s, loss=5.624, lr=4.4e-05] epoch 1/8: 35%|███▌ | 990/2797 [03:16<05:49, 5.16batch/s, loss=5.578, lr=4.5e-05] epoch 1/8: 36%|███▌ | 1001/2797 [03:16<05:52, 5.10batch/s, loss=5.578, lr=4.5e-05] epoch 1/8: 36%|███▌ | 1012/2797 [03:18<05:45, 5.16batch/s, loss=5.578, lr=4.5e-05] epoch 1/8: 37%|███▋ | 1023/2797 [03:20<05:49, 5.07batch/s, loss=5.578, lr=4.5e-05] epoch 1/8: 37%|███▋ | 1023/2797 [03:21<05:49, 5.07batch/s, loss=5.532, lr=4.6e-05] epoch 1/8: 37%|███▋ | 1034/2797 [03:22<05:41, 5.16batch/s, loss=5.532, lr=4.6e-05] epoch 1/8: 37%|███▋ | 1045/2797 [03:24<05:38, 5.18batch/s, loss=5.532, lr=4.6e-05] epoch 1/8: 37%|███▋ | 1045/2797 [03:25<05:38, 5.18batch/s, loss=5.486, lr=4.7e-05] epoch 1/8: 38%|███▊ | 1056/2797 [03:26<05:32, 5.23batch/s, loss=5.486, lr=4.7e-05] epoch 1/8: 38%|███▊ | 1067/2797 [03:28<05:28, 5.26batch/s, loss=5.486, lr=4.7e-05] epoch 1/8: 38%|███▊ | 1067/2797 [03:30<05:28, 5.26batch/s, loss=5.442, lr=4.8e-05] epoch 1/8: 39%|███▊ | 1078/2797 [03:31<05:33, 5.15batch/s, loss=5.442, lr=4.8e-05] epoch 1/8: 39%|███▉ | 1089/2797 [03:33<05:46, 4.93batch/s, loss=5.442, lr=4.8e-05] epoch 1/8: 39%|███▉ | 1099/2797 [03:35<05:45, 4.92batch/s, loss=5.442, lr=4.8e-05] epoch 1/8: 39%|███▉ | 1099/2797 [03:36<05:45, 4.92batch/s, loss=5.397, lr=4.9e-05] epoch 1/8: 40%|███▉ | 1111/2797 [03:37<05:30, 5.10batch/s, loss=5.397, lr=4.9e-05] epoch 1/8: 40%|████ | 1122/2797 [03:40<05:31, 5.05batch/s, loss=5.397, lr=4.9e-05] epoch 1/8: 40%|████ | 1122/2797 [03:40<05:31, 5.05batch/s, loss=5.356, lr=5.0e-05] epoch 1/8: 41%|████ | 1133/2797 [03:42<05:30, 5.03batch/s, loss=5.356, lr=5.0e-05] epoch 1/8: 41%|████ | 1144/2797 [03:44<05:30, 5.00batch/s, loss=5.356, lr=5.0e-05] epoch 1/8: 41%|████ | 1144/2797 [03:45<05:30, 5.00batch/s, loss=5.316, lr=5.0e-05] epoch 1/8: 41%|████▏ | 1155/2797 [03:46<05:24, 5.06batch/s, loss=5.316, lr=5.0e-05] epoch 1/8: 42%|████▏ | 1166/2797 [03:48<05:29, 4.96batch/s, loss=5.316, lr=5.0e-05] epoch 1/8: 42%|████▏ | 1166/2797 [03:50<05:29, 4.96batch/s, loss=5.276, lr=5.0e-05] epoch 1/8: 42%|████▏ | 1177/2797 [03:51<05:26, 4.96batch/s, loss=5.276, lr=5.0e-05] epoch 1/8: 42%|████▏ | 1187/2797 [03:53<05:27, 4.92batch/s, loss=5.276, lr=5.0e-05] epoch 1/8: 43%|████▎ | 1198/2797 [03:55<05:18, 5.02batch/s, loss=5.276, lr=5.0e-05] epoch 1/8: 43%|████▎ | 1198/2797 [03:56<05:18, 5.02batch/s, loss=5.238, lr=5.0e-05] epoch 1/8: 43%|████▎ | 1209/2797 [03:57<05:09, 5.13batch/s, loss=5.238, lr=5.0e-05] epoch 1/8: 44%|████▎ | 1220/2797 [03:59<05:13, 5.04batch/s, loss=5.238, lr=5.0e-05] epoch 1/8: 44%|████▎ | 1220/2797 [04:00<05:13, 5.04batch/s, loss=5.201, lr=5.0e-05] epoch 1/8: 44%|████▍ | 1231/2797 [04:01<05:11, 5.03batch/s, loss=5.201, lr=5.0e-05] epoch 1/8: 44%|████▍ | 1243/2797 [04:04<04:59, 5.19batch/s, loss=5.201, lr=5.0e-05] epoch 1/8: 44%|████▍ | 1243/2797 [04:05<04:59, 5.19batch/s, loss=5.164, lr=5.0e-05] epoch 1/8: 45%|████▍ | 1254/2797 [04:06<04:52, 5.27batch/s, loss=5.164, lr=5.0e-05] epoch 1/8: 45%|████▌ | 1265/2797 [04:08<04:47, 5.34batch/s, loss=5.164, lr=5.0e-05] epoch 1/8: 45%|████▌ | 1265/2797 [04:10<04:47, 5.34batch/s, loss=5.129, lr=5.0e-05] epoch 1/8: 46%|████▌ | 1276/2797 [04:10<04:48, 5.28batch/s, loss=5.129, lr=5.0e-05] epoch 1/8: 46%|████▌ | 1287/2797 [04:12<04:58, 5.05batch/s, loss=5.129, lr=5.0e-05] epoch 1/8: 46%|████▋ | 1298/2797 [04:14<04:54, 5.09batch/s, loss=5.129, lr=5.0e-05] epoch 1/8: 46%|████▋ | 1298/2797 [04:15<04:54, 5.09batch/s, loss=5.094, lr=5.0e-05] epoch 1/8: 47%|████▋ | 1309/2797 [04:16<04:52, 5.09batch/s, loss=5.094, lr=5.0e-05] epoch 1/8: 47%|████▋ | 1320/2797 [04:19<04:50, 5.08batch/s, loss=5.094, lr=5.0e-05] epoch 1/8: 47%|████▋ | 1320/2797 [04:20<04:50, 5.08batch/s, loss=5.059, lr=5.0e-05] epoch 1/8: 48%|████▊ | 1331/2797 [04:21<04:49, 5.07batch/s, loss=5.059, lr=5.0e-05] epoch 1/8: 48%|████▊ | 1344/2797 [04:23<04:30, 5.36batch/s, loss=5.059, lr=5.0e-05] epoch 1/8: 48%|████▊ | 1344/2797 [04:24<04:30, 5.36batch/s, loss=5.025, lr=4.9e-05] epoch 1/8: 48%|████▊ | 1355/2797 [04:25<04:35, 5.24batch/s, loss=5.025, lr=4.9e-05] epoch 1/8: 49%|████▉ | 1366/2797 [04:27<04:41, 5.08batch/s, loss=5.025, lr=4.9e-05] epoch 1/8: 49%|████▉ | 1366/2797 [04:30<04:41, 5.08batch/s, loss=4.994, lr=4.9e-05] epoch 1/8: 49%|████▉ | 1377/2797 [04:30<04:47, 4.95batch/s, loss=4.994, lr=4.9e-05] epoch 1/8: 50%|████▉ | 1388/2797 [04:32<04:43, 4.96batch/s, loss=4.994, lr=4.9e-05] epoch 1/8: 50%|████▉ | 1398/2797 [04:34<04:42, 4.95batch/s, loss=4.994, lr=4.9e-05] epoch 1/8: 50%|████▉ | 1398/2797 [04:35<04:42, 4.95batch/s, loss=4.961, lr=4.9e-05] epoch 1/8: 50%|█████ | 1408/2797 [04:36<04:49, 4.80batch/s, loss=4.961, lr=4.9e-05] epoch 1/8: 51%|█████ | 1419/2797 [04:38<04:41, 4.90batch/s, loss=4.961, lr=4.9e-05] epoch 1/8: 51%|█████ | 1419/2797 [04:40<04:41, 4.90batch/s, loss=4.932, lr=4.9e-05] epoch 1/8: 51%|█████ | 1430/2797 [04:41<04:35, 4.96batch/s, loss=4.932, lr=4.9e-05] epoch 1/8: 52%|█████▏ | 1441/2797 [04:43<04:32, 4.98batch/s, loss=4.932, lr=4.9e-05] epoch 1/8: 52%|█████▏ | 1441/2797 [04:45<04:32, 4.98batch/s, loss=4.902, lr=4.9e-05] epoch 1/8: 52%|█████▏ | 1452/2797 [04:45<04:25, 5.07batch/s, loss=4.902, lr=4.9e-05] epoch 1/8: 52%|█████▏ | 1463/2797 [04:47<04:26, 5.01batch/s, loss=4.902, lr=4.9e-05] epoch 1/8: 53%|█████▎ | 1474/2797 [04:50<04:32, 4.85batch/s, loss=4.902, lr=4.9e-05] epoch 1/8: 53%|█████▎ | 1474/2797 [04:50<04:32, 4.85batch/s, loss=4.870, lr=4.9e-05] epoch 1/8: 53%|█████▎ | 1486/2797 [04:52<04:18, 5.07batch/s, loss=4.870, lr=4.9e-05] epoch 1/8: 54%|█████▎ | 1497/2797 [04:54<04:19, 5.01batch/s, loss=4.870, lr=4.9e-05] epoch 1/8: 54%|█████▎ | 1497/2797 [04:55<04:19, 5.01batch/s, loss=4.842, lr=4.9e-05] epoch 1/8: 54%|█████▍ | 1508/2797 [04:56<04:16, 5.03batch/s, loss=4.842, lr=4.9e-05] epoch 1/8: 54%|█████▍ | 1520/2797 [04:58<04:05, 5.21batch/s, loss=4.842, lr=4.9e-05] epoch 1/8: 54%|█████▍ | 1520/2797 [04:59<04:05, 5.21batch/s, loss=4.813, lr=4.9e-05] epoch 1/8: 55%|█████▍ | 1531/2797 [05:01<04:12, 5.01batch/s, loss=4.813, lr=4.9e-05] epoch 1/8: 55%|█████▌ | 1542/2797 [05:03<04:06, 5.10batch/s, loss=4.813, lr=4.9e-05] epoch 1/8: 55%|█████▌ | 1542/2797 [05:04<04:06, 5.10batch/s, loss=4.785, lr=4.9e-05] epoch 1/8: 56%|█████▌ | 1553/2797 [05:05<04:02, 5.12batch/s, loss=4.785, lr=4.9e-05] epoch 1/8: 56%|█████▌ | 1565/2797 [05:07<03:52, 5.30batch/s, loss=4.785, lr=4.9e-05] epoch 1/8: 56%|█████▌ | 1565/2797 [05:09<03:52, 5.30batch/s, loss=4.757, lr=4.9e-05] epoch 1/8: 56%|█████▋ | 1576/2797 [05:09<03:52, 5.25batch/s, loss=4.757, lr=4.9e-05] epoch 1/8: 57%|█████▋ | 1587/2797 [05:11<03:49, 5.27batch/s, loss=4.757, lr=4.9e-05] epoch 1/8: 57%|█████▋ | 1598/2797 [05:13<03:45, 5.33batch/s, loss=4.757, lr=4.9e-05] epoch 1/8: 57%|█████▋ | 1598/2797 [05:14<03:45, 5.33batch/s, loss=4.730, lr=4.9e-05] epoch 1/8: 58%|█████▊ | 1609/2797 [05:15<03:43, 5.32batch/s, loss=4.730, lr=4.9e-05] epoch 1/8: 58%|█████▊ | 1620/2797 [05:17<03:43, 5.27batch/s, loss=4.730, lr=4.9e-05] epoch 1/8: 58%|█████▊ | 1620/2797 [05:19<03:43, 5.27batch/s, loss=4.704, lr=4.9e-05] epoch 1/8: 58%|█████▊ | 1631/2797 [05:19<03:42, 5.23batch/s, loss=4.704, lr=4.9e-05] epoch 1/8: 59%|█████▊ | 1642/2797 [05:22<03:39, 5.26batch/s, loss=4.704, lr=4.9e-05] epoch 1/8: 59%|█████▊ | 1642/2797 [05:23<03:39, 5.26batch/s, loss=4.679, lr=4.9e-05] epoch 1/8: 59%|█████▉ | 1653/2797 [05:24<03:43, 5.13batch/s, loss=4.679, lr=4.9e-05] epoch 1/8: 59%|█████▉ | 1664/2797 [05:26<03:39, 5.16batch/s, loss=4.679, lr=4.9e-05] epoch 1/8: 59%|█████▉ | 1664/2797 [05:28<03:39, 5.16batch/s, loss=4.655, lr=4.9e-05] epoch 1/8: 60%|█████▉ | 1676/2797 [05:28<03:32, 5.27batch/s, loss=4.655, lr=4.9e-05] epoch 1/8: 60%|██████ | 1687/2797 [05:30<03:30, 5.27batch/s, loss=4.655, lr=4.9e-05] epoch 1/8: 61%|██████ | 1698/2797 [05:32<03:30, 5.21batch/s, loss=4.655, lr=4.9e-05] epoch 1/8: 61%|██████ | 1698/2797 [05:33<03:30, 5.21batch/s, loss=4.631, lr=4.9e-05] epoch 1/8: 61%|██████ | 1709/2797 [05:34<03:30, 5.18batch/s, loss=4.631, lr=4.9e-05] epoch 1/8: 61%|██████▏ | 1720/2797 [05:37<03:33, 5.04batch/s, loss=4.631, lr=4.9e-05] epoch 1/8: 61%|██████▏ | 1720/2797 [05:38<03:33, 5.04batch/s, loss=4.607, lr=4.9e-05] epoch 1/8: 62%|██████▏ | 1732/2797 [05:39<03:22, 5.25batch/s, loss=4.607, lr=4.9e-05] epoch 1/8: 62%|██████▏ | 1743/2797 [05:41<03:18, 5.30batch/s, loss=4.607, lr=4.9e-05] epoch 1/8: 62%|██████▏ | 1743/2797 [05:42<03:18, 5.30batch/s, loss=4.585, lr=4.9e-05] epoch 1/8: 63%|██████▎ | 1754/2797 [05:43<03:19, 5.24batch/s, loss=4.585, lr=4.9e-05] epoch 1/8: 63%|██████▎ | 1765/2797 [05:45<03:14, 5.31batch/s, loss=4.585, lr=4.9e-05] epoch 1/8: 63%|██████▎ | 1765/2797 [05:47<03:14, 5.31batch/s, loss=4.562, lr=4.8e-05] epoch 1/8: 63%|██████▎ | 1776/2797 [05:47<03:16, 5.20batch/s, loss=4.562, lr=4.8e-05] epoch 1/8: 64%|██████▍ | 1787/2797 [05:49<03:13, 5.21batch/s, loss=4.562, lr=4.8e-05] epoch 1/8: 64%|██████▍ | 1799/2797 [05:51<03:06, 5.34batch/s, loss=4.562, lr=4.8e-05] epoch 1/8: 64%|██████▍ | 1799/2797 [05:52<03:06, 5.34batch/s, loss=4.541, lr=4.8e-05] epoch 1/8: 65%|██████▍ | 1810/2797 [05:54<03:08, 5.25batch/s, loss=4.541, lr=4.8e-05] epoch 1/8: 65%|██████▌ | 1822/2797 [05:56<03:04, 5.30batch/s, loss=4.541, lr=4.8e-05] epoch 1/8: 65%|██████▌ | 1822/2797 [05:57<03:04, 5.30batch/s, loss=4.521, lr=4.8e-05] epoch 1/8: 66%|██████▌ | 1833/2797 [05:58<03:05, 5.19batch/s, loss=4.521, lr=4.8e-05] epoch 1/8: 66%|██████▌ | 1844/2797 [06:00<03:01, 5.24batch/s, loss=4.521, lr=4.8e-05] epoch 1/8: 66%|██████▌ | 1844/2797 [06:02<03:01, 5.24batch/s, loss=4.499, lr=4.8e-05] epoch 1/8: 66%|██████▋ | 1855/2797 [06:02<02:59, 5.26batch/s, loss=4.499, lr=4.8e-05] epoch 1/8: 67%|██████▋ | 1866/2797 [06:04<02:57, 5.25batch/s, loss=4.499, lr=4.8e-05] epoch 1/8: 67%|██████▋ | 1866/2797 [06:06<02:57, 5.25batch/s, loss=4.479, lr=4.8e-05] epoch 1/8: 67%|██████▋ | 1877/2797 [06:07<02:58, 5.16batch/s, loss=4.479, lr=4.8e-05] epoch 1/8: 68%|██████▊ | 1888/2797 [06:09<03:02, 4.99batch/s, loss=4.479, lr=4.8e-05] epoch 1/8: 68%|██████▊ | 1899/2797 [06:11<02:59, 5.01batch/s, loss=4.479, lr=4.8e-05] epoch 1/8: 68%|██████▊ | 1899/2797 [06:12<02:59, 5.01batch/s, loss=4.460, lr=4.8e-05] epoch 1/8: 68%|██████▊ | 1910/2797 [06:13<03:01, 4.89batch/s, loss=4.460, lr=4.8e-05] epoch 1/8: 69%|██████▊ | 1920/2797 [06:16<03:00, 4.86batch/s, loss=4.460, lr=4.8e-05] epoch 1/8: 69%|██████▊ | 1920/2797 [06:17<03:00, 4.86batch/s, loss=4.440, lr=4.8e-05] epoch 1/8: 69%|██████▉ | 1931/2797 [06:18<02:53, 4.98batch/s, loss=4.440, lr=4.8e-05] epoch 1/8: 69%|██████▉ | 1942/2797 [06:20<02:49, 5.05batch/s, loss=4.440, lr=4.8e-05] epoch 1/8: 69%|██████▉ | 1942/2797 [06:21<02:49, 5.05batch/s, loss=4.421, lr=4.8e-05] epoch 1/8: 70%|██████▉ | 1953/2797 [06:22<02:45, 5.10batch/s, loss=4.421, lr=4.8e-05] epoch 1/8: 70%|███████ | 1964/2797 [06:24<02:44, 5.08batch/s, loss=4.421, lr=4.8e-05] epoch 1/8: 71%|███████ | 1975/2797 [06:26<02:42, 5.05batch/s, loss=4.421, lr=4.8e-05] epoch 1/8: 71%|███████ | 1975/2797 [06:27<02:42, 5.05batch/s, loss=4.402, lr=4.8e-05] epoch 1/8: 71%|███████ | 1986/2797 [06:29<02:45, 4.91batch/s, loss=4.402, lr=4.8e-05] epoch 1/8: 71%|███████▏ | 1997/2797 [06:31<02:41, 4.95batch/s, loss=4.402, lr=4.8e-05] epoch 1/8: 71%|███████▏ | 1997/2797 [06:32<02:41, 4.95batch/s, loss=4.384, lr=4.8e-05] epoch 1/8: 72%|███████▏ | 2007/2797 [06:33<02:42, 4.85batch/s, loss=4.384, lr=4.8e-05] epoch 1/8: 72%|███████▏ | 2018/2797 [06:35<02:35, 5.00batch/s, loss=4.384, lr=4.8e-05] epoch 1/8: 72%|███████▏ | 2018/2797 [06:37<02:35, 5.00batch/s, loss=4.366, lr=4.8e-05] epoch 1/8: 73%|███████▎ | 2029/2797 [06:37<02:34, 4.99batch/s, loss=4.366, lr=4.8e-05] epoch 1/8: 73%|███████▎ | 2040/2797 [06:39<02:31, 5.00batch/s, loss=4.366, lr=4.8e-05] epoch 1/8: 73%|███████▎ | 2040/2797 [06:41<02:31, 5.00batch/s, loss=4.347, lr=4.8e-05] epoch 1/8: 73%|███████▎ | 2051/2797 [06:41<02:25, 5.12batch/s, loss=4.347, lr=4.8e-05] epoch 1/8: 74%|███████▎ | 2062/2797 [06:44<02:25, 5.04batch/s, loss=4.347, lr=4.8e-05] epoch 1/8: 74%|███████▍ | 2073/2797 [06:46<02:27, 4.92batch/s, loss=4.347, lr=4.8e-05] epoch 1/8: 74%|███████▍ | 2073/2797 [06:47<02:27, 4.92batch/s, loss=4.330, lr=4.8e-05] epoch 1/8: 75%|███████▍ | 2084/2797 [06:48<02:21, 5.04batch/s, loss=4.330, lr=4.8e-05] epoch 1/8: 75%|███████▍ | 2095/2797 [06:50<02:18, 5.08batch/s, loss=4.330, lr=4.8e-05] epoch 1/8: 75%|███████▍ | 2095/2797 [06:52<02:18, 5.08batch/s, loss=4.312, lr=4.8e-05] epoch 1/8: 75%|███████▌ | 2106/2797 [06:52<02:15, 5.11batch/s, loss=4.312, lr=4.8e-05] epoch 1/8: 76%|███████▌ | 2117/2797 [06:55<02:12, 5.14batch/s, loss=4.312, lr=4.8e-05] epoch 1/8: 76%|███████▌ | 2117/2797 [06:56<02:12, 5.14batch/s, loss=4.297, lr=4.8e-05] epoch 1/8: 76%|███████▌ | 2128/2797 [06:57<02:10, 5.11batch/s, loss=4.297, lr=4.8e-05] epoch 1/8: 76%|███████▋ | 2139/2797 [06:59<02:11, 5.02batch/s, loss=4.297, lr=4.8e-05] epoch 1/8: 77%|███████▋ | 2150/2797 [07:01<02:11, 4.93batch/s, loss=4.297, lr=4.8e-05] epoch 1/8: 77%|███████▋ | 2150/2797 [07:02<02:11, 4.93batch/s, loss=4.279, lr=4.8e-05] epoch 1/8: 77%|███████▋ | 2161/2797 [07:04<02:08, 4.95batch/s, loss=4.279, lr=4.8e-05] epoch 1/8: 78%|███████▊ | 2171/2797 [07:06<02:06, 4.95batch/s, loss=4.279, lr=4.8e-05] epoch 1/8: 78%|███████▊ | 2171/2797 [07:07<02:06, 4.95batch/s, loss=4.262, lr=4.8e-05] epoch 1/8: 78%|███████▊ | 2181/2797 [07:08<02:04, 4.93batch/s, loss=4.262, lr=4.8e-05] epoch 1/8: 78%|███████▊ | 2192/2797 [07:10<01:59, 5.04batch/s, loss=4.262, lr=4.8e-05] epoch 1/8: 78%|███████▊ | 2192/2797 [07:11<01:59, 5.04batch/s, loss=4.245, lr=4.7e-05] epoch 1/8: 79%|███████▉ | 2203/2797 [07:12<01:57, 5.05batch/s, loss=4.245, lr=4.7e-05] epoch 1/8: 79%|███████▉ | 2214/2797 [07:14<01:55, 5.04batch/s, loss=4.245, lr=4.7e-05] epoch 1/8: 79%|███████▉ | 2214/2797 [07:16<01:55, 5.04batch/s, loss=4.229, lr=4.7e-05] epoch 1/8: 80%|███████▉ | 2226/2797 [07:16<01:49, 5.20batch/s, loss=4.229, lr=4.7e-05] epoch 1/8: 80%|███████▉ | 2237/2797 [07:18<01:46, 5.24batch/s, loss=4.229, lr=4.7e-05] epoch 1/8: 80%|████████ | 2248/2797 [07:20<01:46, 5.17batch/s, loss=4.229, lr=4.7e-05] epoch 1/8: 80%|████████ | 2248/2797 [07:21<01:46, 5.17batch/s, loss=4.213, lr=4.7e-05] epoch 1/8: 81%|████████ | 2259/2797 [07:23<01:45, 5.10batch/s, loss=4.213, lr=4.7e-05] epoch 1/8: 81%|████████ | 2270/2797 [07:25<01:41, 5.18batch/s, loss=4.213, lr=4.7e-05] epoch 1/8: 81%|████████ | 2270/2797 [07:26<01:41, 5.18batch/s, loss=4.199, lr=4.7e-05] epoch 1/8: 82%|████████▏ | 2281/2797 [07:27<01:41, 5.06batch/s, loss=4.199, lr=4.7e-05] epoch 1/8: 82%|████████▏ | 2292/2797 [07:29<01:43, 4.87batch/s, loss=4.199, lr=4.7e-05] epoch 1/8: 82%|████████▏ | 2292/2797 [07:31<01:43, 4.87batch/s, loss=4.183, lr=4.7e-05] epoch 1/8: 82%|████████▏ | 2303/2797 [07:32<01:40, 4.93batch/s, loss=4.183, lr=4.7e-05] epoch 1/8: 83%|████████▎ | 2313/2797 [07:34<01:38, 4.93batch/s, loss=4.183, lr=4.7e-05] epoch 1/8: 83%|████████▎ | 2324/2797 [07:36<01:35, 4.98batch/s, loss=4.183, lr=4.7e-05] epoch 1/8: 83%|████████▎ | 2324/2797 [07:36<01:35, 4.98batch/s, loss=4.168, lr=4.7e-05] epoch 1/8: 83%|████████▎ | 2335/2797 [07:38<01:32, 5.01batch/s, loss=4.168, lr=4.7e-05] epoch 1/8: 84%|████████▍ | 2346/2797 [07:40<01:27, 5.13batch/s, loss=4.168, lr=4.7e-05] epoch 1/8: 84%|████████▍ | 2346/2797 [07:41<01:27, 5.13batch/s, loss=4.154, lr=4.7e-05] epoch 1/8: 84%|████████▍ | 2357/2797 [07:42<01:26, 5.10batch/s, loss=4.154, lr=4.7e-05] epoch 1/8: 85%|████████▍ | 2368/2797 [07:44<01:23, 5.15batch/s, loss=4.154, lr=4.7e-05] epoch 1/8: 85%|████████▍ | 2368/2797 [07:46<01:23, 5.15batch/s, loss=4.139, lr=4.7e-05] epoch 1/8: 85%|████████▌ | 2379/2797 [07:47<01:22, 5.05batch/s, loss=4.139, lr=4.7e-05] epoch 1/8: 85%|████████▌ | 2390/2797 [07:49<01:22, 4.94batch/s, loss=4.139, lr=4.7e-05] epoch 1/8: 85%|████████▌ | 2390/2797 [07:51<01:22, 4.94batch/s, loss=4.125, lr=4.7e-05] epoch 1/8: 86%|████████▌ | 2401/2797 [07:51<01:19, 4.96batch/s, loss=4.125, lr=4.7e-05] epoch 1/8: 86%|████████▋ | 2413/2797 [07:53<01:14, 5.12batch/s, loss=4.125, lr=4.7e-05] epoch 1/8: 87%|████████▋ | 2424/2797 [07:55<01:12, 5.15batch/s, loss=4.125, lr=4.7e-05] epoch 1/8: 87%|████████▋ | 2424/2797 [07:56<01:12, 5.15batch/s, loss=4.112, lr=4.7e-05] epoch 1/8: 87%|████████▋ | 2435/2797 [07:58<01:13, 4.93batch/s, loss=4.112, lr=4.7e-05] epoch 1/8: 87%|████████▋ | 2447/2797 [08:00<01:07, 5.20batch/s, loss=4.112, lr=4.7e-05] epoch 1/8: 87%|████████▋ | 2447/2797 [08:00<01:07, 5.20batch/s, loss=4.099, lr=4.7e-05] epoch 1/8: 88%|████████▊ | 2459/2797 [08:02<01:04, 5.26batch/s, loss=4.099, lr=4.7e-05] epoch 1/8: 88%|████████▊ | 2470/2797 [08:04<01:02, 5.26batch/s, loss=4.099, lr=4.7e-05] epoch 1/8: 88%|████████▊ | 2470/2797 [08:05<01:02, 5.26batch/s, loss=4.084, lr=4.7e-05] epoch 1/8: 89%|████████▊ | 2481/2797 [08:06<01:00, 5.18batch/s, loss=4.084, lr=4.7e-05] epoch 1/8: 89%|████████▉ | 2492/2797 [08:09<00:59, 5.10batch/s, loss=4.084, lr=4.7e-05] epoch 1/8: 89%|████████▉ | 2492/2797 [08:10<00:59, 5.10batch/s, loss=4.071, lr=4.7e-05] epoch 1/8: 89%|████████▉ | 2503/2797 [08:11<00:58, 5.06batch/s, loss=4.071, lr=4.7e-05] epoch 1/8: 90%|████████▉ | 2514/2797 [08:13<00:56, 5.01batch/s, loss=4.071, lr=4.7e-05] epoch 1/8: 90%|█████████ | 2525/2797 [08:15<00:54, 5.00batch/s, loss=4.071, lr=4.7e-05] epoch 1/8: 90%|█████████ | 2525/2797 [08:15<00:54, 5.00batch/s, loss=4.058, lr=4.7e-05] epoch 1/8: 91%|█████████ | 2536/2797 [08:17<00:52, 5.01batch/s, loss=4.058, lr=4.7e-05] epoch 1/8: 91%|█████████ | 2547/2797 [08:20<00:49, 5.02batch/s, loss=4.058, lr=4.7e-05] epoch 1/8: 91%|█████████ | 2547/2797 [08:20<00:49, 5.02batch/s, loss=4.045, lr=4.7e-05] epoch 1/8: 91%|█████████▏| 2558/2797 [08:22<00:47, 5.07batch/s, loss=4.045, lr=4.7e-05] epoch 1/8: 92%|█████████▏| 2569/2797 [08:24<00:45, 5.00batch/s, loss=4.045, lr=4.7e-05] epoch 1/8: 92%|█████████▏| 2569/2797 [08:25<00:45, 5.00batch/s, loss=4.033, lr=4.7e-05] epoch 1/8: 92%|█████████▏| 2580/2797 [08:26<00:43, 5.01batch/s, loss=4.033, lr=4.7e-05] epoch 1/8: 93%|█████████▎| 2592/2797 [08:28<00:39, 5.18batch/s, loss=4.033, lr=4.7e-05] epoch 1/8: 93%|█████████▎| 2592/2797 [08:30<00:39, 5.18batch/s, loss=4.021, lr=4.7e-05] epoch 1/8: 93%|█████████▎| 2603/2797 [08:31<00:38, 5.07batch/s, loss=4.021, lr=4.7e-05] epoch 1/8: 93%|█████████▎| 2614/2797 [08:33<00:36, 4.99batch/s, loss=4.021, lr=4.7e-05] epoch 1/8: 94%|█████████▍| 2624/2797 [08:35<00:34, 4.99batch/s, loss=4.021, lr=4.7e-05] epoch 1/8: 94%|█████████▍| 2624/2797 [08:35<00:34, 4.99batch/s, loss=4.008, lr=4.6e-05] epoch 1/8: 94%|█████████▍| 2635/2797 [08:37<00:32, 5.04batch/s, loss=4.008, lr=4.6e-05] epoch 1/8: 95%|█████████▍| 2646/2797 [08:39<00:29, 5.08batch/s, loss=4.008, lr=4.6e-05] epoch 1/8: 95%|█████████▍| 2646/2797 [08:40<00:29, 5.08batch/s, loss=3.996, lr=4.6e-05] epoch 1/8: 95%|█████████▍| 2657/2797 [08:41<00:27, 5.08batch/s, loss=3.996, lr=4.6e-05] epoch 1/8: 95%|█████████▌| 2668/2797 [08:44<00:25, 5.02batch/s, loss=3.996, lr=4.6e-05] epoch 1/8: 95%|█████████▌| 2668/2797 [08:45<00:25, 5.02batch/s, loss=3.984, lr=4.6e-05] epoch 1/8: 96%|█████████▌| 2679/2797 [08:46<00:24, 4.90batch/s, loss=3.984, lr=4.6e-05] epoch 1/8: 96%|█████████▌| 2689/2797 [08:48<00:22, 4.83batch/s, loss=3.984, lr=4.6e-05] epoch 1/8: 97%|█████████▋| 2700/2797 [08:50<00:19, 5.00batch/s, loss=3.984, lr=4.6e-05] epoch 1/8: 97%|█████████▋| 2700/2797 [08:50<00:19, 5.00batch/s, loss=3.973, lr=4.6e-05] epoch 1/8: 97%|█████████▋| 2711/2797 [08:52<00:17, 5.05batch/s, loss=3.973, lr=4.6e-05] epoch 1/8: 97%|█████████▋| 2722/2797 [08:54<00:14, 5.04batch/s, loss=3.973, lr=4.6e-05] epoch 1/8: 97%|█████████▋| 2722/2797 [08:55<00:14, 5.04batch/s, loss=3.960, lr=4.6e-05] epoch 1/8: 98%|█████████▊| 2734/2797 [08:57<00:11, 5.26batch/s, loss=3.960, lr=4.6e-05] epoch 1/8: 98%|█████████▊| 2745/2797 [08:59<00:09, 5.23batch/s, loss=3.960, lr=4.6e-05] epoch 1/8: 98%|█████████▊| 2745/2797 [09:00<00:09, 5.23batch/s, loss=3.949, lr=4.6e-05] epoch 1/8: 99%|█████████▊| 2756/2797 [09:01<00:07, 5.13batch/s, loss=3.949, lr=4.6e-05] epoch 1/8: 99%|█████████▉| 2767/2797 [09:03<00:05, 5.21batch/s, loss=3.949, lr=4.6e-05] epoch 1/8: 99%|█████████▉| 2767/2797 [09:05<00:05, 5.21batch/s, loss=3.938, lr=4.6e-05] epoch 1/8: 99%|█████████▉| 2778/2797 [09:05<00:03, 5.29batch/s, loss=3.938, lr=4.6e-05] epoch 1/8: 100%|█████████▉| 2789/2797 [09:07<00:01, 5.20batch/s, loss=3.938, lr=4.6e-05] epoch 1/8: 100%|██████████| 2797/2797 [09:08<00:00, 5.10batch/s, loss=3.938, lr=4.6e-05]
epoch 1: train loss 3.929 · validation loss 2.476 · broad 77.8% (top-3 93.3%) · path 66.4% (top-3 85.2%, plausible or look-alike 83.2%) · 590s elapsed
epoch 2/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 2/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=2.668, lr=4.6e-05] epoch 2/8: 0%| | 12/2797 [00:02<07:53, 5.89batch/s, loss=2.668, lr=4.6e-05] epoch 2/8: 1%| | 24/2797 [00:04<08:42, 5.31batch/s, loss=2.668, lr=4.6e-05] epoch 2/8: 1%| | 24/2797 [00:04<08:42, 5.31batch/s, loss=2.416, lr=4.6e-05] epoch 2/8: 1%|▏ | 35/2797 [00:06<08:32, 5.39batch/s, loss=2.416, lr=4.6e-05] epoch 2/8: 2%|▏ | 46/2797 [00:08<08:33, 5.36batch/s, loss=2.416, lr=4.6e-05] epoch 2/8: 2%|▏ | 46/2797 [00:09<08:33, 5.36batch/s, loss=2.420, lr=4.6e-05] epoch 2/8: 2%|▏ | 57/2797 [00:10<08:44, 5.22batch/s, loss=2.420, lr=4.6e-05] epoch 2/8: 2%|▏ | 69/2797 [00:12<08:27, 5.37batch/s, loss=2.420, lr=4.6e-05] epoch 2/8: 2%|▏ | 69/2797 [00:14<08:27, 5.37batch/s, loss=2.399, lr=4.6e-05] epoch 2/8: 3%|▎ | 80/2797 [00:15<08:37, 5.25batch/s, loss=2.399, lr=4.6e-05] epoch 2/8: 3%|▎ | 91/2797 [00:17<08:34, 5.26batch/s, loss=2.399, lr=4.6e-05] epoch 2/8: 3%|▎ | 91/2797 [00:19<08:34, 5.26batch/s, loss=2.401, lr=4.6e-05] epoch 2/8: 4%|▎ | 102/2797 [00:19<08:32, 5.26batch/s, loss=2.401, lr=4.6e-05] epoch 2/8: 4%|▍ | 113/2797 [00:21<08:30, 5.26batch/s, loss=2.401, lr=4.6e-05] epoch 2/8: 4%|▍ | 124/2797 [00:23<08:35, 5.19batch/s, loss=2.401, lr=4.6e-05] epoch 2/8: 4%|▍ | 124/2797 [00:23<08:35, 5.19batch/s, loss=2.404, lr=4.6e-05] epoch 2/8: 5%|▍ | 135/2797 [00:25<08:32, 5.19batch/s, loss=2.404, lr=4.6e-05] epoch 2/8: 5%|▌ | 146/2797 [00:27<08:47, 5.03batch/s, loss=2.404, lr=4.6e-05] epoch 2/8: 5%|▌ | 146/2797 [00:28<08:47, 5.03batch/s, loss=2.423, lr=4.6e-05] epoch 2/8: 6%|▌ | 158/2797 [00:30<08:33, 5.14batch/s, loss=2.423, lr=4.6e-05] epoch 2/8: 6%|▌ | 169/2797 [00:32<08:36, 5.09batch/s, loss=2.423, lr=4.6e-05] epoch 2/8: 6%|▌ | 169/2797 [00:33<08:36, 5.09batch/s, loss=2.414, lr=4.6e-05] epoch 2/8: 6%|▋ | 181/2797 [00:34<08:20, 5.23batch/s, loss=2.414, lr=4.6e-05] epoch 2/8: 7%|▋ | 192/2797 [00:36<08:15, 5.26batch/s, loss=2.414, lr=4.6e-05] epoch 2/8: 7%|▋ | 192/2797 [00:38<08:15, 5.26batch/s, loss=2.414, lr=4.6e-05] epoch 2/8: 7%|▋ | 203/2797 [00:38<08:21, 5.18batch/s, loss=2.414, lr=4.6e-05] epoch 2/8: 8%|▊ | 215/2797 [00:40<08:03, 5.34batch/s, loss=2.414, lr=4.6e-05] epoch 2/8: 8%|▊ | 215/2797 [00:43<08:03, 5.34batch/s, loss=2.409, lr=4.6e-05] epoch 2/8: 8%|▊ | 226/2797 [00:43<08:11, 5.23batch/s, loss=2.409, lr=4.6e-05] epoch 2/8: 8%|▊ | 237/2797 [00:45<08:23, 5.08batch/s, loss=2.409, lr=4.6e-05] epoch 2/8: 9%|▉ | 248/2797 [00:47<08:32, 4.97batch/s, loss=2.409, lr=4.6e-05] epoch 2/8: 9%|▉ | 248/2797 [00:48<08:32, 4.97batch/s, loss=2.414, lr=4.5e-05] epoch 2/8: 9%|▉ | 259/2797 [00:49<08:28, 4.99batch/s, loss=2.414, lr=4.5e-05] epoch 2/8: 10%|▉ | 270/2797 [00:52<08:16, 5.09batch/s, loss=2.414, lr=4.5e-05] epoch 2/8: 10%|▉ | 270/2797 [00:53<08:16, 5.09batch/s, loss=2.411, lr=4.5e-05] epoch 2/8: 10%|█ | 282/2797 [00:54<07:58, 5.25batch/s, loss=2.411, lr=4.5e-05] epoch 2/8: 10%|█ | 293/2797 [00:56<08:02, 5.19batch/s, loss=2.411, lr=4.5e-05] epoch 2/8: 10%|█ | 293/2797 [00:57<08:02, 5.19batch/s, loss=2.404, lr=4.5e-05] epoch 2/8: 11%|█ | 304/2797 [00:58<08:00, 5.18batch/s, loss=2.404, lr=4.5e-05] epoch 2/8: 11%|█▏ | 315/2797 [01:00<08:06, 5.11batch/s, loss=2.404, lr=4.5e-05] epoch 2/8: 11%|█▏ | 315/2797 [01:02<08:06, 5.11batch/s, loss=2.412, lr=4.5e-05] epoch 2/8: 12%|█▏ | 326/2797 [01:02<08:07, 5.06batch/s, loss=2.412, lr=4.5e-05] epoch 2/8: 12%|█▏ | 338/2797 [01:05<07:55, 5.17batch/s, loss=2.412, lr=4.5e-05] epoch 2/8: 13%|█▎ | 350/2797 [01:07<07:44, 5.26batch/s, loss=2.412, lr=4.5e-05] epoch 2/8: 13%|█▎ | 350/2797 [01:07<07:44, 5.26batch/s, loss=2.418, lr=4.5e-05] epoch 2/8: 13%|█▎ | 361/2797 [01:09<07:53, 5.14batch/s, loss=2.418, lr=4.5e-05] epoch 2/8: 13%|█▎ | 372/2797 [01:11<07:56, 5.09batch/s, loss=2.418, lr=4.5e-05] epoch 2/8: 13%|█▎ | 372/2797 [01:12<07:56, 5.09batch/s, loss=2.419, lr=4.5e-05] epoch 2/8: 14%|█▎ | 383/2797 [01:14<08:01, 5.01batch/s, loss=2.419, lr=4.5e-05] epoch 2/8: 14%|█▍ | 395/2797 [01:16<07:42, 5.19batch/s, loss=2.419, lr=4.5e-05] epoch 2/8: 14%|█▍ | 395/2797 [01:17<07:42, 5.19batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 15%|█▍ | 406/2797 [01:18<07:48, 5.10batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 15%|█▍ | 417/2797 [01:20<07:50, 5.06batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 15%|█▍ | 417/2797 [01:22<07:50, 5.06batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 15%|█▌ | 428/2797 [01:22<07:42, 5.13batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 16%|█▌ | 439/2797 [01:24<07:34, 5.18batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 16%|█▌ | 450/2797 [01:26<07:29, 5.22batch/s, loss=2.415, lr=4.5e-05] epoch 2/8: 16%|█▌ | 450/2797 [01:27<07:29, 5.22batch/s, loss=2.409, lr=4.5e-05] epoch 2/8: 16%|█▋ | 461/2797 [01:29<07:45, 5.02batch/s, loss=2.409, lr=4.5e-05] epoch 2/8: 17%|█▋ | 472/2797 [01:31<07:48, 4.96batch/s, loss=2.409, lr=4.5e-05] epoch 2/8: 17%|█▋ | 472/2797 [01:32<07:48, 4.96batch/s, loss=2.409, lr=4.5e-05] epoch 2/8: 17%|█▋ | 483/2797 [01:33<07:45, 4.97batch/s, loss=2.409, lr=4.5e-05] epoch 2/8: 18%|█▊ | 494/2797 [01:35<07:41, 5.00batch/s, loss=2.409, lr=4.5e-05] epoch 2/8: 18%|█▊ | 494/2797 [01:37<07:41, 5.00batch/s, loss=2.407, lr=4.5e-05] epoch 2/8: 18%|█▊ | 505/2797 [01:38<07:46, 4.91batch/s, loss=2.407, lr=4.5e-05] epoch 2/8: 18%|█▊ | 517/2797 [01:40<07:25, 5.12batch/s, loss=2.407, lr=4.5e-05] epoch 2/8: 18%|█▊ | 517/2797 [01:42<07:25, 5.12batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 19%|█▉ | 528/2797 [01:42<07:18, 5.18batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 19%|█▉ | 539/2797 [01:44<07:26, 5.06batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 20%|█▉ | 550/2797 [01:46<07:29, 5.00batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 20%|█▉ | 550/2797 [01:47<07:29, 5.00batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 20%|██ | 561/2797 [01:49<07:32, 4.94batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 20%|██ | 571/2797 [01:51<07:44, 4.79batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 20%|██ | 571/2797 [01:52<07:44, 4.79batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 21%|██ | 583/2797 [01:53<07:23, 4.99batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 21%|██ | 594/2797 [01:55<07:21, 4.99batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 21%|██ | 594/2797 [01:57<07:21, 4.99batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 22%|██▏ | 604/2797 [01:57<07:23, 4.95batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 22%|██▏ | 614/2797 [02:00<07:30, 4.85batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 22%|██▏ | 625/2797 [02:02<07:25, 4.88batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 22%|██▏ | 625/2797 [02:02<07:25, 4.88batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 23%|██▎ | 636/2797 [02:04<07:12, 5.00batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 23%|██▎ | 647/2797 [02:06<07:11, 4.98batch/s, loss=2.405, lr=4.5e-05] epoch 2/8: 23%|██▎ | 647/2797 [02:07<07:11, 4.98batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 23%|██▎ | 657/2797 [02:08<07:11, 4.96batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 24%|██▍ | 667/2797 [02:10<07:08, 4.97batch/s, loss=2.402, lr=4.5e-05] epoch 2/8: 24%|██▍ | 667/2797 [02:12<07:08, 4.97batch/s, loss=2.395, lr=4.4e-05] epoch 2/8: 24%|██▍ | 678/2797 [02:12<06:57, 5.08batch/s, loss=2.395, lr=4.4e-05] epoch 2/8: 25%|██▍ | 689/2797 [02:14<06:49, 5.15batch/s, loss=2.395, lr=4.4e-05] epoch 2/8: 25%|██▌ | 700/2797 [02:17<06:56, 5.04batch/s, loss=2.395, lr=4.4e-05] epoch 2/8: 25%|██▌ | 700/2797 [02:17<06:56, 5.04batch/s, loss=2.394, lr=4.4e-05] epoch 2/8: 25%|██▌ | 711/2797 [02:19<06:51, 5.07batch/s, loss=2.394, lr=4.4e-05] epoch 2/8: 26%|██▌ | 722/2797 [02:21<06:44, 5.13batch/s, loss=2.394, lr=4.4e-05] epoch 2/8: 26%|██▌ | 722/2797 [02:22<06:44, 5.13batch/s, loss=2.390, lr=4.4e-05] epoch 2/8: 26%|██▌ | 733/2797 [02:23<06:44, 5.10batch/s, loss=2.390, lr=4.4e-05] epoch 2/8: 27%|██▋ | 744/2797 [02:25<06:39, 5.15batch/s, loss=2.390, lr=4.4e-05] epoch 2/8: 27%|██▋ | 744/2797 [02:27<06:39, 5.15batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 27%|██▋ | 755/2797 [02:27<06:44, 5.04batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 27%|██▋ | 766/2797 [02:30<06:42, 5.05batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 27%|██▋ | 766/2797 [02:31<06:42, 5.05batch/s, loss=2.391, lr=4.4e-05] epoch 2/8: 28%|██▊ | 778/2797 [02:32<06:31, 5.16batch/s, loss=2.391, lr=4.4e-05] epoch 2/8: 28%|██▊ | 790/2797 [02:34<06:23, 5.23batch/s, loss=2.391, lr=4.4e-05] epoch 2/8: 28%|██▊ | 790/2797 [02:36<06:23, 5.23batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 29%|██▊ | 801/2797 [02:36<06:26, 5.16batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 29%|██▉ | 812/2797 [02:39<06:32, 5.06batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 29%|██▉ | 823/2797 [02:41<06:22, 5.17batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 29%|██▉ | 823/2797 [02:41<06:22, 5.17batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 30%|██▉ | 834/2797 [02:43<06:19, 5.18batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 30%|███ | 845/2797 [02:45<06:17, 5.17batch/s, loss=2.389, lr=4.4e-05] epoch 2/8: 30%|███ | 845/2797 [02:46<06:17, 5.17batch/s, loss=2.387, lr=4.4e-05] epoch 2/8: 31%|███ | 856/2797 [02:47<06:19, 5.12batch/s, loss=2.387, lr=4.4e-05] epoch 2/8: 31%|███ | 867/2797 [02:49<06:10, 5.20batch/s, loss=2.387, lr=4.4e-05] epoch 2/8: 31%|███ | 867/2797 [02:51<06:10, 5.20batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 31%|███▏ | 878/2797 [02:51<06:24, 5.00batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 32%|███▏ | 889/2797 [02:54<06:31, 4.87batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 32%|███▏ | 899/2797 [02:56<06:29, 4.87batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 32%|███▏ | 899/2797 [02:56<06:29, 4.87batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 33%|███▎ | 910/2797 [02:58<06:23, 4.92batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 33%|███▎ | 922/2797 [03:00<06:07, 5.10batch/s, loss=2.382, lr=4.4e-05] epoch 2/8: 33%|███▎ | 922/2797 [03:01<06:07, 5.10batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 33%|███▎ | 933/2797 [03:02<06:03, 5.12batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 34%|███▍ | 944/2797 [03:05<06:07, 5.05batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 34%|███▍ | 944/2797 [03:06<06:07, 5.05batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 34%|███▍ | 955/2797 [03:07<06:08, 5.00batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 35%|███▍ | 967/2797 [03:09<05:55, 5.15batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 35%|███▍ | 967/2797 [03:11<05:55, 5.15batch/s, loss=2.379, lr=4.4e-05] epoch 2/8: 35%|███▌ | 979/2797 [03:11<05:43, 5.29batch/s, loss=2.379, lr=4.4e-05] epoch 2/8: 35%|███▌ | 990/2797 [03:13<05:43, 5.26batch/s, loss=2.379, lr=4.4e-05] epoch 2/8: 35%|███▌ | 990/2797 [03:15<05:43, 5.26batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 36%|███▌ | 1002/2797 [03:15<05:33, 5.39batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 36%|███▌ | 1013/2797 [03:18<05:42, 5.20batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 37%|███▋ | 1024/2797 [03:20<05:44, 5.15batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 37%|███▋ | 1024/2797 [03:20<05:44, 5.15batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 37%|███▋ | 1035/2797 [03:22<05:42, 5.14batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 37%|███▋ | 1046/2797 [03:24<05:42, 5.12batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 37%|███▋ | 1046/2797 [03:25<05:42, 5.12batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 38%|███▊ | 1058/2797 [03:26<05:29, 5.27batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 38%|███▊ | 1069/2797 [03:28<05:28, 5.27batch/s, loss=2.378, lr=4.4e-05] epoch 2/8: 38%|███▊ | 1069/2797 [03:30<05:28, 5.27batch/s, loss=2.375, lr=4.4e-05] epoch 2/8: 39%|███▊ | 1080/2797 [03:31<05:29, 5.21batch/s, loss=2.375, lr=4.4e-05] epoch 2/8: 39%|███▉ | 1091/2797 [03:33<05:30, 5.16batch/s, loss=2.375, lr=4.4e-05] epoch 2/8: 39%|███▉ | 1091/2797 [03:35<05:30, 5.16batch/s, loss=2.374, lr=4.3e-05] epoch 2/8: 39%|███▉ | 1102/2797 [03:35<05:27, 5.17batch/s, loss=2.374, lr=4.3e-05] epoch 2/8: 40%|███▉ | 1114/2797 [03:37<05:12, 5.38batch/s, loss=2.374, lr=4.3e-05] epoch 2/8: 40%|████ | 1125/2797 [03:39<05:19, 5.24batch/s, loss=2.374, lr=4.3e-05] epoch 2/8: 40%|████ | 1125/2797 [03:39<05:19, 5.24batch/s, loss=2.372, lr=4.3e-05] epoch 2/8: 41%|████ | 1136/2797 [03:41<05:19, 5.19batch/s, loss=2.372, lr=4.3e-05] epoch 2/8: 41%|████ | 1147/2797 [03:44<05:24, 5.08batch/s, loss=2.372, lr=4.3e-05] epoch 2/8: 41%|████ | 1147/2797 [03:45<05:24, 5.08batch/s, loss=2.371, lr=4.3e-05] epoch 2/8: 41%|████▏ | 1158/2797 [03:46<05:20, 5.11batch/s, loss=2.371, lr=4.3e-05] epoch 2/8: 42%|████▏ | 1169/2797 [03:48<05:21, 5.06batch/s, loss=2.371, lr=4.3e-05] epoch 2/8: 42%|████▏ | 1169/2797 [03:49<05:21, 5.06batch/s, loss=2.370, lr=4.3e-05] epoch 2/8: 42%|████▏ | 1180/2797 [03:50<05:18, 5.08batch/s, loss=2.370, lr=4.3e-05] epoch 2/8: 43%|████▎ | 1192/2797 [03:52<05:06, 5.23batch/s, loss=2.370, lr=4.3e-05] epoch 2/8: 43%|████▎ | 1192/2797 [03:54<05:06, 5.23batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 43%|████▎ | 1203/2797 [03:54<05:10, 5.13batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 43%|████▎ | 1214/2797 [03:56<05:02, 5.23batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 43%|████▎ | 1214/2797 [03:59<05:02, 5.23batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 44%|████▍ | 1226/2797 [03:59<04:51, 5.39batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 44%|████▍ | 1237/2797 [04:01<04:51, 5.35batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 45%|████▍ | 1248/2797 [04:03<04:53, 5.28batch/s, loss=2.368, lr=4.3e-05] epoch 2/8: 45%|████▍ | 1248/2797 [04:03<04:53, 5.28batch/s, loss=2.366, lr=4.3e-05] epoch 2/8: 45%|████▌ | 1259/2797 [04:05<04:52, 5.25batch/s, loss=2.366, lr=4.3e-05] epoch 2/8: 45%|████▌ | 1270/2797 [04:07<04:54, 5.19batch/s, loss=2.366, lr=4.3e-05] epoch 2/8: 45%|████▌ | 1270/2797 [04:08<04:54, 5.19batch/s, loss=2.365, lr=4.3e-05] epoch 2/8: 46%|████▌ | 1281/2797 [04:09<04:59, 5.06batch/s, loss=2.365, lr=4.3e-05] epoch 2/8: 46%|████▌ | 1292/2797 [04:12<04:54, 5.11batch/s, loss=2.365, lr=4.3e-05] epoch 2/8: 46%|████▌ | 1292/2797 [04:13<04:54, 5.11batch/s, loss=2.364, lr=4.3e-05] epoch 2/8: 47%|████▋ | 1303/2797 [04:14<04:59, 4.99batch/s, loss=2.364, lr=4.3e-05] epoch 2/8: 47%|████▋ | 1314/2797 [04:16<04:54, 5.04batch/s, loss=2.364, lr=4.3e-05] epoch 2/8: 47%|████▋ | 1325/2797 [04:18<04:51, 5.04batch/s, loss=2.364, lr=4.3e-05] epoch 2/8: 47%|████▋ | 1325/2797 [04:18<04:51, 5.04batch/s, loss=2.363, lr=4.3e-05] epoch 2/8: 48%|████▊ | 1336/2797 [04:20<04:46, 5.10batch/s, loss=2.363, lr=4.3e-05] epoch 2/8: 48%|████▊ | 1347/2797 [04:22<04:43, 5.12batch/s, loss=2.363, lr=4.3e-05] epoch 2/8: 48%|████▊ | 1347/2797 [04:23<04:43, 5.12batch/s, loss=2.362, lr=4.3e-05] epoch 2/8: 49%|████▊ | 1358/2797 [04:25<04:44, 5.05batch/s, loss=2.362, lr=4.3e-05] epoch 2/8: 49%|████▉ | 1369/2797 [04:27<04:41, 5.07batch/s, loss=2.362, lr=4.3e-05] epoch 2/8: 49%|████▉ | 1369/2797 [04:28<04:41, 5.07batch/s, loss=2.362, lr=4.3e-05] epoch 2/8: 49%|████▉ | 1380/2797 [04:29<04:34, 5.16batch/s, loss=2.362, lr=4.3e-05] epoch 2/8: 50%|████▉ | 1391/2797 [04:31<04:33, 5.15batch/s, loss=2.362, lr=4.3e-05] epoch 2/8: 50%|████▉ | 1391/2797 [04:33<04:33, 5.15batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 50%|█████ | 1402/2797 [04:33<04:31, 5.13batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 51%|█████ | 1413/2797 [04:35<04:27, 5.18batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 51%|█████ | 1424/2797 [04:37<04:25, 5.18batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 51%|█████ | 1424/2797 [04:38<04:25, 5.18batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 51%|█████▏ | 1435/2797 [04:40<04:27, 5.09batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 52%|█████▏ | 1446/2797 [04:42<04:23, 5.12batch/s, loss=2.361, lr=4.3e-05] epoch 2/8: 52%|█████▏ | 1446/2797 [04:43<04:23, 5.12batch/s, loss=2.360, lr=4.3e-05] epoch 2/8: 52%|█████▏ | 1457/2797 [04:44<04:32, 4.91batch/s, loss=2.360, lr=4.3e-05] epoch 2/8: 52%|█████▏ | 1468/2797 [04:46<04:29, 4.93batch/s, loss=2.360, lr=4.3e-05] epoch 2/8: 52%|█████▏ | 1468/2797 [04:48<04:29, 4.93batch/s, loss=2.359, lr=4.3e-05] epoch 2/8: 53%|█████▎ | 1479/2797 [04:48<04:23, 5.00batch/s, loss=2.359, lr=4.3e-05] epoch 2/8: 53%|█████▎ | 1490/2797 [04:51<04:18, 5.05batch/s, loss=2.359, lr=4.3e-05] epoch 2/8: 53%|█████▎ | 1490/2797 [04:53<04:18, 5.05batch/s, loss=2.357, lr=4.3e-05] epoch 2/8: 54%|█████▎ | 1501/2797 [04:53<04:13, 5.12batch/s, loss=2.357, lr=4.3e-05] epoch 2/8: 54%|█████▍ | 1513/2797 [04:55<04:03, 5.27batch/s, loss=2.357, lr=4.3e-05] epoch 2/8: 54%|█████▍ | 1524/2797 [04:57<04:01, 5.27batch/s, loss=2.357, lr=4.3e-05] epoch 2/8: 54%|█████▍ | 1524/2797 [04:57<04:01, 5.27batch/s, loss=2.357, lr=4.2e-05] epoch 2/8: 55%|█████▍ | 1535/2797 [04:59<04:00, 5.25batch/s, loss=2.357, lr=4.2e-05] epoch 2/8: 55%|█████▌ | 1546/2797 [05:01<03:59, 5.22batch/s, loss=2.357, lr=4.2e-05] epoch 2/8: 55%|█████▌ | 1546/2797 [05:02<03:59, 5.22batch/s, loss=2.356, lr=4.2e-05] epoch 2/8: 56%|█████▌ | 1557/2797 [05:03<03:58, 5.21batch/s, loss=2.356, lr=4.2e-05] epoch 2/8: 56%|█████▌ | 1568/2797 [05:05<03:53, 5.26batch/s, loss=2.356, lr=4.2e-05] epoch 2/8: 56%|█████▌ | 1568/2797 [05:07<03:53, 5.26batch/s, loss=2.356, lr=4.2e-05] epoch 2/8: 56%|█████▋ | 1579/2797 [05:07<03:49, 5.32batch/s, loss=2.356, lr=4.2e-05] epoch 2/8: 57%|█████▋ | 1590/2797 [05:10<03:53, 5.16batch/s, loss=2.356, lr=4.2e-05] epoch 2/8: 57%|█████▋ | 1590/2797 [05:12<03:53, 5.16batch/s, loss=2.355, lr=4.2e-05] epoch 2/8: 57%|█████▋ | 1601/2797 [05:12<03:49, 5.20batch/s, loss=2.355, lr=4.2e-05] epoch 2/8: 58%|█████▊ | 1613/2797 [05:14<03:41, 5.34batch/s, loss=2.355, lr=4.2e-05] epoch 2/8: 58%|█████▊ | 1624/2797 [05:16<03:43, 5.25batch/s, loss=2.355, lr=4.2e-05] epoch 2/8: 58%|█████▊ | 1624/2797 [05:16<03:43, 5.25batch/s, loss=2.354, lr=4.2e-05] epoch 2/8: 58%|█████▊ | 1635/2797 [05:18<03:46, 5.14batch/s, loss=2.354, lr=4.2e-05] epoch 2/8: 59%|█████▉ | 1646/2797 [05:20<03:46, 5.08batch/s, loss=2.354, lr=4.2e-05] epoch 2/8: 59%|█████▉ | 1646/2797 [05:22<03:46, 5.08batch/s, loss=2.353, lr=4.2e-05] epoch 2/8: 59%|█████▉ | 1657/2797 [05:23<03:45, 5.06batch/s, loss=2.353, lr=4.2e-05] epoch 2/8: 60%|█████▉ | 1668/2797 [05:25<03:44, 5.03batch/s, loss=2.353, lr=4.2e-05] epoch 2/8: 60%|█████▉ | 1668/2797 [05:27<03:44, 5.03batch/s, loss=2.352, lr=4.2e-05] epoch 2/8: 60%|██████ | 1679/2797 [05:27<03:47, 4.90batch/s, loss=2.352, lr=4.2e-05] epoch 2/8: 60%|██████ | 1690/2797 [05:29<03:42, 4.97batch/s, loss=2.352, lr=4.2e-05] epoch 2/8: 61%|██████ | 1700/2797 [05:32<03:44, 4.88batch/s, loss=2.352, lr=4.2e-05] epoch 2/8: 61%|██████ | 1700/2797 [05:32<03:44, 4.88batch/s, loss=2.350, lr=4.2e-05] epoch 2/8: 61%|██████ | 1712/2797 [05:34<03:35, 5.03batch/s, loss=2.350, lr=4.2e-05] epoch 2/8: 62%|██████▏ | 1723/2797 [05:36<03:32, 5.05batch/s, loss=2.350, lr=4.2e-05] epoch 2/8: 62%|██████▏ | 1723/2797 [05:37<03:32, 5.05batch/s, loss=2.349, lr=4.2e-05] epoch 2/8: 62%|██████▏ | 1734/2797 [05:38<03:32, 5.00batch/s, loss=2.349, lr=4.2e-05] epoch 2/8: 62%|██████▏ | 1746/2797 [05:40<03:20, 5.24batch/s, loss=2.349, lr=4.2e-05] epoch 2/8: 62%|██████▏ | 1746/2797 [05:41<03:20, 5.24batch/s, loss=2.347, lr=4.2e-05] epoch 2/8: 63%|██████▎ | 1757/2797 [05:42<03:22, 5.13batch/s, loss=2.347, lr=4.2e-05] epoch 2/8: 63%|██████▎ | 1768/2797 [05:45<03:21, 5.10batch/s, loss=2.347, lr=4.2e-05] epoch 2/8: 63%|██████▎ | 1768/2797 [05:46<03:21, 5.10batch/s, loss=2.346, lr=4.2e-05] epoch 2/8: 64%|██████▎ | 1779/2797 [05:47<03:19, 5.10batch/s, loss=2.346, lr=4.2e-05] epoch 2/8: 64%|██████▍ | 1790/2797 [05:49<03:18, 5.07batch/s, loss=2.346, lr=4.2e-05] epoch 2/8: 64%|██████▍ | 1790/2797 [05:51<03:18, 5.07batch/s, loss=2.345, lr=4.2e-05] epoch 2/8: 64%|██████▍ | 1801/2797 [05:51<03:17, 5.04batch/s, loss=2.345, lr=4.2e-05] epoch 2/8: 65%|██████▍ | 1812/2797 [05:53<03:11, 5.15batch/s, loss=2.345, lr=4.2e-05] epoch 2/8: 65%|██████▌ | 1823/2797 [05:55<03:11, 5.08batch/s, loss=2.345, lr=4.2e-05] epoch 2/8: 65%|██████▌ | 1823/2797 [05:56<03:11, 5.08batch/s, loss=2.344, lr=4.2e-05] epoch 2/8: 66%|██████▌ | 1834/2797 [05:58<03:10, 5.06batch/s, loss=2.344, lr=4.2e-05] epoch 2/8: 66%|██████▌ | 1845/2797 [06:00<03:11, 4.98batch/s, loss=2.344, lr=4.2e-05] epoch 2/8: 66%|██████▌ | 1845/2797 [06:01<03:11, 4.98batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 66%|██████▋ | 1856/2797 [06:02<03:06, 5.04batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 67%|██████▋ | 1867/2797 [06:04<03:04, 5.04batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 67%|██████▋ | 1867/2797 [06:06<03:04, 5.04batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 67%|██████▋ | 1878/2797 [06:07<03:05, 4.95batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 68%|██████▊ | 1889/2797 [06:09<02:59, 5.05batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 68%|██████▊ | 1900/2797 [06:11<02:57, 5.04batch/s, loss=2.343, lr=4.2e-05] epoch 2/8: 68%|██████▊ | 1900/2797 [06:11<02:57, 5.04batch/s, loss=2.342, lr=4.2e-05] epoch 2/8: 68%|██████▊ | 1911/2797 [06:13<02:55, 5.05batch/s, loss=2.342, lr=4.2e-05] epoch 2/8: 69%|██████▊ | 1922/2797 [06:15<02:51, 5.10batch/s, loss=2.342, lr=4.2e-05] epoch 2/8: 69%|██████▊ | 1922/2797 [06:16<02:51, 5.10batch/s, loss=2.342, lr=4.2e-05] epoch 2/8: 69%|██████▉ | 1933/2797 [06:17<02:48, 5.13batch/s, loss=2.342, lr=4.2e-05] epoch 2/8: 70%|██████▉ | 1944/2797 [06:19<02:43, 5.23batch/s, loss=2.342, lr=4.2e-05] epoch 2/8: 70%|██████▉ | 1944/2797 [06:21<02:43, 5.23batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 70%|██████▉ | 1955/2797 [06:21<02:43, 5.16batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 70%|███████ | 1967/2797 [06:24<02:38, 5.23batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 70%|███████ | 1967/2797 [06:26<02:38, 5.23batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 71%|███████ | 1978/2797 [06:26<02:39, 5.14batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 71%|███████ | 1989/2797 [06:28<02:37, 5.11batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 72%|███████▏ | 2000/2797 [06:30<02:34, 5.17batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 72%|███████▏ | 2000/2797 [06:30<02:34, 5.17batch/s, loss=2.340, lr=4.1e-05] epoch 2/8: 72%|███████▏ | 2011/2797 [06:32<02:35, 5.06batch/s, loss=2.340, lr=4.1e-05] epoch 2/8: 72%|███████▏ | 2022/2797 [06:35<02:31, 5.10batch/s, loss=2.340, lr=4.1e-05] epoch 2/8: 72%|███████▏ | 2022/2797 [06:35<02:31, 5.10batch/s, loss=2.340, lr=4.1e-05] epoch 2/8: 73%|███████▎ | 2033/2797 [06:37<02:29, 5.10batch/s, loss=2.340, lr=4.1e-05] epoch 2/8: 73%|███████▎ | 2044/2797 [06:39<02:26, 5.13batch/s, loss=2.340, lr=4.1e-05] epoch 2/8: 73%|███████▎ | 2044/2797 [06:40<02:26, 5.13batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 73%|███████▎ | 2055/2797 [06:41<02:24, 5.13batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 74%|███████▍ | 2066/2797 [06:43<02:23, 5.11batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 74%|███████▍ | 2066/2797 [06:45<02:23, 5.11batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 74%|███████▍ | 2077/2797 [06:45<02:23, 5.00batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 75%|███████▍ | 2088/2797 [06:48<02:25, 4.88batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 75%|███████▌ | 2099/2797 [06:50<02:20, 4.96batch/s, loss=2.341, lr=4.1e-05] epoch 2/8: 75%|███████▌ | 2099/2797 [06:50<02:20, 4.96batch/s, loss=2.339, lr=4.1e-05] epoch 2/8: 75%|███████▌ | 2109/2797 [06:52<02:20, 4.89batch/s, loss=2.339, lr=4.1e-05] epoch 2/8: 76%|███████▌ | 2119/2797 [06:54<02:18, 4.91batch/s, loss=2.339, lr=4.1e-05] epoch 2/8: 76%|███████▌ | 2119/2797 [06:55<02:18, 4.91batch/s, loss=2.337, lr=4.1e-05] epoch 2/8: 76%|███████▌ | 2129/2797 [06:56<02:15, 4.94batch/s, loss=2.337, lr=4.1e-05] epoch 2/8: 76%|███████▋ | 2139/2797 [06:58<02:14, 4.90batch/s, loss=2.337, lr=4.1e-05] epoch 2/8: 77%|███████▋ | 2150/2797 [07:00<02:10, 4.97batch/s, loss=2.337, lr=4.1e-05] epoch 2/8: 77%|███████▋ | 2150/2797 [07:01<02:10, 4.97batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 77%|███████▋ | 2161/2797 [07:02<02:05, 5.05batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 78%|███████▊ | 2173/2797 [07:05<02:00, 5.19batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 78%|███████▊ | 2173/2797 [07:05<02:00, 5.19batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 78%|███████▊ | 2184/2797 [07:07<01:59, 5.15batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 78%|███████▊ | 2195/2797 [07:09<01:59, 5.05batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 78%|███████▊ | 2195/2797 [07:10<01:59, 5.05batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 79%|███████▉ | 2206/2797 [07:11<01:58, 5.00batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 79%|███████▉ | 2216/2797 [07:14<01:59, 4.87batch/s, loss=2.336, lr=4.1e-05] epoch 2/8: 79%|███████▉ | 2216/2797 [07:15<01:59, 4.87batch/s, loss=2.335, lr=4.1e-05] epoch 2/8: 80%|███████▉ | 2228/2797 [07:16<01:50, 5.16batch/s, loss=2.335, lr=4.1e-05] epoch 2/8: 80%|████████ | 2239/2797 [07:18<01:48, 5.15batch/s, loss=2.335, lr=4.1e-05] epoch 2/8: 80%|████████ | 2250/2797 [07:20<01:45, 5.18batch/s, loss=2.335, lr=4.1e-05] epoch 2/8: 80%|████████ | 2250/2797 [07:20<01:45, 5.18batch/s, loss=2.334, lr=4.1e-05] epoch 2/8: 81%|████████ | 2261/2797 [07:22<01:43, 5.20batch/s, loss=2.334, lr=4.1e-05] epoch 2/8: 81%|████████ | 2272/2797 [07:24<01:43, 5.09batch/s, loss=2.334, lr=4.1e-05] epoch 2/8: 81%|████████ | 2272/2797 [07:25<01:43, 5.09batch/s, loss=2.332, lr=4.1e-05] epoch 2/8: 82%|████████▏ | 2284/2797 [07:26<01:37, 5.26batch/s, loss=2.332, lr=4.1e-05] epoch 2/8: 82%|████████▏ | 2295/2797 [07:28<01:37, 5.16batch/s, loss=2.332, lr=4.1e-05] epoch 2/8: 82%|████████▏ | 2295/2797 [07:30<01:37, 5.16batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 82%|████████▏ | 2306/2797 [07:31<01:35, 5.13batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 83%|████████▎ | 2317/2797 [07:33<01:34, 5.09batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 83%|████████▎ | 2317/2797 [07:35<01:34, 5.09batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 83%|████████▎ | 2328/2797 [07:35<01:32, 5.08batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 84%|████████▎ | 2339/2797 [07:37<01:30, 5.05batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 84%|████████▎ | 2339/2797 [07:39<01:30, 5.05batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 84%|████████▍ | 2351/2797 [07:39<01:25, 5.23batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 84%|████████▍ | 2362/2797 [07:41<01:23, 5.23batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 85%|████████▍ | 2373/2797 [07:44<01:21, 5.22batch/s, loss=2.331, lr=4.1e-05] epoch 2/8: 85%|████████▍ | 2373/2797 [07:44<01:21, 5.22batch/s, loss=2.330, lr=4.0e-05] epoch 2/8: 85%|████████▌ | 2384/2797 [07:46<01:18, 5.23batch/s, loss=2.330, lr=4.0e-05] epoch 2/8: 86%|████████▌ | 2395/2797 [07:48<01:16, 5.25batch/s, loss=2.330, lr=4.0e-05] epoch 2/8: 86%|████████▌ | 2395/2797 [07:49<01:16, 5.25batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 86%|████████▌ | 2406/2797 [07:50<01:16, 5.09batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 86%|████████▋ | 2417/2797 [07:52<01:15, 5.01batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 86%|████████▋ | 2417/2797 [07:54<01:15, 5.01batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 87%|████████▋ | 2428/2797 [07:55<01:13, 5.02batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 87%|████████▋ | 2439/2797 [07:57<01:09, 5.14batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 88%|████████▊ | 2450/2797 [07:59<01:07, 5.17batch/s, loss=2.331, lr=4.0e-05] epoch 2/8: 88%|████████▊ | 2450/2797 [07:59<01:07, 5.17batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 88%|████████▊ | 2461/2797 [08:01<01:04, 5.21batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 88%|████████▊ | 2472/2797 [08:03<01:03, 5.08batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 88%|████████▊ | 2472/2797 [08:04<01:03, 5.08batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 89%|████████▉ | 2483/2797 [08:05<01:01, 5.12batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 89%|████████▉ | 2494/2797 [08:07<01:00, 5.03batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 89%|████████▉ | 2494/2797 [08:09<01:00, 5.03batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 90%|████████▉ | 2505/2797 [08:10<00:57, 5.06batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 90%|████████▉ | 2517/2797 [08:12<00:53, 5.26batch/s, loss=2.329, lr=4.0e-05] epoch 2/8: 90%|████████▉ | 2517/2797 [08:13<00:53, 5.26batch/s, loss=2.328, lr=4.0e-05] epoch 2/8: 90%|█████████ | 2528/2797 [08:14<00:51, 5.20batch/s, loss=2.328, lr=4.0e-05] epoch 2/8: 91%|█████████ | 2539/2797 [08:16<00:49, 5.17batch/s, loss=2.328, lr=4.0e-05] epoch 2/8: 91%|█████████ | 2550/2797 [08:18<00:48, 5.11batch/s, loss=2.328, lr=4.0e-05] epoch 2/8: 91%|█████████ | 2550/2797 [08:18<00:48, 5.11batch/s, loss=2.327, lr=4.0e-05] epoch 2/8: 92%|█████████▏| 2561/2797 [08:20<00:45, 5.15batch/s, loss=2.327, lr=4.0e-05] epoch 2/8: 92%|█████████▏| 2572/2797 [08:22<00:43, 5.22batch/s, loss=2.327, lr=4.0e-05] epoch 2/8: 92%|█████████▏| 2572/2797 [08:23<00:43, 5.22batch/s, loss=2.326, lr=4.0e-05] epoch 2/8: 92%|█████████▏| 2584/2797 [08:24<00:39, 5.34batch/s, loss=2.326, lr=4.0e-05] epoch 2/8: 93%|█████████▎| 2595/2797 [08:27<00:38, 5.28batch/s, loss=2.326, lr=4.0e-05] epoch 2/8: 93%|█████████▎| 2595/2797 [08:28<00:38, 5.28batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 93%|█████████▎| 2606/2797 [08:29<00:37, 5.03batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 94%|█████████▎| 2617/2797 [08:31<00:35, 5.01batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 94%|█████████▎| 2617/2797 [08:33<00:35, 5.01batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 94%|█████████▍| 2628/2797 [08:34<00:34, 4.94batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 94%|█████████▍| 2639/2797 [08:36<00:31, 5.02batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 95%|█████████▍| 2650/2797 [08:38<00:29, 4.98batch/s, loss=2.325, lr=4.0e-05] epoch 2/8: 95%|█████████▍| 2650/2797 [08:38<00:29, 4.98batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 95%|█████████▌| 2661/2797 [08:40<00:26, 5.04batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 96%|█████████▌| 2672/2797 [08:42<00:25, 5.00batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 96%|█████████▌| 2672/2797 [08:43<00:25, 5.00batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 96%|█████████▌| 2683/2797 [08:44<00:22, 5.09batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 96%|█████████▋| 2694/2797 [08:47<00:20, 4.98batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 96%|█████████▋| 2694/2797 [08:48<00:20, 4.98batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 97%|█████████▋| 2704/2797 [08:49<00:18, 4.98batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 97%|█████████▋| 2714/2797 [08:51<00:16, 4.88batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 97%|█████████▋| 2725/2797 [08:53<00:14, 4.95batch/s, loss=2.324, lr=4.0e-05] epoch 2/8: 97%|█████████▋| 2725/2797 [08:53<00:14, 4.95batch/s, loss=2.323, lr=4.0e-05] epoch 2/8: 98%|█████████▊| 2736/2797 [08:55<00:12, 5.03batch/s, loss=2.323, lr=4.0e-05] epoch 2/8: 98%|█████████▊| 2747/2797 [08:57<00:10, 4.97batch/s, loss=2.323, lr=4.0e-05] epoch 2/8: 98%|█████████▊| 2747/2797 [08:58<00:10, 4.97batch/s, loss=2.322, lr=4.0e-05] epoch 2/8: 99%|█████████▊| 2757/2797 [08:59<00:08, 4.88batch/s, loss=2.322, lr=4.0e-05] epoch 2/8: 99%|█████████▉| 2768/2797 [09:02<00:05, 4.94batch/s, loss=2.322, lr=4.0e-05] epoch 2/8: 99%|█████████▉| 2768/2797 [09:03<00:05, 4.94batch/s, loss=2.322, lr=4.0e-05] epoch 2/8: 99%|█████████▉| 2779/2797 [09:04<00:03, 5.03batch/s, loss=2.322, lr=4.0e-05] epoch 2/8: 100%|█████████▉| 2790/2797 [09:06<00:01, 5.05batch/s, loss=2.322, lr=4.0e-05] epoch 2/8: 100%|██████████| 2797/2797 [09:07<00:00, 5.11batch/s, loss=2.322, lr=4.0e-05]
epoch 2: train loss 2.322 · validation loss 2.246 · broad 79.7% (top-3 94.5%) · path 69.9% (top-3 87.6%, plausible or look-alike 85.8%) · 1178s elapsed
epoch 3/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 3/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=1.774, lr=3.9e-05] epoch 3/8: 0%| | 11/2797 [00:02<09:16, 5.00batch/s, loss=1.774, lr=3.9e-05] epoch 3/8: 1%| | 22/2797 [00:04<09:27, 4.89batch/s, loss=1.774, lr=3.9e-05] epoch 3/8: 1%| | 22/2797 [00:05<09:27, 4.89batch/s, loss=1.967, lr=3.9e-05] epoch 3/8: 1%| | 32/2797 [00:06<09:51, 4.68batch/s, loss=1.967, lr=3.9e-05] epoch 3/8: 2%|▏ | 44/2797 [00:08<09:07, 5.03batch/s, loss=1.967, lr=3.9e-05] epoch 3/8: 2%|▏ | 44/2797 [00:10<09:07, 5.03batch/s, loss=1.972, lr=3.9e-05] epoch 3/8: 2%|▏ | 55/2797 [00:10<08:54, 5.13batch/s, loss=1.972, lr=3.9e-05] epoch 3/8: 2%|▏ | 66/2797 [00:13<08:53, 5.12batch/s, loss=1.972, lr=3.9e-05] epoch 3/8: 2%|▏ | 66/2797 [00:15<08:53, 5.12batch/s, loss=1.980, lr=3.9e-05] epoch 3/8: 3%|▎ | 77/2797 [00:15<08:51, 5.12batch/s, loss=1.980, lr=3.9e-05] epoch 3/8: 3%|▎ | 88/2797 [00:17<09:02, 4.99batch/s, loss=1.980, lr=3.9e-05] epoch 3/8: 4%|▎ | 99/2797 [00:19<08:56, 5.03batch/s, loss=1.980, lr=3.9e-05] epoch 3/8: 4%|▎ | 99/2797 [00:20<08:56, 5.03batch/s, loss=1.979, lr=3.9e-05] epoch 3/8: 4%|▍ | 110/2797 [00:21<08:57, 5.00batch/s, loss=1.979, lr=3.9e-05] epoch 3/8: 4%|▍ | 121/2797 [00:24<08:53, 5.01batch/s, loss=1.979, lr=3.9e-05] epoch 3/8: 4%|▍ | 121/2797 [00:25<08:53, 5.01batch/s, loss=1.977, lr=3.9e-05] epoch 3/8: 5%|▍ | 132/2797 [00:26<08:46, 5.06batch/s, loss=1.977, lr=3.9e-05] epoch 3/8: 5%|▌ | 143/2797 [00:28<08:50, 5.00batch/s, loss=1.977, lr=3.9e-05] epoch 3/8: 5%|▌ | 143/2797 [00:30<08:50, 5.00batch/s, loss=1.967, lr=3.9e-05] epoch 3/8: 6%|▌ | 154/2797 [00:30<08:39, 5.08batch/s, loss=1.967, lr=3.9e-05] epoch 3/8: 6%|▌ | 165/2797 [00:32<08:25, 5.20batch/s, loss=1.967, lr=3.9e-05] epoch 3/8: 6%|▌ | 165/2797 [00:34<08:25, 5.20batch/s, loss=1.965, lr=3.9e-05] epoch 3/8: 6%|▋ | 176/2797 [00:34<08:25, 5.19batch/s, loss=1.965, lr=3.9e-05] epoch 3/8: 7%|▋ | 187/2797 [00:37<08:45, 4.97batch/s, loss=1.965, lr=3.9e-05] epoch 3/8: 7%|▋ | 199/2797 [00:39<08:25, 5.14batch/s, loss=1.965, lr=3.9e-05] epoch 3/8: 7%|▋ | 199/2797 [00:39<08:25, 5.14batch/s, loss=1.960, lr=3.9e-05] epoch 3/8: 8%|▊ | 210/2797 [00:41<08:19, 5.18batch/s, loss=1.960, lr=3.9e-05] epoch 3/8: 8%|▊ | 221/2797 [00:43<08:20, 5.15batch/s, loss=1.960, lr=3.9e-05] epoch 3/8: 8%|▊ | 221/2797 [00:44<08:20, 5.15batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 8%|▊ | 233/2797 [00:45<08:06, 5.27batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 9%|▊ | 244/2797 [00:47<08:12, 5.18batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 9%|▊ | 244/2797 [00:49<08:12, 5.18batch/s, loss=1.950, lr=3.9e-05] epoch 3/8: 9%|▉ | 255/2797 [00:50<08:18, 5.10batch/s, loss=1.950, lr=3.9e-05] epoch 3/8: 10%|▉ | 266/2797 [00:52<08:10, 5.15batch/s, loss=1.950, lr=3.9e-05] epoch 3/8: 10%|▉ | 266/2797 [00:54<08:10, 5.15batch/s, loss=1.952, lr=3.9e-05] epoch 3/8: 10%|▉ | 277/2797 [00:54<08:10, 5.13batch/s, loss=1.952, lr=3.9e-05] epoch 3/8: 10%|█ | 288/2797 [00:56<08:02, 5.20batch/s, loss=1.952, lr=3.9e-05] epoch 3/8: 11%|█ | 299/2797 [00:58<08:10, 5.09batch/s, loss=1.952, lr=3.9e-05] epoch 3/8: 11%|█ | 299/2797 [00:59<08:10, 5.09batch/s, loss=1.958, lr=3.9e-05] epoch 3/8: 11%|█ | 310/2797 [01:00<08:03, 5.14batch/s, loss=1.958, lr=3.9e-05] epoch 3/8: 12%|█▏ | 322/2797 [01:02<07:49, 5.28batch/s, loss=1.958, lr=3.9e-05] epoch 3/8: 12%|█▏ | 322/2797 [01:03<07:49, 5.28batch/s, loss=1.957, lr=3.9e-05] epoch 3/8: 12%|█▏ | 334/2797 [01:05<07:37, 5.38batch/s, loss=1.957, lr=3.9e-05] epoch 3/8: 12%|█▏ | 346/2797 [01:07<07:30, 5.44batch/s, loss=1.957, lr=3.9e-05] epoch 3/8: 12%|█▏ | 346/2797 [01:08<07:30, 5.44batch/s, loss=1.957, lr=3.9e-05] epoch 3/8: 13%|█▎ | 357/2797 [01:09<07:32, 5.39batch/s, loss=1.957, lr=3.9e-05] epoch 3/8: 13%|█▎ | 368/2797 [01:11<07:43, 5.24batch/s, loss=1.957, lr=3.9e-05] epoch 3/8: 13%|█▎ | 368/2797 [01:13<07:43, 5.24batch/s, loss=1.961, lr=3.9e-05] epoch 3/8: 14%|█▎ | 379/2797 [01:13<07:43, 5.22batch/s, loss=1.961, lr=3.9e-05] epoch 3/8: 14%|█▍ | 390/2797 [01:16<07:59, 5.02batch/s, loss=1.961, lr=3.9e-05] epoch 3/8: 14%|█▍ | 390/2797 [01:18<07:59, 5.02batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 14%|█▍ | 401/2797 [01:18<07:56, 5.03batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 15%|█▍ | 412/2797 [01:20<07:53, 5.04batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 15%|█▌ | 423/2797 [01:22<07:41, 5.14batch/s, loss=1.959, lr=3.9e-05] epoch 3/8: 15%|█▌ | 423/2797 [01:23<07:41, 5.14batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 16%|█▌ | 434/2797 [01:24<07:38, 5.15batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 16%|█▌ | 445/2797 [01:26<07:31, 5.21batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 16%|█▌ | 445/2797 [01:27<07:31, 5.21batch/s, loss=1.959, lr=3.8e-05] epoch 3/8: 16%|█▋ | 456/2797 [01:28<07:39, 5.09batch/s, loss=1.959, lr=3.8e-05] epoch 3/8: 17%|█▋ | 467/2797 [01:31<07:36, 5.11batch/s, loss=1.959, lr=3.8e-05] epoch 3/8: 17%|█▋ | 467/2797 [01:32<07:36, 5.11batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 17%|█▋ | 478/2797 [01:33<07:29, 5.16batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 17%|█▋ | 489/2797 [01:35<07:32, 5.10batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 18%|█▊ | 500/2797 [01:37<07:28, 5.12batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 18%|█▊ | 500/2797 [01:37<07:28, 5.12batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 18%|█▊ | 511/2797 [01:39<07:27, 5.11batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 19%|█▊ | 522/2797 [01:41<07:28, 5.08batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 19%|█▊ | 522/2797 [01:42<07:28, 5.08batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 19%|█▉ | 533/2797 [01:44<07:33, 4.99batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 19%|█▉ | 544/2797 [01:46<07:24, 5.07batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 19%|█▉ | 544/2797 [01:47<07:24, 5.07batch/s, loss=1.959, lr=3.8e-05] epoch 3/8: 20%|█▉ | 555/2797 [01:48<07:18, 5.11batch/s, loss=1.959, lr=3.8e-05] epoch 3/8: 20%|██ | 566/2797 [01:50<07:18, 5.09batch/s, loss=1.959, lr=3.8e-05] epoch 3/8: 20%|██ | 566/2797 [01:52<07:18, 5.09batch/s, loss=1.958, lr=3.8e-05] epoch 3/8: 21%|██ | 577/2797 [01:53<07:35, 4.87batch/s, loss=1.958, lr=3.8e-05] epoch 3/8: 21%|██ | 588/2797 [01:55<07:26, 4.95batch/s, loss=1.958, lr=3.8e-05] epoch 3/8: 21%|██▏ | 599/2797 [01:57<07:15, 5.05batch/s, loss=1.958, lr=3.8e-05] epoch 3/8: 21%|██▏ | 599/2797 [01:57<07:15, 5.05batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 22%|██▏ | 610/2797 [01:59<07:13, 5.05batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 22%|██▏ | 621/2797 [02:01<07:09, 5.07batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 22%|██▏ | 621/2797 [02:02<07:09, 5.07batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 23%|██▎ | 632/2797 [02:03<07:06, 5.07batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 23%|██▎ | 643/2797 [02:05<07:02, 5.10batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 23%|██▎ | 643/2797 [02:07<07:02, 5.10batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 23%|██▎ | 654/2797 [02:08<07:16, 4.91batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 24%|██▎ | 664/2797 [02:10<07:13, 4.92batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 24%|██▍ | 675/2797 [02:12<07:06, 4.97batch/s, loss=1.956, lr=3.8e-05] epoch 3/8: 24%|██▍ | 675/2797 [02:12<07:06, 4.97batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 24%|██▍ | 685/2797 [02:14<07:09, 4.91batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 25%|██▍ | 695/2797 [02:16<07:16, 4.81batch/s, loss=1.957, lr=3.8e-05] epoch 3/8: 25%|██▍ | 695/2797 [02:17<07:16, 4.81batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 25%|██▌ | 705/2797 [02:18<07:10, 4.86batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 26%|██▌ | 715/2797 [02:21<07:32, 4.60batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 26%|██▌ | 715/2797 [02:23<07:32, 4.60batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 26%|██▌ | 726/2797 [02:23<07:13, 4.78batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 26%|██▋ | 738/2797 [02:25<06:52, 4.99batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 27%|██▋ | 749/2797 [02:27<06:47, 5.03batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 27%|██▋ | 749/2797 [02:28<06:47, 5.03batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 27%|██▋ | 760/2797 [02:30<06:53, 4.93batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 28%|██▊ | 770/2797 [02:32<06:50, 4.94batch/s, loss=1.955, lr=3.8e-05] epoch 3/8: 28%|██▊ | 770/2797 [02:33<06:50, 4.94batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 28%|██▊ | 781/2797 [02:34<06:44, 4.98batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 28%|██▊ | 791/2797 [02:36<06:42, 4.98batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 28%|██▊ | 791/2797 [02:38<06:42, 4.98batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 29%|██▊ | 801/2797 [02:38<06:45, 4.92batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 29%|██▉ | 813/2797 [02:40<06:30, 5.08batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 29%|██▉ | 824/2797 [02:42<06:29, 5.07batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 29%|██▉ | 824/2797 [02:43<06:29, 5.07batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 30%|██▉ | 835/2797 [02:44<06:28, 5.05batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 30%|███ | 846/2797 [02:47<06:24, 5.07batch/s, loss=1.953, lr=3.8e-05] epoch 3/8: 30%|███ | 846/2797 [02:48<06:24, 5.07batch/s, loss=1.954, lr=3.7e-05] epoch 3/8: 31%|███ | 857/2797 [02:49<06:36, 4.90batch/s, loss=1.954, lr=3.7e-05] epoch 3/8: 31%|███ | 868/2797 [02:51<06:25, 5.00batch/s, loss=1.954, lr=3.7e-05] epoch 3/8: 31%|███ | 868/2797 [02:53<06:25, 5.00batch/s, loss=1.954, lr=3.7e-05] epoch 3/8: 31%|███▏ | 879/2797 [02:53<06:26, 4.97batch/s, loss=1.954, lr=3.7e-05] epoch 3/8: 32%|███▏ | 890/2797 [02:55<06:16, 5.07batch/s, loss=1.954, lr=3.7e-05] epoch 3/8: 32%|███▏ | 890/2797 [02:57<06:16, 5.07batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 32%|███▏ | 902/2797 [02:58<06:04, 5.19batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 33%|███▎ | 913/2797 [03:00<06:06, 5.13batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 33%|███▎ | 924/2797 [03:02<06:03, 5.15batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 33%|███▎ | 924/2797 [03:02<06:03, 5.15batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 33%|███▎ | 935/2797 [03:04<06:07, 5.06batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 34%|███▍ | 946/2797 [03:06<06:06, 5.04batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 34%|███▍ | 946/2797 [03:07<06:06, 5.04batch/s, loss=1.953, lr=3.7e-05] epoch 3/8: 34%|███▍ | 957/2797 [03:08<05:57, 5.14batch/s, loss=1.953, lr=3.7e-05] epoch 3/8: 35%|███▍ | 968/2797 [03:11<05:59, 5.09batch/s, loss=1.953, lr=3.7e-05] epoch 3/8: 35%|███▍ | 968/2797 [03:12<05:59, 5.09batch/s, loss=1.953, lr=3.7e-05] epoch 3/8: 35%|███▌ | 979/2797 [03:13<05:57, 5.09batch/s, loss=1.953, lr=3.7e-05] epoch 3/8: 35%|███▌ | 990/2797 [03:15<05:53, 5.12batch/s, loss=1.953, lr=3.7e-05] epoch 3/8: 35%|███▌ | 990/2797 [03:17<05:53, 5.12batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 36%|███▌ | 1001/2797 [03:17<05:55, 5.06batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 36%|███▌ | 1012/2797 [03:19<05:59, 4.97batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 37%|███▋ | 1022/2797 [03:21<05:58, 4.95batch/s, loss=1.952, lr=3.7e-05] epoch 3/8: 37%|███▋ | 1022/2797 [03:22<05:58, 4.95batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 37%|███▋ | 1034/2797 [03:24<05:45, 5.10batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 37%|███▋ | 1045/2797 [03:26<05:40, 5.14batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 37%|███▋ | 1045/2797 [03:27<05:40, 5.14batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 38%|███▊ | 1056/2797 [03:28<05:36, 5.18batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 38%|███▊ | 1067/2797 [03:30<05:33, 5.19batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 38%|███▊ | 1067/2797 [03:32<05:33, 5.19batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 39%|███▊ | 1078/2797 [03:32<05:37, 5.10batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 39%|███▉ | 1089/2797 [03:34<05:29, 5.19batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 39%|███▉ | 1100/2797 [03:37<05:39, 5.00batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 39%|███▉ | 1100/2797 [03:37<05:39, 5.00batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 40%|███▉ | 1112/2797 [03:39<05:26, 5.16batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 40%|████ | 1123/2797 [03:41<05:27, 5.11batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 40%|████ | 1123/2797 [03:42<05:27, 5.11batch/s, loss=1.950, lr=3.7e-05] epoch 3/8: 41%|████ | 1134/2797 [03:43<05:27, 5.08batch/s, loss=1.950, lr=3.7e-05] epoch 3/8: 41%|████ | 1145/2797 [03:46<05:33, 4.96batch/s, loss=1.950, lr=3.7e-05] epoch 3/8: 41%|████ | 1145/2797 [03:47<05:33, 4.96batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 41%|████▏ | 1156/2797 [03:48<05:28, 4.99batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 42%|████▏ | 1167/2797 [03:50<05:23, 5.04batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 42%|████▏ | 1167/2797 [03:52<05:23, 5.04batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 42%|████▏ | 1178/2797 [03:52<05:17, 5.10batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 43%|████▎ | 1189/2797 [03:54<05:18, 5.05batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 43%|████▎ | 1200/2797 [03:56<05:19, 5.00batch/s, loss=1.951, lr=3.7e-05] epoch 3/8: 43%|████▎ | 1200/2797 [03:57<05:19, 5.00batch/s, loss=1.950, lr=3.7e-05] epoch 3/8: 43%|████▎ | 1211/2797 [03:59<05:17, 4.99batch/s, loss=1.950, lr=3.7e-05] epoch 3/8: 44%|████▎ | 1222/2797 [04:01<05:10, 5.07batch/s, loss=1.950, lr=3.7e-05] epoch 3/8: 44%|████▎ | 1222/2797 [04:01<05:10, 5.07batch/s, loss=1.949, lr=3.7e-05] epoch 3/8: 44%|████▍ | 1233/2797 [04:03<05:08, 5.07batch/s, loss=1.949, lr=3.7e-05] epoch 3/8: 44%|████▍ | 1244/2797 [04:05<05:06, 5.06batch/s, loss=1.949, lr=3.7e-05] epoch 3/8: 44%|████▍ | 1244/2797 [04:06<05:06, 5.06batch/s, loss=1.948, lr=3.7e-05] epoch 3/8: 45%|████▍ | 1255/2797 [04:07<04:58, 5.17batch/s, loss=1.948, lr=3.7e-05] epoch 3/8: 45%|████▌ | 1266/2797 [04:09<05:02, 5.06batch/s, loss=1.948, lr=3.7e-05] epoch 3/8: 45%|████▌ | 1266/2797 [04:11<05:02, 5.06batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 46%|████▌ | 1277/2797 [04:12<05:06, 4.96batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 46%|████▌ | 1288/2797 [04:14<04:56, 5.09batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 46%|████▋ | 1299/2797 [04:16<04:52, 5.12batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 46%|████▋ | 1299/2797 [04:16<04:52, 5.12batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 47%|████▋ | 1310/2797 [04:18<04:57, 4.99batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 47%|████▋ | 1322/2797 [04:20<04:47, 5.13batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 47%|████▋ | 1322/2797 [04:21<04:47, 5.13batch/s, loss=1.950, lr=3.6e-05] epoch 3/8: 48%|████▊ | 1333/2797 [04:22<04:40, 5.21batch/s, loss=1.950, lr=3.6e-05] epoch 3/8: 48%|████▊ | 1344/2797 [04:25<04:41, 5.17batch/s, loss=1.950, lr=3.6e-05] epoch 3/8: 48%|████▊ | 1344/2797 [04:26<04:41, 5.17batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 48%|████▊ | 1355/2797 [04:27<04:35, 5.24batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 49%|████▉ | 1366/2797 [04:29<04:37, 5.16batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 49%|████▉ | 1366/2797 [04:31<04:37, 5.16batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 49%|████▉ | 1377/2797 [04:31<04:40, 5.07batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 50%|████▉ | 1388/2797 [04:33<04:38, 5.05batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 50%|█████ | 1399/2797 [04:35<04:32, 5.13batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 50%|█████ | 1399/2797 [04:36<04:32, 5.13batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 50%|█████ | 1410/2797 [04:37<04:25, 5.23batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 51%|█████ | 1421/2797 [04:39<04:22, 5.25batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 51%|█████ | 1421/2797 [04:40<04:22, 5.25batch/s, loss=1.950, lr=3.6e-05] epoch 3/8: 51%|█████ | 1432/2797 [04:42<04:24, 5.17batch/s, loss=1.950, lr=3.6e-05] epoch 3/8: 52%|█████▏ | 1444/2797 [04:44<04:12, 5.37batch/s, loss=1.950, lr=3.6e-05] epoch 3/8: 52%|█████▏ | 1444/2797 [04:45<04:12, 5.37batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 52%|█████▏ | 1455/2797 [04:46<04:21, 5.14batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 52%|█████▏ | 1466/2797 [04:48<04:24, 5.03batch/s, loss=1.949, lr=3.6e-05] epoch 3/8: 52%|█████▏ | 1466/2797 [04:50<04:24, 5.03batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 53%|█████▎ | 1477/2797 [04:50<04:19, 5.09batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 53%|█████▎ | 1488/2797 [04:53<04:20, 5.03batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 54%|█████▎ | 1500/2797 [04:55<04:07, 5.24batch/s, loss=1.948, lr=3.6e-05] epoch 3/8: 54%|█████▎ | 1500/2797 [04:55<04:07, 5.24batch/s, loss=1.947, lr=3.6e-05] epoch 3/8: 54%|█████▍ | 1511/2797 [04:57<04:17, 4.99batch/s, loss=1.947, lr=3.6e-05] epoch 3/8: 54%|█████▍ | 1522/2797 [04:59<04:13, 5.03batch/s, loss=1.947, lr=3.6e-05] epoch 3/8: 54%|█████▍ | 1522/2797 [05:00<04:13, 5.03batch/s, loss=1.947, lr=3.6e-05] epoch 3/8: 55%|█████▍ | 1533/2797 [05:02<04:13, 4.99batch/s, loss=1.947, lr=3.6e-05] epoch 3/8: 55%|█████▌ | 1544/2797 [05:04<04:11, 4.98batch/s, loss=1.947, lr=3.6e-05] epoch 3/8: 55%|█████▌ | 1544/2797 [05:05<04:11, 4.98batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 56%|█████▌ | 1555/2797 [05:06<04:06, 5.03batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 56%|█████▌ | 1566/2797 [05:08<04:02, 5.07batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 56%|█████▌ | 1566/2797 [05:10<04:02, 5.07batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 56%|█████▋ | 1578/2797 [05:10<03:51, 5.27batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 57%|█████▋ | 1589/2797 [05:12<03:51, 5.22batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 57%|█████▋ | 1600/2797 [05:14<03:49, 5.22batch/s, loss=1.946, lr=3.6e-05] epoch 3/8: 57%|█████▋ | 1600/2797 [05:15<03:49, 5.22batch/s, loss=1.945, lr=3.6e-05] epoch 3/8: 58%|█████▊ | 1611/2797 [05:17<03:51, 5.13batch/s, loss=1.945, lr=3.6e-05] epoch 3/8: 58%|█████▊ | 1622/2797 [05:19<03:49, 5.13batch/s, loss=1.945, lr=3.6e-05] epoch 3/8: 58%|█████▊ | 1622/2797 [05:20<03:49, 5.13batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 58%|█████▊ | 1633/2797 [05:21<03:55, 4.95batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 59%|█████▊ | 1643/2797 [05:23<03:52, 4.96batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 59%|█████▊ | 1643/2797 [05:25<03:52, 4.96batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 59%|█████▉ | 1653/2797 [05:25<03:57, 4.81batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 59%|█████▉ | 1663/2797 [05:28<03:55, 4.81batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 60%|█████▉ | 1674/2797 [05:30<03:47, 4.93batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 60%|█████▉ | 1674/2797 [05:30<03:47, 4.93batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 60%|██████ | 1684/2797 [05:32<03:46, 4.92batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 61%|██████ | 1694/2797 [05:34<03:43, 4.93batch/s, loss=1.944, lr=3.6e-05] epoch 3/8: 61%|██████ | 1694/2797 [05:35<03:43, 4.93batch/s, loss=1.943, lr=3.5e-05] epoch 3/8: 61%|██████ | 1704/2797 [05:36<03:42, 4.91batch/s, loss=1.943, lr=3.5e-05] epoch 3/8: 61%|██████▏ | 1715/2797 [05:38<03:39, 4.93batch/s, loss=1.943, lr=3.5e-05] epoch 3/8: 62%|██████▏ | 1725/2797 [05:40<03:39, 4.89batch/s, loss=1.943, lr=3.5e-05] epoch 3/8: 62%|██████▏ | 1725/2797 [05:40<03:39, 4.89batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 62%|██████▏ | 1736/2797 [05:42<03:35, 4.93batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 62%|██████▏ | 1747/2797 [05:44<03:30, 4.98batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 62%|██████▏ | 1747/2797 [05:45<03:30, 4.98batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 63%|██████▎ | 1757/2797 [05:47<03:32, 4.90batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 63%|██████▎ | 1768/2797 [05:49<03:26, 4.97batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 63%|██████▎ | 1768/2797 [05:50<03:26, 4.97batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 64%|██████▎ | 1779/2797 [05:51<03:21, 5.06batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 64%|██████▍ | 1790/2797 [05:53<03:18, 5.06batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 64%|██████▍ | 1790/2797 [05:55<03:18, 5.06batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 64%|██████▍ | 1801/2797 [05:55<03:20, 4.97batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 65%|██████▍ | 1812/2797 [05:57<03:15, 5.04batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 65%|██████▌ | 1823/2797 [06:00<03:13, 5.02batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 65%|██████▌ | 1823/2797 [06:00<03:13, 5.02batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 66%|██████▌ | 1834/2797 [06:02<03:13, 4.98batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 66%|██████▌ | 1844/2797 [06:04<03:18, 4.79batch/s, loss=1.942, lr=3.5e-05] epoch 3/8: 66%|██████▌ | 1844/2797 [06:05<03:18, 4.79batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 66%|██████▋ | 1855/2797 [06:06<03:09, 4.98batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 67%|██████▋ | 1866/2797 [06:09<03:12, 4.83batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 67%|██████▋ | 1866/2797 [06:11<03:12, 4.83batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 67%|██████▋ | 1876/2797 [06:11<03:10, 4.83batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 67%|██████▋ | 1886/2797 [06:13<03:11, 4.76batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 68%|██████▊ | 1896/2797 [06:15<03:08, 4.77batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 68%|██████▊ | 1896/2797 [06:16<03:08, 4.77batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 68%|██████▊ | 1907/2797 [06:17<02:59, 4.96batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 69%|██████▊ | 1917/2797 [06:19<03:01, 4.86batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 69%|██████▊ | 1917/2797 [06:21<03:01, 4.86batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 69%|██████▉ | 1928/2797 [06:21<02:53, 5.00batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 69%|██████▉ | 1939/2797 [06:23<02:51, 5.01batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 70%|██████▉ | 1950/2797 [06:25<02:46, 5.09batch/s, loss=1.941, lr=3.5e-05] epoch 3/8: 70%|██████▉ | 1950/2797 [06:26<02:46, 5.09batch/s, loss=1.940, lr=3.5e-05] epoch 3/8: 70%|███████ | 1961/2797 [06:28<02:47, 5.00batch/s, loss=1.940, lr=3.5e-05] epoch 3/8: 71%|███████ | 1972/2797 [06:30<02:42, 5.08batch/s, loss=1.940, lr=3.5e-05] epoch 3/8: 71%|███████ | 1972/2797 [06:31<02:42, 5.08batch/s, loss=1.939, lr=3.5e-05] epoch 3/8: 71%|███████ | 1983/2797 [06:32<02:38, 5.12batch/s, loss=1.939, lr=3.5e-05] epoch 3/8: 71%|███████▏ | 1994/2797 [06:34<02:36, 5.13batch/s, loss=1.939, lr=3.5e-05] epoch 3/8: 71%|███████▏ | 1994/2797 [06:35<02:36, 5.13batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 72%|███████▏ | 2006/2797 [06:36<02:29, 5.29batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 72%|███████▏ | 2017/2797 [06:38<02:30, 5.18batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 72%|███████▏ | 2017/2797 [06:40<02:30, 5.18batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 73%|███████▎ | 2028/2797 [06:40<02:28, 5.19batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 73%|███████▎ | 2039/2797 [06:43<02:27, 5.15batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 73%|███████▎ | 2039/2797 [06:45<02:27, 5.15batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 73%|███████▎ | 2051/2797 [06:45<02:20, 5.31batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 74%|███████▎ | 2062/2797 [06:47<02:24, 5.10batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 74%|███████▍ | 2073/2797 [06:49<02:19, 5.18batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 74%|███████▍ | 2073/2797 [06:50<02:19, 5.18batch/s, loss=1.937, lr=3.5e-05] epoch 3/8: 75%|███████▍ | 2084/2797 [06:51<02:17, 5.19batch/s, loss=1.937, lr=3.5e-05] epoch 3/8: 75%|███████▍ | 2096/2797 [06:53<02:10, 5.38batch/s, loss=1.937, lr=3.5e-05] epoch 3/8: 75%|███████▍ | 2096/2797 [06:54<02:10, 5.38batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 75%|███████▌ | 2107/2797 [06:56<02:15, 5.10batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 76%|███████▌ | 2118/2797 [06:58<02:13, 5.08batch/s, loss=1.938, lr=3.5e-05] epoch 3/8: 76%|███████▌ | 2118/2797 [06:59<02:13, 5.08batch/s, loss=1.938, lr=3.4e-05] epoch 3/8: 76%|███████▌ | 2130/2797 [07:00<02:07, 5.25batch/s, loss=1.938, lr=3.4e-05] epoch 3/8: 77%|███████▋ | 2142/2797 [07:02<02:02, 5.33batch/s, loss=1.938, lr=3.4e-05] epoch 3/8: 77%|███████▋ | 2142/2797 [07:04<02:02, 5.33batch/s, loss=1.938, lr=3.4e-05] epoch 3/8: 77%|███████▋ | 2154/2797 [07:04<01:57, 5.49batch/s, loss=1.938, lr=3.4e-05] epoch 3/8: 77%|███████▋ | 2166/2797 [07:07<01:58, 5.32batch/s, loss=1.938, lr=3.4e-05] epoch 3/8: 77%|███████▋ | 2166/2797 [07:09<01:58, 5.32batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 78%|███████▊ | 2177/2797 [07:09<02:01, 5.10batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 78%|███████▊ | 2188/2797 [07:11<02:02, 4.96batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 79%|███████▊ | 2198/2797 [07:13<02:00, 4.95batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 79%|███████▊ | 2198/2797 [07:14<02:00, 4.95batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 79%|███████▉ | 2209/2797 [07:16<01:56, 5.04batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 79%|███████▉ | 2220/2797 [07:18<01:52, 5.15batch/s, loss=1.937, lr=3.4e-05] epoch 3/8: 79%|███████▉ | 2220/2797 [07:19<01:52, 5.15batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 80%|███████▉ | 2231/2797 [07:20<01:48, 5.20batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 80%|████████ | 2242/2797 [07:22<01:45, 5.29batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 80%|████████ | 2242/2797 [07:24<01:45, 5.29batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 81%|████████ | 2253/2797 [07:24<01:45, 5.14batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 81%|████████ | 2264/2797 [07:26<01:44, 5.09batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 81%|████████▏ | 2275/2797 [07:28<01:40, 5.18batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 81%|████████▏ | 2275/2797 [07:28<01:40, 5.18batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 82%|████████▏ | 2287/2797 [07:30<01:36, 5.30batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 82%|████████▏ | 2298/2797 [07:33<01:38, 5.08batch/s, loss=1.936, lr=3.4e-05] epoch 3/8: 82%|████████▏ | 2298/2797 [07:33<01:38, 5.08batch/s, loss=1.935, lr=3.4e-05] epoch 3/8: 83%|████████▎ | 2309/2797 [07:35<01:37, 5.03batch/s, loss=1.935, lr=3.4e-05] epoch 3/8: 83%|████████▎ | 2320/2797 [07:37<01:35, 4.98batch/s, loss=1.935, lr=3.4e-05] epoch 3/8: 83%|████████▎ | 2320/2797 [07:38<01:35, 4.98batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 83%|████████▎ | 2330/2797 [07:39<01:34, 4.95batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 84%|████████▎ | 2341/2797 [07:41<01:30, 5.06batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 84%|████████▎ | 2341/2797 [07:43<01:30, 5.06batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 84%|████████▍ | 2352/2797 [07:43<01:26, 5.13batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 84%|████████▍ | 2363/2797 [07:46<01:25, 5.06batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 85%|████████▍ | 2375/2797 [07:48<01:21, 5.20batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 85%|████████▍ | 2375/2797 [07:48<01:21, 5.20batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 85%|████████▌ | 2386/2797 [07:50<01:19, 5.18batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 86%|████████▌ | 2399/2797 [07:52<01:12, 5.51batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 86%|████████▌ | 2399/2797 [07:52<01:12, 5.51batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 86%|████████▌ | 2411/2797 [07:54<01:11, 5.36batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 87%|████████▋ | 2422/2797 [07:57<01:11, 5.25batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 87%|████████▋ | 2422/2797 [07:57<01:11, 5.25batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 87%|████████▋ | 2433/2797 [07:59<01:11, 5.10batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 87%|████████▋ | 2444/2797 [08:01<01:08, 5.12batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 87%|████████▋ | 2444/2797 [08:02<01:08, 5.12batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 88%|████████▊ | 2455/2797 [08:03<01:07, 5.10batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 88%|████████▊ | 2466/2797 [08:05<01:04, 5.12batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 88%|████████▊ | 2466/2797 [08:07<01:04, 5.12batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 89%|████████▊ | 2477/2797 [08:08<01:02, 5.08batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 89%|████████▉ | 2488/2797 [08:10<01:03, 4.89batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 89%|████████▉ | 2498/2797 [08:12<01:00, 4.92batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 89%|████████▉ | 2498/2797 [08:12<01:00, 4.92batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 90%|████████▉ | 2510/2797 [08:14<00:55, 5.15batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 90%|█████████ | 2521/2797 [08:16<00:53, 5.12batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 90%|█████████ | 2521/2797 [08:17<00:53, 5.12batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 91%|█████████ | 2532/2797 [08:18<00:52, 5.08batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 91%|█████████ | 2543/2797 [08:21<00:49, 5.08batch/s, loss=1.934, lr=3.4e-05] epoch 3/8: 91%|█████████ | 2543/2797 [08:22<00:49, 5.08batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 91%|█████████▏| 2555/2797 [08:23<00:46, 5.24batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 92%|█████████▏| 2566/2797 [08:25<00:44, 5.25batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 92%|█████████▏| 2566/2797 [08:27<00:44, 5.25batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 92%|█████████▏| 2577/2797 [08:27<00:41, 5.30batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 93%|█████████▎| 2588/2797 [08:29<00:39, 5.25batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 93%|█████████▎| 2599/2797 [08:31<00:37, 5.32batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 93%|█████████▎| 2599/2797 [08:31<00:37, 5.32batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 93%|█████████▎| 2610/2797 [08:33<00:35, 5.21batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 94%|█████████▎| 2621/2797 [08:35<00:34, 5.13batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 94%|█████████▎| 2621/2797 [08:36<00:34, 5.13batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 94%|█████████▍| 2632/2797 [08:38<00:31, 5.18batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 94%|█████████▍| 2643/2797 [08:40<00:30, 5.02batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 94%|█████████▍| 2643/2797 [08:41<00:30, 5.02batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 95%|█████████▍| 2655/2797 [08:42<00:27, 5.23batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 95%|█████████▌| 2666/2797 [08:44<00:25, 5.24batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 95%|█████████▌| 2666/2797 [08:46<00:25, 5.24batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 96%|█████████▌| 2677/2797 [08:46<00:22, 5.24batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 96%|█████████▌| 2688/2797 [08:48<00:20, 5.21batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 96%|█████████▋| 2699/2797 [08:51<00:19, 5.03batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 96%|█████████▋| 2699/2797 [08:51<00:19, 5.03batch/s, loss=1.935, lr=3.3e-05] epoch 3/8: 97%|█████████▋| 2710/2797 [08:53<00:17, 5.07batch/s, loss=1.935, lr=3.3e-05] epoch 3/8: 97%|█████████▋| 2721/2797 [08:55<00:15, 5.00batch/s, loss=1.935, lr=3.3e-05] epoch 3/8: 97%|█████████▋| 2721/2797 [08:56<00:15, 5.00batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 98%|█████████▊| 2732/2797 [08:57<00:12, 5.08batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 98%|█████████▊| 2743/2797 [08:59<00:10, 5.10batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 98%|█████████▊| 2743/2797 [09:01<00:10, 5.10batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 98%|█████████▊| 2754/2797 [09:01<00:08, 5.10batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 99%|█████████▉| 2765/2797 [09:04<00:06, 4.95batch/s, loss=1.934, lr=3.3e-05] epoch 3/8: 99%|█████████▉| 2765/2797 [09:06<00:06, 4.95batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 99%|█████████▉| 2776/2797 [09:06<00:04, 4.99batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 100%|█████████▉| 2788/2797 [09:08<00:01, 5.11batch/s, loss=1.933, lr=3.3e-05] epoch 3/8: 100%|██████████| 2797/2797 [09:10<00:00, 5.08batch/s, loss=1.933, lr=3.3e-05]
epoch 3: train loss 1.933 · validation loss 2.161 · broad 80.6% (top-3 95.0%) · path 71.2% (top-3 88.6%, plausible or look-alike 87.0%) · 1769s elapsed
epoch 4/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 4/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=1.807, lr=3.3e-05] epoch 4/8: 0%| | 11/2797 [00:02<08:59, 5.17batch/s, loss=1.807, lr=3.3e-05] epoch 4/8: 1%| | 23/2797 [00:04<08:39, 5.34batch/s, loss=1.807, lr=3.3e-05] epoch 4/8: 1%| | 23/2797 [00:04<08:39, 5.34batch/s, loss=1.718, lr=3.3e-05] epoch 4/8: 1%| | 34/2797 [00:06<08:32, 5.39batch/s, loss=1.718, lr=3.3e-05] epoch 4/8: 2%|▏ | 45/2797 [00:08<08:37, 5.32batch/s, loss=1.718, lr=3.3e-05] epoch 4/8: 2%|▏ | 45/2797 [00:09<08:37, 5.32batch/s, loss=1.741, lr=3.3e-05] epoch 4/8: 2%|▏ | 56/2797 [00:10<09:01, 5.06batch/s, loss=1.741, lr=3.3e-05] epoch 4/8: 2%|▏ | 67/2797 [00:13<09:07, 4.99batch/s, loss=1.741, lr=3.3e-05] epoch 4/8: 2%|▏ | 67/2797 [00:14<09:07, 4.99batch/s, loss=1.720, lr=3.3e-05] epoch 4/8: 3%|▎ | 78/2797 [00:15<09:00, 5.03batch/s, loss=1.720, lr=3.3e-05] epoch 4/8: 3%|▎ | 89/2797 [00:17<09:05, 4.96batch/s, loss=1.720, lr=3.3e-05] epoch 4/8: 4%|▎ | 100/2797 [00:19<08:55, 5.03batch/s, loss=1.720, lr=3.3e-05] epoch 4/8: 4%|▎ | 100/2797 [00:19<08:55, 5.03batch/s, loss=1.735, lr=3.3e-05] epoch 4/8: 4%|▍ | 111/2797 [00:21<08:54, 5.02batch/s, loss=1.735, lr=3.3e-05] epoch 4/8: 4%|▍ | 122/2797 [00:23<08:46, 5.08batch/s, loss=1.735, lr=3.3e-05] epoch 4/8: 4%|▍ | 122/2797 [00:24<08:46, 5.08batch/s, loss=1.752, lr=3.3e-05] epoch 4/8: 5%|▍ | 133/2797 [00:25<08:34, 5.18batch/s, loss=1.752, lr=3.3e-05] epoch 4/8: 5%|▌ | 144/2797 [00:28<08:33, 5.17batch/s, loss=1.752, lr=3.3e-05] epoch 4/8: 5%|▌ | 144/2797 [00:29<08:33, 5.17batch/s, loss=1.747, lr=3.3e-05] epoch 4/8: 6%|▌ | 155/2797 [00:30<08:32, 5.15batch/s, loss=1.747, lr=3.3e-05] epoch 4/8: 6%|▌ | 166/2797 [00:32<08:31, 5.14batch/s, loss=1.747, lr=3.3e-05] epoch 4/8: 6%|▌ | 166/2797 [00:34<08:31, 5.14batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 6%|▋ | 177/2797 [00:34<08:34, 5.09batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 7%|▋ | 188/2797 [00:36<08:31, 5.10batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 7%|▋ | 199/2797 [00:39<08:46, 4.94batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 7%|▋ | 199/2797 [00:39<08:46, 4.94batch/s, loss=1.751, lr=3.2e-05] epoch 4/8: 7%|▋ | 209/2797 [00:41<08:43, 4.95batch/s, loss=1.751, lr=3.2e-05] epoch 4/8: 8%|▊ | 219/2797 [00:43<08:43, 4.92batch/s, loss=1.751, lr=3.2e-05] epoch 4/8: 8%|▊ | 219/2797 [00:44<08:43, 4.92batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 8%|▊ | 230/2797 [00:45<08:35, 4.98batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 9%|▊ | 241/2797 [00:47<08:19, 5.12batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 9%|▊ | 241/2797 [00:49<08:19, 5.12batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 9%|▉ | 252/2797 [00:49<08:18, 5.10batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 9%|▉ | 263/2797 [00:51<08:27, 4.99batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 10%|▉ | 274/2797 [00:53<08:18, 5.06batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 10%|▉ | 274/2797 [00:54<08:18, 5.06batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 10%|█ | 285/2797 [00:56<08:11, 5.11batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 11%|█ | 296/2797 [00:58<08:15, 5.05batch/s, loss=1.747, lr=3.2e-05] epoch 4/8: 11%|█ | 296/2797 [00:59<08:15, 5.05batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 11%|█ | 307/2797 [01:00<08:26, 4.92batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 11%|█▏ | 318/2797 [01:02<08:16, 4.99batch/s, loss=1.754, lr=3.2e-05] epoch 4/8: 11%|█▏ | 318/2797 [01:04<08:16, 4.99batch/s, loss=1.753, lr=3.2e-05] epoch 4/8: 12%|█▏ | 330/2797 [01:04<07:48, 5.26batch/s, loss=1.753, lr=3.2e-05] epoch 4/8: 12%|█▏ | 342/2797 [01:06<07:29, 5.47batch/s, loss=1.753, lr=3.2e-05] epoch 4/8: 12%|█▏ | 342/2797 [01:08<07:29, 5.47batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 13%|█▎ | 353/2797 [01:09<07:41, 5.29batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 13%|█▎ | 364/2797 [01:11<07:45, 5.23batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 13%|█▎ | 375/2797 [01:13<07:41, 5.25batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 13%|█▎ | 375/2797 [01:13<07:41, 5.25batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 14%|█▍ | 386/2797 [01:15<07:51, 5.11batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 14%|█▍ | 397/2797 [01:17<07:54, 5.06batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 14%|█▍ | 397/2797 [01:18<07:54, 5.06batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 15%|█▍ | 408/2797 [01:19<07:49, 5.09batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 15%|█▍ | 419/2797 [01:22<07:52, 5.03batch/s, loss=1.755, lr=3.2e-05] epoch 4/8: 15%|█▍ | 419/2797 [01:23<07:52, 5.03batch/s, loss=1.753, lr=3.2e-05] epoch 4/8: 15%|█▌ | 430/2797 [01:24<07:40, 5.14batch/s, loss=1.753, lr=3.2e-05] epoch 4/8: 16%|█▌ | 441/2797 [01:26<07:49, 5.01batch/s, loss=1.753, lr=3.2e-05] epoch 4/8: 16%|█▌ | 441/2797 [01:28<07:49, 5.01batch/s, loss=1.758, lr=3.2e-05] epoch 4/8: 16%|█▌ | 452/2797 [01:28<07:45, 5.04batch/s, loss=1.758, lr=3.2e-05] epoch 4/8: 17%|█▋ | 463/2797 [01:31<07:58, 4.88batch/s, loss=1.758, lr=3.2e-05] epoch 4/8: 17%|█▋ | 474/2797 [01:33<07:50, 4.94batch/s, loss=1.758, lr=3.2e-05] epoch 4/8: 17%|█▋ | 474/2797 [01:33<07:50, 4.94batch/s, loss=1.761, lr=3.2e-05] epoch 4/8: 17%|█▋ | 485/2797 [01:35<07:41, 5.01batch/s, loss=1.761, lr=3.2e-05] epoch 4/8: 18%|█▊ | 496/2797 [01:37<07:47, 4.92batch/s, loss=1.761, lr=3.2e-05] epoch 4/8: 18%|█▊ | 496/2797 [01:38<07:47, 4.92batch/s, loss=1.760, lr=3.2e-05] epoch 4/8: 18%|█▊ | 506/2797 [01:39<07:48, 4.89batch/s, loss=1.760, lr=3.2e-05] epoch 4/8: 19%|█▊ | 518/2797 [01:41<07:27, 5.10batch/s, loss=1.760, lr=3.2e-05] epoch 4/8: 19%|█▊ | 518/2797 [01:43<07:27, 5.10batch/s, loss=1.762, lr=3.2e-05] epoch 4/8: 19%|█▉ | 529/2797 [01:44<07:30, 5.03batch/s, loss=1.762, lr=3.2e-05] epoch 4/8: 19%|█▉ | 540/2797 [01:46<07:32, 4.99batch/s, loss=1.762, lr=3.2e-05] epoch 4/8: 20%|█▉ | 550/2797 [01:48<07:33, 4.96batch/s, loss=1.762, lr=3.2e-05] epoch 4/8: 20%|█▉ | 550/2797 [01:48<07:33, 4.96batch/s, loss=1.759, lr=3.2e-05] epoch 4/8: 20%|██ | 561/2797 [01:50<07:24, 5.03batch/s, loss=1.759, lr=3.2e-05] epoch 4/8: 20%|██ | 572/2797 [01:52<07:31, 4.93batch/s, loss=1.759, lr=3.2e-05] epoch 4/8: 20%|██ | 572/2797 [01:53<07:31, 4.93batch/s, loss=1.763, lr=3.2e-05] epoch 4/8: 21%|██ | 583/2797 [01:55<07:17, 5.06batch/s, loss=1.763, lr=3.2e-05] epoch 4/8: 21%|██ | 594/2797 [01:57<07:11, 5.11batch/s, loss=1.763, lr=3.2e-05] epoch 4/8: 21%|██ | 594/2797 [01:58<07:11, 5.11batch/s, loss=1.762, lr=3.1e-05] epoch 4/8: 22%|██▏ | 605/2797 [01:59<07:19, 4.98batch/s, loss=1.762, lr=3.1e-05] epoch 4/8: 22%|██▏ | 615/2797 [02:01<07:20, 4.96batch/s, loss=1.762, lr=3.1e-05] epoch 4/8: 22%|██▏ | 615/2797 [02:03<07:20, 4.96batch/s, loss=1.759, lr=3.1e-05] epoch 4/8: 22%|██▏ | 626/2797 [02:03<07:11, 5.04batch/s, loss=1.759, lr=3.1e-05] epoch 4/8: 23%|██▎ | 637/2797 [02:05<07:18, 4.93batch/s, loss=1.759, lr=3.1e-05] epoch 4/8: 23%|██▎ | 648/2797 [02:08<07:07, 5.03batch/s, loss=1.759, lr=3.1e-05] epoch 4/8: 23%|██▎ | 648/2797 [02:08<07:07, 5.03batch/s, loss=1.757, lr=3.1e-05] epoch 4/8: 24%|██▎ | 659/2797 [02:10<06:58, 5.11batch/s, loss=1.757, lr=3.1e-05] epoch 4/8: 24%|██▍ | 670/2797 [02:12<06:53, 5.15batch/s, loss=1.757, lr=3.1e-05] epoch 4/8: 24%|██▍ | 670/2797 [02:13<06:53, 5.15batch/s, loss=1.756, lr=3.1e-05] epoch 4/8: 24%|██▍ | 681/2797 [02:14<06:56, 5.08batch/s, loss=1.756, lr=3.1e-05] epoch 4/8: 25%|██▍ | 692/2797 [02:16<06:59, 5.02batch/s, loss=1.756, lr=3.1e-05] epoch 4/8: 25%|██▍ | 692/2797 [02:18<06:59, 5.02batch/s, loss=1.758, lr=3.1e-05] epoch 4/8: 25%|██▌ | 703/2797 [02:19<07:04, 4.93batch/s, loss=1.758, lr=3.1e-05] epoch 4/8: 25%|██▌ | 713/2797 [02:21<07:09, 4.85batch/s, loss=1.758, lr=3.1e-05] epoch 4/8: 26%|██▌ | 724/2797 [02:23<06:55, 4.99batch/s, loss=1.758, lr=3.1e-05] epoch 4/8: 26%|██▌ | 724/2797 [02:23<06:55, 4.99batch/s, loss=1.757, lr=3.1e-05] epoch 4/8: 26%|██▋ | 736/2797 [02:25<06:36, 5.20batch/s, loss=1.757, lr=3.1e-05] epoch 4/8: 27%|██▋ | 747/2797 [02:27<06:51, 4.99batch/s, loss=1.757, lr=3.1e-05] epoch 4/8: 27%|██▋ | 747/2797 [02:28<06:51, 4.99batch/s, loss=1.756, lr=3.1e-05] epoch 4/8: 27%|██▋ | 758/2797 [02:29<06:38, 5.11batch/s, loss=1.756, lr=3.1e-05] epoch 4/8: 27%|██▋ | 769/2797 [02:31<06:37, 5.10batch/s, loss=1.756, lr=3.1e-05] epoch 4/8: 27%|██▋ | 769/2797 [02:33<06:37, 5.10batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 28%|██▊ | 781/2797 [02:34<06:23, 5.26batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 28%|██▊ | 792/2797 [02:36<06:26, 5.18batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 28%|██▊ | 792/2797 [02:38<06:26, 5.18batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 29%|██▊ | 803/2797 [02:38<06:34, 5.06batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 29%|██▉ | 814/2797 [02:40<06:32, 5.05batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 29%|██▉ | 825/2797 [02:42<06:21, 5.16batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 29%|██▉ | 825/2797 [02:42<06:21, 5.16batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 30%|██▉ | 836/2797 [02:45<06:26, 5.07batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 30%|███ | 847/2797 [02:47<06:19, 5.14batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 30%|███ | 847/2797 [02:47<06:19, 5.14batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 31%|███ | 858/2797 [02:49<06:18, 5.12batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 31%|███ | 869/2797 [02:51<06:22, 5.04batch/s, loss=1.754, lr=3.1e-05] epoch 4/8: 31%|███ | 869/2797 [02:52<06:22, 5.04batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 31%|███▏ | 880/2797 [02:53<06:18, 5.07batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 32%|███▏ | 891/2797 [02:56<06:24, 4.95batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 32%|███▏ | 891/2797 [02:58<06:24, 4.95batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 32%|███▏ | 902/2797 [02:58<06:20, 4.99batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 33%|███▎ | 913/2797 [03:00<06:11, 5.07batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 33%|███▎ | 925/2797 [03:02<05:58, 5.22batch/s, loss=1.755, lr=3.1e-05] epoch 4/8: 33%|███▎ | 925/2797 [03:02<05:58, 5.22batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 33%|███▎ | 936/2797 [03:04<05:53, 5.26batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 34%|███▍ | 947/2797 [03:06<05:58, 5.16batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 34%|███▍ | 947/2797 [03:07<05:58, 5.16batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 34%|███▍ | 958/2797 [03:08<05:56, 5.16batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 35%|███▍ | 969/2797 [03:11<06:04, 5.02batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 35%|███▍ | 969/2797 [03:12<06:04, 5.02batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 35%|███▌ | 981/2797 [03:13<05:50, 5.17batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 35%|███▌ | 992/2797 [03:15<05:51, 5.13batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 35%|███▌ | 992/2797 [03:17<05:51, 5.13batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 36%|███▌ | 1003/2797 [03:17<05:57, 5.02batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 36%|███▋ | 1015/2797 [03:19<05:39, 5.25batch/s, loss=1.753, lr=3.1e-05] epoch 4/8: 36%|███▋ | 1015/2797 [03:21<05:39, 5.25batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 37%|███▋ | 1026/2797 [03:21<05:33, 5.31batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 37%|███▋ | 1037/2797 [03:24<05:39, 5.18batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 37%|███▋ | 1048/2797 [03:26<05:34, 5.23batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 37%|███▋ | 1048/2797 [03:26<05:34, 5.23batch/s, loss=1.750, lr=3.0e-05] epoch 4/8: 38%|███▊ | 1059/2797 [03:28<05:35, 5.19batch/s, loss=1.750, lr=3.0e-05] epoch 4/8: 38%|███▊ | 1070/2797 [03:30<05:41, 5.05batch/s, loss=1.750, lr=3.0e-05] epoch 4/8: 38%|███▊ | 1070/2797 [03:31<05:41, 5.05batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 39%|███▊ | 1081/2797 [03:32<05:31, 5.17batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 39%|███▉ | 1092/2797 [03:34<05:27, 5.20batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 39%|███▉ | 1092/2797 [03:36<05:27, 5.20batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 39%|███▉ | 1104/2797 [03:36<05:20, 5.28batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 40%|███▉ | 1115/2797 [03:39<05:19, 5.26batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 40%|███▉ | 1115/2797 [03:41<05:19, 5.26batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 40%|████ | 1126/2797 [03:41<05:25, 5.13batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 41%|████ | 1137/2797 [03:43<05:23, 5.14batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 41%|████ | 1148/2797 [03:45<05:18, 5.18batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 41%|████ | 1148/2797 [03:46<05:18, 5.18batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 41%|████▏ | 1159/2797 [03:47<05:24, 5.05batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 42%|████▏ | 1170/2797 [03:50<05:31, 4.91batch/s, loss=1.751, lr=3.0e-05] epoch 4/8: 42%|████▏ | 1170/2797 [03:51<05:31, 4.91batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 42%|████▏ | 1181/2797 [03:52<05:26, 4.95batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 43%|████▎ | 1192/2797 [03:54<05:21, 4.99batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 43%|████▎ | 1192/2797 [03:56<05:21, 4.99batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 43%|████▎ | 1203/2797 [03:56<05:22, 4.94batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 43%|████▎ | 1213/2797 [03:59<05:28, 4.82batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 44%|████▍ | 1224/2797 [04:01<05:18, 4.94batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 44%|████▍ | 1224/2797 [04:01<05:18, 4.94batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 44%|████▍ | 1235/2797 [04:03<05:08, 5.06batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 45%|████▍ | 1246/2797 [04:05<05:04, 5.09batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 45%|████▍ | 1246/2797 [04:06<05:04, 5.09batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 45%|████▍ | 1257/2797 [04:07<05:05, 5.05batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 45%|████▌ | 1269/2797 [04:09<04:52, 5.22batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 45%|████▌ | 1269/2797 [04:11<04:52, 5.22batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 46%|████▌ | 1280/2797 [04:12<05:01, 5.04batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 46%|████▌ | 1291/2797 [04:14<05:01, 5.00batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 46%|████▌ | 1291/2797 [04:16<05:01, 5.00batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 47%|████▋ | 1302/2797 [04:16<05:05, 4.89batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 47%|████▋ | 1313/2797 [04:18<05:00, 4.93batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 47%|████▋ | 1325/2797 [04:20<04:45, 5.16batch/s, loss=1.754, lr=3.0e-05] epoch 4/8: 47%|████▋ | 1325/2797 [04:21<04:45, 5.16batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 48%|████▊ | 1336/2797 [04:23<04:45, 5.11batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 48%|████▊ | 1347/2797 [04:25<04:45, 5.08batch/s, loss=1.752, lr=3.0e-05] epoch 4/8: 48%|████▊ | 1347/2797 [04:26<04:45, 5.08batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 49%|████▊ | 1358/2797 [04:27<04:45, 5.05batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 49%|████▉ | 1370/2797 [04:29<04:33, 5.22batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 49%|████▉ | 1370/2797 [04:30<04:33, 5.22batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 49%|████▉ | 1381/2797 [04:31<04:30, 5.24batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 50%|████▉ | 1393/2797 [04:34<04:25, 5.30batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 50%|████▉ | 1393/2797 [04:35<04:25, 5.30batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 50%|█████ | 1404/2797 [04:36<04:25, 5.25batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 51%|█████ | 1415/2797 [04:38<04:32, 5.08batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 51%|█████ | 1415/2797 [04:40<04:32, 5.08batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 51%|█████ | 1426/2797 [04:40<04:29, 5.09batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 51%|█████▏ | 1437/2797 [04:42<04:30, 5.03batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 52%|█████▏ | 1449/2797 [04:45<04:22, 5.14batch/s, loss=1.753, lr=3.0e-05] epoch 4/8: 52%|█████▏ | 1449/2797 [04:45<04:22, 5.14batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 52%|█████▏ | 1461/2797 [04:47<04:14, 5.25batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 53%|█████▎ | 1472/2797 [04:49<04:17, 5.15batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 53%|█████▎ | 1472/2797 [04:50<04:17, 5.15batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 53%|█████▎ | 1485/2797 [04:51<04:01, 5.42batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 53%|█████▎ | 1496/2797 [04:53<04:06, 5.28batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 53%|█████▎ | 1496/2797 [04:54<04:06, 5.28batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 54%|█████▍ | 1507/2797 [04:55<04:01, 5.34batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 54%|█████▍ | 1518/2797 [04:58<04:11, 5.09batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 54%|█████▍ | 1518/2797 [04:59<04:11, 5.09batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 55%|█████▍ | 1529/2797 [05:00<04:06, 5.15batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 55%|█████▌ | 1540/2797 [05:02<04:10, 5.02batch/s, loss=1.753, lr=2.9e-05] epoch 4/8: 55%|█████▌ | 1540/2797 [05:04<04:10, 5.02batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 55%|█████▌ | 1551/2797 [05:04<04:05, 5.07batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 56%|█████▌ | 1562/2797 [05:07<04:06, 5.00batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 56%|█████▋ | 1574/2797 [05:09<03:54, 5.22batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 56%|█████▋ | 1574/2797 [05:09<03:54, 5.22batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 57%|█████▋ | 1585/2797 [05:11<03:59, 5.05batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 57%|█████▋ | 1596/2797 [05:13<03:54, 5.13batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 57%|█████▋ | 1596/2797 [05:14<03:54, 5.13batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 57%|█████▋ | 1607/2797 [05:15<03:51, 5.14batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 58%|█████▊ | 1618/2797 [05:17<03:53, 5.05batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 58%|█████▊ | 1618/2797 [05:19<03:53, 5.05batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 58%|█████▊ | 1629/2797 [05:20<03:47, 5.14batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 59%|█████▊ | 1640/2797 [05:22<03:48, 5.06batch/s, loss=1.752, lr=2.9e-05] epoch 4/8: 59%|█████▊ | 1640/2797 [05:24<03:48, 5.06batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 59%|█████▉ | 1651/2797 [05:24<03:52, 4.93batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 59%|█████▉ | 1662/2797 [05:26<03:43, 5.07batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 60%|█████▉ | 1673/2797 [05:28<03:38, 5.14batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 60%|█████▉ | 1673/2797 [05:29<03:38, 5.14batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 60%|██████ | 1684/2797 [05:30<03:37, 5.13batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 61%|██████ | 1695/2797 [05:33<03:37, 5.06batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 61%|██████ | 1695/2797 [05:34<03:37, 5.06batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 61%|██████ | 1706/2797 [05:35<03:37, 5.01batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 61%|██████▏ | 1717/2797 [05:37<03:36, 5.00batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 61%|██████▏ | 1717/2797 [05:39<03:36, 5.00batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 62%|██████▏ | 1729/2797 [05:39<03:25, 5.20batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 62%|██████▏ | 1741/2797 [05:41<03:18, 5.32batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 62%|██████▏ | 1741/2797 [05:43<03:18, 5.32batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 63%|██████▎ | 1752/2797 [05:43<03:17, 5.29batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 63%|██████▎ | 1763/2797 [05:46<03:21, 5.13batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 63%|██████▎ | 1774/2797 [05:48<03:22, 5.06batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 63%|██████▎ | 1774/2797 [05:48<03:22, 5.06batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 64%|██████▍ | 1785/2797 [05:50<03:20, 5.05batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 64%|██████▍ | 1796/2797 [05:52<03:16, 5.10batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 64%|██████▍ | 1796/2797 [05:53<03:16, 5.10batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 65%|██████▍ | 1807/2797 [05:54<03:14, 5.10batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 65%|██████▌ | 1819/2797 [05:57<03:06, 5.23batch/s, loss=1.750, lr=2.9e-05] epoch 4/8: 65%|██████▌ | 1819/2797 [05:58<03:06, 5.23batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 65%|██████▌ | 1830/2797 [05:59<03:06, 5.19batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 66%|██████▌ | 1841/2797 [06:01<03:06, 5.12batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 66%|██████▌ | 1841/2797 [06:03<03:06, 5.12batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 66%|██████▌ | 1852/2797 [06:03<03:10, 4.97batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 67%|██████▋ | 1862/2797 [06:05<03:08, 4.95batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 67%|██████▋ | 1872/2797 [06:07<03:06, 4.96batch/s, loss=1.751, lr=2.9e-05] epoch 4/8: 67%|██████▋ | 1872/2797 [06:08<03:06, 4.96batch/s, loss=1.750, lr=2.8e-05] epoch 4/8: 67%|██████▋ | 1883/2797 [06:09<03:00, 5.08batch/s, loss=1.750, lr=2.8e-05] epoch 4/8: 68%|██████▊ | 1894/2797 [06:11<02:53, 5.20batch/s, loss=1.750, lr=2.8e-05] epoch 4/8: 68%|██████▊ | 1894/2797 [06:13<02:53, 5.20batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 68%|██████▊ | 1905/2797 [06:14<02:54, 5.10batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 69%|██████▊ | 1916/2797 [06:16<02:50, 5.15batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 69%|██████▊ | 1916/2797 [06:18<02:50, 5.15batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 69%|██████▉ | 1927/2797 [06:18<02:51, 5.08batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 69%|██████▉ | 1939/2797 [06:20<02:44, 5.20batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 70%|██████▉ | 1950/2797 [06:22<02:42, 5.21batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 70%|██████▉ | 1950/2797 [06:22<02:42, 5.21batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 70%|███████ | 1961/2797 [06:24<02:39, 5.23batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 71%|███████ | 1972/2797 [06:26<02:37, 5.25batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 71%|███████ | 1972/2797 [06:27<02:37, 5.25batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 71%|███████ | 1983/2797 [06:29<02:41, 5.03batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 71%|███████▏ | 1994/2797 [06:31<02:40, 5.00batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 71%|███████▏ | 1994/2797 [06:32<02:40, 5.00batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 72%|███████▏ | 2005/2797 [06:33<02:39, 4.96batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 72%|███████▏ | 2015/2797 [06:35<02:37, 4.96batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 72%|███████▏ | 2015/2797 [06:37<02:37, 4.96batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 72%|███████▏ | 2027/2797 [06:38<02:29, 5.13batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 73%|███████▎ | 2038/2797 [06:40<02:27, 5.14batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 73%|███████▎ | 2049/2797 [06:42<02:25, 5.15batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 73%|███████▎ | 2049/2797 [06:42<02:25, 5.15batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 74%|███████▎ | 2060/2797 [06:44<02:26, 5.02batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 74%|███████▍ | 2072/2797 [06:46<02:20, 5.17batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 74%|███████▍ | 2072/2797 [06:47<02:20, 5.17batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 74%|███████▍ | 2083/2797 [06:48<02:18, 5.15batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 75%|███████▍ | 2094/2797 [06:51<02:20, 4.99batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 75%|███████▍ | 2094/2797 [06:52<02:20, 4.99batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 75%|███████▌ | 2105/2797 [06:53<02:21, 4.89batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 76%|███████▌ | 2117/2797 [06:55<02:12, 5.14batch/s, loss=1.753, lr=2.8e-05] epoch 4/8: 76%|███████▌ | 2117/2797 [06:57<02:12, 5.14batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 76%|███████▌ | 2128/2797 [06:57<02:11, 5.07batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 76%|███████▋ | 2139/2797 [07:00<02:08, 5.14batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 77%|███████▋ | 2150/2797 [07:02<02:05, 5.14batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 77%|███████▋ | 2150/2797 [07:02<02:05, 5.14batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 77%|███████▋ | 2161/2797 [07:04<02:02, 5.18batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 78%|███████▊ | 2172/2797 [07:06<02:03, 5.06batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 78%|███████▊ | 2172/2797 [07:07<02:03, 5.06batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 78%|███████▊ | 2184/2797 [07:08<01:57, 5.21batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 78%|███████▊ | 2195/2797 [07:10<01:54, 5.25batch/s, loss=1.752, lr=2.8e-05] epoch 4/8: 78%|███████▊ | 2195/2797 [07:11<01:54, 5.25batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 79%|███████▉ | 2206/2797 [07:12<01:52, 5.26batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 79%|███████▉ | 2217/2797 [07:15<01:51, 5.19batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 79%|███████▉ | 2217/2797 [07:16<01:51, 5.19batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 80%|███████▉ | 2228/2797 [07:17<01:49, 5.21batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 80%|████████ | 2239/2797 [07:19<01:49, 5.11batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 80%|████████ | 2250/2797 [07:21<01:48, 5.06batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 80%|████████ | 2250/2797 [07:21<01:48, 5.06batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 81%|████████ | 2261/2797 [07:24<01:49, 4.90batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 81%|████████ | 2271/2797 [07:26<01:47, 4.91batch/s, loss=1.751, lr=2.8e-05] epoch 4/8: 81%|████████ | 2271/2797 [07:27<01:47, 4.91batch/s, loss=1.750, lr=2.8e-05] epoch 4/8: 82%|████████▏ | 2282/2797 [07:28<01:43, 4.97batch/s, loss=1.750, lr=2.8e-05] epoch 4/8: 82%|████████▏ | 2292/2797 [07:30<01:43, 4.88batch/s, loss=1.750, lr=2.8e-05] epoch 4/8: 82%|████████▏ | 2292/2797 [07:32<01:43, 4.88batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 82%|████████▏ | 2303/2797 [07:32<01:40, 4.94batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 83%|████████▎ | 2313/2797 [07:34<01:37, 4.95batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 83%|████████▎ | 2324/2797 [07:36<01:33, 5.03batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 83%|████████▎ | 2324/2797 [07:37<01:33, 5.03batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 83%|████████▎ | 2335/2797 [07:38<01:32, 4.99batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 84%|████████▍ | 2345/2797 [07:40<01:31, 4.94batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 84%|████████▍ | 2345/2797 [07:42<01:31, 4.94batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 84%|████████▍ | 2356/2797 [07:43<01:27, 5.04batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 85%|████████▍ | 2367/2797 [07:45<01:27, 4.93batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 85%|████████▍ | 2367/2797 [07:47<01:27, 4.93batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 85%|████████▍ | 2377/2797 [07:47<01:26, 4.85batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 85%|████████▌ | 2388/2797 [07:49<01:21, 5.03batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 86%|████████▌ | 2399/2797 [07:51<01:19, 4.98batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 86%|████████▌ | 2399/2797 [07:52<01:19, 4.98batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 86%|████████▌ | 2410/2797 [07:53<01:17, 5.02batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 87%|████████▋ | 2421/2797 [07:55<01:13, 5.14batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 87%|████████▋ | 2421/2797 [07:56<01:13, 5.14batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 87%|████████▋ | 2432/2797 [07:58<01:12, 5.01batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 87%|████████▋ | 2443/2797 [08:00<01:10, 5.03batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 87%|████████▋ | 2443/2797 [08:01<01:10, 5.03batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 88%|████████▊ | 2454/2797 [08:02<01:06, 5.16batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 88%|████████▊ | 2465/2797 [08:04<01:05, 5.11batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 88%|████████▊ | 2465/2797 [08:07<01:05, 5.11batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 89%|████████▊ | 2476/2797 [08:07<01:05, 4.93batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 89%|████████▉ | 2487/2797 [08:09<01:01, 5.01batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 89%|████████▉ | 2499/2797 [08:11<00:57, 5.20batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 89%|████████▉ | 2499/2797 [08:11<00:57, 5.20batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 90%|████████▉ | 2510/2797 [08:13<00:54, 5.28batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 90%|█████████ | 2521/2797 [08:15<00:52, 5.25batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 90%|█████████ | 2521/2797 [08:16<00:52, 5.25batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 91%|█████████ | 2532/2797 [08:17<00:49, 5.32batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 91%|█████████ | 2543/2797 [08:19<00:48, 5.21batch/s, loss=1.750, lr=2.7e-05] epoch 4/8: 91%|█████████ | 2543/2797 [08:21<00:48, 5.21batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 91%|█████████▏| 2554/2797 [08:21<00:46, 5.20batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 92%|█████████▏| 2565/2797 [08:24<00:45, 5.09batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 92%|█████████▏| 2565/2797 [08:26<00:45, 5.09batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 92%|█████████▏| 2576/2797 [08:26<00:44, 4.94batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 92%|█████████▏| 2586/2797 [08:28<00:42, 4.95batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 93%|█████████▎| 2598/2797 [08:30<00:38, 5.18batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 93%|█████████▎| 2598/2797 [08:31<00:38, 5.18batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 93%|█████████▎| 2609/2797 [08:32<00:36, 5.15batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 94%|█████████▎| 2620/2797 [08:34<00:34, 5.19batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 94%|█████████▎| 2620/2797 [08:35<00:34, 5.19batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 94%|█████████▍| 2631/2797 [08:36<00:32, 5.16batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 94%|█████████▍| 2642/2797 [08:39<00:30, 5.09batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 94%|█████████▍| 2642/2797 [08:40<00:30, 5.09batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 95%|█████████▍| 2653/2797 [08:41<00:28, 5.12batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 95%|█████████▌| 2664/2797 [08:43<00:26, 5.02batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 96%|█████████▌| 2675/2797 [08:45<00:24, 5.03batch/s, loss=1.749, lr=2.7e-05] epoch 4/8: 96%|█████████▌| 2675/2797 [08:45<00:24, 5.03batch/s, loss=1.748, lr=2.7e-05] epoch 4/8: 96%|█████████▌| 2687/2797 [08:47<00:21, 5.20batch/s, loss=1.748, lr=2.7e-05] epoch 4/8: 96%|█████████▋| 2698/2797 [08:50<00:19, 5.11batch/s, loss=1.748, lr=2.7e-05] epoch 4/8: 96%|█████████▋| 2698/2797 [08:50<00:19, 5.11batch/s, loss=1.748, lr=2.7e-05] epoch 4/8: 97%|█████████▋| 2709/2797 [08:52<00:16, 5.21batch/s, loss=1.748, lr=2.7e-05] epoch 4/8: 97%|█████████▋| 2720/2797 [08:54<00:14, 5.20batch/s, loss=1.748, lr=2.7e-05] epoch 4/8: 97%|█████████▋| 2720/2797 [08:55<00:14, 5.20batch/s, loss=1.748, lr=2.6e-05] epoch 4/8: 98%|█████████▊| 2731/2797 [08:56<00:13, 5.05batch/s, loss=1.748, lr=2.6e-05] epoch 4/8: 98%|█████████▊| 2742/2797 [08:58<00:10, 5.09batch/s, loss=1.748, lr=2.6e-05] epoch 4/8: 98%|█████████▊| 2742/2797 [09:00<00:10, 5.09batch/s, loss=1.749, lr=2.6e-05] epoch 4/8: 98%|█████████▊| 2754/2797 [09:00<00:08, 5.22batch/s, loss=1.749, lr=2.6e-05] epoch 4/8: 99%|█████████▉| 2765/2797 [09:02<00:06, 5.24batch/s, loss=1.749, lr=2.6e-05] epoch 4/8: 99%|█████████▉| 2765/2797 [09:05<00:06, 5.24batch/s, loss=1.749, lr=2.6e-05] epoch 4/8: 99%|█████████▉| 2776/2797 [09:05<00:04, 5.15batch/s, loss=1.749, lr=2.6e-05] epoch 4/8: 100%|█████████▉| 2787/2797 [09:07<00:01, 5.07batch/s, loss=1.749, lr=2.6e-05] epoch 4/8: 100%|██████████| 2797/2797 [09:09<00:00, 5.09batch/s, loss=1.749, lr=2.6e-05]
epoch 4: train loss 1.749 · validation loss 2.118 · broad 80.9% (top-3 95.1%) · path 71.9% (top-3 89.1%, plausible or look-alike 87.8%) · 2360s elapsed
epoch 5/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 5/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=1.645, lr=2.6e-05] epoch 5/8: 0%| | 11/2797 [00:02<09:11, 5.05batch/s, loss=1.645, lr=2.6e-05] epoch 5/8: 1%| | 22/2797 [00:04<09:23, 4.93batch/s, loss=1.645, lr=2.6e-05] epoch 5/8: 1%| | 22/2797 [00:05<09:23, 4.93batch/s, loss=1.634, lr=2.6e-05] epoch 5/8: 1%| | 32/2797 [00:06<09:25, 4.89batch/s, loss=1.634, lr=2.6e-05] epoch 5/8: 2%|▏ | 42/2797 [00:08<09:25, 4.88batch/s, loss=1.634, lr=2.6e-05] epoch 5/8: 2%|▏ | 42/2797 [00:10<09:25, 4.88batch/s, loss=1.629, lr=2.6e-05] epoch 5/8: 2%|▏ | 53/2797 [00:10<09:14, 4.95batch/s, loss=1.629, lr=2.6e-05] epoch 5/8: 2%|▏ | 63/2797 [00:12<09:12, 4.95batch/s, loss=1.629, lr=2.6e-05] epoch 5/8: 3%|▎ | 74/2797 [00:14<08:59, 5.05batch/s, loss=1.629, lr=2.6e-05] epoch 5/8: 3%|▎ | 74/2797 [00:15<08:59, 5.05batch/s, loss=1.636, lr=2.6e-05] epoch 5/8: 3%|▎ | 85/2797 [00:17<09:06, 4.96batch/s, loss=1.636, lr=2.6e-05] epoch 5/8: 3%|▎ | 96/2797 [00:19<09:02, 4.98batch/s, loss=1.636, lr=2.6e-05] epoch 5/8: 3%|▎ | 96/2797 [00:20<09:02, 4.98batch/s, loss=1.631, lr=2.6e-05] epoch 5/8: 4%|▍ | 107/2797 [00:21<08:55, 5.03batch/s, loss=1.631, lr=2.6e-05] epoch 5/8: 4%|▍ | 119/2797 [00:23<08:30, 5.25batch/s, loss=1.631, lr=2.6e-05] epoch 5/8: 4%|▍ | 119/2797 [00:25<08:30, 5.25batch/s, loss=1.646, lr=2.6e-05] epoch 5/8: 5%|▍ | 130/2797 [00:25<08:44, 5.08batch/s, loss=1.646, lr=2.6e-05] epoch 5/8: 5%|▌ | 141/2797 [00:28<08:50, 5.00batch/s, loss=1.646, lr=2.6e-05] epoch 5/8: 5%|▌ | 141/2797 [00:30<08:50, 5.00batch/s, loss=1.647, lr=2.6e-05] epoch 5/8: 5%|▌ | 152/2797 [00:30<08:51, 4.98batch/s, loss=1.647, lr=2.6e-05] epoch 5/8: 6%|▌ | 162/2797 [00:32<08:48, 4.98batch/s, loss=1.647, lr=2.6e-05] epoch 5/8: 6%|▌ | 173/2797 [00:34<08:37, 5.07batch/s, loss=1.647, lr=2.6e-05] epoch 5/8: 6%|▌ | 173/2797 [00:35<08:37, 5.07batch/s, loss=1.643, lr=2.6e-05] epoch 5/8: 7%|▋ | 184/2797 [00:36<08:32, 5.10batch/s, loss=1.643, lr=2.6e-05] epoch 5/8: 7%|▋ | 195/2797 [00:38<08:43, 4.97batch/s, loss=1.643, lr=2.6e-05] epoch 5/8: 7%|▋ | 195/2797 [00:40<08:43, 4.97batch/s, loss=1.641, lr=2.6e-05] epoch 5/8: 7%|▋ | 206/2797 [00:41<08:36, 5.02batch/s, loss=1.641, lr=2.6e-05] epoch 5/8: 8%|▊ | 217/2797 [00:43<08:32, 5.03batch/s, loss=1.641, lr=2.6e-05] epoch 5/8: 8%|▊ | 217/2797 [00:45<08:32, 5.03batch/s, loss=1.642, lr=2.6e-05] epoch 5/8: 8%|▊ | 228/2797 [00:45<08:26, 5.07batch/s, loss=1.642, lr=2.6e-05] epoch 5/8: 9%|▊ | 239/2797 [00:47<08:31, 5.00batch/s, loss=1.642, lr=2.6e-05] epoch 5/8: 9%|▉ | 250/2797 [00:49<08:35, 4.94batch/s, loss=1.642, lr=2.6e-05] epoch 5/8: 9%|▉ | 250/2797 [00:50<08:35, 4.94batch/s, loss=1.650, lr=2.6e-05] epoch 5/8: 9%|▉ | 262/2797 [00:52<08:18, 5.08batch/s, loss=1.650, lr=2.6e-05] epoch 5/8: 10%|▉ | 273/2797 [00:54<08:10, 5.15batch/s, loss=1.650, lr=2.6e-05] epoch 5/8: 10%|▉ | 273/2797 [00:54<08:10, 5.15batch/s, loss=1.653, lr=2.6e-05] epoch 5/8: 10%|█ | 284/2797 [00:56<08:10, 5.12batch/s, loss=1.653, lr=2.6e-05] epoch 5/8: 11%|█ | 295/2797 [00:58<08:16, 5.04batch/s, loss=1.653, lr=2.6e-05] epoch 5/8: 11%|█ | 295/2797 [00:59<08:16, 5.04batch/s, loss=1.650, lr=2.6e-05] epoch 5/8: 11%|█ | 306/2797 [01:00<08:13, 5.05batch/s, loss=1.650, lr=2.6e-05] epoch 5/8: 11%|█▏ | 317/2797 [01:02<08:03, 5.13batch/s, loss=1.650, lr=2.6e-05] epoch 5/8: 11%|█▏ | 317/2797 [01:04<08:03, 5.13batch/s, loss=1.648, lr=2.6e-05] epoch 5/8: 12%|█▏ | 328/2797 [01:04<07:52, 5.23batch/s, loss=1.648, lr=2.6e-05] epoch 5/8: 12%|█▏ | 339/2797 [01:07<08:00, 5.12batch/s, loss=1.648, lr=2.6e-05] epoch 5/8: 13%|█▎ | 350/2797 [01:09<08:03, 5.06batch/s, loss=1.648, lr=2.6e-05] epoch 5/8: 13%|█▎ | 350/2797 [01:09<08:03, 5.06batch/s, loss=1.644, lr=2.5e-05] epoch 5/8: 13%|█▎ | 361/2797 [01:11<08:03, 5.04batch/s, loss=1.644, lr=2.5e-05] epoch 5/8: 13%|█▎ | 372/2797 [01:13<08:01, 5.04batch/s, loss=1.644, lr=2.5e-05] epoch 5/8: 13%|█▎ | 372/2797 [01:14<08:01, 5.04batch/s, loss=1.647, lr=2.5e-05] epoch 5/8: 14%|█▎ | 383/2797 [01:15<07:59, 5.04batch/s, loss=1.647, lr=2.5e-05] epoch 5/8: 14%|█▍ | 394/2797 [01:18<08:03, 4.97batch/s, loss=1.647, lr=2.5e-05] epoch 5/8: 14%|█▍ | 394/2797 [01:19<08:03, 4.97batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 14%|█▍ | 405/2797 [01:20<07:49, 5.09batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 15%|█▍ | 416/2797 [01:22<07:46, 5.10batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 15%|█▍ | 416/2797 [01:24<07:46, 5.10batch/s, loss=1.650, lr=2.5e-05] epoch 5/8: 15%|█▌ | 427/2797 [01:24<07:36, 5.19batch/s, loss=1.650, lr=2.5e-05] epoch 5/8: 16%|█▌ | 438/2797 [01:26<07:34, 5.19batch/s, loss=1.650, lr=2.5e-05] epoch 5/8: 16%|█▌ | 449/2797 [01:28<07:34, 5.16batch/s, loss=1.650, lr=2.5e-05] epoch 5/8: 16%|█▌ | 449/2797 [01:29<07:34, 5.16batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 16%|█▋ | 460/2797 [01:30<07:25, 5.25batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 17%|█▋ | 471/2797 [01:32<07:23, 5.24batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 17%|█▋ | 471/2797 [01:33<07:23, 5.24batch/s, loss=1.651, lr=2.5e-05] epoch 5/8: 17%|█▋ | 482/2797 [01:35<07:29, 5.15batch/s, loss=1.651, lr=2.5e-05] epoch 5/8: 18%|█▊ | 494/2797 [01:37<07:15, 5.29batch/s, loss=1.651, lr=2.5e-05] epoch 5/8: 18%|█▊ | 494/2797 [01:38<07:15, 5.29batch/s, loss=1.651, lr=2.5e-05] epoch 5/8: 18%|█▊ | 505/2797 [01:39<07:26, 5.14batch/s, loss=1.651, lr=2.5e-05] epoch 5/8: 18%|█▊ | 516/2797 [01:41<07:21, 5.16batch/s, loss=1.651, lr=2.5e-05] epoch 5/8: 18%|█▊ | 516/2797 [01:43<07:21, 5.16batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 19%|█▉ | 527/2797 [01:43<07:26, 5.08batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 19%|█▉ | 538/2797 [01:45<07:17, 5.17batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 20%|█▉ | 549/2797 [01:48<07:23, 5.07batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 20%|█▉ | 549/2797 [01:48<07:23, 5.07batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 20%|██ | 560/2797 [01:50<07:22, 5.05batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 20%|██ | 571/2797 [01:52<07:20, 5.05batch/s, loss=1.648, lr=2.5e-05] epoch 5/8: 20%|██ | 571/2797 [01:53<07:20, 5.05batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 21%|██ | 582/2797 [01:54<07:24, 4.98batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 21%|██ | 594/2797 [01:57<07:07, 5.15batch/s, loss=1.649, lr=2.5e-05] epoch 5/8: 21%|██ | 594/2797 [01:58<07:07, 5.15batch/s, loss=1.652, lr=2.5e-05] epoch 5/8: 22%|██▏ | 605/2797 [01:59<07:08, 5.12batch/s, loss=1.652, lr=2.5e-05] epoch 5/8: 22%|██▏ | 616/2797 [02:01<07:09, 5.08batch/s, loss=1.652, lr=2.5e-05] epoch 5/8: 22%|██▏ | 616/2797 [02:03<07:09, 5.08batch/s, loss=1.653, lr=2.5e-05] epoch 5/8: 22%|██▏ | 627/2797 [02:03<07:07, 5.08batch/s, loss=1.653, lr=2.5e-05] epoch 5/8: 23%|██▎ | 638/2797 [02:05<07:13, 4.98batch/s, loss=1.653, lr=2.5e-05] epoch 5/8: 23%|██▎ | 648/2797 [02:07<07:13, 4.95batch/s, loss=1.653, lr=2.5e-05] epoch 5/8: 23%|██▎ | 648/2797 [02:08<07:13, 4.95batch/s, loss=1.654, lr=2.5e-05] epoch 5/8: 24%|██▎ | 659/2797 [02:09<07:02, 5.06batch/s, loss=1.654, lr=2.5e-05] epoch 5/8: 24%|██▍ | 670/2797 [02:12<07:06, 4.99batch/s, loss=1.654, lr=2.5e-05] epoch 5/8: 24%|██▍ | 670/2797 [02:13<07:06, 4.99batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 24%|██▍ | 680/2797 [02:14<07:11, 4.91batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 25%|██▍ | 691/2797 [02:16<07:03, 4.97batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 25%|██▍ | 691/2797 [02:18<07:03, 4.97batch/s, loss=1.657, lr=2.5e-05] epoch 5/8: 25%|██▌ | 703/2797 [02:18<06:49, 5.11batch/s, loss=1.657, lr=2.5e-05] epoch 5/8: 26%|██▌ | 714/2797 [02:20<06:51, 5.06batch/s, loss=1.657, lr=2.5e-05] epoch 5/8: 26%|██▌ | 725/2797 [02:23<06:51, 5.03batch/s, loss=1.657, lr=2.5e-05] epoch 5/8: 26%|██▌ | 725/2797 [02:23<06:51, 5.03batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 26%|██▋ | 736/2797 [02:25<06:50, 5.02batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 27%|██▋ | 747/2797 [02:27<06:52, 4.97batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 27%|██▋ | 747/2797 [02:28<06:52, 4.97batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 27%|██▋ | 758/2797 [02:29<06:41, 5.08batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 27%|██▋ | 769/2797 [02:31<06:45, 5.00batch/s, loss=1.656, lr=2.5e-05] epoch 5/8: 27%|██▋ | 769/2797 [02:33<06:45, 5.00batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 28%|██▊ | 780/2797 [02:34<06:56, 4.85batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 28%|██▊ | 792/2797 [02:36<06:35, 5.07batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 28%|██▊ | 792/2797 [02:38<06:35, 5.07batch/s, loss=1.656, lr=2.4e-05] epoch 5/8: 29%|██▊ | 803/2797 [02:38<06:34, 5.06batch/s, loss=1.656, lr=2.4e-05] epoch 5/8: 29%|██▉ | 814/2797 [02:40<06:25, 5.14batch/s, loss=1.656, lr=2.4e-05] epoch 5/8: 29%|██▉ | 814/2797 [02:42<06:25, 5.14batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 30%|██▉ | 826/2797 [02:42<06:13, 5.27batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 30%|██▉ | 837/2797 [02:45<06:30, 5.02batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 30%|███ | 848/2797 [02:47<06:25, 5.05batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 30%|███ | 848/2797 [02:48<06:25, 5.05batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 31%|███ | 859/2797 [02:49<06:20, 5.09batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 31%|███ | 870/2797 [02:51<06:23, 5.03batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 31%|███ | 870/2797 [02:52<06:23, 5.03batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 31%|███▏ | 881/2797 [02:53<06:14, 5.12batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 32%|███▏ | 892/2797 [02:56<06:10, 5.14batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 32%|███▏ | 892/2797 [02:57<06:10, 5.14batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 32%|███▏ | 903/2797 [02:58<06:08, 5.15batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 33%|███▎ | 915/2797 [03:00<05:52, 5.34batch/s, loss=1.655, lr=2.4e-05] epoch 5/8: 33%|███▎ | 915/2797 [03:02<05:52, 5.34batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 33%|███▎ | 926/2797 [03:02<05:51, 5.32batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 34%|███▎ | 937/2797 [03:04<05:47, 5.35batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 34%|███▍ | 949/2797 [03:06<05:35, 5.50batch/s, loss=1.654, lr=2.4e-05] epoch 5/8: 34%|███▍ | 949/2797 [03:06<05:35, 5.50batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 34%|███▍ | 961/2797 [03:08<05:49, 5.26batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 35%|███▍ | 972/2797 [03:10<05:43, 5.32batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 35%|███▍ | 972/2797 [03:11<05:43, 5.32batch/s, loss=1.651, lr=2.4e-05] epoch 5/8: 35%|███▌ | 983/2797 [03:13<06:00, 5.03batch/s, loss=1.651, lr=2.4e-05] epoch 5/8: 36%|███▌ | 994/2797 [03:15<05:57, 5.04batch/s, loss=1.651, lr=2.4e-05] epoch 5/8: 36%|███▌ | 994/2797 [03:17<05:57, 5.04batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 36%|███▌ | 1005/2797 [03:17<05:58, 5.00batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 36%|███▋ | 1016/2797 [03:19<05:50, 5.08batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 36%|███▋ | 1016/2797 [03:22<05:50, 5.08batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 37%|███▋ | 1027/2797 [03:22<05:56, 4.97batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 37%|███▋ | 1037/2797 [03:24<05:56, 4.94batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 37%|███▋ | 1048/2797 [03:26<05:51, 4.98batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 37%|███▋ | 1048/2797 [03:27<05:51, 4.98batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 38%|███▊ | 1059/2797 [03:28<05:49, 4.97batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 38%|███▊ | 1069/2797 [03:30<05:51, 4.92batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 38%|███▊ | 1069/2797 [03:32<05:51, 4.92batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 39%|███▊ | 1079/2797 [03:32<05:48, 4.93batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 39%|███▉ | 1090/2797 [03:34<05:40, 5.02batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 39%|███▉ | 1090/2797 [03:37<05:40, 5.02batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 39%|███▉ | 1101/2797 [03:37<05:37, 5.03batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 40%|███▉ | 1112/2797 [03:39<05:36, 5.00batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 40%|████ | 1123/2797 [03:41<05:35, 5.00batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 40%|████ | 1123/2797 [03:42<05:35, 5.00batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 41%|████ | 1134/2797 [03:43<05:25, 5.12batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 41%|████ | 1145/2797 [03:45<05:21, 5.14batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 41%|████ | 1145/2797 [03:46<05:21, 5.14batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 41%|████▏ | 1156/2797 [03:47<05:13, 5.23batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 42%|████▏ | 1167/2797 [03:49<05:12, 5.22batch/s, loss=1.653, lr=2.4e-05] epoch 5/8: 42%|████▏ | 1167/2797 [03:51<05:12, 5.22batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 42%|████▏ | 1179/2797 [03:51<05:02, 5.34batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 43%|████▎ | 1191/2797 [03:54<04:55, 5.44batch/s, loss=1.652, lr=2.4e-05] epoch 5/8: 43%|████▎ | 1191/2797 [03:56<04:55, 5.44batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 43%|████▎ | 1202/2797 [03:56<05:06, 5.21batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 43%|████▎ | 1213/2797 [03:58<05:06, 5.17batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 44%|████▍ | 1224/2797 [04:00<05:09, 5.08batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 44%|████▍ | 1224/2797 [04:01<05:09, 5.08batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 44%|████▍ | 1235/2797 [04:03<05:11, 5.02batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 45%|████▍ | 1246/2797 [04:05<05:06, 5.06batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 45%|████▍ | 1246/2797 [04:06<05:06, 5.06batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 45%|████▍ | 1257/2797 [04:07<05:06, 5.03batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 45%|████▌ | 1268/2797 [04:09<05:05, 5.01batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 45%|████▌ | 1268/2797 [04:11<05:05, 5.01batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 46%|████▌ | 1279/2797 [04:11<05:01, 5.03batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 46%|████▌ | 1290/2797 [04:13<04:57, 5.07batch/s, loss=1.652, lr=2.3e-05] epoch 5/8: 46%|████▌ | 1290/2797 [04:15<04:57, 5.07batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 47%|████▋ | 1302/2797 [04:16<04:49, 5.16batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 47%|████▋ | 1313/2797 [04:18<04:51, 5.09batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 47%|████▋ | 1324/2797 [04:20<04:44, 5.17batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 47%|████▋ | 1324/2797 [04:20<04:44, 5.17batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 48%|████▊ | 1335/2797 [04:22<04:44, 5.14batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 48%|████▊ | 1346/2797 [04:24<04:49, 5.00batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 48%|████▊ | 1346/2797 [04:25<04:49, 5.00batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 49%|████▊ | 1357/2797 [04:27<04:43, 5.07batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 49%|████▉ | 1369/2797 [04:29<04:30, 5.28batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 49%|████▉ | 1369/2797 [04:30<04:30, 5.28batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 49%|████▉ | 1380/2797 [04:31<04:26, 5.32batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 50%|████▉ | 1391/2797 [04:33<04:30, 5.20batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 50%|████▉ | 1391/2797 [04:35<04:30, 5.20batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 50%|█████ | 1402/2797 [04:35<04:27, 5.22batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 51%|█████ | 1414/2797 [04:37<04:21, 5.29batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 51%|█████ | 1425/2797 [04:39<04:20, 5.27batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 51%|█████ | 1425/2797 [04:39<04:20, 5.27batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 51%|█████▏ | 1436/2797 [04:41<04:23, 5.17batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 52%|█████▏ | 1447/2797 [04:44<04:22, 5.14batch/s, loss=1.651, lr=2.3e-05] epoch 5/8: 52%|█████▏ | 1447/2797 [04:44<04:22, 5.14batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 52%|█████▏ | 1458/2797 [04:46<04:23, 5.08batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 53%|█████▎ | 1469/2797 [04:48<04:18, 5.13batch/s, loss=1.650, lr=2.3e-05] epoch 5/8: 53%|█████▎ | 1469/2797 [04:49<04:18, 5.13batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 53%|█████▎ | 1480/2797 [04:50<04:15, 5.16batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 53%|█████▎ | 1491/2797 [04:52<04:12, 5.16batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 53%|█████▎ | 1491/2797 [04:54<04:12, 5.16batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 54%|█████▎ | 1502/2797 [04:54<04:09, 5.18batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 54%|█████▍ | 1513/2797 [04:56<04:06, 5.21batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 54%|█████▍ | 1524/2797 [04:59<04:04, 5.20batch/s, loss=1.649, lr=2.3e-05] epoch 5/8: 54%|█████▍ | 1524/2797 [04:59<04:04, 5.20batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 55%|█████▍ | 1536/2797 [05:01<03:55, 5.34batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 55%|█████▌ | 1547/2797 [05:03<03:54, 5.32batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 55%|█████▌ | 1547/2797 [05:03<03:54, 5.32batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 56%|█████▌ | 1558/2797 [05:05<03:55, 5.27batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 56%|█████▌ | 1569/2797 [05:07<04:00, 5.11batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 56%|█████▌ | 1569/2797 [05:08<04:00, 5.11batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 56%|█████▋ | 1580/2797 [05:09<03:56, 5.16batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 57%|█████▋ | 1591/2797 [05:11<03:51, 5.20batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 57%|█████▋ | 1591/2797 [05:13<03:51, 5.20batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 57%|█████▋ | 1602/2797 [05:14<03:57, 5.03batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 58%|█████▊ | 1613/2797 [05:16<03:58, 4.97batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 58%|█████▊ | 1623/2797 [05:18<03:56, 4.96batch/s, loss=1.648, lr=2.3e-05] epoch 5/8: 58%|█████▊ | 1623/2797 [05:19<03:56, 4.96batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 58%|█████▊ | 1634/2797 [05:20<03:53, 4.98batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 59%|█████▉ | 1644/2797 [05:22<03:55, 4.89batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 59%|█████▉ | 1644/2797 [05:24<03:55, 4.89batch/s, loss=1.650, lr=2.2e-05] epoch 5/8: 59%|█████▉ | 1654/2797 [05:24<03:52, 4.92batch/s, loss=1.650, lr=2.2e-05] epoch 5/8: 59%|█████▉ | 1664/2797 [05:26<03:49, 4.93batch/s, loss=1.650, lr=2.2e-05] epoch 5/8: 60%|█████▉ | 1675/2797 [05:28<03:43, 5.03batch/s, loss=1.650, lr=2.2e-05] epoch 5/8: 60%|█████▉ | 1675/2797 [05:29<03:43, 5.03batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 60%|██████ | 1686/2797 [05:31<03:44, 4.94batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 61%|██████ | 1696/2797 [05:33<03:42, 4.94batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 61%|██████ | 1696/2797 [05:34<03:42, 4.94batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 61%|██████ | 1706/2797 [05:35<03:43, 4.88batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 61%|██████▏ | 1717/2797 [05:37<03:36, 4.99batch/s, loss=1.649, lr=2.2e-05] epoch 5/8: 61%|██████▏ | 1717/2797 [05:39<03:36, 4.99batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 62%|██████▏ | 1729/2797 [05:39<03:27, 5.15batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 62%|██████▏ | 1740/2797 [05:41<03:31, 5.01batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 62%|██████▏ | 1740/2797 [05:44<03:31, 5.01batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 63%|██████▎ | 1751/2797 [05:44<03:29, 4.99batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 63%|██████▎ | 1761/2797 [05:46<03:27, 4.99batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 63%|██████▎ | 1771/2797 [05:48<03:26, 4.98batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 63%|██████▎ | 1771/2797 [05:49<03:26, 4.98batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 64%|██████▎ | 1781/2797 [05:50<03:23, 4.98batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 64%|██████▍ | 1792/2797 [05:52<03:21, 4.98batch/s, loss=1.648, lr=2.2e-05] epoch 5/8: 64%|██████▍ | 1792/2797 [05:54<03:21, 4.98batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 64%|██████▍ | 1804/2797 [05:54<03:08, 5.26batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 65%|██████▍ | 1815/2797 [05:56<03:06, 5.26batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 65%|██████▍ | 1815/2797 [05:58<03:06, 5.26batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 65%|██████▌ | 1827/2797 [05:58<02:59, 5.39batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 66%|██████▌ | 1838/2797 [06:00<02:58, 5.37batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 66%|██████▌ | 1849/2797 [06:02<02:56, 5.36batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 66%|██████▌ | 1849/2797 [06:03<02:56, 5.36batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 66%|██████▋ | 1860/2797 [06:05<03:01, 5.17batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 67%|██████▋ | 1871/2797 [06:07<02:57, 5.22batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 67%|██████▋ | 1871/2797 [06:08<02:57, 5.22batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 67%|██████▋ | 1882/2797 [06:09<02:59, 5.08batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 68%|██████▊ | 1895/2797 [06:11<02:46, 5.40batch/s, loss=1.647, lr=2.2e-05] epoch 5/8: 68%|██████▊ | 1895/2797 [06:12<02:46, 5.40batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 68%|██████▊ | 1906/2797 [06:13<02:47, 5.31batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 69%|██████▊ | 1917/2797 [06:15<02:46, 5.29batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 69%|██████▊ | 1917/2797 [06:17<02:46, 5.29batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 69%|██████▉ | 1928/2797 [06:18<02:51, 5.06batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 69%|██████▉ | 1939/2797 [06:20<02:46, 5.14batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 70%|██████▉ | 1950/2797 [06:22<02:44, 5.16batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 70%|██████▉ | 1950/2797 [06:22<02:44, 5.16batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 70%|███████ | 1961/2797 [06:24<02:41, 5.17batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 71%|███████ | 1972/2797 [06:26<02:43, 5.06batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 71%|███████ | 1972/2797 [06:27<02:43, 5.06batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 71%|███████ | 1983/2797 [06:29<02:43, 4.99batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 71%|███████▏ | 1994/2797 [06:31<02:38, 5.07batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 71%|███████▏ | 1994/2797 [06:32<02:38, 5.07batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 72%|███████▏ | 2005/2797 [06:33<02:36, 5.07batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 72%|███████▏ | 2016/2797 [06:35<02:35, 5.03batch/s, loss=1.646, lr=2.2e-05] epoch 5/8: 72%|███████▏ | 2016/2797 [06:37<02:35, 5.03batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 72%|███████▏ | 2027/2797 [06:37<02:33, 5.02batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 73%|███████▎ | 2038/2797 [06:39<02:27, 5.14batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 73%|███████▎ | 2049/2797 [06:41<02:22, 5.24batch/s, loss=1.645, lr=2.2e-05] epoch 5/8: 73%|███████▎ | 2049/2797 [06:42<02:22, 5.24batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 74%|███████▎ | 2060/2797 [06:44<02:24, 5.10batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 74%|███████▍ | 2071/2797 [06:46<02:19, 5.21batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 74%|███████▍ | 2071/2797 [06:47<02:19, 5.21batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 74%|███████▍ | 2082/2797 [06:48<02:23, 4.99batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 75%|███████▍ | 2094/2797 [06:50<02:13, 5.25batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 75%|███████▍ | 2094/2797 [06:52<02:13, 5.25batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 75%|███████▌ | 2105/2797 [06:52<02:17, 5.03batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 76%|███████▌ | 2116/2797 [06:54<02:13, 5.11batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 76%|███████▌ | 2116/2797 [06:56<02:13, 5.11batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 76%|███████▌ | 2127/2797 [06:57<02:12, 5.07batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 76%|███████▋ | 2138/2797 [06:59<02:08, 5.14batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 77%|███████▋ | 2149/2797 [07:01<02:07, 5.09batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 77%|███████▋ | 2149/2797 [07:01<02:07, 5.09batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 77%|███████▋ | 2161/2797 [07:03<02:01, 5.24batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 78%|███████▊ | 2173/2797 [07:05<01:56, 5.37batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 78%|███████▊ | 2173/2797 [07:06<01:56, 5.37batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 78%|███████▊ | 2184/2797 [07:08<02:07, 4.81batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 78%|███████▊ | 2195/2797 [07:10<02:04, 4.84batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 78%|███████▊ | 2195/2797 [07:12<02:04, 4.84batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 79%|███████▉ | 2205/2797 [07:12<02:03, 4.80batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 79%|███████▉ | 2217/2797 [07:15<01:55, 5.01batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 79%|███████▉ | 2217/2797 [07:17<01:55, 5.01batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 80%|███████▉ | 2228/2797 [07:17<01:58, 4.82batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 80%|████████ | 2239/2797 [07:19<01:52, 4.95batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 80%|████████ | 2250/2797 [07:21<01:50, 4.95batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 80%|████████ | 2250/2797 [07:22<01:50, 4.95batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 81%|████████ | 2260/2797 [07:23<01:48, 4.96batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 81%|████████ | 2272/2797 [07:25<01:40, 5.22batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 81%|████████ | 2272/2797 [07:26<01:40, 5.22batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 82%|████████▏ | 2283/2797 [07:28<01:39, 5.19batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 82%|████████▏ | 2294/2797 [07:30<01:39, 5.08batch/s, loss=1.645, lr=2.1e-05] epoch 5/8: 82%|████████▏ | 2294/2797 [07:32<01:39, 5.08batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 82%|████████▏ | 2305/2797 [07:32<01:41, 4.84batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 83%|████████▎ | 2315/2797 [07:34<01:39, 4.86batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 83%|████████▎ | 2315/2797 [07:36<01:39, 4.86batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 83%|████████▎ | 2327/2797 [07:37<01:32, 5.06batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 84%|████████▎ | 2339/2797 [07:39<01:27, 5.23batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 84%|████████▍ | 2350/2797 [07:41<01:27, 5.12batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 84%|████████▍ | 2350/2797 [07:41<01:27, 5.12batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 84%|████████▍ | 2361/2797 [07:43<01:23, 5.21batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 85%|████████▍ | 2372/2797 [07:45<01:20, 5.29batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 85%|████████▍ | 2372/2797 [07:46<01:20, 5.29batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 85%|████████▌ | 2383/2797 [07:47<01:20, 5.17batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 86%|████████▌ | 2394/2797 [07:50<01:20, 4.99batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 86%|████████▌ | 2394/2797 [07:51<01:20, 4.99batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 86%|████████▌ | 2405/2797 [07:52<01:17, 5.03batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 86%|████████▋ | 2416/2797 [07:54<01:14, 5.09batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 86%|████████▋ | 2416/2797 [07:56<01:14, 5.09batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 87%|████████▋ | 2427/2797 [07:56<01:12, 5.07batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 87%|████████▋ | 2438/2797 [07:58<01:09, 5.18batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 88%|████████▊ | 2449/2797 [08:00<01:06, 5.20batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 88%|████████▊ | 2449/2797 [08:01<01:06, 5.20batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 88%|████████▊ | 2460/2797 [08:02<01:04, 5.21batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 88%|████████▊ | 2471/2797 [08:04<01:01, 5.27batch/s, loss=1.646, lr=2.1e-05] epoch 5/8: 88%|████████▊ | 2471/2797 [08:05<01:01, 5.27batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 89%|████████▊ | 2482/2797 [08:07<01:01, 5.12batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 89%|████████▉ | 2493/2797 [08:09<00:58, 5.16batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 89%|████████▉ | 2493/2797 [08:11<00:58, 5.16batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 90%|████████▉ | 2504/2797 [08:11<00:59, 4.95batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 90%|████████▉ | 2515/2797 [08:13<00:56, 4.96batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 90%|████████▉ | 2515/2797 [08:15<00:56, 4.96batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 90%|█████████ | 2527/2797 [08:16<00:52, 5.17batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 91%|█████████ | 2538/2797 [08:18<00:49, 5.22batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 91%|█████████ | 2549/2797 [08:20<00:48, 5.15batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 91%|█████████ | 2549/2797 [08:20<00:48, 5.15batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 92%|█████████▏| 2561/2797 [08:22<00:44, 5.32batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 92%|█████████▏| 2572/2797 [08:24<00:42, 5.35batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 92%|█████████▏| 2572/2797 [08:25<00:42, 5.35batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 92%|█████████▏| 2583/2797 [08:26<00:40, 5.25batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 93%|█████████▎| 2594/2797 [08:28<00:40, 5.04batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 93%|█████████▎| 2594/2797 [08:30<00:40, 5.04batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 93%|█████████▎| 2605/2797 [08:31<00:37, 5.11batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 94%|█████████▎| 2616/2797 [08:33<00:35, 5.08batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 94%|█████████▎| 2616/2797 [08:35<00:35, 5.08batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 94%|█████████▍| 2627/2797 [08:35<00:33, 5.09batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 94%|█████████▍| 2638/2797 [08:37<00:31, 5.08batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 95%|█████████▍| 2649/2797 [08:39<00:29, 5.07batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 95%|█████████▍| 2649/2797 [08:40<00:29, 5.07batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 95%|█████████▌| 2660/2797 [08:41<00:26, 5.08batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 95%|█████████▌| 2671/2797 [08:44<00:24, 5.11batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 95%|█████████▌| 2671/2797 [08:44<00:24, 5.11batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 96%|█████████▌| 2682/2797 [08:46<00:22, 5.21batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 96%|█████████▋| 2693/2797 [08:48<00:20, 5.12batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 96%|█████████▋| 2693/2797 [08:49<00:20, 5.12batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 97%|█████████▋| 2704/2797 [08:50<00:18, 5.14batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 97%|█████████▋| 2716/2797 [08:52<00:15, 5.26batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 97%|█████████▋| 2716/2797 [08:54<00:15, 5.26batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 97%|█████████▋| 2727/2797 [08:54<00:13, 5.24batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 98%|█████████▊| 2738/2797 [08:56<00:11, 5.27batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 98%|█████████▊| 2749/2797 [08:58<00:09, 5.27batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 98%|█████████▊| 2749/2797 [08:59<00:09, 5.27batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 99%|█████████▊| 2760/2797 [09:00<00:06, 5.29batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 99%|█████████▉| 2771/2797 [09:03<00:05, 5.14batch/s, loss=1.646, lr=2.0e-05] epoch 5/8: 99%|█████████▉| 2771/2797 [09:04<00:05, 5.14batch/s, loss=1.645, lr=2.0e-05] epoch 5/8: 99%|█████████▉| 2782/2797 [09:05<00:02, 5.01batch/s, loss=1.645, lr=2.0e-05] epoch 5/8: 100%|█████████▉| 2793/2797 [09:07<00:00, 4.89batch/s, loss=1.645, lr=2.0e-05] epoch 5/8: 100%|██████████| 2797/2797 [09:08<00:00, 5.10batch/s, loss=1.645, lr=2.0e-05]
epoch 5: train loss 1.645 · validation loss 2.096 · broad 81.3% (top-3 95.1%) · path 72.4% (top-3 89.3%, plausible or look-alike 88.1%) · 2949s elapsed
epoch 6/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 6/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=1.375, lr=2.0e-05] epoch 6/8: 0%| | 11/2797 [00:02<08:39, 5.36batch/s, loss=1.375, lr=2.0e-05] epoch 6/8: 1%| | 22/2797 [00:04<08:50, 5.23batch/s, loss=1.375, lr=2.0e-05] epoch 6/8: 1%| | 22/2797 [00:04<08:50, 5.23batch/s, loss=1.575, lr=2.0e-05] epoch 6/8: 1%| | 33/2797 [00:06<09:00, 5.12batch/s, loss=1.575, lr=2.0e-05] epoch 6/8: 2%|▏ | 44/2797 [00:08<09:00, 5.09batch/s, loss=1.575, lr=2.0e-05] epoch 6/8: 2%|▏ | 44/2797 [00:09<09:00, 5.09batch/s, loss=1.595, lr=2.0e-05] epoch 6/8: 2%|▏ | 55/2797 [00:10<08:55, 5.12batch/s, loss=1.595, lr=2.0e-05] epoch 6/8: 2%|▏ | 66/2797 [00:12<08:58, 5.07batch/s, loss=1.595, lr=2.0e-05] epoch 6/8: 2%|▏ | 66/2797 [00:14<08:58, 5.07batch/s, loss=1.587, lr=2.0e-05] epoch 6/8: 3%|▎ | 77/2797 [00:15<08:55, 5.08batch/s, loss=1.587, lr=2.0e-05] epoch 6/8: 3%|▎ | 88/2797 [00:17<09:03, 4.99batch/s, loss=1.587, lr=2.0e-05] epoch 6/8: 4%|▎ | 99/2797 [00:19<08:53, 5.05batch/s, loss=1.587, lr=2.0e-05] epoch 6/8: 4%|▎ | 99/2797 [00:19<08:53, 5.05batch/s, loss=1.587, lr=1.9e-05] epoch 6/8: 4%|▍ | 110/2797 [00:21<08:51, 5.06batch/s, loss=1.587, lr=1.9e-05] epoch 6/8: 4%|▍ | 121/2797 [00:23<08:55, 4.99batch/s, loss=1.587, lr=1.9e-05] epoch 6/8: 4%|▍ | 121/2797 [00:24<08:55, 4.99batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 5%|▍ | 131/2797 [00:26<09:03, 4.90batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 5%|▌ | 142/2797 [00:28<08:53, 4.97batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 5%|▌ | 142/2797 [00:30<08:53, 4.97batch/s, loss=1.581, lr=1.9e-05] epoch 6/8: 5%|▌ | 152/2797 [00:30<09:03, 4.87batch/s, loss=1.581, lr=1.9e-05] epoch 6/8: 6%|▌ | 163/2797 [00:32<08:52, 4.95batch/s, loss=1.581, lr=1.9e-05] epoch 6/8: 6%|▌ | 173/2797 [00:34<08:51, 4.94batch/s, loss=1.581, lr=1.9e-05] epoch 6/8: 6%|▌ | 173/2797 [00:35<08:51, 4.94batch/s, loss=1.584, lr=1.9e-05] epoch 6/8: 7%|▋ | 184/2797 [00:36<08:45, 4.98batch/s, loss=1.584, lr=1.9e-05] epoch 6/8: 7%|▋ | 195/2797 [00:38<08:36, 5.03batch/s, loss=1.584, lr=1.9e-05] epoch 6/8: 7%|▋ | 195/2797 [00:40<08:36, 5.03batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 7%|▋ | 206/2797 [00:41<08:48, 4.91batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 8%|▊ | 217/2797 [00:43<08:35, 5.01batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 8%|▊ | 217/2797 [00:44<08:35, 5.01batch/s, loss=1.573, lr=1.9e-05] epoch 6/8: 8%|▊ | 229/2797 [00:45<08:14, 5.19batch/s, loss=1.573, lr=1.9e-05] epoch 6/8: 9%|▊ | 240/2797 [00:47<08:30, 5.00batch/s, loss=1.573, lr=1.9e-05] epoch 6/8: 9%|▊ | 240/2797 [00:50<08:30, 5.00batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 9%|▉ | 251/2797 [00:50<08:32, 4.97batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 9%|▉ | 262/2797 [00:52<08:28, 4.98batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 10%|▉ | 272/2797 [00:54<08:35, 4.90batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 10%|▉ | 272/2797 [00:55<08:35, 4.90batch/s, loss=1.576, lr=1.9e-05] epoch 6/8: 10%|█ | 283/2797 [00:56<08:22, 5.01batch/s, loss=1.576, lr=1.9e-05] epoch 6/8: 11%|█ | 294/2797 [00:58<08:11, 5.09batch/s, loss=1.576, lr=1.9e-05] epoch 6/8: 11%|█ | 294/2797 [00:59<08:11, 5.09batch/s, loss=1.578, lr=1.9e-05] epoch 6/8: 11%|█ | 305/2797 [01:00<08:01, 5.18batch/s, loss=1.578, lr=1.9e-05] epoch 6/8: 11%|█▏ | 316/2797 [01:03<08:19, 4.96batch/s, loss=1.578, lr=1.9e-05] epoch 6/8: 11%|█▏ | 316/2797 [01:05<08:19, 4.96batch/s, loss=1.583, lr=1.9e-05] epoch 6/8: 12%|█▏ | 326/2797 [01:05<08:19, 4.95batch/s, loss=1.583, lr=1.9e-05] epoch 6/8: 12%|█▏ | 336/2797 [01:07<08:16, 4.96batch/s, loss=1.583, lr=1.9e-05] epoch 6/8: 12%|█▏ | 347/2797 [01:09<08:05, 5.05batch/s, loss=1.583, lr=1.9e-05] epoch 6/8: 12%|█▏ | 347/2797 [01:10<08:05, 5.05batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 13%|█▎ | 358/2797 [01:11<08:11, 4.96batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 13%|█▎ | 370/2797 [01:13<07:48, 5.18batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 13%|█▎ | 370/2797 [01:14<07:48, 5.18batch/s, loss=1.580, lr=1.9e-05] epoch 6/8: 14%|█▎ | 381/2797 [01:15<07:40, 5.24batch/s, loss=1.580, lr=1.9e-05] epoch 6/8: 14%|█▍ | 392/2797 [01:17<07:33, 5.30batch/s, loss=1.580, lr=1.9e-05] epoch 6/8: 14%|█▍ | 392/2797 [01:19<07:33, 5.30batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 14%|█▍ | 403/2797 [01:19<07:38, 5.22batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 15%|█▍ | 414/2797 [01:21<07:37, 5.21batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 15%|█▌ | 425/2797 [01:24<07:37, 5.19batch/s, loss=1.582, lr=1.9e-05] epoch 6/8: 15%|█▌ | 425/2797 [01:24<07:37, 5.19batch/s, loss=1.580, lr=1.9e-05] epoch 6/8: 16%|█▌ | 436/2797 [01:26<07:29, 5.25batch/s, loss=1.580, lr=1.9e-05] epoch 6/8: 16%|█▌ | 447/2797 [01:28<07:38, 5.12batch/s, loss=1.580, lr=1.9e-05] epoch 6/8: 16%|█▌ | 447/2797 [01:29<07:38, 5.12batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 16%|█▋ | 458/2797 [01:30<07:50, 4.97batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 17%|█▋ | 468/2797 [01:32<08:00, 4.85batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 17%|█▋ | 468/2797 [01:34<08:00, 4.85batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 17%|█▋ | 479/2797 [01:35<07:52, 4.91batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 17%|█▋ | 489/2797 [01:37<08:03, 4.77batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 18%|█▊ | 499/2797 [01:39<07:57, 4.81batch/s, loss=1.579, lr=1.9e-05] epoch 6/8: 18%|█▊ | 499/2797 [01:39<07:57, 4.81batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 18%|█▊ | 511/2797 [01:41<07:30, 5.08batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 19%|█▊ | 522/2797 [01:43<07:29, 5.06batch/s, loss=1.575, lr=1.9e-05] epoch 6/8: 19%|█▊ | 522/2797 [01:44<07:29, 5.06batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 19%|█▉ | 533/2797 [01:45<07:17, 5.18batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 19%|█▉ | 544/2797 [01:47<07:23, 5.08batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 19%|█▉ | 544/2797 [01:49<07:23, 5.08batch/s, loss=1.576, lr=1.8e-05] epoch 6/8: 20%|█▉ | 555/2797 [01:49<07:13, 5.17batch/s, loss=1.576, lr=1.8e-05] epoch 6/8: 20%|██ | 566/2797 [01:52<07:12, 5.16batch/s, loss=1.576, lr=1.8e-05] epoch 6/8: 20%|██ | 566/2797 [01:54<07:12, 5.16batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 21%|██ | 577/2797 [01:54<07:11, 5.14batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 21%|██ | 589/2797 [01:56<07:01, 5.24batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 21%|██▏ | 600/2797 [01:58<07:09, 5.11batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 21%|██▏ | 600/2797 [01:58<07:09, 5.11batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 22%|██▏ | 611/2797 [02:00<07:10, 5.08batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 22%|██▏ | 622/2797 [02:02<06:59, 5.18batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 22%|██▏ | 622/2797 [02:03<06:59, 5.18batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 23%|██▎ | 633/2797 [02:05<07:11, 5.02batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 23%|██▎ | 644/2797 [02:07<07:04, 5.07batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 23%|██▎ | 644/2797 [02:08<07:04, 5.07batch/s, loss=1.576, lr=1.8e-05] epoch 6/8: 23%|██▎ | 655/2797 [02:09<06:54, 5.17batch/s, loss=1.576, lr=1.8e-05] epoch 6/8: 24%|██▍ | 667/2797 [02:11<06:46, 5.24batch/s, loss=1.576, lr=1.8e-05] epoch 6/8: 24%|██▍ | 667/2797 [02:13<06:46, 5.24batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 24%|██▍ | 679/2797 [02:13<06:36, 5.34batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 25%|██▍ | 690/2797 [02:15<06:35, 5.33batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 25%|██▍ | 690/2797 [02:18<06:35, 5.33batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 25%|██▌ | 701/2797 [02:18<06:52, 5.09batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 25%|██▌ | 712/2797 [02:20<06:58, 4.98batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 26%|██▌ | 722/2797 [02:22<07:04, 4.88batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 26%|██▌ | 722/2797 [02:23<07:04, 4.88batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 26%|██▌ | 733/2797 [02:24<06:55, 4.97batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 27%|██▋ | 743/2797 [02:26<06:57, 4.92batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 27%|██▋ | 743/2797 [02:28<06:57, 4.92batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 27%|██▋ | 753/2797 [02:29<06:59, 4.87batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 27%|██▋ | 763/2797 [02:31<06:59, 4.85batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 28%|██▊ | 774/2797 [02:33<06:50, 4.93batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 28%|██▊ | 774/2797 [02:33<06:50, 4.93batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 28%|██▊ | 785/2797 [02:35<06:37, 5.06batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 28%|██▊ | 796/2797 [02:37<06:33, 5.09batch/s, loss=1.573, lr=1.8e-05] epoch 6/8: 28%|██▊ | 796/2797 [02:38<06:33, 5.09batch/s, loss=1.572, lr=1.8e-05] epoch 6/8: 29%|██▉ | 807/2797 [02:39<06:35, 5.04batch/s, loss=1.572, lr=1.8e-05] epoch 6/8: 29%|██▉ | 818/2797 [02:41<06:23, 5.17batch/s, loss=1.572, lr=1.8e-05] epoch 6/8: 29%|██▉ | 818/2797 [02:43<06:23, 5.17batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 30%|██▉ | 829/2797 [02:43<06:24, 5.12batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 30%|███ | 840/2797 [02:46<06:30, 5.01batch/s, loss=1.575, lr=1.8e-05] epoch 6/8: 30%|███ | 840/2797 [02:48<06:30, 5.01batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 30%|███ | 851/2797 [02:48<06:32, 4.95batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 31%|███ | 861/2797 [02:50<06:31, 4.95batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 31%|███ | 871/2797 [02:52<06:35, 4.87batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 31%|███ | 871/2797 [02:53<06:35, 4.87batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 31%|███▏ | 881/2797 [02:54<06:37, 4.81batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 32%|███▏ | 892/2797 [02:56<06:25, 4.94batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 32%|███▏ | 892/2797 [02:58<06:25, 4.94batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 32%|███▏ | 902/2797 [02:59<06:27, 4.89batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 33%|███▎ | 915/2797 [03:01<06:00, 5.22batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 33%|███▎ | 915/2797 [03:03<06:00, 5.22batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 33%|███▎ | 926/2797 [03:03<05:53, 5.29batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 34%|███▎ | 937/2797 [03:05<05:54, 5.25batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 34%|███▍ | 948/2797 [03:07<05:53, 5.22batch/s, loss=1.574, lr=1.8e-05] epoch 6/8: 34%|███▍ | 948/2797 [03:07<05:53, 5.22batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 34%|███▍ | 959/2797 [03:09<05:49, 5.27batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 35%|███▍ | 970/2797 [03:11<05:50, 5.22batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 35%|███▍ | 970/2797 [03:12<05:50, 5.22batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 35%|███▌ | 981/2797 [03:13<05:50, 5.18batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 35%|███▌ | 992/2797 [03:16<05:59, 5.01batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 35%|███▌ | 992/2797 [03:17<05:59, 5.01batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 36%|███▌ | 1003/2797 [03:18<05:52, 5.08batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 36%|███▋ | 1014/2797 [03:20<05:45, 5.16batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 37%|███▋ | 1025/2797 [03:22<05:53, 5.01batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 37%|███▋ | 1025/2797 [03:22<05:53, 5.01batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 37%|███▋ | 1037/2797 [03:24<05:41, 5.15batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 37%|███▋ | 1048/2797 [03:27<05:44, 5.07batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 37%|███▋ | 1048/2797 [03:27<05:44, 5.07batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 38%|███▊ | 1060/2797 [03:29<05:35, 5.18batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 38%|███▊ | 1071/2797 [03:31<05:27, 5.27batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 38%|███▊ | 1071/2797 [03:32<05:27, 5.27batch/s, loss=1.577, lr=1.7e-05] epoch 6/8: 39%|███▊ | 1082/2797 [03:33<05:33, 5.14batch/s, loss=1.577, lr=1.7e-05] epoch 6/8: 39%|███▉ | 1093/2797 [03:35<05:32, 5.13batch/s, loss=1.577, lr=1.7e-05] epoch 6/8: 39%|███▉ | 1093/2797 [03:37<05:32, 5.13batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 39%|███▉ | 1104/2797 [03:38<05:35, 5.05batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 40%|███▉ | 1115/2797 [03:40<05:31, 5.07batch/s, loss=1.576, lr=1.7e-05] epoch 6/8: 40%|███▉ | 1115/2797 [03:42<05:31, 5.07batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 40%|████ | 1126/2797 [03:42<05:38, 4.94batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 41%|████ | 1137/2797 [03:44<05:30, 5.03batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 41%|████ | 1149/2797 [03:46<05:19, 5.16batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 41%|████ | 1149/2797 [03:47<05:19, 5.16batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 41%|████▏ | 1160/2797 [03:49<05:25, 5.03batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 42%|████▏ | 1171/2797 [03:51<05:28, 4.95batch/s, loss=1.575, lr=1.7e-05] epoch 6/8: 42%|████▏ | 1171/2797 [03:52<05:28, 4.95batch/s, loss=1.574, lr=1.7e-05] epoch 6/8: 42%|████▏ | 1182/2797 [03:53<05:21, 5.03batch/s, loss=1.574, lr=1.7e-05] epoch 6/8: 43%|████▎ | 1193/2797 [03:55<05:22, 4.97batch/s, loss=1.574, lr=1.7e-05] epoch 6/8: 43%|████▎ | 1193/2797 [03:57<05:22, 4.97batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 43%|████▎ | 1203/2797 [03:57<05:20, 4.97batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 43%|████▎ | 1213/2797 [03:59<05:19, 4.95batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 44%|████▎ | 1223/2797 [04:02<05:26, 4.83batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 44%|████▎ | 1223/2797 [04:02<05:26, 4.83batch/s, loss=1.574, lr=1.7e-05] epoch 6/8: 44%|████▍ | 1234/2797 [04:04<05:15, 4.95batch/s, loss=1.574, lr=1.7e-05] epoch 6/8: 44%|████▍ | 1244/2797 [04:06<05:18, 4.87batch/s, loss=1.574, lr=1.7e-05] epoch 6/8: 44%|████▍ | 1244/2797 [04:07<05:18, 4.87batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 45%|████▍ | 1255/2797 [04:08<05:09, 4.98batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 45%|████▌ | 1267/2797 [04:10<04:55, 5.17batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 45%|████▌ | 1267/2797 [04:12<04:55, 5.17batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 46%|████▌ | 1278/2797 [04:12<04:49, 5.25batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 46%|████▌ | 1289/2797 [04:14<04:44, 5.30batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 46%|████▋ | 1300/2797 [04:16<04:47, 5.21batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 46%|████▋ | 1300/2797 [04:17<04:47, 5.21batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 47%|████▋ | 1311/2797 [04:18<04:48, 5.15batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 47%|████▋ | 1322/2797 [04:21<04:45, 5.16batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 47%|████▋ | 1322/2797 [04:22<04:45, 5.16batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 48%|████▊ | 1333/2797 [04:23<04:51, 5.03batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 48%|████▊ | 1344/2797 [04:25<04:46, 5.06batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 48%|████▊ | 1344/2797 [04:26<04:46, 5.06batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 48%|████▊ | 1355/2797 [04:27<04:40, 5.14batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 49%|████▉ | 1366/2797 [04:29<04:37, 5.16batch/s, loss=1.573, lr=1.7e-05] epoch 6/8: 49%|████▉ | 1366/2797 [04:31<04:37, 5.16batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 49%|████▉ | 1377/2797 [04:32<04:42, 5.03batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 50%|████▉ | 1388/2797 [04:34<04:41, 5.00batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 50%|█████ | 1399/2797 [04:36<04:34, 5.09batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 50%|█████ | 1399/2797 [04:36<04:34, 5.09batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 50%|█████ | 1410/2797 [04:38<04:37, 5.00batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 51%|█████ | 1422/2797 [04:40<04:25, 5.18batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 51%|█████ | 1422/2797 [04:41<04:25, 5.18batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 51%|█████ | 1433/2797 [04:43<04:28, 5.09batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 52%|█████▏ | 1444/2797 [04:45<04:24, 5.11batch/s, loss=1.573, lr=1.6e-05] epoch 6/8: 52%|█████▏ | 1444/2797 [04:46<04:24, 5.11batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 52%|█████▏ | 1455/2797 [04:47<04:22, 5.11batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 52%|█████▏ | 1467/2797 [04:49<04:13, 5.24batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 52%|█████▏ | 1467/2797 [04:51<04:13, 5.24batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 53%|█████▎ | 1478/2797 [04:51<04:15, 5.17batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 53%|█████▎ | 1489/2797 [04:53<04:13, 5.16batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 54%|█████▎ | 1500/2797 [04:55<04:07, 5.23batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 54%|█████▎ | 1500/2797 [04:55<04:07, 5.23batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 54%|█████▍ | 1511/2797 [04:58<04:07, 5.20batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 54%|█████▍ | 1522/2797 [05:00<04:12, 5.05batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 54%|█████▍ | 1522/2797 [05:01<04:12, 5.05batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 55%|█████▍ | 1533/2797 [05:02<04:08, 5.09batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 55%|█████▌ | 1544/2797 [05:04<04:11, 4.97batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 55%|█████▌ | 1544/2797 [05:06<04:11, 4.97batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 56%|█████▌ | 1554/2797 [05:07<04:18, 4.81batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 56%|█████▌ | 1564/2797 [05:09<04:13, 4.86batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 56%|█████▋ | 1575/2797 [05:11<04:08, 4.92batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 56%|█████▋ | 1575/2797 [05:11<04:08, 4.92batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 57%|█████▋ | 1585/2797 [05:13<04:13, 4.78batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 57%|█████▋ | 1596/2797 [05:15<04:05, 4.90batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 57%|█████▋ | 1596/2797 [05:16<04:05, 4.90batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 57%|█████▋ | 1606/2797 [05:17<04:03, 4.88batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 58%|█████▊ | 1617/2797 [05:19<03:54, 5.03batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 58%|█████▊ | 1617/2797 [05:21<03:54, 5.03batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 58%|█████▊ | 1628/2797 [05:21<03:50, 5.08batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 59%|█████▊ | 1639/2797 [05:23<03:48, 5.06batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 59%|█████▉ | 1650/2797 [05:26<03:47, 5.05batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 59%|█████▉ | 1650/2797 [05:26<03:47, 5.05batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 59%|█████▉ | 1661/2797 [05:28<03:43, 5.08batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 60%|█████▉ | 1672/2797 [05:30<03:45, 4.99batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 60%|█████▉ | 1672/2797 [05:31<03:45, 4.99batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 60%|██████ | 1683/2797 [05:32<03:38, 5.10batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 61%|██████ | 1694/2797 [05:34<03:40, 5.01batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 61%|██████ | 1694/2797 [05:36<03:40, 5.01batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 61%|██████ | 1705/2797 [05:37<03:37, 5.03batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 61%|██████▏ | 1716/2797 [05:39<03:30, 5.14batch/s, loss=1.576, lr=1.6e-05] epoch 6/8: 61%|██████▏ | 1716/2797 [05:41<03:30, 5.14batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 62%|██████▏ | 1727/2797 [05:41<03:26, 5.18batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 62%|██████▏ | 1738/2797 [05:43<03:23, 5.22batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 63%|██████▎ | 1749/2797 [05:45<03:20, 5.24batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 63%|██████▎ | 1749/2797 [05:45<03:20, 5.24batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 63%|██████▎ | 1760/2797 [05:47<03:20, 5.18batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 63%|██████▎ | 1771/2797 [05:49<03:19, 5.14batch/s, loss=1.575, lr=1.6e-05] epoch 6/8: 63%|██████▎ | 1771/2797 [05:50<03:19, 5.14batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 64%|██████▎ | 1782/2797 [05:51<03:20, 5.07batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 64%|██████▍ | 1793/2797 [05:54<03:16, 5.12batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 64%|██████▍ | 1793/2797 [05:55<03:16, 5.12batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 64%|██████▍ | 1804/2797 [05:56<03:16, 5.07batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 65%|██████▍ | 1815/2797 [05:58<03:10, 5.16batch/s, loss=1.574, lr=1.6e-05] epoch 6/8: 65%|██████▍ | 1815/2797 [06:00<03:10, 5.16batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 65%|██████▌ | 1826/2797 [06:00<03:13, 5.01batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 66%|██████▌ | 1837/2797 [06:02<03:11, 5.01batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 66%|██████▌ | 1848/2797 [06:05<03:11, 4.96batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 66%|██████▌ | 1848/2797 [06:05<03:11, 4.96batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 66%|██████▋ | 1858/2797 [06:07<03:12, 4.88batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 67%|██████▋ | 1869/2797 [06:09<03:06, 4.99batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 67%|██████▋ | 1869/2797 [06:10<03:06, 4.99batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 67%|██████▋ | 1880/2797 [06:11<02:58, 5.13batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 68%|██████▊ | 1891/2797 [06:13<02:53, 5.22batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 68%|██████▊ | 1891/2797 [06:15<02:53, 5.22batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 68%|██████▊ | 1902/2797 [06:15<02:58, 5.00batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 68%|██████▊ | 1913/2797 [06:18<02:58, 4.96batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 69%|██████▉ | 1925/2797 [06:20<02:51, 5.09batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 69%|██████▉ | 1925/2797 [06:20<02:51, 5.09batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 69%|██████▉ | 1936/2797 [06:22<02:48, 5.12batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 70%|██████▉ | 1947/2797 [06:24<02:44, 5.17batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 70%|██████▉ | 1947/2797 [06:25<02:44, 5.17batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 70%|███████ | 1958/2797 [06:26<02:45, 5.06batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 70%|███████ | 1969/2797 [06:28<02:40, 5.15batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 70%|███████ | 1969/2797 [06:30<02:40, 5.15batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 71%|███████ | 1980/2797 [06:31<02:39, 5.12batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 71%|███████ | 1991/2797 [06:33<02:40, 5.03batch/s, loss=1.574, lr=1.5e-05] epoch 6/8: 71%|███████ | 1991/2797 [06:35<02:40, 5.03batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 72%|███████▏ | 2002/2797 [06:35<02:37, 5.04batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 72%|███████▏ | 2013/2797 [06:37<02:34, 5.07batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 72%|███████▏ | 2024/2797 [06:39<02:34, 5.01batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 72%|███████▏ | 2024/2797 [06:40<02:34, 5.01batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 73%|███████▎ | 2035/2797 [06:42<02:31, 5.03batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 73%|███████▎ | 2046/2797 [06:44<02:30, 4.98batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 73%|███████▎ | 2046/2797 [06:45<02:30, 4.98batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 74%|███████▎ | 2057/2797 [06:46<02:25, 5.10batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 74%|███████▍ | 2068/2797 [06:48<02:24, 5.04batch/s, loss=1.573, lr=1.5e-05] epoch 6/8: 74%|███████▍ | 2068/2797 [06:50<02:24, 5.04batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 74%|███████▍ | 2080/2797 [06:50<02:18, 5.17batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 75%|███████▍ | 2091/2797 [06:52<02:15, 5.20batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 75%|███████▍ | 2091/2797 [06:54<02:15, 5.20batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 75%|███████▌ | 2102/2797 [06:54<02:13, 5.21batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 76%|███████▌ | 2113/2797 [06:56<02:09, 5.28batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 76%|███████▌ | 2124/2797 [06:59<02:08, 5.24batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 76%|███████▌ | 2124/2797 [06:59<02:08, 5.24batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 76%|███████▋ | 2135/2797 [07:01<02:11, 5.04batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 77%|███████▋ | 2146/2797 [07:03<02:06, 5.15batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 77%|███████▋ | 2146/2797 [07:04<02:06, 5.15batch/s, loss=1.571, lr=1.5e-05] epoch 6/8: 77%|███████▋ | 2158/2797 [07:05<02:00, 5.30batch/s, loss=1.571, lr=1.5e-05] epoch 6/8: 78%|███████▊ | 2169/2797 [07:07<02:01, 5.18batch/s, loss=1.571, lr=1.5e-05] epoch 6/8: 78%|███████▊ | 2169/2797 [07:09<02:01, 5.18batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 78%|███████▊ | 2180/2797 [07:09<01:58, 5.22batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 78%|███████▊ | 2191/2797 [07:12<01:58, 5.10batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 78%|███████▊ | 2191/2797 [07:13<01:58, 5.10batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 79%|███████▉ | 2203/2797 [07:14<01:52, 5.29batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 79%|███████▉ | 2214/2797 [07:16<01:51, 5.21batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 80%|███████▉ | 2225/2797 [07:18<01:51, 5.13batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 80%|███████▉ | 2225/2797 [07:18<01:51, 5.13batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 80%|███████▉ | 2236/2797 [07:20<01:47, 5.23batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 80%|████████ | 2247/2797 [07:23<01:48, 5.05batch/s, loss=1.572, lr=1.5e-05] epoch 6/8: 80%|████████ | 2247/2797 [07:23<01:48, 5.05batch/s, loss=1.572, lr=1.4e-05] epoch 6/8: 81%|████████ | 2258/2797 [07:25<01:45, 5.13batch/s, loss=1.572, lr=1.4e-05] epoch 6/8: 81%|████████ | 2270/2797 [07:27<01:40, 5.24batch/s, loss=1.572, lr=1.4e-05] epoch 6/8: 81%|████████ | 2270/2797 [07:28<01:40, 5.24batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 82%|████████▏ | 2281/2797 [07:29<01:38, 5.26batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 82%|████████▏ | 2292/2797 [07:31<01:35, 5.31batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 82%|████████▏ | 2292/2797 [07:33<01:35, 5.31batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 82%|████████▏ | 2303/2797 [07:33<01:34, 5.21batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 83%|████████▎ | 2314/2797 [07:35<01:31, 5.26batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 83%|████████▎ | 2325/2797 [07:37<01:31, 5.18batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 83%|████████▎ | 2325/2797 [07:38<01:31, 5.18batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 84%|████████▎ | 2336/2797 [07:40<01:30, 5.12batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 84%|████████▍ | 2348/2797 [07:42<01:25, 5.24batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 84%|████████▍ | 2348/2797 [07:42<01:25, 5.24batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 84%|████████▍ | 2359/2797 [07:44<01:23, 5.22batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 85%|████████▍ | 2370/2797 [07:46<01:24, 5.03batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 85%|████████▍ | 2370/2797 [07:48<01:24, 5.03batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 85%|████████▌ | 2381/2797 [07:49<01:23, 4.96batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 86%|████████▌ | 2392/2797 [07:51<01:19, 5.10batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 86%|████████▌ | 2392/2797 [07:52<01:19, 5.10batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 86%|████████▌ | 2404/2797 [07:53<01:14, 5.28batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 86%|████████▋ | 2416/2797 [07:55<01:10, 5.39batch/s, loss=1.571, lr=1.4e-05] epoch 6/8: 86%|████████▋ | 2416/2797 [07:57<01:10, 5.39batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 87%|████████▋ | 2427/2797 [07:57<01:10, 5.24batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 87%|████████▋ | 2438/2797 [07:59<01:09, 5.18batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 88%|████████▊ | 2449/2797 [08:01<01:08, 5.05batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 88%|████████▊ | 2449/2797 [08:02<01:08, 5.05batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 88%|████████▊ | 2460/2797 [08:04<01:06, 5.09batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 88%|████████▊ | 2471/2797 [08:06<01:04, 5.04batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 88%|████████▊ | 2471/2797 [08:07<01:04, 5.04batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 89%|████████▊ | 2482/2797 [08:08<01:02, 5.08batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 89%|████████▉ | 2493/2797 [08:10<00:58, 5.17batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 89%|████████▉ | 2493/2797 [08:12<00:58, 5.17batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 90%|████████▉ | 2505/2797 [08:12<00:55, 5.25batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 90%|████████▉ | 2516/2797 [08:14<00:53, 5.29batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 90%|████████▉ | 2516/2797 [08:16<00:53, 5.29batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 90%|█████████ | 2527/2797 [08:16<00:51, 5.21batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 91%|█████████ | 2538/2797 [08:19<00:50, 5.09batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 91%|█████████ | 2550/2797 [08:21<00:46, 5.30batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 91%|█████████ | 2550/2797 [08:21<00:46, 5.30batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 92%|█████████▏| 2561/2797 [08:23<00:44, 5.30batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 92%|█████████▏| 2572/2797 [08:25<00:42, 5.31batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 92%|█████████▏| 2572/2797 [08:26<00:42, 5.31batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 92%|█████████▏| 2583/2797 [08:27<00:40, 5.25batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 93%|█████████▎| 2594/2797 [08:29<00:39, 5.15batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 93%|█████████▎| 2594/2797 [08:31<00:39, 5.15batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 93%|█████████▎| 2605/2797 [08:31<00:37, 5.14batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 94%|█████████▎| 2616/2797 [08:33<00:34, 5.23batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 94%|█████████▎| 2616/2797 [08:35<00:34, 5.23batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 94%|█████████▍| 2627/2797 [08:36<00:32, 5.21batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 94%|█████████▍| 2638/2797 [08:38<00:31, 5.01batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 95%|█████████▍| 2649/2797 [08:40<00:29, 5.05batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 95%|█████████▍| 2649/2797 [08:41<00:29, 5.05batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 95%|█████████▌| 2660/2797 [08:42<00:27, 4.98batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 95%|█████████▌| 2671/2797 [08:45<00:25, 5.02batch/s, loss=1.570, lr=1.4e-05] epoch 6/8: 95%|█████████▌| 2671/2797 [08:46<00:25, 5.02batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 96%|█████████▌| 2682/2797 [08:47<00:22, 5.09batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 96%|█████████▋| 2693/2797 [08:49<00:20, 5.06batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 96%|█████████▋| 2693/2797 [08:50<00:20, 5.06batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 97%|█████████▋| 2704/2797 [08:51<00:18, 5.10batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 97%|█████████▋| 2715/2797 [08:53<00:15, 5.14batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 97%|█████████▋| 2715/2797 [08:55<00:15, 5.14batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 97%|█████████▋| 2726/2797 [08:55<00:13, 5.13batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 98%|█████████▊| 2737/2797 [08:58<00:12, 4.98batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 98%|█████████▊| 2747/2797 [09:00<00:10, 4.84batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 98%|█████████▊| 2747/2797 [09:01<00:10, 4.84batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 99%|█████████▊| 2757/2797 [09:02<00:08, 4.83batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 99%|█████████▉| 2767/2797 [09:04<00:06, 4.80batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 99%|█████████▉| 2767/2797 [09:06<00:06, 4.80batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 99%|█████████▉| 2778/2797 [09:06<00:03, 4.95batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 100%|█████████▉| 2788/2797 [09:08<00:01, 4.95batch/s, loss=1.571, lr=1.3e-05] epoch 6/8: 100%|██████████| 2797/2797 [09:10<00:00, 5.08batch/s, loss=1.571, lr=1.3e-05]
epoch 6: train loss 1.571 · validation loss 2.078 · broad 81.5% (top-3 95.3%) · path 72.8% (top-3 89.5%, plausible or look-alike 88.2%) · 3540s elapsed
epoch 7/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 7/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=1.668, lr=1.3e-05] epoch 7/8: 0%| | 12/2797 [00:02<08:01, 5.78batch/s, loss=1.668, lr=1.3e-05] epoch 7/8: 1%| | 24/2797 [00:04<09:04, 5.09batch/s, loss=1.668, lr=1.3e-05] epoch 7/8: 1%| | 24/2797 [00:05<09:04, 5.09batch/s, loss=1.529, lr=1.3e-05] epoch 7/8: 1%|▏ | 35/2797 [00:06<08:52, 5.19batch/s, loss=1.529, lr=1.3e-05] epoch 7/8: 2%|▏ | 46/2797 [00:08<09:03, 5.06batch/s, loss=1.529, lr=1.3e-05] epoch 7/8: 2%|▏ | 46/2797 [00:09<09:03, 5.06batch/s, loss=1.498, lr=1.3e-05] epoch 7/8: 2%|▏ | 57/2797 [00:11<09:00, 5.07batch/s, loss=1.498, lr=1.3e-05] epoch 7/8: 2%|▏ | 68/2797 [00:13<08:59, 5.06batch/s, loss=1.498, lr=1.3e-05] epoch 7/8: 2%|▏ | 68/2797 [00:14<08:59, 5.06batch/s, loss=1.520, lr=1.3e-05] epoch 7/8: 3%|▎ | 80/2797 [00:15<08:44, 5.18batch/s, loss=1.520, lr=1.3e-05] epoch 7/8: 3%|▎ | 93/2797 [00:17<08:15, 5.46batch/s, loss=1.520, lr=1.3e-05] epoch 7/8: 3%|▎ | 93/2797 [00:19<08:15, 5.46batch/s, loss=1.510, lr=1.3e-05] epoch 7/8: 4%|▎ | 104/2797 [00:19<08:21, 5.37batch/s, loss=1.510, lr=1.3e-05] epoch 7/8: 4%|▍ | 115/2797 [00:22<08:34, 5.21batch/s, loss=1.510, lr=1.3e-05] epoch 7/8: 4%|▍ | 115/2797 [00:24<08:34, 5.21batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 5%|▍ | 126/2797 [00:24<08:40, 5.13batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 5%|▍ | 137/2797 [00:26<08:38, 5.13batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 5%|▌ | 148/2797 [00:28<08:54, 4.96batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 5%|▌ | 148/2797 [00:29<08:54, 4.96batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 6%|▌ | 158/2797 [00:31<09:06, 4.83batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 6%|▌ | 169/2797 [00:33<08:45, 5.00batch/s, loss=1.507, lr=1.3e-05] epoch 7/8: 6%|▌ | 169/2797 [00:34<08:45, 5.00batch/s, loss=1.506, lr=1.3e-05] epoch 7/8: 6%|▋ | 180/2797 [00:35<08:29, 5.14batch/s, loss=1.506, lr=1.3e-05] epoch 7/8: 7%|▋ | 191/2797 [00:37<08:37, 5.03batch/s, loss=1.506, lr=1.3e-05] epoch 7/8: 7%|▋ | 191/2797 [00:39<08:37, 5.03batch/s, loss=1.513, lr=1.3e-05] epoch 7/8: 7%|▋ | 202/2797 [00:39<08:36, 5.03batch/s, loss=1.513, lr=1.3e-05] epoch 7/8: 8%|▊ | 213/2797 [00:41<08:45, 4.92batch/s, loss=1.513, lr=1.3e-05] epoch 7/8: 8%|▊ | 224/2797 [00:43<08:33, 5.01batch/s, loss=1.513, lr=1.3e-05] epoch 7/8: 8%|▊ | 224/2797 [00:44<08:33, 5.01batch/s, loss=1.514, lr=1.3e-05] epoch 7/8: 8%|▊ | 235/2797 [00:46<08:35, 4.97batch/s, loss=1.514, lr=1.3e-05] epoch 7/8: 9%|▉ | 245/2797 [00:48<08:35, 4.95batch/s, loss=1.514, lr=1.3e-05] epoch 7/8: 9%|▉ | 245/2797 [00:49<08:35, 4.95batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 9%|▉ | 256/2797 [00:50<08:33, 4.95batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 10%|▉ | 267/2797 [00:52<08:18, 5.08batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 10%|▉ | 267/2797 [00:54<08:18, 5.08batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 10%|▉ | 278/2797 [00:54<08:09, 5.14batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 10%|█ | 289/2797 [00:56<08:05, 5.17batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 11%|█ | 300/2797 [00:58<08:05, 5.14batch/s, loss=1.512, lr=1.3e-05] epoch 7/8: 11%|█ | 300/2797 [00:59<08:05, 5.14batch/s, loss=1.507, lr=1.2e-05] epoch 7/8: 11%|█ | 311/2797 [01:00<08:00, 5.18batch/s, loss=1.507, lr=1.2e-05] epoch 7/8: 12%|█▏ | 322/2797 [01:03<08:05, 5.10batch/s, loss=1.507, lr=1.2e-05] epoch 7/8: 12%|█▏ | 322/2797 [01:03<08:05, 5.10batch/s, loss=1.510, lr=1.2e-05] epoch 7/8: 12%|█▏ | 333/2797 [01:05<08:03, 5.09batch/s, loss=1.510, lr=1.2e-05] epoch 7/8: 12%|█▏ | 344/2797 [01:07<08:23, 4.88batch/s, loss=1.510, lr=1.2e-05] epoch 7/8: 12%|█▏ | 344/2797 [01:09<08:23, 4.88batch/s, loss=1.511, lr=1.2e-05] epoch 7/8: 13%|█▎ | 357/2797 [01:10<07:52, 5.16batch/s, loss=1.511, lr=1.2e-05] epoch 7/8: 13%|█▎ | 368/2797 [01:12<07:50, 5.16batch/s, loss=1.511, lr=1.2e-05] epoch 7/8: 13%|█▎ | 368/2797 [01:13<07:50, 5.16batch/s, loss=1.513, lr=1.2e-05] epoch 7/8: 14%|█▎ | 379/2797 [01:14<08:00, 5.04batch/s, loss=1.513, lr=1.2e-05] epoch 7/8: 14%|█▍ | 390/2797 [01:16<07:51, 5.10batch/s, loss=1.513, lr=1.2e-05] epoch 7/8: 14%|█▍ | 390/2797 [01:18<07:51, 5.10batch/s, loss=1.514, lr=1.2e-05] epoch 7/8: 14%|█▍ | 401/2797 [01:18<07:56, 5.03batch/s, loss=1.514, lr=1.2e-05] epoch 7/8: 15%|█▍ | 413/2797 [01:20<07:36, 5.22batch/s, loss=1.514, lr=1.2e-05] epoch 7/8: 15%|█▌ | 424/2797 [01:23<07:46, 5.08batch/s, loss=1.514, lr=1.2e-05] epoch 7/8: 15%|█▌ | 424/2797 [01:23<07:46, 5.08batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 16%|█▌ | 435/2797 [01:25<07:39, 5.14batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 16%|█▌ | 446/2797 [01:27<07:45, 5.05batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 16%|█▌ | 446/2797 [01:28<07:45, 5.05batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 16%|█▋ | 457/2797 [01:29<07:36, 5.13batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 17%|█▋ | 468/2797 [01:31<07:38, 5.08batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 17%|█▋ | 468/2797 [01:33<07:38, 5.08batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 17%|█▋ | 479/2797 [01:34<07:42, 5.01batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 18%|█▊ | 490/2797 [01:36<07:42, 4.99batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 18%|█▊ | 500/2797 [01:38<07:50, 4.88batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 18%|█▊ | 500/2797 [01:38<07:50, 4.88batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 18%|█▊ | 512/2797 [01:40<07:20, 5.19batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 19%|█▊ | 523/2797 [01:42<07:27, 5.08batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 19%|█▊ | 523/2797 [01:43<07:27, 5.08batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 19%|█▉ | 534/2797 [01:45<07:33, 4.99batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 19%|█▉ | 545/2797 [01:47<07:31, 4.99batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 19%|█▉ | 545/2797 [01:48<07:31, 4.99batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 20%|█▉ | 555/2797 [01:49<07:35, 4.92batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 20%|██ | 567/2797 [01:51<07:18, 5.08batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 20%|██ | 567/2797 [01:53<07:18, 5.08batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 21%|██ | 578/2797 [01:53<07:15, 5.10batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 21%|██ | 589/2797 [01:56<07:21, 5.00batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 21%|██▏ | 600/2797 [01:58<07:22, 4.97batch/s, loss=1.516, lr=1.2e-05] epoch 7/8: 21%|██▏ | 600/2797 [01:58<07:22, 4.97batch/s, loss=1.517, lr=1.2e-05] epoch 7/8: 22%|██▏ | 611/2797 [02:00<07:18, 4.99batch/s, loss=1.517, lr=1.2e-05] epoch 7/8: 22%|██▏ | 622/2797 [02:02<07:13, 5.02batch/s, loss=1.517, lr=1.2e-05] epoch 7/8: 22%|██▏ | 622/2797 [02:03<07:13, 5.02batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 23%|██▎ | 633/2797 [02:04<07:05, 5.09batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 23%|██▎ | 644/2797 [02:07<07:08, 5.03batch/s, loss=1.518, lr=1.2e-05] epoch 7/8: 23%|██▎ | 644/2797 [02:08<07:08, 5.03batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 23%|██▎ | 655/2797 [02:09<07:09, 4.98batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 24%|██▍ | 666/2797 [02:11<07:05, 5.01batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 24%|██▍ | 666/2797 [02:13<07:05, 5.01batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 24%|██▍ | 678/2797 [02:13<06:53, 5.12batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 25%|██▍ | 689/2797 [02:15<06:56, 5.06batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 25%|██▌ | 700/2797 [02:17<06:46, 5.16batch/s, loss=1.519, lr=1.2e-05] epoch 7/8: 25%|██▌ | 700/2797 [02:18<06:46, 5.16batch/s, loss=1.520, lr=1.2e-05] epoch 7/8: 25%|██▌ | 711/2797 [02:20<06:50, 5.09batch/s, loss=1.520, lr=1.2e-05] epoch 7/8: 26%|██▌ | 722/2797 [02:22<06:42, 5.16batch/s, loss=1.520, lr=1.2e-05] epoch 7/8: 26%|██▌ | 722/2797 [02:23<06:42, 5.16batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 26%|██▌ | 733/2797 [02:24<06:51, 5.02batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 27%|██▋ | 744/2797 [02:26<06:40, 5.13batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 27%|██▋ | 744/2797 [02:28<06:40, 5.13batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 27%|██▋ | 755/2797 [02:28<06:46, 5.02batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 27%|██▋ | 767/2797 [02:30<06:27, 5.23batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 27%|██▋ | 767/2797 [02:32<06:27, 5.23batch/s, loss=1.522, lr=1.1e-05] epoch 7/8: 28%|██▊ | 778/2797 [02:33<06:30, 5.17batch/s, loss=1.522, lr=1.1e-05] epoch 7/8: 28%|██▊ | 789/2797 [02:35<06:35, 5.07batch/s, loss=1.522, lr=1.1e-05] epoch 7/8: 28%|██▊ | 789/2797 [02:37<06:35, 5.07batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 29%|██▊ | 801/2797 [02:37<06:23, 5.21batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 29%|██▉ | 812/2797 [02:39<06:29, 5.10batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 29%|██▉ | 823/2797 [02:41<06:24, 5.14batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 29%|██▉ | 823/2797 [02:42<06:24, 5.14batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 30%|██▉ | 834/2797 [02:44<06:17, 5.19batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 30%|███ | 846/2797 [02:46<06:11, 5.26batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 30%|███ | 846/2797 [02:47<06:11, 5.26batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 31%|███ | 857/2797 [02:48<06:23, 5.06batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 31%|███ | 868/2797 [02:50<06:20, 5.07batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 31%|███ | 868/2797 [02:52<06:20, 5.07batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 31%|███▏ | 879/2797 [02:53<06:26, 4.96batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 32%|███▏ | 890/2797 [02:55<06:17, 5.05batch/s, loss=1.521, lr=1.1e-05] epoch 7/8: 32%|███▏ | 890/2797 [02:57<06:17, 5.05batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 32%|███▏ | 902/2797 [02:57<06:00, 5.26batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 33%|███▎ | 914/2797 [02:59<05:52, 5.34batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 33%|███▎ | 925/2797 [03:01<05:57, 5.23batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 33%|███▎ | 925/2797 [03:01<05:57, 5.23batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 33%|███▎ | 936/2797 [03:03<05:56, 5.22batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 34%|███▍ | 947/2797 [03:06<06:00, 5.13batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 34%|███▍ | 947/2797 [03:06<06:00, 5.13batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 34%|███▍ | 958/2797 [03:08<06:08, 4.99batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 35%|███▍ | 969/2797 [03:10<06:10, 4.93batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 35%|███▍ | 969/2797 [03:12<06:10, 4.93batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 35%|███▌ | 979/2797 [03:12<06:09, 4.92batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 35%|███▌ | 990/2797 [03:14<06:05, 4.95batch/s, loss=1.520, lr=1.1e-05] epoch 7/8: 35%|███▌ | 990/2797 [03:17<06:05, 4.95batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 36%|███▌ | 1001/2797 [03:17<05:59, 4.99batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 36%|███▌ | 1012/2797 [03:19<05:56, 5.01batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 37%|███▋ | 1023/2797 [03:21<05:56, 4.97batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 37%|███▋ | 1023/2797 [03:22<05:56, 4.97batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 37%|███▋ | 1034/2797 [03:23<05:51, 5.01batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 37%|███▋ | 1045/2797 [03:25<05:51, 4.99batch/s, loss=1.519, lr=1.1e-05] epoch 7/8: 37%|███▋ | 1045/2797 [03:27<05:51, 4.99batch/s, loss=1.518, lr=1.1e-05] epoch 7/8: 38%|███▊ | 1055/2797 [03:27<05:54, 4.92batch/s, loss=1.518, lr=1.1e-05] epoch 7/8: 38%|███▊ | 1065/2797 [03:29<05:51, 4.93batch/s, loss=1.518, lr=1.1e-05] epoch 7/8: 38%|███▊ | 1065/2797 [03:32<05:51, 4.93batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 38%|███▊ | 1076/2797 [03:32<05:39, 5.07batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 39%|███▉ | 1087/2797 [03:34<05:42, 5.00batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 39%|███▉ | 1098/2797 [03:36<05:39, 5.00batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 39%|███▉ | 1098/2797 [03:37<05:39, 5.00batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 40%|███▉ | 1109/2797 [03:38<05:33, 5.06batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 40%|████ | 1120/2797 [03:40<05:24, 5.17batch/s, loss=1.517, lr=1.1e-05] epoch 7/8: 40%|████ | 1120/2797 [03:41<05:24, 5.17batch/s, loss=1.516, lr=1.1e-05] epoch 7/8: 40%|████ | 1131/2797 [03:42<05:22, 5.17batch/s, loss=1.516, lr=1.1e-05] epoch 7/8: 41%|████ | 1142/2797 [03:45<05:30, 5.01batch/s, loss=1.516, lr=1.1e-05] epoch 7/8: 41%|████ | 1142/2797 [03:46<05:30, 5.01batch/s, loss=1.517, lr=1.0e-05] epoch 7/8: 41%|████ | 1153/2797 [03:47<05:31, 4.96batch/s, loss=1.517, lr=1.0e-05] epoch 7/8: 42%|████▏ | 1163/2797 [03:49<05:31, 4.93batch/s, loss=1.517, lr=1.0e-05] epoch 7/8: 42%|████▏ | 1174/2797 [03:51<05:22, 5.04batch/s, loss=1.517, lr=1.0e-05] epoch 7/8: 42%|████▏ | 1174/2797 [03:51<05:22, 5.04batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 42%|████▏ | 1185/2797 [03:53<05:16, 5.09batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 43%|████▎ | 1196/2797 [03:55<05:12, 5.13batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 43%|████▎ | 1196/2797 [03:56<05:12, 5.13batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 43%|████▎ | 1208/2797 [03:57<05:00, 5.28batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 44%|████▎ | 1219/2797 [04:00<05:04, 5.18batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 44%|████▎ | 1219/2797 [04:01<05:04, 5.18batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 44%|████▍ | 1230/2797 [04:02<05:07, 5.09batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 44%|████▍ | 1241/2797 [04:04<05:03, 5.12batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 44%|████▍ | 1241/2797 [04:06<05:03, 5.12batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 45%|████▍ | 1252/2797 [04:06<04:56, 5.21batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 45%|████▌ | 1263/2797 [04:08<05:02, 5.07batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 46%|████▌ | 1274/2797 [04:10<04:57, 5.12batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 46%|████▌ | 1274/2797 [04:11<04:57, 5.12batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 46%|████▌ | 1285/2797 [04:13<05:05, 4.95batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 46%|████▋ | 1297/2797 [04:15<04:49, 5.18batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 46%|████▋ | 1297/2797 [04:16<04:49, 5.18batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 47%|████▋ | 1308/2797 [04:17<04:51, 5.11batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 47%|████▋ | 1320/2797 [04:19<04:39, 5.28batch/s, loss=1.515, lr=1.0e-05] epoch 7/8: 47%|████▋ | 1320/2797 [04:20<04:39, 5.28batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 48%|████▊ | 1331/2797 [04:21<04:44, 5.15batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 48%|████▊ | 1342/2797 [04:24<04:47, 5.07batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 48%|████▊ | 1342/2797 [04:25<04:47, 5.07batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 48%|████▊ | 1353/2797 [04:26<04:45, 5.05batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 49%|████▉ | 1364/2797 [04:28<04:44, 5.03batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 49%|████▉ | 1375/2797 [04:31<04:53, 4.85batch/s, loss=1.516, lr=1.0e-05] epoch 7/8: 49%|████▉ | 1375/2797 [04:31<04:53, 4.85batch/s, loss=1.517, lr=9.9e-06] epoch 7/8: 50%|████▉ | 1386/2797 [04:33<04:45, 4.94batch/s, loss=1.517, lr=9.9e-06] epoch 7/8: 50%|████▉ | 1397/2797 [04:35<04:38, 5.02batch/s, loss=1.517, lr=9.9e-06] epoch 7/8: 50%|████▉ | 1397/2797 [04:36<04:38, 5.02batch/s, loss=1.518, lr=9.9e-06] epoch 7/8: 50%|█████ | 1408/2797 [04:37<04:29, 5.15batch/s, loss=1.518, lr=9.9e-06] epoch 7/8: 51%|█████ | 1419/2797 [04:39<04:26, 5.18batch/s, loss=1.518, lr=9.9e-06] epoch 7/8: 51%|█████ | 1419/2797 [04:40<04:26, 5.18batch/s, loss=1.518, lr=9.8e-06] epoch 7/8: 51%|█████ | 1430/2797 [04:41<04:27, 5.11batch/s, loss=1.518, lr=9.8e-06] epoch 7/8: 52%|█████▏ | 1441/2797 [04:43<04:26, 5.08batch/s, loss=1.518, lr=9.8e-06] epoch 7/8: 52%|█████▏ | 1441/2797 [04:45<04:26, 5.08batch/s, loss=1.517, lr=9.7e-06] epoch 7/8: 52%|█████▏ | 1452/2797 [04:45<04:21, 5.14batch/s, loss=1.517, lr=9.7e-06] epoch 7/8: 52%|█████▏ | 1463/2797 [04:48<04:25, 5.03batch/s, loss=1.517, lr=9.7e-06] epoch 7/8: 53%|█████▎ | 1474/2797 [04:50<04:18, 5.12batch/s, loss=1.517, lr=9.7e-06] epoch 7/8: 53%|█████▎ | 1474/2797 [04:50<04:18, 5.12batch/s, loss=1.518, lr=9.7e-06] epoch 7/8: 53%|█████▎ | 1486/2797 [04:52<04:09, 5.26batch/s, loss=1.518, lr=9.7e-06] epoch 7/8: 54%|█████▎ | 1497/2797 [04:54<04:09, 5.21batch/s, loss=1.518, lr=9.7e-06] epoch 7/8: 54%|█████▎ | 1497/2797 [04:55<04:09, 5.21batch/s, loss=1.517, lr=9.6e-06] epoch 7/8: 54%|█████▍ | 1509/2797 [04:56<04:04, 5.27batch/s, loss=1.517, lr=9.6e-06] epoch 7/8: 54%|█████▍ | 1520/2797 [04:58<04:01, 5.30batch/s, loss=1.517, lr=9.6e-06] epoch 7/8: 54%|█████▍ | 1520/2797 [04:59<04:01, 5.30batch/s, loss=1.517, lr=9.6e-06] epoch 7/8: 55%|█████▍ | 1532/2797 [05:00<03:51, 5.46batch/s, loss=1.517, lr=9.6e-06] epoch 7/8: 55%|█████▌ | 1543/2797 [05:03<03:54, 5.34batch/s, loss=1.517, lr=9.6e-06] epoch 7/8: 55%|█████▌ | 1543/2797 [05:04<03:54, 5.34batch/s, loss=1.518, lr=9.5e-06] epoch 7/8: 56%|█████▌ | 1556/2797 [05:05<03:40, 5.63batch/s, loss=1.518, lr=9.5e-06] epoch 7/8: 56%|█████▌ | 1568/2797 [05:07<03:51, 5.30batch/s, loss=1.518, lr=9.5e-06] epoch 7/8: 56%|█████▌ | 1568/2797 [05:09<03:51, 5.30batch/s, loss=1.518, lr=9.5e-06] epoch 7/8: 56%|█████▋ | 1579/2797 [05:09<03:50, 5.28batch/s, loss=1.518, lr=9.5e-06] epoch 7/8: 57%|█████▋ | 1590/2797 [05:11<03:47, 5.31batch/s, loss=1.518, lr=9.5e-06] epoch 7/8: 57%|█████▋ | 1590/2797 [05:14<03:47, 5.31batch/s, loss=1.518, lr=9.4e-06] epoch 7/8: 57%|█████▋ | 1601/2797 [05:14<03:51, 5.18batch/s, loss=1.518, lr=9.4e-06] epoch 7/8: 58%|█████▊ | 1612/2797 [05:16<03:48, 5.20batch/s, loss=1.518, lr=9.4e-06] epoch 7/8: 58%|█████▊ | 1623/2797 [05:18<03:43, 5.26batch/s, loss=1.518, lr=9.4e-06] epoch 7/8: 58%|█████▊ | 1623/2797 [05:18<03:43, 5.26batch/s, loss=1.518, lr=9.3e-06] epoch 7/8: 58%|█████▊ | 1634/2797 [05:20<03:42, 5.23batch/s, loss=1.518, lr=9.3e-06] epoch 7/8: 59%|█████▉ | 1645/2797 [05:22<03:43, 5.16batch/s, loss=1.518, lr=9.3e-06] epoch 7/8: 59%|█████▉ | 1645/2797 [05:23<03:43, 5.16batch/s, loss=1.517, lr=9.3e-06] epoch 7/8: 59%|█████▉ | 1656/2797 [05:24<03:42, 5.12batch/s, loss=1.517, lr=9.3e-06] epoch 7/8: 60%|█████▉ | 1667/2797 [05:27<03:46, 4.98batch/s, loss=1.517, lr=9.3e-06] epoch 7/8: 60%|█████▉ | 1667/2797 [05:28<03:46, 4.98batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 60%|█████▉ | 1678/2797 [05:29<03:43, 5.01batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 60%|██████ | 1689/2797 [05:31<03:49, 4.82batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 61%|██████ | 1699/2797 [05:33<03:47, 4.82batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 61%|██████ | 1699/2797 [05:34<03:47, 4.82batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 61%|██████ | 1709/2797 [05:35<03:46, 4.81batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 61%|██████▏ | 1720/2797 [05:37<03:36, 4.97batch/s, loss=1.517, lr=9.2e-06] epoch 7/8: 61%|██████▏ | 1720/2797 [05:39<03:36, 4.97batch/s, loss=1.517, lr=9.1e-06] epoch 7/8: 62%|██████▏ | 1731/2797 [05:40<03:34, 4.98batch/s, loss=1.517, lr=9.1e-06] epoch 7/8: 62%|██████▏ | 1741/2797 [05:42<03:31, 4.98batch/s, loss=1.517, lr=9.1e-06] epoch 7/8: 62%|██████▏ | 1741/2797 [05:44<03:31, 4.98batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 63%|██████▎ | 1751/2797 [05:44<03:31, 4.94batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 63%|██████▎ | 1761/2797 [05:46<03:30, 4.92batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 63%|██████▎ | 1772/2797 [05:48<03:21, 5.08batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 63%|██████▎ | 1772/2797 [05:48<03:21, 5.08batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 64%|██████▍ | 1784/2797 [05:50<03:12, 5.26batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 64%|██████▍ | 1795/2797 [05:52<03:15, 5.14batch/s, loss=1.517, lr=9.0e-06] epoch 7/8: 64%|██████▍ | 1795/2797 [05:53<03:15, 5.14batch/s, loss=1.517, lr=8.9e-06] epoch 7/8: 65%|██████▍ | 1806/2797 [05:54<03:11, 5.17batch/s, loss=1.517, lr=8.9e-06] epoch 7/8: 65%|██████▍ | 1817/2797 [05:56<03:07, 5.24batch/s, loss=1.517, lr=8.9e-06] epoch 7/8: 65%|██████▍ | 1817/2797 [05:58<03:07, 5.24batch/s, loss=1.516, lr=8.9e-06] epoch 7/8: 65%|██████▌ | 1829/2797 [05:58<03:02, 5.31batch/s, loss=1.516, lr=8.9e-06] epoch 7/8: 66%|██████▌ | 1840/2797 [06:01<03:08, 5.08batch/s, loss=1.516, lr=8.9e-06] epoch 7/8: 66%|██████▌ | 1840/2797 [06:03<03:08, 5.08batch/s, loss=1.516, lr=8.8e-06] epoch 7/8: 66%|██████▌ | 1851/2797 [06:03<03:09, 5.00batch/s, loss=1.516, lr=8.8e-06] epoch 7/8: 67%|██████▋ | 1862/2797 [06:05<03:02, 5.11batch/s, loss=1.516, lr=8.8e-06] epoch 7/8: 67%|██████▋ | 1873/2797 [06:07<02:57, 5.22batch/s, loss=1.516, lr=8.8e-06] epoch 7/8: 67%|██████▋ | 1873/2797 [06:08<02:57, 5.22batch/s, loss=1.517, lr=8.7e-06] epoch 7/8: 67%|██████▋ | 1884/2797 [06:09<02:54, 5.24batch/s, loss=1.517, lr=8.7e-06] epoch 7/8: 68%|██████▊ | 1896/2797 [06:11<02:48, 5.33batch/s, loss=1.517, lr=8.7e-06] epoch 7/8: 68%|██████▊ | 1896/2797 [06:12<02:48, 5.33batch/s, loss=1.516, lr=8.7e-06] epoch 7/8: 68%|██████▊ | 1907/2797 [06:13<02:46, 5.35batch/s, loss=1.516, lr=8.7e-06] epoch 7/8: 69%|██████▊ | 1918/2797 [06:16<02:48, 5.23batch/s, loss=1.516, lr=8.7e-06] epoch 7/8: 69%|██████▊ | 1918/2797 [06:17<02:48, 5.23batch/s, loss=1.516, lr=8.6e-06] epoch 7/8: 69%|██████▉ | 1929/2797 [06:18<02:47, 5.19batch/s, loss=1.516, lr=8.6e-06] epoch 7/8: 69%|██████▉ | 1940/2797 [06:20<02:48, 5.07batch/s, loss=1.516, lr=8.6e-06] epoch 7/8: 69%|██████▉ | 1940/2797 [06:22<02:48, 5.07batch/s, loss=1.517, lr=8.6e-06] epoch 7/8: 70%|██████▉ | 1951/2797 [06:22<02:44, 5.14batch/s, loss=1.517, lr=8.6e-06] epoch 7/8: 70%|███████ | 1963/2797 [06:24<02:39, 5.22batch/s, loss=1.517, lr=8.6e-06] epoch 7/8: 71%|███████ | 1974/2797 [06:27<02:37, 5.22batch/s, loss=1.517, lr=8.6e-06] epoch 7/8: 71%|███████ | 1974/2797 [06:27<02:37, 5.22batch/s, loss=1.516, lr=8.5e-06] epoch 7/8: 71%|███████ | 1985/2797 [06:29<02:35, 5.22batch/s, loss=1.516, lr=8.5e-06] epoch 7/8: 71%|███████▏ | 1996/2797 [06:31<02:36, 5.11batch/s, loss=1.516, lr=8.5e-06] epoch 7/8: 71%|███████▏ | 1996/2797 [06:32<02:36, 5.11batch/s, loss=1.516, lr=8.5e-06] epoch 7/8: 72%|███████▏ | 2007/2797 [06:33<02:36, 5.06batch/s, loss=1.516, lr=8.5e-06] epoch 7/8: 72%|███████▏ | 2018/2797 [06:35<02:33, 5.09batch/s, loss=1.516, lr=8.5e-06] epoch 7/8: 72%|███████▏ | 2018/2797 [06:37<02:33, 5.09batch/s, loss=1.516, lr=8.4e-06] epoch 7/8: 73%|███████▎ | 2029/2797 [06:37<02:31, 5.05batch/s, loss=1.516, lr=8.4e-06] epoch 7/8: 73%|███████▎ | 2040/2797 [06:40<02:30, 5.04batch/s, loss=1.516, lr=8.4e-06] epoch 7/8: 73%|███████▎ | 2040/2797 [06:42<02:30, 5.04batch/s, loss=1.516, lr=8.3e-06] epoch 7/8: 73%|███████▎ | 2051/2797 [06:42<02:25, 5.14batch/s, loss=1.516, lr=8.3e-06] epoch 7/8: 74%|███████▍ | 2063/2797 [06:44<02:18, 5.29batch/s, loss=1.516, lr=8.3e-06] epoch 7/8: 74%|███████▍ | 2074/2797 [06:46<02:18, 5.23batch/s, loss=1.516, lr=8.3e-06] epoch 7/8: 74%|███████▍ | 2074/2797 [06:46<02:18, 5.23batch/s, loss=1.517, lr=8.3e-06] epoch 7/8: 75%|███████▍ | 2085/2797 [06:48<02:23, 4.97batch/s, loss=1.517, lr=8.3e-06] epoch 7/8: 75%|███████▍ | 2095/2797 [06:50<02:21, 4.97batch/s, loss=1.517, lr=8.3e-06] epoch 7/8: 75%|███████▍ | 2095/2797 [06:52<02:21, 4.97batch/s, loss=1.517, lr=8.2e-06] epoch 7/8: 75%|███████▌ | 2106/2797 [06:53<02:16, 5.07batch/s, loss=1.517, lr=8.2e-06] epoch 7/8: 76%|███████▌ | 2117/2797 [06:55<02:13, 5.09batch/s, loss=1.517, lr=8.2e-06] epoch 7/8: 76%|███████▌ | 2117/2797 [06:57<02:13, 5.09batch/s, loss=1.516, lr=8.2e-06] epoch 7/8: 76%|███████▌ | 2128/2797 [06:57<02:11, 5.10batch/s, loss=1.516, lr=8.2e-06] epoch 7/8: 76%|███████▋ | 2139/2797 [06:59<02:09, 5.07batch/s, loss=1.516, lr=8.2e-06] epoch 7/8: 77%|███████▋ | 2150/2797 [07:01<02:05, 5.14batch/s, loss=1.516, lr=8.2e-06] epoch 7/8: 77%|███████▋ | 2150/2797 [07:01<02:05, 5.14batch/s, loss=1.516, lr=8.1e-06] epoch 7/8: 77%|███████▋ | 2161/2797 [07:03<02:06, 5.05batch/s, loss=1.516, lr=8.1e-06] epoch 7/8: 78%|███████▊ | 2172/2797 [07:05<02:02, 5.10batch/s, loss=1.516, lr=8.1e-06] epoch 7/8: 78%|███████▊ | 2172/2797 [07:06<02:02, 5.10batch/s, loss=1.516, lr=8.0e-06] epoch 7/8: 78%|███████▊ | 2183/2797 [07:08<01:58, 5.18batch/s, loss=1.516, lr=8.0e-06] epoch 7/8: 78%|███████▊ | 2194/2797 [07:10<01:56, 5.19batch/s, loss=1.516, lr=8.0e-06] epoch 7/8: 78%|███████▊ | 2194/2797 [07:11<01:56, 5.19batch/s, loss=1.517, lr=8.0e-06] epoch 7/8: 79%|███████▉ | 2205/2797 [07:12<01:56, 5.07batch/s, loss=1.517, lr=8.0e-06] epoch 7/8: 79%|███████▉ | 2217/2797 [07:14<01:51, 5.20batch/s, loss=1.517, lr=8.0e-06] epoch 7/8: 79%|███████▉ | 2217/2797 [07:16<01:51, 5.20batch/s, loss=1.516, lr=7.9e-06] epoch 7/8: 80%|███████▉ | 2228/2797 [07:16<01:52, 5.07batch/s, loss=1.516, lr=7.9e-06] epoch 7/8: 80%|████████ | 2239/2797 [07:19<01:50, 5.06batch/s, loss=1.516, lr=7.9e-06] epoch 7/8: 80%|████████ | 2250/2797 [07:21<01:49, 5.00batch/s, loss=1.516, lr=7.9e-06] epoch 7/8: 80%|████████ | 2250/2797 [07:21<01:49, 5.00batch/s, loss=1.517, lr=7.9e-06] epoch 7/8: 81%|████████ | 2262/2797 [07:23<01:41, 5.25batch/s, loss=1.517, lr=7.9e-06] epoch 7/8: 81%|████████▏ | 2273/2797 [07:25<01:42, 5.10batch/s, loss=1.517, lr=7.9e-06] epoch 7/8: 81%|████████▏ | 2273/2797 [07:26<01:42, 5.10batch/s, loss=1.517, lr=7.8e-06] epoch 7/8: 82%|████████▏ | 2284/2797 [07:27<01:41, 5.05batch/s, loss=1.517, lr=7.8e-06] epoch 7/8: 82%|████████▏ | 2295/2797 [07:30<01:38, 5.11batch/s, loss=1.517, lr=7.8e-06] epoch 7/8: 82%|████████▏ | 2295/2797 [07:31<01:38, 5.11batch/s, loss=1.517, lr=7.7e-06] epoch 7/8: 82%|████████▏ | 2306/2797 [07:32<01:34, 5.19batch/s, loss=1.517, lr=7.7e-06] epoch 7/8: 83%|████████▎ | 2317/2797 [07:34<01:31, 5.24batch/s, loss=1.517, lr=7.7e-06] epoch 7/8: 83%|████████▎ | 2317/2797 [07:35<01:31, 5.24batch/s, loss=1.517, lr=7.7e-06] epoch 7/8: 83%|████████▎ | 2329/2797 [07:36<01:28, 5.31batch/s, loss=1.517, lr=7.7e-06] epoch 7/8: 84%|████████▎ | 2340/2797 [07:38<01:27, 5.23batch/s, loss=1.517, lr=7.7e-06] epoch 7/8: 84%|████████▎ | 2340/2797 [07:40<01:27, 5.23batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 84%|████████▍ | 2351/2797 [07:40<01:27, 5.11batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 84%|████████▍ | 2362/2797 [07:43<01:27, 4.97batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 85%|████████▍ | 2373/2797 [07:45<01:24, 5.04batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 85%|████████▍ | 2373/2797 [07:45<01:24, 5.04batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 85%|████████▌ | 2384/2797 [07:47<01:21, 5.04batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 86%|████████▌ | 2396/2797 [07:49<01:16, 5.21batch/s, loss=1.517, lr=7.6e-06] epoch 7/8: 86%|████████▌ | 2396/2797 [07:50<01:16, 5.21batch/s, loss=1.517, lr=7.5e-06] epoch 7/8: 86%|████████▌ | 2407/2797 [07:51<01:15, 5.16batch/s, loss=1.517, lr=7.5e-06] epoch 7/8: 86%|████████▋ | 2418/2797 [07:53<01:14, 5.09batch/s, loss=1.517, lr=7.5e-06] epoch 7/8: 86%|████████▋ | 2418/2797 [07:55<01:14, 5.09batch/s, loss=1.517, lr=7.5e-06] epoch 7/8: 87%|████████▋ | 2429/2797 [07:56<01:12, 5.09batch/s, loss=1.517, lr=7.5e-06] epoch 7/8: 87%|████████▋ | 2441/2797 [07:58<01:07, 5.24batch/s, loss=1.517, lr=7.5e-06] epoch 7/8: 87%|████████▋ | 2441/2797 [08:00<01:07, 5.24batch/s, loss=1.517, lr=7.4e-06] epoch 7/8: 88%|████████▊ | 2452/2797 [08:00<01:06, 5.18batch/s, loss=1.517, lr=7.4e-06] epoch 7/8: 88%|████████▊ | 2463/2797 [08:02<01:04, 5.17batch/s, loss=1.517, lr=7.4e-06] epoch 7/8: 88%|████████▊ | 2474/2797 [08:04<01:02, 5.19batch/s, loss=1.517, lr=7.4e-06] epoch 7/8: 88%|████████▊ | 2474/2797 [08:05<01:02, 5.19batch/s, loss=1.517, lr=7.3e-06] epoch 7/8: 89%|████████▉ | 2485/2797 [08:06<00:59, 5.22batch/s, loss=1.517, lr=7.3e-06] epoch 7/8: 89%|████████▉ | 2496/2797 [08:09<00:59, 5.09batch/s, loss=1.517, lr=7.3e-06] epoch 7/8: 89%|████████▉ | 2496/2797 [08:09<00:59, 5.09batch/s, loss=1.517, lr=7.3e-06] epoch 7/8: 90%|████████▉ | 2507/2797 [08:11<00:56, 5.09batch/s, loss=1.517, lr=7.3e-06] epoch 7/8: 90%|█████████ | 2518/2797 [08:13<00:56, 4.93batch/s, loss=1.517, lr=7.3e-06] epoch 7/8: 90%|█████████ | 2518/2797 [08:15<00:56, 4.93batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 90%|█████████ | 2528/2797 [08:15<00:56, 4.75batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 91%|█████████ | 2539/2797 [08:18<00:53, 4.87batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 91%|█████████ | 2549/2797 [08:20<00:50, 4.89batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 91%|█████████ | 2549/2797 [08:20<00:50, 4.89batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 92%|█████████▏| 2560/2797 [08:22<00:48, 4.92batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 92%|█████████▏| 2570/2797 [08:24<00:46, 4.88batch/s, loss=1.517, lr=7.2e-06] epoch 7/8: 92%|█████████▏| 2570/2797 [08:25<00:46, 4.88batch/s, loss=1.517, lr=7.1e-06] epoch 7/8: 92%|█████████▏| 2580/2797 [08:26<00:44, 4.86batch/s, loss=1.517, lr=7.1e-06] epoch 7/8: 93%|█████████▎| 2591/2797 [08:28<00:41, 5.01batch/s, loss=1.517, lr=7.1e-06] epoch 7/8: 93%|█████████▎| 2591/2797 [08:30<00:41, 5.01batch/s, loss=1.518, lr=7.0e-06] epoch 7/8: 93%|█████████▎| 2602/2797 [08:30<00:38, 5.09batch/s, loss=1.518, lr=7.0e-06] epoch 7/8: 93%|█████████▎| 2613/2797 [08:32<00:36, 5.01batch/s, loss=1.518, lr=7.0e-06] epoch 7/8: 94%|█████████▍| 2624/2797 [08:35<00:35, 4.89batch/s, loss=1.518, lr=7.0e-06] epoch 7/8: 94%|█████████▍| 2624/2797 [08:35<00:35, 4.89batch/s, loss=1.517, lr=7.0e-06] epoch 7/8: 94%|█████████▍| 2634/2797 [08:37<00:33, 4.90batch/s, loss=1.517, lr=7.0e-06] epoch 7/8: 95%|█████████▍| 2645/2797 [08:39<00:30, 5.05batch/s, loss=1.517, lr=7.0e-06] epoch 7/8: 95%|█████████▍| 2645/2797 [08:40<00:30, 5.05batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 95%|█████████▍| 2656/2797 [08:41<00:27, 5.15batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 95%|█████████▌| 2667/2797 [08:43<00:24, 5.22batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 95%|█████████▌| 2667/2797 [08:45<00:24, 5.22batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 96%|█████████▌| 2678/2797 [08:45<00:23, 5.05batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 96%|█████████▌| 2689/2797 [08:48<00:22, 4.89batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 96%|█████████▋| 2699/2797 [08:50<00:20, 4.89batch/s, loss=1.517, lr=6.9e-06] epoch 7/8: 96%|█████████▋| 2699/2797 [08:50<00:20, 4.89batch/s, loss=1.517, lr=6.8e-06] epoch 7/8: 97%|█████████▋| 2711/2797 [08:52<00:16, 5.13batch/s, loss=1.517, lr=6.8e-06] epoch 7/8: 97%|█████████▋| 2722/2797 [08:54<00:14, 5.21batch/s, loss=1.517, lr=6.8e-06] epoch 7/8: 97%|█████████▋| 2722/2797 [08:55<00:14, 5.21batch/s, loss=1.517, lr=6.7e-06] epoch 7/8: 98%|█████████▊| 2733/2797 [08:56<00:12, 5.17batch/s, loss=1.517, lr=6.7e-06] epoch 7/8: 98%|█████████▊| 2744/2797 [08:58<00:10, 5.05batch/s, loss=1.517, lr=6.7e-06] epoch 7/8: 98%|█████████▊| 2744/2797 [09:00<00:10, 5.05batch/s, loss=1.516, lr=6.7e-06] epoch 7/8: 98%|█████████▊| 2755/2797 [09:00<00:08, 5.03batch/s, loss=1.516, lr=6.7e-06] epoch 7/8: 99%|█████████▉| 2766/2797 [09:02<00:06, 5.13batch/s, loss=1.516, lr=6.7e-06] epoch 7/8: 99%|█████████▉| 2766/2797 [09:05<00:06, 5.13batch/s, loss=1.516, lr=6.6e-06] epoch 7/8: 99%|█████████▉| 2777/2797 [09:05<00:03, 5.02batch/s, loss=1.516, lr=6.6e-06] epoch 7/8: 100%|█████████▉| 2788/2797 [09:07<00:01, 5.08batch/s, loss=1.516, lr=6.6e-06] epoch 7/8: 100%|██████████| 2797/2797 [09:09<00:00, 5.09batch/s, loss=1.516, lr=6.6e-06]
epoch 7: train loss 1.516 · validation loss 2.075 · broad 81.7% (top-3 95.3%) · path 72.9% (top-3 89.6%, plausible or look-alike 88.5%) · 4131s elapsed
epoch 8/8: 0%| | 0/2797 [00:00<?, ?batch/s] epoch 8/8: 0%| | 0/2797 [00:00<?, ?batch/s, loss=1.658, lr=6.6e-06] epoch 8/8: 0%| | 11/2797 [00:02<09:00, 5.16batch/s, loss=1.658, lr=6.6e-06] epoch 8/8: 1%| | 22/2797 [00:04<09:19, 4.96batch/s, loss=1.658, lr=6.6e-06] epoch 8/8: 1%| | 22/2797 [00:05<09:19, 4.96batch/s, loss=1.411, lr=6.5e-06] epoch 8/8: 1%| | 33/2797 [00:06<09:17, 4.96batch/s, loss=1.411, lr=6.5e-06] epoch 8/8: 2%|▏ | 44/2797 [00:08<09:07, 5.02batch/s, loss=1.411, lr=6.5e-06] epoch 8/8: 2%|▏ | 44/2797 [00:10<09:07, 5.02batch/s, loss=1.422, lr=6.5e-06] epoch 8/8: 2%|▏ | 55/2797 [00:10<08:54, 5.13batch/s, loss=1.422, lr=6.5e-06] epoch 8/8: 2%|▏ | 66/2797 [00:12<08:53, 5.12batch/s, loss=1.422, lr=6.5e-06] epoch 8/8: 2%|▏ | 66/2797 [00:14<08:53, 5.12batch/s, loss=1.437, lr=6.4e-06] epoch 8/8: 3%|▎ | 77/2797 [00:15<08:49, 5.14batch/s, loss=1.437, lr=6.4e-06] epoch 8/8: 3%|▎ | 88/2797 [00:17<08:59, 5.02batch/s, loss=1.437, lr=6.4e-06] epoch 8/8: 4%|▎ | 99/2797 [00:19<09:00, 4.99batch/s, loss=1.437, lr=6.4e-06] epoch 8/8: 4%|▎ | 99/2797 [00:20<09:00, 4.99batch/s, loss=1.438, lr=6.3e-06] epoch 8/8: 4%|▍ | 109/2797 [00:21<09:04, 4.94batch/s, loss=1.438, lr=6.3e-06] epoch 8/8: 4%|▍ | 120/2797 [00:23<08:48, 5.07batch/s, loss=1.438, lr=6.3e-06] epoch 8/8: 4%|▍ | 120/2797 [00:24<08:48, 5.07batch/s, loss=1.441, lr=6.3e-06] epoch 8/8: 5%|▍ | 131/2797 [00:25<08:36, 5.16batch/s, loss=1.441, lr=6.3e-06] epoch 8/8: 5%|▌ | 142/2797 [00:27<08:30, 5.20batch/s, loss=1.441, lr=6.3e-06] epoch 8/8: 5%|▌ | 142/2797 [00:29<08:30, 5.20batch/s, loss=1.449, lr=6.2e-06] epoch 8/8: 5%|▌ | 153/2797 [00:30<08:35, 5.13batch/s, loss=1.449, lr=6.2e-06] epoch 8/8: 6%|▌ | 164/2797 [00:32<08:40, 5.06batch/s, loss=1.449, lr=6.2e-06] epoch 8/8: 6%|▋ | 175/2797 [00:34<08:35, 5.09batch/s, loss=1.449, lr=6.2e-06] epoch 8/8: 6%|▋ | 175/2797 [00:34<08:35, 5.09batch/s, loss=1.457, lr=6.2e-06] epoch 8/8: 7%|▋ | 186/2797 [00:36<08:29, 5.12batch/s, loss=1.457, lr=6.2e-06] epoch 8/8: 7%|▋ | 197/2797 [00:38<08:18, 5.22batch/s, loss=1.457, lr=6.2e-06] epoch 8/8: 7%|▋ | 197/2797 [00:39<08:18, 5.22batch/s, loss=1.463, lr=6.1e-06] epoch 8/8: 7%|▋ | 208/2797 [00:40<08:29, 5.08batch/s, loss=1.463, lr=6.1e-06] epoch 8/8: 8%|▊ | 219/2797 [00:43<08:27, 5.08batch/s, loss=1.463, lr=6.1e-06] epoch 8/8: 8%|▊ | 219/2797 [00:44<08:27, 5.08batch/s, loss=1.462, lr=6.0e-06] epoch 8/8: 8%|▊ | 230/2797 [00:45<08:20, 5.13batch/s, loss=1.462, lr=6.0e-06] epoch 8/8: 9%|▊ | 241/2797 [00:47<08:08, 5.23batch/s, loss=1.462, lr=6.0e-06] epoch 8/8: 9%|▊ | 241/2797 [00:49<08:08, 5.23batch/s, loss=1.463, lr=6.0e-06] epoch 8/8: 9%|▉ | 252/2797 [00:49<08:10, 5.19batch/s, loss=1.463, lr=6.0e-06] epoch 8/8: 9%|▉ | 263/2797 [00:51<08:18, 5.09batch/s, loss=1.463, lr=6.0e-06] epoch 8/8: 10%|▉ | 274/2797 [00:53<08:24, 5.01batch/s, loss=1.463, lr=6.0e-06] epoch 8/8: 10%|▉ | 274/2797 [00:54<08:24, 5.01batch/s, loss=1.469, lr=5.9e-06] epoch 8/8: 10%|█ | 285/2797 [00:56<08:26, 4.96batch/s, loss=1.469, lr=5.9e-06] epoch 8/8: 11%|█ | 296/2797 [00:58<08:20, 4.99batch/s, loss=1.469, lr=5.9e-06] epoch 8/8: 11%|█ | 296/2797 [00:59<08:20, 4.99batch/s, loss=1.472, lr=5.9e-06] epoch 8/8: 11%|█ | 307/2797 [01:00<08:24, 4.94batch/s, loss=1.472, lr=5.9e-06] epoch 8/8: 11%|█▏ | 317/2797 [01:02<08:28, 4.88batch/s, loss=1.472, lr=5.9e-06] epoch 8/8: 11%|█▏ | 317/2797 [01:04<08:28, 4.88batch/s, loss=1.473, lr=5.8e-06] epoch 8/8: 12%|█▏ | 328/2797 [01:04<08:12, 5.01batch/s, loss=1.473, lr=5.8e-06] epoch 8/8: 12%|█▏ | 340/2797 [01:06<07:45, 5.28batch/s, loss=1.473, lr=5.8e-06] epoch 8/8: 12%|█▏ | 340/2797 [01:08<07:45, 5.28batch/s, loss=1.471, lr=5.8e-06] epoch 8/8: 13%|█▎ | 352/2797 [01:08<07:38, 5.34batch/s, loss=1.471, lr=5.8e-06] epoch 8/8: 13%|█▎ | 363/2797 [01:11<07:59, 5.08batch/s, loss=1.471, lr=5.8e-06] epoch 8/8: 13%|█▎ | 374/2797 [01:13<08:07, 4.97batch/s, loss=1.471, lr=5.8e-06] epoch 8/8: 13%|█▎ | 374/2797 [01:14<08:07, 4.97batch/s, loss=1.475, lr=5.7e-06] epoch 8/8: 14%|█▎ | 384/2797 [01:15<08:14, 4.88batch/s, loss=1.475, lr=5.7e-06] epoch 8/8: 14%|█▍ | 395/2797 [01:18<08:09, 4.91batch/s, loss=1.475, lr=5.7e-06] epoch 8/8: 14%|█▍ | 395/2797 [01:19<08:09, 4.91batch/s, loss=1.473, lr=5.6e-06] epoch 8/8: 15%|█▍ | 406/2797 [01:20<07:59, 4.99batch/s, loss=1.473, lr=5.6e-06] epoch 8/8: 15%|█▍ | 417/2797 [01:22<07:45, 5.11batch/s, loss=1.473, lr=5.6e-06] epoch 8/8: 15%|█▍ | 417/2797 [01:23<07:45, 5.11batch/s, loss=1.472, lr=5.6e-06] epoch 8/8: 15%|█▌ | 428/2797 [01:24<07:44, 5.10batch/s, loss=1.472, lr=5.6e-06] epoch 8/8: 16%|█▌ | 439/2797 [01:26<08:05, 4.86batch/s, loss=1.472, lr=5.6e-06] epoch 8/8: 16%|█▌ | 450/2797 [01:28<07:46, 5.03batch/s, loss=1.472, lr=5.6e-06] epoch 8/8: 16%|█▌ | 450/2797 [01:29<07:46, 5.03batch/s, loss=1.472, lr=5.5e-06] epoch 8/8: 16%|█▋ | 461/2797 [01:30<07:36, 5.12batch/s, loss=1.472, lr=5.5e-06] epoch 8/8: 17%|█▋ | 472/2797 [01:33<07:40, 5.05batch/s, loss=1.472, lr=5.5e-06] epoch 8/8: 17%|█▋ | 472/2797 [01:34<07:40, 5.05batch/s, loss=1.472, lr=5.5e-06] epoch 8/8: 17%|█▋ | 483/2797 [01:35<07:48, 4.94batch/s, loss=1.472, lr=5.5e-06] epoch 8/8: 18%|█▊ | 494/2797 [01:37<07:41, 4.99batch/s, loss=1.472, lr=5.5e-06] epoch 8/8: 18%|█▊ | 494/2797 [01:39<07:41, 4.99batch/s, loss=1.471, lr=5.4e-06] epoch 8/8: 18%|█▊ | 505/2797 [01:39<07:37, 5.01batch/s, loss=1.471, lr=5.4e-06] epoch 8/8: 18%|█▊ | 516/2797 [01:42<07:31, 5.06batch/s, loss=1.471, lr=5.4e-06] epoch 8/8: 18%|█▊ | 516/2797 [01:44<07:31, 5.06batch/s, loss=1.472, lr=5.3e-06] epoch 8/8: 19%|█▉ | 527/2797 [01:44<07:44, 4.89batch/s, loss=1.472, lr=5.3e-06] epoch 8/8: 19%|█▉ | 538/2797 [01:46<07:35, 4.96batch/s, loss=1.472, lr=5.3e-06] epoch 8/8: 20%|█▉ | 548/2797 [01:48<07:42, 4.86batch/s, loss=1.472, lr=5.3e-06] epoch 8/8: 20%|█▉ | 548/2797 [01:49<07:42, 4.86batch/s, loss=1.474, lr=5.3e-06] epoch 8/8: 20%|█▉ | 559/2797 [01:50<07:30, 4.96batch/s, loss=1.474, lr=5.3e-06] epoch 8/8: 20%|██ | 569/2797 [01:53<07:43, 4.80batch/s, loss=1.474, lr=5.3e-06] epoch 8/8: 20%|██ | 569/2797 [01:54<07:43, 4.80batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 21%|██ | 580/2797 [01:55<07:29, 4.94batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 21%|██ | 591/2797 [01:57<07:20, 5.01batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 21%|██ | 591/2797 [01:59<07:20, 5.01batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 22%|██▏ | 603/2797 [01:59<06:54, 5.29batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 22%|██▏ | 614/2797 [02:01<06:52, 5.29batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 22%|██▏ | 625/2797 [02:03<06:58, 5.19batch/s, loss=1.475, lr=5.2e-06] epoch 8/8: 22%|██▏ | 625/2797 [02:03<06:58, 5.19batch/s, loss=1.476, lr=5.1e-06] epoch 8/8: 23%|██▎ | 636/2797 [02:05<06:58, 5.16batch/s, loss=1.476, lr=5.1e-06] epoch 8/8: 23%|██▎ | 647/2797 [02:07<06:58, 5.14batch/s, loss=1.476, lr=5.1e-06] epoch 8/8: 23%|██▎ | 647/2797 [02:08<06:58, 5.14batch/s, loss=1.473, lr=5.0e-06] epoch 8/8: 24%|██▎ | 658/2797 [02:10<07:09, 4.98batch/s, loss=1.473, lr=5.0e-06] epoch 8/8: 24%|██▍ | 669/2797 [02:12<06:59, 5.07batch/s, loss=1.473, lr=5.0e-06] epoch 8/8: 24%|██▍ | 669/2797 [02:13<06:59, 5.07batch/s, loss=1.473, lr=5.0e-06] epoch 8/8: 24%|██▍ | 680/2797 [02:14<07:01, 5.03batch/s, loss=1.473, lr=5.0e-06] epoch 8/8: 25%|██▍ | 691/2797 [02:16<07:06, 4.94batch/s, loss=1.473, lr=5.0e-06] epoch 8/8: 25%|██▍ | 691/2797 [02:19<07:06, 4.94batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 25%|██▌ | 701/2797 [02:19<07:17, 4.79batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 25%|██▌ | 712/2797 [02:21<07:04, 4.91batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 26%|██▌ | 722/2797 [02:23<07:01, 4.93batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 26%|██▌ | 722/2797 [02:24<07:01, 4.93batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 26%|██▌ | 733/2797 [02:25<06:52, 5.01batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 27%|██▋ | 744/2797 [02:27<07:03, 4.85batch/s, loss=1.473, lr=4.9e-06] epoch 8/8: 27%|██▋ | 744/2797 [02:29<07:03, 4.85batch/s, loss=1.472, lr=4.8e-06] epoch 8/8: 27%|██▋ | 755/2797 [02:29<06:52, 4.95batch/s, loss=1.472, lr=4.8e-06] epoch 8/8: 27%|██▋ | 766/2797 [02:32<06:45, 5.01batch/s, loss=1.472, lr=4.8e-06] epoch 8/8: 27%|██▋ | 766/2797 [02:34<06:45, 5.01batch/s, loss=1.473, lr=4.8e-06] epoch 8/8: 28%|██▊ | 777/2797 [02:34<06:33, 5.13batch/s, loss=1.473, lr=4.8e-06] epoch 8/8: 28%|██▊ | 788/2797 [02:36<06:27, 5.19batch/s, loss=1.473, lr=4.8e-06] epoch 8/8: 29%|██▊ | 800/2797 [02:38<06:12, 5.36batch/s, loss=1.473, lr=4.8e-06] epoch 8/8: 29%|██▊ | 800/2797 [02:38<06:12, 5.36batch/s, loss=1.473, lr=4.7e-06] epoch 8/8: 29%|██▉ | 811/2797 [02:40<06:15, 5.29batch/s, loss=1.473, lr=4.7e-06] epoch 8/8: 29%|██▉ | 822/2797 [02:42<06:32, 5.03batch/s, loss=1.473, lr=4.7e-06] epoch 8/8: 29%|██▉ | 822/2797 [02:43<06:32, 5.03batch/s, loss=1.472, lr=4.6e-06] epoch 8/8: 30%|██▉ | 833/2797 [02:45<06:28, 5.06batch/s, loss=1.472, lr=4.6e-06] epoch 8/8: 30%|███ | 844/2797 [02:47<06:21, 5.12batch/s, loss=1.472, lr=4.6e-06] epoch 8/8: 30%|███ | 844/2797 [02:48<06:21, 5.12batch/s, loss=1.473, lr=4.6e-06] epoch 8/8: 31%|███ | 855/2797 [02:49<06:24, 5.04batch/s, loss=1.473, lr=4.6e-06] epoch 8/8: 31%|███ | 866/2797 [02:51<06:21, 5.06batch/s, loss=1.473, lr=4.6e-06] epoch 8/8: 31%|███ | 866/2797 [02:53<06:21, 5.06batch/s, loss=1.473, lr=4.5e-06] epoch 8/8: 31%|███▏ | 877/2797 [02:53<06:21, 5.03batch/s, loss=1.473, lr=4.5e-06] epoch 8/8: 32%|███▏ | 888/2797 [02:55<06:17, 5.06batch/s, loss=1.473, lr=4.5e-06] epoch 8/8: 32%|███▏ | 899/2797 [02:57<06:12, 5.09batch/s, loss=1.473, lr=4.5e-06] epoch 8/8: 32%|███▏ | 899/2797 [02:58<06:12, 5.09batch/s, loss=1.475, lr=4.5e-06] epoch 8/8: 33%|███▎ | 910/2797 [03:00<06:17, 5.00batch/s, loss=1.475, lr=4.5e-06] epoch 8/8: 33%|███▎ | 922/2797 [03:02<06:02, 5.17batch/s, loss=1.475, lr=4.5e-06] epoch 8/8: 33%|███▎ | 922/2797 [03:03<06:02, 5.17batch/s, loss=1.475, lr=4.4e-06] epoch 8/8: 33%|███▎ | 933/2797 [03:04<06:03, 5.12batch/s, loss=1.475, lr=4.4e-06] epoch 8/8: 34%|███▍ | 944/2797 [03:06<06:01, 5.13batch/s, loss=1.475, lr=4.4e-06] epoch 8/8: 34%|███▍ | 944/2797 [03:08<06:01, 5.13batch/s, loss=1.475, lr=4.3e-06] epoch 8/8: 34%|███▍ | 955/2797 [03:08<05:57, 5.15batch/s, loss=1.475, lr=4.3e-06] epoch 8/8: 35%|███▍ | 966/2797 [03:10<05:51, 5.21batch/s, loss=1.475, lr=4.3e-06] epoch 8/8: 35%|███▍ | 966/2797 [03:12<05:51, 5.21batch/s, loss=1.475, lr=4.3e-06] epoch 8/8: 35%|███▍ | 978/2797 [03:13<05:44, 5.28batch/s, loss=1.475, lr=4.3e-06] epoch 8/8: 35%|███▌ | 989/2797 [03:15<05:55, 5.08batch/s, loss=1.475, lr=4.3e-06] epoch 8/8: 35%|███▌ | 989/2797 [03:17<05:55, 5.08batch/s, loss=1.475, lr=4.2e-06] epoch 8/8: 36%|███▌ | 1001/2797 [03:17<05:43, 5.23batch/s, loss=1.475, lr=4.2e-06] epoch 8/8: 36%|███▌ | 1012/2797 [03:19<05:45, 5.17batch/s, loss=1.475, lr=4.2e-06] epoch 8/8: 37%|███▋ | 1023/2797 [03:22<05:52, 5.03batch/s, loss=1.475, lr=4.2e-06] epoch 8/8: 37%|███▋ | 1023/2797 [03:22<05:52, 5.03batch/s, loss=1.474, lr=4.2e-06] epoch 8/8: 37%|███▋ | 1034/2797 [03:24<05:52, 5.00batch/s, loss=1.474, lr=4.2e-06] epoch 8/8: 37%|███▋ | 1045/2797 [03:26<05:45, 5.07batch/s, loss=1.474, lr=4.2e-06] epoch 8/8: 37%|███▋ | 1045/2797 [03:27<05:45, 5.07batch/s, loss=1.473, lr=4.1e-06] epoch 8/8: 38%|███▊ | 1056/2797 [03:28<05:42, 5.08batch/s, loss=1.473, lr=4.1e-06] epoch 8/8: 38%|███▊ | 1067/2797 [03:30<05:39, 5.10batch/s, loss=1.473, lr=4.1e-06] epoch 8/8: 38%|███▊ | 1067/2797 [03:32<05:39, 5.10batch/s, loss=1.474, lr=4.0e-06] epoch 8/8: 39%|███▊ | 1078/2797 [03:33<05:49, 4.92batch/s, loss=1.474, lr=4.0e-06] epoch 8/8: 39%|███▉ | 1089/2797 [03:35<05:46, 4.93batch/s, loss=1.474, lr=4.0e-06] epoch 8/8: 39%|███▉ | 1100/2797 [03:37<05:37, 5.02batch/s, loss=1.474, lr=4.0e-06] epoch 8/8: 39%|███▉ | 1100/2797 [03:37<05:37, 5.02batch/s, loss=1.472, lr=4.0e-06] epoch 8/8: 40%|███▉ | 1111/2797 [03:39<05:36, 5.01batch/s, loss=1.472, lr=4.0e-06] epoch 8/8: 40%|████ | 1122/2797 [03:42<05:40, 4.91batch/s, loss=1.472, lr=4.0e-06] epoch 8/8: 40%|████ | 1122/2797 [03:42<05:40, 4.91batch/s, loss=1.473, lr=3.9e-06] epoch 8/8: 40%|████ | 1132/2797 [03:44<05:38, 4.92batch/s, loss=1.473, lr=3.9e-06] epoch 8/8: 41%|████ | 1143/2797 [03:46<05:29, 5.02batch/s, loss=1.473, lr=3.9e-06] epoch 8/8: 41%|████ | 1143/2797 [03:47<05:29, 5.02batch/s, loss=1.472, lr=3.9e-06] epoch 8/8: 41%|████▏ | 1154/2797 [03:48<05:33, 4.93batch/s, loss=1.472, lr=3.9e-06] epoch 8/8: 42%|████▏ | 1166/2797 [03:50<05:13, 5.20batch/s, loss=1.472, lr=3.9e-06] epoch 8/8: 42%|████▏ | 1166/2797 [03:52<05:13, 5.20batch/s, loss=1.473, lr=3.8e-06] epoch 8/8: 42%|████▏ | 1177/2797 [03:52<05:13, 5.18batch/s, loss=1.473, lr=3.8e-06] epoch 8/8: 42%|████▏ | 1188/2797 [03:54<05:15, 5.10batch/s, loss=1.473, lr=3.8e-06] epoch 8/8: 43%|████▎ | 1199/2797 [03:57<05:20, 4.98batch/s, loss=1.473, lr=3.8e-06] epoch 8/8: 43%|████▎ | 1199/2797 [03:57<05:20, 4.98batch/s, loss=1.472, lr=3.8e-06] epoch 8/8: 43%|████▎ | 1210/2797 [03:59<05:12, 5.08batch/s, loss=1.472, lr=3.8e-06] epoch 8/8: 44%|████▎ | 1222/2797 [04:01<05:00, 5.24batch/s, loss=1.472, lr=3.8e-06] epoch 8/8: 44%|████▎ | 1222/2797 [04:02<05:00, 5.24batch/s, loss=1.473, lr=3.7e-06] epoch 8/8: 44%|████▍ | 1233/2797 [04:03<04:57, 5.26batch/s, loss=1.473, lr=3.7e-06] epoch 8/8: 44%|████▍ | 1244/2797 [04:05<04:58, 5.21batch/s, loss=1.473, lr=3.7e-06] epoch 8/8: 44%|████▍ | 1244/2797 [04:07<04:58, 5.21batch/s, loss=1.473, lr=3.6e-06] epoch 8/8: 45%|████▍ | 1255/2797 [04:08<05:07, 5.01batch/s, loss=1.473, lr=3.6e-06] epoch 8/8: 45%|████▌ | 1266/2797 [04:10<05:00, 5.09batch/s, loss=1.473, lr=3.6e-06] epoch 8/8: 45%|████▌ | 1266/2797 [04:12<05:00, 5.09batch/s, loss=1.474, lr=3.6e-06] epoch 8/8: 46%|████▌ | 1277/2797 [04:12<04:59, 5.07batch/s, loss=1.474, lr=3.6e-06] epoch 8/8: 46%|████▌ | 1288/2797 [04:14<04:58, 5.06batch/s, loss=1.474, lr=3.6e-06] epoch 8/8: 46%|████▋ | 1299/2797 [04:16<04:59, 5.00batch/s, loss=1.474, lr=3.6e-06] epoch 8/8: 46%|████▋ | 1299/2797 [04:17<04:59, 5.00batch/s, loss=1.475, lr=3.5e-06] epoch 8/8: 47%|████▋ | 1310/2797 [04:18<04:53, 5.06batch/s, loss=1.475, lr=3.5e-06] epoch 8/8: 47%|████▋ | 1321/2797 [04:21<04:59, 4.93batch/s, loss=1.475, lr=3.5e-06] epoch 8/8: 47%|████▋ | 1321/2797 [04:22<04:59, 4.93batch/s, loss=1.476, lr=3.5e-06] epoch 8/8: 48%|████▊ | 1332/2797 [04:23<04:53, 5.00batch/s, loss=1.476, lr=3.5e-06] epoch 8/8: 48%|████▊ | 1343/2797 [04:25<04:44, 5.11batch/s, loss=1.476, lr=3.5e-06] epoch 8/8: 48%|████▊ | 1343/2797 [04:27<04:44, 5.11batch/s, loss=1.476, lr=3.4e-06] epoch 8/8: 48%|████▊ | 1354/2797 [04:27<04:45, 5.05batch/s, loss=1.476, lr=3.4e-06] epoch 8/8: 49%|████▉ | 1366/2797 [04:29<04:30, 5.29batch/s, loss=1.476, lr=3.4e-06] epoch 8/8: 49%|████▉ | 1366/2797 [04:31<04:30, 5.29batch/s, loss=1.476, lr=3.3e-06] epoch 8/8: 49%|████▉ | 1377/2797 [04:31<04:29, 5.27batch/s, loss=1.476, lr=3.3e-06] epoch 8/8: 50%|████▉ | 1388/2797 [04:34<04:39, 5.03batch/s, loss=1.476, lr=3.3e-06] epoch 8/8: 50%|█████ | 1399/2797 [04:36<04:48, 4.85batch/s, loss=1.476, lr=3.3e-06] epoch 8/8: 50%|█████ | 1399/2797 [04:37<04:48, 4.85batch/s, loss=1.477, lr=3.3e-06] epoch 8/8: 50%|█████ | 1410/2797 [04:38<04:39, 4.97batch/s, loss=1.477, lr=3.3e-06] epoch 8/8: 51%|█████ | 1421/2797 [04:40<04:35, 4.99batch/s, loss=1.477, lr=3.3e-06] epoch 8/8: 51%|█████ | 1421/2797 [04:42<04:35, 4.99batch/s, loss=1.477, lr=3.2e-06] epoch 8/8: 51%|█████ | 1432/2797 [04:43<04:36, 4.94batch/s, loss=1.477, lr=3.2e-06] epoch 8/8: 52%|█████▏ | 1443/2797 [04:45<04:26, 5.08batch/s, loss=1.477, lr=3.2e-06] epoch 8/8: 52%|█████▏ | 1443/2797 [04:46<04:26, 5.08batch/s, loss=1.478, lr=3.2e-06] epoch 8/8: 52%|█████▏ | 1454/2797 [04:47<04:27, 5.03batch/s, loss=1.478, lr=3.2e-06] epoch 8/8: 52%|█████▏ | 1465/2797 [04:49<04:22, 5.08batch/s, loss=1.478, lr=3.2e-06] epoch 8/8: 52%|█████▏ | 1465/2797 [04:51<04:22, 5.08batch/s, loss=1.477, lr=3.1e-06] epoch 8/8: 53%|█████▎ | 1476/2797 [04:51<04:19, 5.09batch/s, loss=1.477, lr=3.1e-06] epoch 8/8: 53%|█████▎ | 1488/2797 [04:53<04:07, 5.29batch/s, loss=1.477, lr=3.1e-06] epoch 8/8: 54%|█████▎ | 1499/2797 [04:56<04:08, 5.22batch/s, loss=1.477, lr=3.1e-06] epoch 8/8: 54%|█████▎ | 1499/2797 [04:56<04:08, 5.22batch/s, loss=1.476, lr=3.0e-06] epoch 8/8: 54%|█████▍ | 1510/2797 [04:58<04:04, 5.25batch/s, loss=1.476, lr=3.0e-06] epoch 8/8: 54%|█████▍ | 1521/2797 [05:00<04:06, 5.18batch/s, loss=1.476, lr=3.0e-06] epoch 8/8: 54%|█████▍ | 1521/2797 [05:01<04:06, 5.18batch/s, loss=1.476, lr=3.0e-06] epoch 8/8: 55%|█████▍ | 1532/2797 [05:02<04:08, 5.09batch/s, loss=1.476, lr=3.0e-06] epoch 8/8: 55%|█████▌ | 1543/2797 [05:04<04:04, 5.13batch/s, loss=1.476, lr=3.0e-06] epoch 8/8: 55%|█████▌ | 1543/2797 [05:06<04:04, 5.13batch/s, loss=1.476, lr=2.9e-06] epoch 8/8: 56%|█████▌ | 1554/2797 [05:06<04:01, 5.15batch/s, loss=1.476, lr=2.9e-06] epoch 8/8: 56%|█████▌ | 1565/2797 [05:08<04:02, 5.09batch/s, loss=1.476, lr=2.9e-06] epoch 8/8: 56%|█████▌ | 1565/2797 [05:11<04:02, 5.09batch/s, loss=1.477, lr=2.9e-06] epoch 8/8: 56%|█████▋ | 1576/2797 [05:11<04:02, 5.04batch/s, loss=1.477, lr=2.9e-06] epoch 8/8: 57%|█████▋ | 1587/2797 [05:13<03:58, 5.07batch/s, loss=1.477, lr=2.9e-06] epoch 8/8: 57%|█████▋ | 1598/2797 [05:15<03:52, 5.16batch/s, loss=1.477, lr=2.9e-06] epoch 8/8: 57%|█████▋ | 1598/2797 [05:15<03:52, 5.16batch/s, loss=1.478, lr=2.8e-06] epoch 8/8: 58%|█████▊ | 1609/2797 [05:17<03:55, 5.05batch/s, loss=1.478, lr=2.8e-06] epoch 8/8: 58%|█████▊ | 1620/2797 [05:19<03:54, 5.02batch/s, loss=1.478, lr=2.8e-06] epoch 8/8: 58%|█████▊ | 1620/2797 [05:21<03:54, 5.02batch/s, loss=1.478, lr=2.8e-06] epoch 8/8: 58%|█████▊ | 1631/2797 [05:22<03:49, 5.08batch/s, loss=1.478, lr=2.8e-06] epoch 8/8: 59%|█████▊ | 1642/2797 [05:24<03:47, 5.07batch/s, loss=1.478, lr=2.8e-06] epoch 8/8: 59%|█████▊ | 1642/2797 [05:26<03:47, 5.07batch/s, loss=1.477, lr=2.7e-06] epoch 8/8: 59%|█████▉ | 1653/2797 [05:26<03:49, 4.99batch/s, loss=1.477, lr=2.7e-06] epoch 8/8: 59%|█████▉ | 1664/2797 [05:28<03:43, 5.07batch/s, loss=1.477, lr=2.7e-06] epoch 8/8: 60%|█████▉ | 1675/2797 [05:30<03:44, 4.99batch/s, loss=1.477, lr=2.7e-06] epoch 8/8: 60%|█████▉ | 1675/2797 [05:31<03:44, 4.99batch/s, loss=1.476, lr=2.6e-06] epoch 8/8: 60%|██████ | 1686/2797 [05:33<03:48, 4.86batch/s, loss=1.476, lr=2.6e-06] epoch 8/8: 61%|██████ | 1696/2797 [05:35<03:48, 4.82batch/s, loss=1.476, lr=2.6e-06] epoch 8/8: 61%|██████ | 1696/2797 [05:36<03:48, 4.82batch/s, loss=1.477, lr=2.6e-06] epoch 8/8: 61%|██████ | 1706/2797 [05:37<03:51, 4.71batch/s, loss=1.477, lr=2.6e-06] epoch 8/8: 61%|██████▏ | 1717/2797 [05:39<03:44, 4.81batch/s, loss=1.477, lr=2.6e-06] epoch 8/8: 61%|██████▏ | 1717/2797 [05:41<03:44, 4.81batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 62%|██████▏ | 1728/2797 [05:41<03:39, 4.87batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 62%|██████▏ | 1739/2797 [05:44<03:34, 4.93batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 63%|██████▎ | 1749/2797 [05:46<03:34, 4.89batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 63%|██████▎ | 1749/2797 [05:46<03:34, 4.89batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 63%|██████▎ | 1760/2797 [05:48<03:28, 4.97batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 63%|██████▎ | 1771/2797 [05:50<03:22, 5.06batch/s, loss=1.476, lr=2.5e-06] epoch 8/8: 63%|██████▎ | 1771/2797 [05:51<03:22, 5.06batch/s, loss=1.477, lr=2.4e-06] epoch 8/8: 64%|██████▎ | 1782/2797 [05:52<03:19, 5.09batch/s, loss=1.477, lr=2.4e-06] epoch 8/8: 64%|██████▍ | 1793/2797 [05:54<03:15, 5.13batch/s, loss=1.477, lr=2.4e-06] epoch 8/8: 64%|██████▍ | 1793/2797 [05:56<03:15, 5.13batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 64%|██████▍ | 1804/2797 [05:56<03:14, 5.10batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 65%|██████▍ | 1815/2797 [05:59<03:16, 5.00batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 65%|██████▍ | 1815/2797 [06:01<03:16, 5.00batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 65%|██████▌ | 1826/2797 [06:01<03:12, 5.04batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 66%|██████▌ | 1837/2797 [06:03<03:06, 5.15batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 66%|██████▌ | 1848/2797 [06:05<03:03, 5.16batch/s, loss=1.477, lr=2.3e-06] epoch 8/8: 66%|██████▌ | 1848/2797 [06:06<03:03, 5.16batch/s, loss=1.477, lr=2.2e-06] epoch 8/8: 66%|██████▋ | 1859/2797 [06:07<02:59, 5.21batch/s, loss=1.477, lr=2.2e-06] epoch 8/8: 67%|██████▋ | 1870/2797 [06:09<02:57, 5.22batch/s, loss=1.477, lr=2.2e-06] epoch 8/8: 67%|██████▋ | 1870/2797 [06:10<02:57, 5.22batch/s, loss=1.478, lr=2.2e-06] epoch 8/8: 67%|██████▋ | 1881/2797 [06:11<02:54, 5.24batch/s, loss=1.478, lr=2.2e-06] epoch 8/8: 68%|██████▊ | 1892/2797 [06:13<02:51, 5.28batch/s, loss=1.478, lr=2.2e-06] epoch 8/8: 68%|██████▊ | 1892/2797 [06:15<02:51, 5.28batch/s, loss=1.478, lr=2.1e-06] epoch 8/8: 68%|██████▊ | 1904/2797 [06:15<02:45, 5.39batch/s, loss=1.478, lr=2.1e-06] epoch 8/8: 68%|██████▊ | 1915/2797 [06:18<02:46, 5.30batch/s, loss=1.478, lr=2.1e-06] epoch 8/8: 68%|██████▊ | 1915/2797 [06:20<02:46, 5.30batch/s, loss=1.477, lr=2.0e-06] epoch 8/8: 69%|██████▉ | 1926/2797 [06:20<02:48, 5.18batch/s, loss=1.477, lr=2.0e-06] epoch 8/8: 69%|██████▉ | 1937/2797 [06:22<02:48, 5.10batch/s, loss=1.477, lr=2.0e-06] epoch 8/8: 70%|██████▉ | 1948/2797 [06:24<02:49, 5.00batch/s, loss=1.477, lr=2.0e-06] epoch 8/8: 70%|██████▉ | 1948/2797 [06:25<02:49, 5.00batch/s, loss=1.478, lr=2.0e-06] epoch 8/8: 70%|███████ | 1960/2797 [06:26<02:39, 5.26batch/s, loss=1.478, lr=2.0e-06] epoch 8/8: 70%|███████ | 1971/2797 [06:29<02:38, 5.21batch/s, loss=1.478, lr=2.0e-06] epoch 8/8: 70%|███████ | 1971/2797 [06:29<02:38, 5.21batch/s, loss=1.478, lr=1.9e-06] epoch 8/8: 71%|███████ | 1982/2797 [06:31<02:36, 5.19batch/s, loss=1.478, lr=1.9e-06] epoch 8/8: 71%|███████▏ | 1993/2797 [06:33<02:33, 5.23batch/s, loss=1.478, lr=1.9e-06] epoch 8/8: 71%|███████▏ | 1993/2797 [06:34<02:33, 5.23batch/s, loss=1.477, lr=1.9e-06] epoch 8/8: 72%|███████▏ | 2004/2797 [06:35<02:35, 5.09batch/s, loss=1.477, lr=1.9e-06] epoch 8/8: 72%|███████▏ | 2015/2797 [06:37<02:32, 5.13batch/s, loss=1.477, lr=1.9e-06] epoch 8/8: 72%|███████▏ | 2015/2797 [06:39<02:32, 5.13batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 72%|███████▏ | 2026/2797 [06:39<02:31, 5.10batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 73%|███████▎ | 2037/2797 [06:41<02:27, 5.14batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 73%|███████▎ | 2048/2797 [06:44<02:28, 5.06batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 73%|███████▎ | 2048/2797 [06:44<02:28, 5.06batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 74%|███████▎ | 2059/2797 [06:46<02:27, 4.99batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 74%|███████▍ | 2070/2797 [06:48<02:22, 5.09batch/s, loss=1.478, lr=1.8e-06] epoch 8/8: 74%|███████▍ | 2070/2797 [06:49<02:22, 5.09batch/s, loss=1.478, lr=1.7e-06] epoch 8/8: 74%|███████▍ | 2081/2797 [06:50<02:20, 5.10batch/s, loss=1.478, lr=1.7e-06] epoch 8/8: 75%|███████▍ | 2092/2797 [06:53<02:25, 4.83batch/s, loss=1.478, lr=1.7e-06] epoch 8/8: 75%|███████▍ | 2092/2797 [06:54<02:25, 4.83batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 75%|███████▌ | 2104/2797 [06:55<02:17, 5.05batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 76%|███████▌ | 2116/2797 [06:57<02:08, 5.28batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 76%|███████▌ | 2116/2797 [06:59<02:08, 5.28batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 76%|███████▌ | 2128/2797 [06:59<02:02, 5.46batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 76%|███████▋ | 2139/2797 [07:01<02:02, 5.35batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 77%|███████▋ | 2150/2797 [07:03<02:02, 5.27batch/s, loss=1.478, lr=1.6e-06] epoch 8/8: 77%|███████▋ | 2150/2797 [07:03<02:02, 5.27batch/s, loss=1.478, lr=1.5e-06] epoch 8/8: 77%|███████▋ | 2161/2797 [07:05<02:00, 5.27batch/s, loss=1.478, lr=1.5e-06] epoch 8/8: 78%|███████▊ | 2172/2797 [07:08<02:02, 5.11batch/s, loss=1.478, lr=1.5e-06] epoch 8/8: 78%|███████▊ | 2172/2797 [07:08<02:02, 5.11batch/s, loss=1.478, lr=1.5e-06] epoch 8/8: 78%|███████▊ | 2183/2797 [07:10<02:01, 5.05batch/s, loss=1.478, lr=1.5e-06] epoch 8/8: 78%|███████▊ | 2194/2797 [07:12<02:03, 4.87batch/s, loss=1.478, lr=1.5e-06] epoch 8/8: 78%|███████▊ | 2194/2797 [07:14<02:03, 4.87batch/s, loss=1.478, lr=1.4e-06] epoch 8/8: 79%|███████▉ | 2205/2797 [07:14<01:59, 4.95batch/s, loss=1.478, lr=1.4e-06] epoch 8/8: 79%|███████▉ | 2216/2797 [07:17<01:55, 5.03batch/s, loss=1.478, lr=1.4e-06] epoch 8/8: 79%|███████▉ | 2216/2797 [07:19<01:55, 5.03batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 80%|███████▉ | 2227/2797 [07:19<01:54, 4.99batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 80%|████████ | 2238/2797 [07:21<01:49, 5.10batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 80%|████████ | 2250/2797 [07:23<01:43, 5.30batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 80%|████████ | 2250/2797 [07:23<01:43, 5.30batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 81%|████████ | 2261/2797 [07:25<01:42, 5.22batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 81%|████████▏ | 2273/2797 [07:27<01:38, 5.34batch/s, loss=1.478, lr=1.3e-06] epoch 8/8: 81%|████████▏ | 2273/2797 [07:28<01:38, 5.34batch/s, loss=1.478, lr=1.2e-06] epoch 8/8: 82%|████████▏ | 2284/2797 [07:30<01:39, 5.15batch/s, loss=1.478, lr=1.2e-06] epoch 8/8: 82%|████████▏ | 2295/2797 [07:32<01:40, 5.00batch/s, loss=1.478, lr=1.2e-06] epoch 8/8: 82%|████████▏ | 2295/2797 [07:33<01:40, 5.00batch/s, loss=1.479, lr=1.2e-06] epoch 8/8: 82%|████████▏ | 2306/2797 [07:34<01:39, 4.95batch/s, loss=1.479, lr=1.2e-06] epoch 8/8: 83%|████████▎ | 2317/2797 [07:36<01:35, 5.03batch/s, loss=1.479, lr=1.2e-06] epoch 8/8: 83%|████████▎ | 2317/2797 [07:38<01:35, 5.03batch/s, loss=1.479, lr=1.1e-06] epoch 8/8: 83%|████████▎ | 2330/2797 [07:38<01:27, 5.36batch/s, loss=1.479, lr=1.1e-06] epoch 8/8: 84%|████████▎ | 2341/2797 [07:41<01:26, 5.29batch/s, loss=1.479, lr=1.1e-06] epoch 8/8: 84%|████████▎ | 2341/2797 [07:43<01:26, 5.29batch/s, loss=1.479, lr=1.0e-06] epoch 8/8: 84%|████████▍ | 2352/2797 [07:43<01:27, 5.11batch/s, loss=1.479, lr=1.0e-06] epoch 8/8: 84%|████████▍ | 2363/2797 [07:45<01:23, 5.20batch/s, loss=1.479, lr=1.0e-06] epoch 8/8: 85%|████████▍ | 2374/2797 [07:47<01:22, 5.14batch/s, loss=1.479, lr=1.0e-06] epoch 8/8: 85%|████████▍ | 2374/2797 [07:47<01:22, 5.14batch/s, loss=1.479, lr=9.9e-07] epoch 8/8: 85%|████████▌ | 2386/2797 [07:49<01:18, 5.24batch/s, loss=1.479, lr=9.9e-07] epoch 8/8: 86%|████████▌ | 2397/2797 [07:52<01:18, 5.10batch/s, loss=1.479, lr=9.9e-07] epoch 8/8: 86%|████████▌ | 2397/2797 [07:52<01:18, 5.10batch/s, loss=1.478, lr=9.3e-07] epoch 8/8: 86%|████████▌ | 2408/2797 [07:54<01:15, 5.15batch/s, loss=1.478, lr=9.3e-07] epoch 8/8: 86%|████████▋ | 2419/2797 [07:56<01:13, 5.11batch/s, loss=1.478, lr=9.3e-07] epoch 8/8: 86%|████████▋ | 2419/2797 [07:57<01:13, 5.11batch/s, loss=1.479, lr=8.7e-07] epoch 8/8: 87%|████████▋ | 2431/2797 [07:58<01:10, 5.21batch/s, loss=1.479, lr=8.7e-07] epoch 8/8: 87%|████████▋ | 2443/2797 [08:00<01:06, 5.33batch/s, loss=1.479, lr=8.7e-07] epoch 8/8: 87%|████████▋ | 2443/2797 [08:02<01:06, 5.33batch/s, loss=1.479, lr=8.1e-07] epoch 8/8: 88%|████████▊ | 2454/2797 [08:02<01:06, 5.18batch/s, loss=1.479, lr=8.1e-07] epoch 8/8: 88%|████████▊ | 2465/2797 [08:05<01:03, 5.21batch/s, loss=1.479, lr=8.1e-07] epoch 8/8: 88%|████████▊ | 2465/2797 [08:07<01:03, 5.21batch/s, loss=1.478, lr=7.6e-07] epoch 8/8: 89%|████████▊ | 2476/2797 [08:07<01:01, 5.19batch/s, loss=1.478, lr=7.6e-07] epoch 8/8: 89%|████████▉ | 2487/2797 [08:09<01:00, 5.12batch/s, loss=1.478, lr=7.6e-07] epoch 8/8: 89%|████████▉ | 2498/2797 [08:11<00:59, 5.05batch/s, loss=1.478, lr=7.6e-07] epoch 8/8: 89%|████████▉ | 2498/2797 [08:12<00:59, 5.05batch/s, loss=1.479, lr=7.0e-07] epoch 8/8: 90%|████████▉ | 2510/2797 [08:13<00:54, 5.22batch/s, loss=1.479, lr=7.0e-07] epoch 8/8: 90%|█████████ | 2521/2797 [08:15<00:53, 5.15batch/s, loss=1.479, lr=7.0e-07] epoch 8/8: 90%|█████████ | 2521/2797 [08:17<00:53, 5.15batch/s, loss=1.478, lr=6.4e-07] epoch 8/8: 91%|█████████ | 2532/2797 [08:18<00:51, 5.14batch/s, loss=1.478, lr=6.4e-07] epoch 8/8: 91%|█████████ | 2543/2797 [08:20<00:50, 5.02batch/s, loss=1.478, lr=6.4e-07] epoch 8/8: 91%|█████████ | 2543/2797 [08:21<00:50, 5.02batch/s, loss=1.478, lr=5.8e-07] epoch 8/8: 91%|█████████▏| 2554/2797 [08:22<00:47, 5.11batch/s, loss=1.478, lr=5.8e-07] epoch 8/8: 92%|█████████▏| 2565/2797 [08:24<00:44, 5.16batch/s, loss=1.478, lr=5.8e-07] epoch 8/8: 92%|█████████▏| 2565/2797 [08:26<00:44, 5.16batch/s, loss=1.478, lr=5.2e-07] epoch 8/8: 92%|█████████▏| 2576/2797 [08:26<00:43, 5.10batch/s, loss=1.478, lr=5.2e-07] epoch 8/8: 92%|█████████▏| 2587/2797 [08:29<00:41, 5.05batch/s, loss=1.478, lr=5.2e-07] epoch 8/8: 93%|█████████▎| 2599/2797 [08:31<00:37, 5.29batch/s, loss=1.478, lr=5.2e-07] epoch 8/8: 93%|█████████▎| 2599/2797 [08:31<00:37, 5.29batch/s, loss=1.478, lr=4.6e-07] epoch 8/8: 93%|█████████▎| 2610/2797 [08:33<00:35, 5.32batch/s, loss=1.478, lr=4.6e-07] epoch 8/8: 94%|█████████▎| 2621/2797 [08:35<00:33, 5.32batch/s, loss=1.478, lr=4.6e-07] epoch 8/8: 94%|█████████▎| 2621/2797 [08:36<00:33, 5.32batch/s, loss=1.478, lr=4.0e-07] epoch 8/8: 94%|█████████▍| 2632/2797 [08:37<00:31, 5.31batch/s, loss=1.478, lr=4.0e-07] epoch 8/8: 94%|█████████▍| 2643/2797 [08:39<00:28, 5.32batch/s, loss=1.478, lr=4.0e-07] epoch 8/8: 94%|█████████▍| 2643/2797 [08:40<00:28, 5.32batch/s, loss=1.478, lr=3.4e-07] epoch 8/8: 95%|█████████▍| 2654/2797 [08:41<00:26, 5.32batch/s, loss=1.478, lr=3.4e-07] epoch 8/8: 95%|█████████▌| 2665/2797 [08:43<00:25, 5.16batch/s, loss=1.478, lr=3.4e-07] epoch 8/8: 95%|█████████▌| 2665/2797 [08:45<00:25, 5.16batch/s, loss=1.478, lr=2.8e-07] epoch 8/8: 96%|█████████▌| 2676/2797 [08:45<00:23, 5.18batch/s, loss=1.478, lr=2.8e-07] epoch 8/8: 96%|█████████▌| 2687/2797 [08:48<00:21, 5.09batch/s, loss=1.478, lr=2.8e-07] epoch 8/8: 96%|█████████▋| 2698/2797 [08:50<00:19, 5.18batch/s, loss=1.478, lr=2.8e-07] epoch 8/8: 96%|█████████▋| 2698/2797 [08:50<00:19, 5.18batch/s, loss=1.478, lr=2.3e-07] epoch 8/8: 97%|█████████▋| 2709/2797 [08:52<00:17, 5.06batch/s, loss=1.478, lr=2.3e-07] epoch 8/8: 97%|█████████▋| 2720/2797 [08:54<00:15, 5.02batch/s, loss=1.478, lr=2.3e-07] epoch 8/8: 97%|█████████▋| 2720/2797 [08:55<00:15, 5.02batch/s, loss=1.478, lr=1.7e-07] epoch 8/8: 98%|█████████▊| 2731/2797 [08:56<00:13, 5.06batch/s, loss=1.478, lr=1.7e-07] epoch 8/8: 98%|█████████▊| 2742/2797 [08:58<00:10, 5.02batch/s, loss=1.478, lr=1.7e-07] epoch 8/8: 98%|█████████▊| 2742/2797 [09:00<00:10, 5.02batch/s, loss=1.477, lr=1.1e-07] epoch 8/8: 98%|█████████▊| 2753/2797 [09:00<00:08, 5.13batch/s, loss=1.477, lr=1.1e-07] epoch 8/8: 99%|█████████▉| 2764/2797 [09:03<00:06, 5.22batch/s, loss=1.477, lr=1.1e-07] epoch 8/8: 99%|█████████▉| 2764/2797 [09:05<00:06, 5.22batch/s, loss=1.477, lr=4.9e-08] epoch 8/8: 99%|█████████▉| 2776/2797 [09:05<00:03, 5.37batch/s, loss=1.477, lr=4.9e-08] epoch 8/8: 100%|█████████▉| 2787/2797 [09:07<00:01, 5.37batch/s, loss=1.477, lr=4.9e-08] epoch 8/8: 100%|██████████| 2797/2797 [09:08<00:00, 5.10batch/s, loss=1.477, lr=4.9e-08]
epoch 8: train loss 1.477 · validation loss 2.079 · broad 81.6% (top-3 95.2%) · path 73.0% (top-3 89.5%, plausible or look-alike 88.5%) · 4720s elapsed
LIVE TEST (10000 held-out live posts): broad 83.8% (top-3 96.3%) · path 75.7% (plausible or look-alike 90.4%)
writing the final TensorBoard report ...
final_val: 30101 posts, path plausible or look-alike 88.5%
final_test: 20058 posts, path plausible or look-alike 87.0%
final_test_common: 20153 posts, path plausible or look-alike 88.0%
human: {'posts': 93, 'accepted': 59, 'rejected': 17, 'unjudged': 17, 'accepted_share': 0.6344086021505376, 'accepted_share_of_judged': 0.7763157894736842}
TEST (windows w21, w22, w23, 20058 posts, best epoch 7): broad 80.6% (top-3 94.5%) · path 71.9% (top-3 88.3%, one of Jev's plausible answers 87.0%) · GPU 770 posts/s · saved to /data/models/v4