sable-v22-canon / train.log
claponsie's picture
Add the training log
c3eb14d verified
Raw History Blame Contribute Delete
66.7 kB
`torch_dtype` is deprecated! Use `dtype` instead!
The model is already on multiple devices. Skipping the move to device specified in `args`.
train=3339 eval=175
trainable params: 36,929,536 || all params: 1,580,643,840 || trainable%: 2.3364
0%| | 0/627 [00:00<?, ?it/s]`use_cache=True` is incompatible with gradient checkpointing. Setting `use_cache=False`.
0%| | 1/627 [00:04<42:10, 4.04s/it] 0%| | 2/627 [00:07<37:50, 3.63s/it] 0%| | 3/627 [00:11<37:50, 3.64s/it] 1%| | 4/627 [00:15<41:15, 3.97s/it] 1%| | 5/627 [00:18<37:02, 3.57s/it] 1%| | 6/627 [00:21<36:26, 3.52s/it] 1%| | 7/627 [00:24<34:30, 3.34s/it] 1%|▏ | 8/627 [00:27<33:56, 3.29s/it] 1%|▏ | 9/627 [00:31<33:09, 3.22s/it] 2%|▏ | 10/627 [00:34<33:50, 3.29s/it] 2%|▏ | 10/627 [00:34<33:50, 3.29s/it] 2%|▏ | 11/627 [00:37<34:04, 3.32s/it] 2%|▏ | 12/627 [00:41<34:35, 3.37s/it] 2%|▏ | 13/627 [00:45<36:36, 3.58s/it] 2%|▏ | 14/627 [00:49<37:51, 3.71s/it] 2%|▏ | 15/627 [00:52<36:46, 3.61s/it] 3%|β–Ž | 16/627 [00:55<34:59, 3.44s/it] 3%|β–Ž | 17/627 [00:59<36:09, 3.56s/it] 3%|β–Ž | 18/627 [01:03<36:44, 3.62s/it] 3%|β–Ž | 19/627 [01:06<34:29, 3.40s/it] 3%|β–Ž | 20/627 [01:09<34:22, 3.40s/it] 3%|β–Ž | 20/627 [01:09<34:22, 3.40s/it] 3%|β–Ž | 21/627 [01:12<31:26, 3.11s/it] 4%|β–Ž | 22/627 [01:15<33:32, 3.33s/it] 4%|β–Ž | 23/627 [01:19<33:48, 3.36s/it] 4%|▍ | 24/627 [01:22<34:19, 3.41s/it] 4%|▍ | 25/627 [01:26<34:34, 3.45s/it]{'loss': 1.3453, 'grad_norm': 1.6655919551849365, 'learning_rate': 9.473684210526316e-05, 'epoch': 0.05}
{'loss': 0.7299, 'grad_norm': 0.927603542804718, 'learning_rate': 0.0002, 'epoch': 0.1}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.84it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.53it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.14it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.96it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.96it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.15it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.28it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 4%|▍ | 25/627 [01:37<34:34, 3.45s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 4%|▍ | 26/627 [01:43<1:15:39, 7.55s/it] 4%|▍ | 27/627 [01:46<1:02:18, 6.23s/it] 4%|▍ | 28/627 [01:49<52:56, 5.30s/it] 5%|▍ | 29/627 [01:53<47:15, 4.74s/it] 5%|▍ | 30/627 [01:57<44:18, 4.45s/it] 5%|▍ | 30/627 [01:57<44:18, 4.45s/it] 5%|▍ | 31/627 [02:01<42:41, 4.30s/it] 5%|β–Œ | 32/627 [02:05<42:33, 4.29s/it] 5%|β–Œ | 33/627 [02:08<40:19, 4.07s/it] 5%|β–Œ | 34/627 [02:12<39:25, 3.99s/it] 6%|β–Œ | 35/627 [02:15<37:16, 3.78s/it] 6%|β–Œ | 36/627 [02:19<35:38, 3.62s/it] 6%|β–Œ | 37/627 [02:22<34:34, 3.52s/it] 6%|β–Œ | 38/627 [02:25<33:19, 3.39s/it] 6%|β–Œ | 39/627 [02:29<34:13, 3.49s/it] 6%|β–‹ | 40/627 [02:32<32:40, 3.34s/it] 6%|β–‹ | 40/627 [02:32<32:40, 3.34s/it] 7%|β–‹ | 41/627 [02:36<33:45, 3.46s/it] 7%|β–‹ | 42/627 [02:40<35:14, 3.61s/it] 7%|β–‹ | 43/627 [02:43<35:50, 3.68s/it] 7%|β–‹ | 44/627 [02:47<36:10, 3.72s/it] 7%|β–‹ | 45/627 [02:50<34:29, 3.56s/it] 7%|β–‹ | 46/627 [02:54<36:01, 3.72s/it] 7%|β–‹ | 47/627 [02:58<35:57, 3.72s/it] 8%|β–Š | 48/627 [03:01<34:22, 3.56s/it] 8%|β–Š | 49/627 [03:05<35:36, 3.70s/it] 8%|β–Š | 50/627 [03:09<34:25, 3.58s/it] 8%|β–Š | 50/627 [03:09<34:25, 3.58s/it]{'eval_loss': 0.5671889781951904, 'eval_runtime': 11.1241, 'eval_samples_per_second': 15.732, 'eval_steps_per_second': 1.978, 'epoch': 0.12}
{'loss': 0.6232, 'grad_norm': 1.0481653213500977, 'learning_rate': 0.00019986653543888568, 'epoch': 0.14}
{'loss': 0.4649, 'grad_norm': 0.6337971091270447, 'learning_rate': 0.00019946649801132427, 'epoch': 0.19}
{'loss': 0.5144, 'grad_norm': 0.72060626745224, 'learning_rate': 0.00019880095553370967, 'epoch': 0.24}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.06it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.26it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.11it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.94it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 8%|β–Š | 50/627 [03:20<34:25, 3.58s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 8%|β–Š | 51/627 [03:26<1:15:06, 7.82s/it] 8%|β–Š | 52/627 [03:30<1:02:04, 6.48s/it] 8%|β–Š | 53/627 [03:34<54:11, 5.67s/it] 9%|β–Š | 54/627 [03:37<49:01, 5.13s/it] 9%|β–‰ | 55/627 [03:41<44:12, 4.64s/it] 9%|β–‰ | 56/627 [03:45<41:37, 4.37s/it] 9%|β–‰ | 57/627 [03:48<39:33, 4.16s/it] 9%|β–‰ | 58/627 [03:52<37:44, 3.98s/it] 9%|β–‰ | 59/627 [03:55<35:57, 3.80s/it] 10%|β–‰ | 60/627 [03:59<35:47, 3.79s/it] 10%|β–‰ | 60/627 [03:59<35:47, 3.79s/it] 10%|β–‰ | 61/627 [04:03<36:35, 3.88s/it] 10%|β–‰ | 62/627 [04:07<35:44, 3.80s/it] 10%|β–ˆ | 63/627 [04:11<36:32, 3.89s/it] 10%|β–ˆ | 64/627 [04:15<36:35, 3.90s/it] 10%|β–ˆ | 65/627 [04:18<33:57, 3.63s/it] 11%|β–ˆ | 66/627 [04:21<33:29, 3.58s/it] 11%|β–ˆ | 67/627 [04:25<32:54, 3.53s/it] 11%|β–ˆ | 68/627 [04:28<33:10, 3.56s/it] 11%|β–ˆ | 69/627 [04:31<31:58, 3.44s/it] 11%|β–ˆ | 70/627 [04:35<32:44, 3.53s/it] 11%|β–ˆ | 70/627 [04:35<32:44, 3.53s/it] 11%|β–ˆβ– | 71/627 [04:38<30:48, 3.33s/it] 11%|β–ˆβ– | 72/627 [04:41<31:03, 3.36s/it] 12%|β–ˆβ– | 73/627 [04:45<32:40, 3.54s/it] 12%|β–ˆβ– | 74/627 [04:50<35:14, 3.82s/it] 12%|β–ˆβ– | 75/627 [04:53<34:00, 3.70s/it]{'eval_loss': 0.5068162083625793, 'eval_runtime': 11.1569, 'eval_samples_per_second': 15.685, 'eval_steps_per_second': 1.972, 'epoch': 0.24}
{'loss': 0.5989, 'grad_norm': 1.1137667894363403, 'learning_rate': 0.00019787168453273544, 'epoch': 0.29}
{'loss': 0.6002, 'grad_norm': 0.49960702657699585, 'learning_rate': 0.00019668116550332766, 'epoch': 0.34}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 12%|β–ˆβ– | 75/627 [05:04<34:00, 3.70s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 12%|β–ˆβ– | 76/627 [05:11<1:12:47, 7.93s/it] 12%|β–ˆβ– | 77/627 [05:15<1:00:38, 6.62s/it] 12%|β–ˆβ– | 78/627 [05:18<52:13, 5.71s/it] 13%|β–ˆβ–Ž | 79/627 [05:22<45:53, 5.03s/it] 13%|β–ˆβ–Ž | 80/627 [05:25<40:46, 4.47s/it] 13%|β–ˆβ–Ž | 80/627 [05:25<40:46, 4.47s/it] 13%|β–ˆβ–Ž | 81/627 [05:29<39:16, 4.32s/it] 13%|β–ˆβ–Ž | 82/627 [05:32<37:11, 4.09s/it] 13%|β–ˆβ–Ž | 83/627 [05:36<36:21, 4.01s/it] 13%|β–ˆβ–Ž | 84/627 [05:39<33:42, 3.72s/it] 14%|β–ˆβ–Ž | 85/627 [05:43<34:01, 3.77s/it] 14%|β–ˆβ–Ž | 86/627 [05:46<32:32, 3.61s/it] 14%|β–ˆβ– | 87/627 [05:49<31:11, 3.47s/it] 14%|β–ˆβ– | 88/627 [05:52<29:48, 3.32s/it] 14%|β–ˆβ– | 89/627 [05:56<31:23, 3.50s/it] 14%|β–ˆβ– | 90/627 [06:00<31:26, 3.51s/it] 14%|β–ˆβ– | 90/627 [06:00<31:26, 3.51s/it] 15%|β–ˆβ– | 91/627 [06:04<32:21, 3.62s/it] 15%|β–ˆβ– | 92/627 [06:08<33:12, 3.72s/it] 15%|β–ˆβ– | 93/627 [06:11<31:31, 3.54s/it] 15%|β–ˆβ– | 94/627 [06:15<32:09, 3.62s/it] 15%|β–ˆβ–Œ | 95/627 [06:18<32:15, 3.64s/it] 15%|β–ˆβ–Œ | 96/627 [06:22<32:27, 3.67s/it] 15%|β–ˆβ–Œ | 97/627 [06:26<32:39, 3.70s/it] 16%|β–ˆβ–Œ | 98/627 [06:29<30:33, 3.47s/it] 16%|β–ˆβ–Œ | 99/627 [06:32<28:56, 3.29s/it] 16%|β–ˆβ–Œ | 100/627 [06:35<28:56, 3.30s/it] 16%|β–ˆβ–Œ | 100/627 [06:35<28:56, 3.30s/it]{'eval_loss': 0.47613394260406494, 'eval_runtime': 11.1439, 'eval_samples_per_second': 15.704, 'eval_steps_per_second': 1.974, 'epoch': 0.36}
{'loss': 0.5485, 'grad_norm': 0.773087739944458, 'learning_rate': 0.00019523257628748146, 'epoch': 0.38}
{'loss': 0.5455, 'grad_norm': 0.9986769556999207, 'learning_rate': 0.0001935297835916754, 'epoch': 0.43}
{'loss': 0.4928, 'grad_norm': 0.8455674052238464, 'learning_rate': 0.00019157733266550575, 'epoch': 0.48}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.51it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.96it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.28it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 16%|β–ˆβ–Œ | 100/627 [06:46<28:56, 3.30s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 16%|β–ˆβ–Œ | 101/627 [06:52<1:05:12, 7.44s/it] 16%|β–ˆβ–‹ | 102/627 [06:56<55:34, 6.35s/it] 16%|β–ˆβ–‹ | 103/627 [06:59<47:30, 5.44s/it] 17%|β–ˆβ–‹ | 104/627 [07:03<42:44, 4.90s/it] 17%|β–ˆβ–‹ | 105/627 [07:06<37:54, 4.36s/it] 17%|β–ˆβ–‹ | 106/627 [07:10<36:46, 4.23s/it] 17%|β–ˆβ–‹ | 107/627 [07:14<35:32, 4.10s/it] 17%|β–ˆβ–‹ | 108/627 [07:17<34:22, 3.97s/it] 17%|β–ˆβ–‹ | 109/627 [07:22<35:58, 4.17s/it] 18%|β–ˆβ–Š | 110/627 [07:25<33:00, 3.83s/it] 18%|β–ˆβ–Š | 110/627 [07:25<33:00, 3.83s/it] 18%|β–ˆβ–Š | 111/627 [07:29<34:42, 4.04s/it] 18%|β–ˆβ–Š | 112/627 [07:33<33:50, 3.94s/it] 18%|β–ˆβ–Š | 113/627 [07:35<29:27, 3.44s/it] 18%|β–ˆβ–Š | 114/627 [07:39<28:40, 3.35s/it] 18%|β–ˆβ–Š | 115/627 [07:43<30:58, 3.63s/it] 19%|β–ˆβ–Š | 116/627 [07:46<29:45, 3.49s/it] 19%|β–ˆβ–Š | 117/627 [07:50<31:26, 3.70s/it] 19%|β–ˆβ–‰ | 118/627 [07:54<30:55, 3.64s/it] 19%|β–ˆβ–‰ | 119/627 [07:58<32:38, 3.85s/it] 19%|β–ˆβ–‰ | 120/627 [08:01<31:02, 3.67s/it] 19%|β–ˆβ–‰ | 120/627 [08:01<31:02, 3.67s/it] 19%|β–ˆβ–‰ | 121/627 [08:05<29:48, 3.53s/it] 19%|β–ˆβ–‰ | 122/627 [08:08<28:37, 3.40s/it] 20%|β–ˆβ–‰ | 123/627 [08:11<29:11, 3.48s/it] 20%|β–ˆβ–‰ | 124/627 [08:14<28:01, 3.34s/it] 20%|β–ˆβ–‰ | 125/627 [08:18<29:18, 3.50s/it]{'eval_loss': 0.4576261639595032, 'eval_runtime': 11.1398, 'eval_samples_per_second': 15.709, 'eval_steps_per_second': 1.975, 'epoch': 0.48}
{'loss': 0.4317, 'grad_norm': 0.4971393346786499, 'learning_rate': 0.0001893804351690917, 'epoch': 0.53}
{'loss': 0.4888, 'grad_norm': 0.7165762782096863, 'learning_rate': 0.0001869449552616367, 'epoch': 0.57}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.84it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.58it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.28it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 20%|β–ˆβ–‰ | 125/627 [08:29<29:18, 3.50s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 20%|β–ˆβ–ˆ | 126/627 [08:36<1:05:14, 7.81s/it] 20%|β–ˆβ–ˆ | 127/627 [08:40<54:15, 6.51s/it] 20%|β–ˆβ–ˆ | 128/627 [08:43<46:36, 5.60s/it] 21%|β–ˆβ–ˆ | 129/627 [08:47<41:20, 4.98s/it] 21%|β–ˆβ–ˆ | 130/627 [08:50<36:28, 4.40s/it] 21%|β–ˆβ–ˆ | 130/627 [08:50<36:28, 4.40s/it] 21%|β–ˆβ–ˆ | 131/627 [08:53<33:30, 4.05s/it] 21%|β–ˆβ–ˆ | 132/627 [08:56<30:49, 3.74s/it] 21%|β–ˆβ–ˆ | 133/627 [09:00<31:26, 3.82s/it] 21%|β–ˆβ–ˆβ– | 134/627 [09:04<31:30, 3.83s/it] 22%|β–ˆβ–ˆβ– | 135/627 [09:08<32:10, 3.92s/it] 22%|β–ˆβ–ˆβ– | 136/627 [09:11<30:40, 3.75s/it] 22%|β–ˆβ–ˆβ– | 137/627 [09:15<31:40, 3.88s/it] 22%|β–ˆβ–ˆβ– | 138/627 [09:19<30:30, 3.74s/it] 22%|β–ˆβ–ˆβ– | 139/627 [09:23<30:17, 3.72s/it] 22%|β–ˆβ–ˆβ– | 140/627 [09:26<29:47, 3.67s/it] 22%|β–ˆβ–ˆβ– | 140/627 [09:26<29:47, 3.67s/it] 22%|β–ˆβ–ˆβ– | 141/627 [09:29<27:24, 3.38s/it] 23%|β–ˆβ–ˆβ–Ž | 142/627 [09:32<27:36, 3.42s/it] 23%|β–ˆβ–ˆβ–Ž | 143/627 [09:36<28:56, 3.59s/it] 23%|β–ˆβ–ˆβ–Ž | 144/627 [09:40<28:48, 3.58s/it] 23%|β–ˆβ–ˆβ–Ž | 145/627 [09:43<28:15, 3.52s/it] 23%|β–ˆβ–ˆβ–Ž | 146/627 [09:47<28:03, 3.50s/it] 23%|β–ˆβ–ˆβ–Ž | 147/627 [09:50<28:03, 3.51s/it] 24%|β–ˆβ–ˆβ–Ž | 148/627 [09:54<28:54, 3.62s/it] 24%|β–ˆβ–ˆβ– | 149/627 [09:58<28:49, 3.62s/it] 24%|β–ˆβ–ˆβ– | 150/627 [10:01<28:46, 3.62s/it] 24%|β–ˆβ–ˆβ– | 150/627 [10:01<28:46, 3.62s/it]{'eval_loss': 0.45111849904060364, 'eval_runtime': 11.1331, 'eval_samples_per_second': 15.719, 'eval_steps_per_second': 1.976, 'epoch': 0.6}
{'loss': 0.5482, 'grad_norm': 0.6212101578712463, 'learning_rate': 0.00018427739394827973, 'epoch': 0.62}
{'loss': 0.4923, 'grad_norm': 0.7878366112709045, 'learning_rate': 0.0001813848717270195, 'epoch': 0.67}
{'loss': 0.4816, 'grad_norm': 0.6119241714477539, 'learning_rate': 0.00017827510958203147, 'epoch': 0.72}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 24%|β–ˆβ–ˆβ– | 150/627 [10:12<28:46, 3.62s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 24%|β–ˆβ–ˆβ– | 151/627 [10:20<1:03:28, 8.00s/it] 24%|β–ˆβ–ˆβ– | 152/627 [10:23<51:44, 6.54s/it] 24%|β–ˆβ–ˆβ– | 153/627 [10:27<45:23, 5.75s/it] 25%|β–ˆβ–ˆβ– | 154/627 [10:30<40:49, 5.18s/it] 25%|β–ˆβ–ˆβ– | 155/627 [10:34<37:47, 4.80s/it] 25%|β–ˆβ–ˆβ– | 156/627 [10:38<35:39, 4.54s/it] 25%|β–ˆβ–ˆβ–Œ | 157/627 [10:42<34:12, 4.37s/it] 25%|β–ˆβ–ˆβ–Œ | 158/627 [10:46<32:12, 4.12s/it] 25%|β–ˆβ–ˆβ–Œ | 159/627 [10:49<30:44, 3.94s/it] 26%|β–ˆβ–ˆβ–Œ | 160/627 [10:53<30:29, 3.92s/it] 26%|β–ˆβ–ˆβ–Œ | 160/627 [10:53<30:29, 3.92s/it] 26%|β–ˆβ–ˆβ–Œ | 161/627 [10:57<29:47, 3.84s/it] 26%|β–ˆβ–ˆβ–Œ | 162/627 [11:00<28:56, 3.73s/it] 26%|β–ˆβ–ˆβ–Œ | 163/627 [11:03<27:32, 3.56s/it] 26%|β–ˆβ–ˆβ–Œ | 164/627 [11:06<26:03, 3.38s/it] 26%|β–ˆβ–ˆβ–‹ | 165/627 [11:11<27:51, 3.62s/it] 26%|β–ˆβ–ˆβ–‹ | 166/627 [11:14<28:00, 3.65s/it] 27%|β–ˆβ–ˆβ–‹ | 167/627 [11:18<27:55, 3.64s/it] 27%|β–ˆβ–ˆβ–‹ | 168/627 [11:22<28:11, 3.68s/it] 27%|β–ˆβ–ˆβ–‹ | 169/627 [11:26<28:49, 3.78s/it] 27%|β–ˆβ–ˆβ–‹ | 170/627 [11:29<27:25, 3.60s/it] 27%|β–ˆβ–ˆβ–‹ | 170/627 [11:29<27:25, 3.60s/it] 27%|β–ˆβ–ˆβ–‹ | 171/627 [11:33<27:35, 3.63s/it] 27%|β–ˆβ–ˆβ–‹ | 172/627 [11:36<27:46, 3.66s/it] 28%|β–ˆβ–ˆβ–Š | 173/627 [11:40<28:41, 3.79s/it] 28%|β–ˆβ–ˆβ–Š | 174/627 [11:45<29:19, 3.88s/it] 28%|β–ˆβ–ˆβ–Š | 175/627 [11:48<28:38, 3.80s/it]{'eval_loss': 0.44454458355903625, 'eval_runtime': 11.1379, 'eval_samples_per_second': 15.712, 'eval_steps_per_second': 1.975, 'epoch': 0.72}
{'loss': 0.5097, 'grad_norm': 0.5294927954673767, 'learning_rate': 0.0001749564083741126, 'epoch': 0.77}
{'loss': 0.4043, 'grad_norm': 0.44832587242126465, 'learning_rate': 0.00017143762668326667, 'epoch': 0.81}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.96it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.28it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 28%|β–ˆβ–ˆβ–Š | 175/627 [11:59<28:38, 3.80s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 28%|β–ˆβ–ˆβ–Š | 176/627 [12:05<58:21, 7.76s/it] 28%|β–ˆβ–ˆβ–Š | 177/627 [12:08<48:15, 6.43s/it] 28%|β–ˆβ–ˆβ–Š | 178/627 [12:12<41:58, 5.61s/it] 29%|β–ˆβ–ˆβ–Š | 179/627 [12:16<37:14, 4.99s/it] 29%|β–ˆβ–ˆβ–Š | 180/627 [12:19<32:41, 4.39s/it] 29%|β–ˆβ–ˆβ–Š | 180/627 [12:19<32:41, 4.39s/it] 29%|β–ˆβ–ˆβ–‰ | 181/627 [12:22<29:42, 4.00s/it] 29%|β–ˆβ–ˆβ–‰ | 182/627 [12:25<28:41, 3.87s/it] 29%|β–ˆβ–ˆβ–‰ | 183/627 [12:30<29:17, 3.96s/it] 29%|β–ˆβ–ˆβ–‰ | 184/627 [12:33<28:49, 3.90s/it] 30%|β–ˆβ–ˆβ–‰ | 185/627 [12:37<28:07, 3.82s/it] 30%|β–ˆβ–ˆβ–‰ | 186/627 [12:41<28:34, 3.89s/it] 30%|β–ˆβ–ˆβ–‰ | 187/627 [12:44<26:37, 3.63s/it] 30%|β–ˆβ–ˆβ–‰ | 188/627 [12:47<25:00, 3.42s/it] 30%|β–ˆβ–ˆβ–ˆ | 189/627 [12:50<24:50, 3.40s/it] 30%|β–ˆβ–ˆβ–ˆ | 190/627 [12:54<24:59, 3.43s/it] 30%|β–ˆβ–ˆβ–ˆ | 190/627 [12:54<24:59, 3.43s/it] 30%|β–ˆβ–ˆβ–ˆ | 191/627 [12:57<24:14, 3.34s/it] 31%|β–ˆβ–ˆβ–ˆ | 192/627 [13:00<23:14, 3.21s/it] 31%|β–ˆβ–ˆβ–ˆ | 193/627 [13:03<22:14, 3.07s/it] 31%|β–ˆβ–ˆβ–ˆ | 194/627 [13:06<23:02, 3.19s/it] 31%|β–ˆβ–ˆβ–ˆ | 195/627 [13:09<23:24, 3.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 196/627 [13:14<25:11, 3.51s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 197/627 [13:17<25:35, 3.57s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 198/627 [13:20<23:23, 3.27s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 199/627 [13:23<23:30, 3.30s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 200/627 [13:27<23:42, 3.33s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 200/627 [13:27<23:42, 3.33s/it]{'eval_loss': 0.43418562412261963, 'eval_runtime': 11.1349, 'eval_samples_per_second': 15.716, 'eval_steps_per_second': 1.976, 'epoch': 0.84}
{'loss': 0.475, 'grad_norm': 0.45687973499298096, 'learning_rate': 0.00016772815716257412, 'epoch': 0.86}
{'loss': 0.4723, 'grad_norm': 0.949528157711029, 'learning_rate': 0.00016383790146646588, 'epoch': 0.91}
{'loss': 0.5401, 'grad_norm': 0.5013876557350159, 'learning_rate': 0.0001597772438203241, 'epoch': 0.96}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.84it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.11it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 32%|β–ˆβ–ˆβ–ˆβ– | 200/627 [13:38<23:42, 3.33s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 32%|β–ˆβ–ˆβ–ˆβ– | 201/627 [13:44<53:37, 7.55s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 202/627 [13:47<44:42, 6.31s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 203/627 [13:51<38:47, 5.49s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 204/627 [13:54<34:10, 4.85s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 205/627 [13:58<30:51, 4.39s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 206/627 [14:01<28:38, 4.08s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 207/627 [14:05<27:28, 3.93s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 208/627 [14:09<28:07, 4.03s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 209/627 [14:11<23:21, 3.35s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 210/627 [14:14<23:18, 3.35s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 210/627 [14:14<23:18, 3.35s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 211/627 [14:18<24:33, 3.54s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 212/627 [14:22<25:08, 3.64s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 213/627 [14:25<24:52, 3.61s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 214/627 [14:29<24:19, 3.53s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 215/627 [14:32<24:19, 3.54s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 216/627 [14:35<23:27, 3.42s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 217/627 [14:39<24:10, 3.54s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 218/627 [14:43<24:12, 3.55s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 219/627 [14:47<24:41, 3.63s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 220/627 [14:50<23:54, 3.53s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 220/627 [14:50<23:54, 3.53s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 221/627 [14:54<24:09, 3.57s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 222/627 [14:57<23:05, 3.42s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 223/627 [15:00<22:38, 3.36s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 224/627 [15:03<22:07, 3.30s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 225/627 [15:07<22:34, 3.37s/it]{'eval_loss': 0.4239582121372223, 'eval_runtime': 11.1435, 'eval_samples_per_second': 15.704, 'eval_steps_per_second': 1.974, 'epoch': 0.96}
{'loss': 0.385, 'grad_norm': 0.31174471974372864, 'learning_rate': 0.00015555702330196023, 'epoch': 1.0}
{'loss': 0.2984, 'grad_norm': 0.4381069242954254, 'learning_rate': 0.00015118850490896012, 'epoch': 1.05}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.96it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ | 225/627 [15:18<22:34, 3.37s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ | 226/627 [15:24<50:45, 7.59s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 227/627 [15:27<41:54, 6.29s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 228/627 [15:30<35:38, 5.36s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 229/627 [15:34<31:24, 4.74s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 230/627 [15:38<29:33, 4.47s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 230/627 [15:38<29:33, 4.47s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 231/627 [15:41<27:29, 4.17s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 232/627 [15:45<27:26, 4.17s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 233/627 [15:49<25:44, 3.92s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 234/627 [15:51<22:46, 3.48s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 235/627 [15:54<21:54, 3.35s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 236/627 [15:58<23:01, 3.53s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 237/627 [16:01<22:53, 3.52s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 238/627 [16:05<22:58, 3.54s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 239/627 [16:08<22:41, 3.51s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 240/627 [16:12<22:21, 3.47s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 240/627 [16:12<22:21, 3.47s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 241/627 [16:15<21:26, 3.33s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 242/627 [16:19<22:05, 3.44s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 243/627 [16:22<22:37, 3.53s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 244/627 [16:26<22:35, 3.54s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 245/627 [16:29<21:07, 3.32s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 246/627 [16:32<21:28, 3.38s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 247/627 [16:36<21:45, 3.43s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 248/627 [16:40<22:44, 3.60s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 249/627 [16:43<22:32, 3.58s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 250/627 [16:47<22:51, 3.64s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 250/627 [16:47<22:51, 3.64s/it]{'eval_loss': 0.4412894546985626, 'eval_runtime': 11.1379, 'eval_samples_per_second': 15.712, 'eval_steps_per_second': 1.975, 'epoch': 1.08}
{'loss': 0.263, 'grad_norm': 0.5986009240150452, 'learning_rate': 0.00014668334948912453, 'epoch': 1.1}
{'loss': 0.3041, 'grad_norm': 1.0014864206314087, 'learning_rate': 0.00014205358261427074, 'epoch': 1.15}
{'loss': 0.2734, 'grad_norm': 0.857399582862854, 'learning_rate': 0.00013731156248047904, 'epoch': 1.2}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.96it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.28it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 40%|β–ˆβ–ˆβ–ˆβ–‰ | 250/627 [16:58<22:51, 3.64s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 251/627 [17:04<47:51, 7.64s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 252/627 [17:08<40:45, 6.52s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 253/627 [17:11<34:59, 5.61s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 254/627 [17:15<30:13, 4.86s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 255/627 [17:19<28:49, 4.65s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 256/627 [17:23<27:11, 4.40s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 257/627 [17:26<25:45, 4.18s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 258/627 [17:29<23:21, 3.80s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 259/627 [17:32<22:10, 3.61s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 260/627 [17:36<22:34, 3.69s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 260/627 [17:36<22:34, 3.69s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 261/627 [17:40<22:08, 3.63s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 262/627 [17:43<20:52, 3.43s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 263/627 [17:47<21:50, 3.60s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 264/627 [17:51<22:43, 3.76s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 265/627 [17:54<21:49, 3.62s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 266/627 [17:58<22:55, 3.81s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 267/627 [18:01<21:35, 3.60s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 268/627 [18:05<21:35, 3.61s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 269/627 [18:09<22:59, 3.85s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 270/627 [18:13<21:36, 3.63s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 270/627 [18:13<21:36, 3.63s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 271/627 [18:16<21:16, 3.59s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 272/627 [18:19<20:32, 3.47s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 273/627 [18:22<19:45, 3.35s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 274/627 [18:26<19:43, 3.35s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 275/627 [18:29<20:08, 3.43s/it]{'eval_loss': 0.44424524903297424, 'eval_runtime': 11.132, 'eval_samples_per_second': 15.72, 'eval_steps_per_second': 1.976, 'epoch': 1.2}
{'loss': 0.3288, 'grad_norm': 0.8974189758300781, 'learning_rate': 0.00013246994692046836, 'epoch': 1.24}
{'loss': 0.2416, 'grad_norm': 0.738292932510376, 'learning_rate': 0.0001275416596161548, 'epoch': 1.29}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.84it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.73it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 275/627 [18:40<20:08, 3.43s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 276/627 [18:46<43:00, 7.35s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 277/627 [18:50<36:37, 6.28s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 278/627 [18:52<30:21, 5.22s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 279/627 [18:56<27:37, 4.76s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 280/627 [18:59<25:14, 4.37s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 280/627 [18:59<25:14, 4.37s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 281/627 [19:03<24:13, 4.20s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 282/627 [19:07<23:18, 4.05s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 283/627 [19:10<21:55, 3.82s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 284/627 [19:14<21:43, 3.80s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 285/627 [19:17<21:05, 3.70s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 286/627 [19:21<20:32, 3.61s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 287/627 [19:24<20:22, 3.59s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 288/627 [19:29<21:16, 3.77s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 289/627 [19:32<21:20, 3.79s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 290/627 [19:36<20:54, 3.72s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 290/627 [19:36<20:54, 3.72s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 291/627 [19:39<20:22, 3.64s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 292/627 [19:43<20:36, 3.69s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 293/627 [19:46<19:38, 3.53s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 294/627 [19:50<19:54, 3.59s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 295/627 [19:54<20:07, 3.64s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 296/627 [19:57<19:58, 3.62s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 297/627 [20:01<19:55, 3.62s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 298/627 [20:05<20:43, 3.78s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 299/627 [20:08<19:41, 3.60s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 300/627 [20:11<18:41, 3.43s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 300/627 [20:11<18:41, 3.43s/it]{'eval_loss': 0.43532201647758484, 'eval_runtime': 11.1396, 'eval_samples_per_second': 15.71, 'eval_steps_per_second': 1.975, 'epoch': 1.32}
{'loss': 0.2525, 'grad_norm': 0.7868597507476807, 'learning_rate': 0.00012253985560158062, 'epoch': 1.34}
{'loss': 0.3057, 'grad_norm': 0.6407854557037354, 'learning_rate': 0.00011747788614829758, 'epoch': 1.39}
{'loss': 0.3063, 'grad_norm': 0.6462728977203369, 'learning_rate': 0.00011236926312693479, 'epoch': 1.44}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.51it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.11it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.94it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 300/627 [20:23<18:41, 3.43s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 301/627 [20:29<41:29, 7.64s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 302/627 [20:33<35:05, 6.48s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 303/627 [20:37<30:42, 5.69s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 304/627 [20:40<27:33, 5.12s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 305/627 [20:45<26:05, 4.86s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 306/627 [20:48<23:45, 4.44s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 307/627 [20:51<21:17, 3.99s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 308/627 [20:55<21:46, 4.09s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 309/627 [20:59<21:06, 3.98s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 310/627 [21:02<18:44, 3.55s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 310/627 [21:02<18:44, 3.55s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 311/627 [21:05<17:54, 3.40s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 312/627 [21:08<17:47, 3.39s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 313/627 [21:12<18:51, 3.60s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 314/627 [21:16<18:37, 3.57s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 315/627 [21:19<17:58, 3.46s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 316/627 [21:22<17:17, 3.34s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 317/627 [21:26<18:31, 3.59s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 318/627 [21:30<18:37, 3.62s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 319/627 [21:33<18:11, 3.54s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 320/627 [21:37<18:49, 3.68s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 320/627 [21:37<18:49, 3.68s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 321/627 [21:41<19:02, 3.73s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 322/627 [21:45<18:46, 3.69s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 323/627 [21:49<19:31, 3.85s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 324/627 [21:53<20:13, 4.00s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 325/627 [21:57<20:38, 4.10s/it]{'eval_loss': 0.4346194863319397, 'eval_runtime': 11.1505, 'eval_samples_per_second': 15.694, 'eval_steps_per_second': 1.973, 'epoch': 1.44}
{'loss': 0.3454, 'grad_norm': 0.9527791142463684, 'learning_rate': 0.00010722762294008106, 'epoch': 1.48}
{'loss': 0.3254, 'grad_norm': 0.9974614977836609, 'learning_rate': 0.00010206669012275545, 'epoch': 1.53}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.84it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.51it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.11it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.94it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 325/627 [22:09<20:38, 4.10s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 326/627 [22:14<40:03, 7.99s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 327/627 [22:18<33:37, 6.72s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 328/627 [22:23<30:16, 6.08s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 329/627 [22:26<25:46, 5.19s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 330/627 [22:30<24:04, 4.86s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 330/627 [22:30<24:04, 4.86s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 331/627 [22:34<22:08, 4.49s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 332/627 [22:38<21:34, 4.39s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 333/627 [22:41<20:13, 4.13s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 334/627 [22:45<18:54, 3.87s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 335/627 [22:48<18:06, 3.72s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 336/627 [22:51<17:29, 3.61s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 337/627 [22:54<16:03, 3.32s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 338/627 [22:57<15:46, 3.27s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 339/627 [23:01<16:57, 3.53s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 340/627 [23:05<16:36, 3.47s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 340/627 [23:05<16:36, 3.47s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 341/627 [23:07<15:22, 3.23s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 342/627 [23:11<16:22, 3.45s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 343/627 [23:14<15:41, 3.31s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 344/627 [23:18<15:39, 3.32s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 345/627 [23:21<15:58, 3.40s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 346/627 [23:25<16:41, 3.57s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 347/627 [23:29<17:03, 3.66s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 348/627 [23:32<16:38, 3.58s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 349/627 [23:36<16:49, 3.63s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 350/627 [23:40<16:43, 3.62s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 350/627 [23:40<16:43, 3.62s/it]{'eval_loss': 0.437606543302536, 'eval_runtime': 11.1535, 'eval_samples_per_second': 15.69, 'eval_steps_per_second': 1.972, 'epoch': 1.56}
{'loss': 0.3722, 'grad_norm': 0.7936748266220093, 'learning_rate': 9.690024070762596e-05, 'epoch': 1.58}
{'loss': 0.3101, 'grad_norm': 0.7704805731773376, 'learning_rate': 9.174206545276677e-05, 'epoch': 1.63}
{'loss': 0.3047, 'grad_norm': 0.6996302604675293, 'learning_rate': 8.660593303010876e-05, 'epoch': 1.68}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.82it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.51it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.56it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.12it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 350/627 [23:51<16:43, 3.62s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 351/627 [23:57<36:05, 7.85s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 352/627 [24:02<30:58, 6.76s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 353/627 [24:05<26:12, 5.74s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 354/627 [24:08<22:57, 5.04s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 355/627 [24:12<20:16, 4.47s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 356/627 [24:15<18:22, 4.07s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 357/627 [24:18<17:49, 3.96s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 358/627 [24:21<16:33, 3.69s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 359/627 [24:25<16:23, 3.67s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 360/627 [24:29<16:48, 3.78s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 360/627 [24:29<16:48, 3.78s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 361/627 [24:33<16:43, 3.77s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 362/627 [24:37<16:37, 3.77s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 363/627 [24:39<15:13, 3.46s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 364/627 [24:43<15:29, 3.53s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 365/627 [24:46<15:05, 3.46s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 366/627 [24:50<14:43, 3.39s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 367/627 [24:53<15:00, 3.46s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 368/627 [24:57<15:27, 3.58s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 369/627 [25:01<15:34, 3.62s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 370/627 [25:04<15:21, 3.59s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 370/627 [25:04<15:21, 3.59s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 371/627 [25:07<14:31, 3.41s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 372/627 [25:11<14:44, 3.47s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 373/627 [25:15<15:31, 3.67s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 374/627 [25:19<15:49, 3.75s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 375/627 [25:23<16:11, 3.86s/it]{'eval_loss': 0.4239315390586853, 'eval_runtime': 11.1494, 'eval_samples_per_second': 15.696, 'eval_steps_per_second': 1.973, 'epoch': 1.68}
{'loss': 0.3147, 'grad_norm': 1.120160460472107, 'learning_rate': 8.150555327284417e-05, 'epoch': 1.72}
{'loss': 0.2812, 'grad_norm': 0.7699580192565918, 'learning_rate': 7.645454057988942e-05, 'epoch': 1.77}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.84it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.51it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.14it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.11it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 375/627 [25:34<16:11, 3.86s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 376/627 [25:40<32:52, 7.86s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 377/627 [25:45<28:28, 6.84s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 378/627 [25:49<24:44, 5.96s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 379/627 [25:52<21:59, 5.32s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 380/627 [25:57<20:39, 5.02s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 380/627 [25:57<20:39, 5.02s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 381/627 [26:00<18:55, 4.61s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 382/627 [26:04<17:43, 4.34s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 383/627 [26:08<17:04, 4.20s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 384/627 [26:13<17:41, 4.37s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 385/627 [26:17<17:23, 4.31s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 386/627 [26:21<16:57, 4.22s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 387/627 [26:24<15:28, 3.87s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 388/627 [26:27<14:38, 3.68s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 389/627 [26:31<14:44, 3.72s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 390/627 [26:34<13:59, 3.54s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 390/627 [26:34<13:59, 3.54s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 391/627 [26:37<13:07, 3.34s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 392/627 [26:41<13:21, 3.41s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 393/627 [26:45<14:09, 3.63s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 394/627 [26:48<13:22, 3.45s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 395/627 [26:51<13:33, 3.51s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 396/627 [26:55<13:53, 3.61s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 397/627 [26:59<13:26, 3.50s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 398/627 [27:02<12:58, 3.40s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 399/627 [27:06<13:36, 3.58s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 400/627 [27:09<13:20, 3.52s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 400/627 [27:09<13:20, 3.52s/it]{'eval_loss': 0.4227089285850525, 'eval_runtime': 11.15, 'eval_samples_per_second': 15.695, 'eval_steps_per_second': 1.973, 'epoch': 1.8}
{'loss': 0.3651, 'grad_norm': 1.090262770652771, 'learning_rate': 7.146637757508949e-05, 'epoch': 1.82}
{'loss': 0.3555, 'grad_norm': 0.8595877885818481, 'learning_rate': 6.655437911816838e-05, 'epoch': 1.87}
{'loss': 0.3476, 'grad_norm': 0.9766652584075928, 'learning_rate': 6.173165676349103e-05, 'epoch': 1.91}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.78it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.48it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.11it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.55it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.12it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.94it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.85it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.82it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.76it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.71it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.74it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.83it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.94it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.03it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.06it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.13it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.26it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.26it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.10it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.94it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.87it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 400/627 [27:20<13:20, 3.52s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.87it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 401/627 [27:28<30:17, 8.04s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 402/627 [27:31<24:28, 6.53s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 403/627 [27:34<20:52, 5.59s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 404/627 [27:38<19:07, 5.14s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 405/627 [27:42<17:14, 4.66s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 406/627 [27:45<16:05, 4.37s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 407/627 [27:49<15:01, 4.10s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 408/627 [27:53<14:41, 4.03s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 409/627 [27:56<14:01, 3.86s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 410/627 [28:00<13:32, 3.74s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 410/627 [28:00<13:32, 3.74s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 411/627 [28:03<13:16, 3.69s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 412/627 [28:07<12:52, 3.59s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 413/627 [28:10<12:38, 3.54s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 414/627 [28:14<12:40, 3.57s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 415/627 [28:17<12:19, 3.49s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 416/627 [28:21<12:59, 3.69s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 417/627 [28:25<13:18, 3.80s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 418/627 [28:28<12:20, 3.54s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 419/627 [28:32<12:14, 3.53s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 420/627 [28:35<11:44, 3.40s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 420/627 [28:35<11:44, 3.40s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 421/627 [28:38<11:37, 3.39s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 422/627 [28:42<11:40, 3.42s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 423/627 [28:46<12:42, 3.74s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 424/627 [28:50<13:09, 3.89s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 425/627 [28:54<13:01, 3.87s/it]{'eval_loss': 0.4214031994342804, 'eval_runtime': 11.2256, 'eval_samples_per_second': 15.589, 'eval_steps_per_second': 1.96, 'epoch': 1.91}
{'loss': 0.2627, 'grad_norm': 0.8787949681282043, 'learning_rate': 5.7011083761506344e-05, 'epoch': 1.96}
{'loss': 0.3227, 'grad_norm': 0.528915524482727, 'learning_rate': 5.240526069629265e-05, 'epoch': 2.01}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.52it/s]
18%|β–ˆβ–Š | 4/22 [00:01<00:05, 3.15it/s]
23%|β–ˆβ–ˆβ–Ž | 5/22 [00:01<00:06, 2.57it/s]
27%|β–ˆβ–ˆβ–‹ | 6/22 [00:02<00:07, 2.13it/s]
32%|β–ˆβ–ˆβ–ˆβ– | 7/22 [00:02<00:07, 1.95it/s]
36%|β–ˆβ–ˆβ–ˆβ–‹ | 8/22 [00:03<00:07, 1.87it/s]
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 9/22 [00:04<00:07, 1.83it/s]
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 10/22 [00:04<00:06, 1.77it/s]
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 11/22 [00:05<00:06, 1.72it/s]
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 12/22 [00:05<00:05, 1.75it/s]
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 13/22 [00:06<00:04, 1.85it/s]
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 14/22 [00:06<00:04, 1.95it/s]
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 15/22 [00:07<00:03, 2.04it/s]
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 16/22 [00:07<00:02, 2.07it/s]
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 17/22 [00:08<00:02, 2.14it/s]
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 18/22 [00:08<00:01, 2.27it/s]
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 19/22 [00:08<00:01, 2.27it/s]
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 20/22 [00:09<00:00, 2.11it/s]
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 21/22 [00:10<00:00, 1.95it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 425/627 [29:05<13:01, 3.87s/it]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 22/22 [00:10<00:00, 1.88it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 426/627 [29:12<27:20, 8.16s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 427/627 [29:16<22:32, 6.76s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 428/627 [29:19<18:38, 5.62s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 429/627 [29:22<16:35, 5.03s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 430/627 [29:26<15:18, 4.66s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 430/627 [29:26<15:18, 4.66s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 431/627 [29:30<14:19, 4.39s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 432/627 [29:34<13:30, 4.16s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 433/627 [29:37<13:05, 4.05s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 434/627 [29:41<12:12, 3.80s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 435/627 [29:44<11:32, 3.61s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 436/627 [29:48<11:56, 3.75s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 437/627 [29:52<12:02, 3.80s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 438/627 [29:55<11:34, 3.67s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 439/627 [29:59<11:38, 3.72s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 440/627 [30:02<10:56, 3.51s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 440/627 [30:02<10:56, 3.51s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 441/627 [30:05<10:47, 3.48s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 442/627 [30:09<10:38, 3.45s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 443/627 [30:12<10:17, 3.36s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 444/627 [30:15<10:14, 3.36s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 445/627 [30:19<10:21, 3.41s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 446/627 [30:22<10:17, 3.41s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 447/627 [30:27<11:15, 3.75s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 448/627 [30:29<09:57, 3.34s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 449/627 [30:33<10:35, 3.57s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 450/627 [30:37<10:18, 3.50s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 450/627 [30:37<10:18, 3.50s/it]{'eval_loss': 0.4369052052497864, 'eval_runtime': 11.142, 'eval_samples_per_second': 15.706, 'eval_steps_per_second': 1.975, 'epoch': 2.03}
{'loss': 0.1542, 'grad_norm': 0.810612142086029, 'learning_rate': 4.792648185092937e-05, 'epoch': 2.06}
{'loss': 0.1741, 'grad_norm': 1.2276535034179688, 'learning_rate': 4.35867023904749e-05, 'epoch': 2.11}
{'loss': 0.1377, 'grad_norm': 0.9994837045669556, 'learning_rate': 3.939750645014977e-05, 'epoch': 2.15}
0%| | 0/22 [00:00<?, ?it/s]
9%|β–‰ | 2/22 [00:00<00:04, 4.83it/s]
14%|β–ˆβ–Ž | 3/22 [00:00<00:05, 3.51it/s]