🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
⚙️ Running in WANDB offline mode
🦥 Unsloth Zoo will now patch everything to make training faster!
==((====))== Unsloth 2026.9.2: Fast Qwen3 patching. Transformers: 4.57.6.
\\ /| NVIDIA H100 NVL. Num GPUs = 1. Max memory: 93.085 GB. Platform: Linux.
O^O/ \_/ \ Torch: 2.11.0+cu128. CUDA: 9.0. CUDA Toolkit: 12.8. Triton: 3.6.0
\ / Bfloat16 = TRUE. FA [Xformers = 0.0.35. FA2 = False]
"-____-" Free license: http://github.com/unslothai/unsloth
Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!
Unsloth: Dropout = 0 is supported for fast patching. You are using dropout = 0.05.
Unsloth will patch all other layers, except LoRA matrices, causing a performance hit.
Unsloth 2026.9.2 patched 36 layers with 0 QKV layers, 0 O layers and 0 MLP layers.
Unsloth: Offloading input_embeddings to disk to save VRAM
Unsloth: Offloading output_embeddings to disk to save VRAM
Unsloth: Training embed_tokens in mixed precision to save VRAM
Unsloth: Training lm_head in mixed precision to save VRAM
Generating train split: 0 examples [00:00, ? examples/s]Generating train split: 922 examples [00:00, 4342.96 examples/s]Generating train split: 1832 examples [00:00, 2501.09 examples/s]Generating train split: 2738 examples [00:00, 3004.52 examples/s]Generating train split: 3657 examples [00:01, 3622.88 examples/s]Generating train split: 4531 examples [00:01, 3650.97 examples/s]Generating train split: 5444 examples [00:01, 2832.86 examples/s]Generating train split: 6344 examples [00:01, 3195.64 examples/s]Generating train split: 7260 examples [00:02, 3421.72 examples/s]Generating train split: 8228 examples [00:02, 2760.04 examples/s]Generating train split: 9118 examples [00:02, 3045.88 examples/s]Generating train split: 10035 examples [00:03, 3303.04 examples/s]Generating train split: 10932 examples [00:03, 3497.24 examples/s]Generating train split: 11851 examples [00:03, 2723.08 examples/s]Generating train split: 12762 examples [00:04, 3040.59 examples/s]Generating train split: 13692 examples [00:04, 3326.80 examples/s]Generating train split: 14586 examples [00:04, 3528.29 examples/s]Generating train split: 15482 examples [00:05, 2774.02 examples/s]Generating train split: 16382 examples [00:05, 3013.23 examples/s]Generating train split: 17267 examples [00:05, 3226.11 examples/s]Generating train split: 18175 examples [00:06, 2588.97 examples/s]Generating train split: 18500 examples [00:06, 3035.96 examples/s]
tokenizing (num_proc=8): 0%| | 0/18500 [00:00<?, ? examples/s]tokenizing (num_proc=8): 0%| | 5/18500 [00:01<1:03:35, 4.85 examples/s]tokenizing (num_proc=8): 0%| | 29/18500 [00:01<09:22, 32.85 examples/s] tokenizing (num_proc=8): 0%| | 79/18500 [00:01<03:02, 100.89 examples/s]tokenizing (num_proc=8): 1%| | 123/18500 [00:01<01:55, 158.70 examples/s]tokenizing (num_proc=8): 1%| | 198/18500 [00:01<01:08, 268.70 examples/s]tokenizing (num_proc=8): 2%|▏ | 279/18500 [00:01<00:47, 382.34 examples/s]tokenizing (num_proc=8): 2%|▏ | 380/18500 [00:01<00:35, 516.13 examples/s]tokenizing (num_proc=8): 3%|▎ | 484/18500 [00:01<00:28, 631.04 examples/s]tokenizing (num_proc=8): 3%|▎ | 578/18500 [00:01<00:25, 696.97 examples/s]tokenizing (num_proc=8): 4%|▎ | 682/18500 [00:01<00:22, 776.08 examples/s]tokenizing (num_proc=8): 4%|▍ | 790/18500 [00:02<00:20, 848.52 examples/s]tokenizing (num_proc=8): 5%|▍ | 885/18500 [00:02<00:20, 839.30 examples/s]tokenizing (num_proc=8): 5%|▌ | 976/18500 [00:02<00:20, 836.34 examples/s]tokenizing (num_proc=8): 6%|▌ | 1069/18500 [00:02<00:21, 826.85 examples/s]tokenizing (num_proc=8): 6%|▌ | 1156/18500 [00:02<00:22, 787.98 examples/s]tokenizing (num_proc=8): 7%|▋ | 1246/18500 [00:02<00:21, 814.25 examples/s]tokenizing (num_proc=8): 7%|▋ | 1341/18500 [00:02<00:20, 834.09 examples/s]tokenizing (num_proc=8): 8%|▊ | 1442/18500 [00:02<00:19, 863.03 examples/s]tokenizing (num_proc=8): 8%|▊ | 1548/18500 [00:02<00:18, 897.45 examples/s]tokenizing (num_proc=8): 9%|▉ | 1654/18500 [00:03<00:18, 932.88 examples/s]tokenizing (num_proc=8): 9%|▉ | 1754/18500 [00:03<00:18, 925.78 examples/s]tokenizing (num_proc=8): 10%|█ | 1852/18500 [00:03<00:17, 929.46 examples/s]tokenizing (num_proc=8): 11%|█ | 1951/18500 [00:03<00:17, 924.47 examples/s]tokenizing (num_proc=8): 11%|█ | 2063/18500 [00:03<00:17, 966.16 examples/s]tokenizing (num_proc=8): 12%|█▏ | 2181/18500 [00:03<00:16, 1007.31 examples/s]tokenizing (num_proc=8): 12%|█▏ | 2287/18500 [00:03<00:16, 992.37 examples/s] tokenizing (num_proc=8): 13%|█▎ | 2402/18500 [00:03<00:15, 1018.72 examples/s]tokenizing (num_proc=8): 14%|█▎ | 2525/18500 [00:03<00:15, 1048.03 examples/s]tokenizing (num_proc=8): 14%|█▍ | 2631/18500 [00:04<00:15, 1040.70 examples/s]tokenizing (num_proc=8): 15%|█▍ | 2736/18500 [00:04<00:15, 1020.62 examples/s]tokenizing (num_proc=8): 15%|█▌ | 2847/18500 [00:04<00:15, 1019.94 examples/s]tokenizing (num_proc=8): 16%|█▌ | 2958/18500 [00:04<00:15, 1023.17 examples/s]tokenizing (num_proc=8): 17%|█▋ | 3071/18500 [00:04<00:15, 1004.38 examples/s]tokenizing (num_proc=8): 17%|█▋ | 3179/18500 [00:04<00:15, 1015.51 examples/s]tokenizing (num_proc=8): 18%|█▊ | 3282/18500 [00:04<00:15, 977.80 examples/s] tokenizing (num_proc=8): 18%|█▊ | 3408/18500 [00:04<00:14, 1050.40 examples/s]tokenizing (num_proc=8): 19%|█▉ | 3524/18500 [00:04<00:14, 1017.94 examples/s]tokenizing (num_proc=8): 20%|█▉ | 3649/18500 [00:05<00:14, 1059.18 examples/s]tokenizing (num_proc=8): 20%|██ | 3757/18500 [00:05<00:13, 1062.41 examples/s]tokenizing (num_proc=8): 21%|██ | 3865/18500 [00:05<00:14, 1030.20 examples/s]tokenizing (num_proc=8): 22%|██▏ | 3978/18500 [00:05<00:13, 1053.30 examples/s]tokenizing (num_proc=8): 22%|██▏ | 4097/18500 [00:05<00:13, 1086.03 examples/s]tokenizing (num_proc=8): 23%|██▎ | 4225/18500 [00:05<00:13, 1096.67 examples/s]tokenizing (num_proc=8): 24%|██▎ | 4354/18500 [00:05<00:12, 1148.58 examples/s]tokenizing (num_proc=8): 24%|██▍ | 4490/18500 [00:05<00:11, 1178.09 examples/s]tokenizing (num_proc=8): 25%|██▍ | 4615/18500 [00:05<00:11, 1180.63 examples/s]tokenizing (num_proc=8): 26%|██▌ | 4740/18500 [00:06<00:11, 1173.56 examples/s]tokenizing (num_proc=8): 26%|██▋ | 4863/18500 [00:06<00:11, 1158.61 examples/s]tokenizing (num_proc=8): 27%|██▋ | 4981/18500 [00:06<00:12, 1073.57 examples/s]tokenizing (num_proc=8): 28%|██▊ | 5091/18500 [00:06<00:12, 1059.39 examples/s]tokenizing (num_proc=8): 28%|██▊ | 5200/18500 [00:06<00:12, 1064.74 examples/s]tokenizing (num_proc=8): 29%|██▉ | 5319/18500 [00:06<00:12, 1053.82 examples/s]tokenizing (num_proc=8): 29%|██▉ | 5442/18500 [00:06<00:12, 1069.45 examples/s]tokenizing (num_proc=8): 30%|███ | 5581/18500 [00:06<00:11, 1112.38 examples/s]tokenizing (num_proc=8): 31%|███ | 5716/18500 [00:06<00:11, 1137.71 examples/s]tokenizing (num_proc=8): 32%|███▏ | 5835/18500 [00:07<00:11, 1122.99 examples/s]tokenizing (num_proc=8): 32%|███▏ | 5960/18500 [00:07<00:11, 1139.36 examples/s]tokenizing (num_proc=8): 33%|███▎ | 6077/18500 [00:07<00:10, 1132.26 examples/s]tokenizing (num_proc=8): 33%|███▎ | 6196/18500 [00:07<00:11, 1104.58 examples/s]tokenizing (num_proc=8): 34%|███▍ | 6321/18500 [00:07<00:10, 1141.29 examples/s]tokenizing (num_proc=8): 35%|███▍ | 6440/18500 [00:07<00:10, 1147.90 examples/s]tokenizing (num_proc=8): 35%|███▌ | 6567/18500 [00:07<00:10, 1172.01 examples/s]tokenizing (num_proc=8): 36%|███▌ | 6686/18500 [00:07<00:10, 1112.30 examples/s]tokenizing (num_proc=8): 37%|███▋ | 6814/18500 [00:07<00:10, 1135.00 examples/s]tokenizing (num_proc=8): 37%|███▋ | 6932/18500 [00:07<00:10, 1143.99 examples/s]tokenizing (num_proc=8): 38%|███▊ | 7047/18500 [00:08<00:10, 1143.55 examples/s]tokenizing (num_proc=8): 39%|███▉ | 7174/18500 [00:08<00:09, 1172.57 examples/s]tokenizing (num_proc=8): 40%|███▉ | 7311/18500 [00:08<00:09, 1204.18 examples/s]tokenizing (num_proc=8): 40%|████ | 7433/18500 [00:08<00:09, 1162.23 examples/s]tokenizing (num_proc=8): 41%|████ | 7559/18500 [00:08<00:10, 1072.71 examples/s]tokenizing (num_proc=8): 41%|████▏ | 7671/18500 [00:08<00:12, 890.94 examples/s] tokenizing (num_proc=8): 42%|████▏ | 7773/18500 [00:08<00:14, 756.27 examples/s]tokenizing (num_proc=8): 42%|████▏ | 7856/18500 [00:09<00:16, 639.50 examples/s]tokenizing (num_proc=8): 43%|████▎ | 7931/18500 [00:09<00:22, 473.05 examples/s]tokenizing (num_proc=8): 43%|████▎ | 7994/18500 [00:09<00:21, 479.02 examples/s]tokenizing (num_proc=8): 44%|████▎ | 8054/18500 [00:09<00:21, 484.57 examples/s]tokenizing (num_proc=8): 44%|████▍ | 8130/18500 [00:09<00:19, 542.02 examples/s]tokenizing (num_proc=8): 44%|████▍ | 8220/18500 [00:09<00:16, 607.38 examples/s]tokenizing (num_proc=8): 45%|████▌ | 8328/18500 [00:09<00:14, 699.36 examples/s]tokenizing (num_proc=8): 46%|████▌ | 8440/18500 [00:10<00:12, 799.40 examples/s]tokenizing (num_proc=8): 46%|████▌ | 8532/18500 [00:10<00:12, 824.80 examples/s]tokenizing (num_proc=8): 47%|████▋ | 8636/18500 [00:10<00:11, 881.93 examples/s]tokenizing (num_proc=8): 47%|████▋ | 8737/18500 [00:10<00:11, 859.76 examples/s]tokenizing (num_proc=8): 48%|████▊ | 8852/18500 [00:10<00:10, 929.36 examples/s]tokenizing (num_proc=8): 48%|████▊ | 8967/18500 [00:10<00:09, 976.55 examples/s]tokenizing (num_proc=8): 49%|████▉ | 9071/18500 [00:10<00:09, 977.85 examples/s]tokenizing (num_proc=8): 50%|████▉ | 9196/18500 [00:10<00:08, 1038.41 examples/s]tokenizing (num_proc=8): 50%|█████ | 9303/18500 [00:10<00:08, 1032.08 examples/s]tokenizing (num_proc=8): 51%|█████ | 9411/18500 [00:11<00:08, 1022.49 examples/s]tokenizing (num_proc=8): 52%|█████▏ | 9537/18500 [00:11<00:08, 1042.10 examples/s]tokenizing (num_proc=8): 52%|█████▏ | 9679/18500 [00:11<00:07, 1117.24 examples/s]tokenizing (num_proc=8): 53%|█████▎ | 9820/18500 [00:11<00:07, 1147.24 examples/s]tokenizing (num_proc=8): 54%|█████▍ | 9958/18500 [00:11<00:07, 1200.80 examples/s]tokenizing (num_proc=8): 54%|█████▍ | 10081/18500 [00:11<00:07, 1185.01 examples/s]tokenizing (num_proc=8): 55%|█████▌ | 10205/18500 [00:11<00:06, 1192.77 examples/s]tokenizing (num_proc=8): 56%|█████▌ | 10335/18500 [00:11<00:06, 1192.48 examples/s]tokenizing (num_proc=8): 57%|█████▋ | 10469/18500 [00:11<00:06, 1188.61 examples/s]tokenizing (num_proc=8): 57%|█████▋ | 10602/18500 [00:12<00:06, 1198.12 examples/s]tokenizing (num_proc=8): 58%|█████▊ | 10723/18500 [00:12<00:06, 1157.15 examples/s]tokenizing (num_proc=8): 59%|█████▉ | 10881/18500 [00:12<00:05, 1273.94 examples/s]tokenizing (num_proc=8): 60%|█████▉ | 11020/18500 [00:12<00:05, 1279.20 examples/s]tokenizing (num_proc=8): 60%|██████ | 11158/18500 [00:12<00:05, 1225.80 examples/s]tokenizing (num_proc=8): 61%|██████ | 11284/18500 [00:12<00:05, 1227.45 examples/s]tokenizing (num_proc=8): 62%|██████▏ | 11414/18500 [00:12<00:05, 1238.75 examples/s]tokenizing (num_proc=8): 62%|██████▏ | 11545/18500 [00:12<00:05, 1238.37 examples/s]tokenizing (num_proc=8): 63%|██████▎ | 11674/18500 [00:12<00:05, 1221.66 examples/s]tokenizing (num_proc=8): 64%|██████▍ | 11829/18500 [00:12<00:05, 1312.07 examples/s]tokenizing (num_proc=8): 65%|██████▍ | 11970/18500 [00:13<00:05, 1295.02 examples/s]tokenizing (num_proc=8): 65%|██████▌ | 12101/18500 [00:13<00:04, 1297.00 examples/s]tokenizing (num_proc=8): 66%|██████▌ | 12233/18500 [00:13<00:05, 1244.80 examples/s]tokenizing (num_proc=8): 67%|██████▋ | 12361/18500 [00:13<00:05, 1218.00 examples/s]tokenizing (num_proc=8): 68%|██████▊ | 12492/18500 [00:13<00:04, 1218.01 examples/s]tokenizing (num_proc=8): 68%|██████▊ | 12617/18500 [00:13<00:04, 1207.81 examples/s]tokenizing (num_proc=8): 69%|██████▉ | 12741/18500 [00:13<00:04, 1215.07 examples/s]tokenizing (num_proc=8): 70%|██████▉ | 12878/18500 [00:13<00:04, 1241.68 examples/s]tokenizing (num_proc=8): 70%|███████ | 13005/18500 [00:13<00:04, 1231.95 examples/s]tokenizing (num_proc=8): 71%|███████ | 13146/18500 [00:14<00:04, 1267.54 examples/s]tokenizing (num_proc=8): 72%|███████▏ | 13274/18500 [00:14<00:04, 1226.06 examples/s]tokenizing (num_proc=8): 72%|███████▏ | 13407/18500 [00:14<00:04, 1254.65 examples/s]tokenizing (num_proc=8): 73%|███████▎ | 13550/18500 [00:14<00:03, 1250.45 examples/s]tokenizing (num_proc=8): 74%|███████▍ | 13690/18500 [00:14<00:03, 1248.22 examples/s]tokenizing (num_proc=8): 75%|███████▍ | 13819/18500 [00:14<00:03, 1217.70 examples/s]tokenizing (num_proc=8): 75%|███████▌ | 13943/18500 [00:14<00:03, 1201.16 examples/s]tokenizing (num_proc=8): 76%|███████▌ | 14077/18500 [00:14<00:03, 1218.20 examples/s]tokenizing (num_proc=8): 77%|███████▋ | 14202/18500 [00:14<00:03, 1206.97 examples/s]tokenizing (num_proc=8): 77%|███████▋ | 14332/18500 [00:15<00:03, 1208.90 examples/s]tokenizing (num_proc=8): 78%|███████▊ | 14470/18500 [00:15<00:03, 1243.67 examples/s]tokenizing (num_proc=8): 79%|███████▉ | 14599/18500 [00:15<00:03, 1228.49 examples/s]tokenizing (num_proc=8): 80%|███████▉ | 14728/18500 [00:15<00:03, 1213.10 examples/s]tokenizing (num_proc=8): 80%|████████ | 14856/18500 [00:15<00:02, 1225.94 examples/s]tokenizing (num_proc=8): 81%|████████ | 14983/18500 [00:15<00:02, 1182.19 examples/s]tokenizing (num_proc=8): 82%|████████▏ | 15102/18500 [00:15<00:02, 1158.71 examples/s]tokenizing (num_proc=8): 82%|████████▏ | 15221/18500 [00:15<00:03, 1020.06 examples/s]tokenizing (num_proc=8): 83%|████████▎ | 15364/18500 [00:15<00:02, 1116.12 examples/s]tokenizing (num_proc=8): 84%|████████▎ | 15480/18500 [00:16<00:02, 1117.33 examples/s]tokenizing (num_proc=8): 84%|████████▍ | 15603/18500 [00:16<00:02, 1114.83 examples/s]tokenizing (num_proc=8): 85%|████████▍ | 15720/18500 [00:16<00:02, 1039.62 examples/s]tokenizing (num_proc=8): 86%|████████▌ | 15827/18500 [00:16<00:02, 980.10 examples/s] tokenizing (num_proc=8): 86%|████████▌ | 15935/18500 [00:16<00:02, 992.36 examples/s]tokenizing (num_proc=8): 87%|████████▋ | 16050/18500 [00:16<00:02, 1013.52 examples/s]tokenizing (num_proc=8): 87%|████████▋ | 16158/18500 [00:16<00:02, 1007.62 examples/s]tokenizing (num_proc=8): 88%|████████▊ | 16269/18500 [00:16<00:02, 1023.51 examples/s]tokenizing (num_proc=8): 88%|████████▊ | 16372/18500 [00:16<00:02, 983.29 examples/s] tokenizing (num_proc=8): 89%|████████▉ | 16478/18500 [00:17<00:02, 960.04 examples/s]tokenizing (num_proc=8): 90%|████████▉ | 16585/18500 [00:17<00:01, 963.49 examples/s]tokenizing (num_proc=8): 90%|█████████ | 16722/18500 [00:17<00:01, 1058.09 examples/s]tokenizing (num_proc=8): 91%|█████████ | 16862/18500 [00:17<00:01, 1109.99 examples/s]tokenizing (num_proc=8): 92%|█████████▏| 16984/18500 [00:17<00:01, 1105.74 examples/s]tokenizing (num_proc=8): 92%|█████████▏| 17106/18500 [00:17<00:01, 1104.30 examples/s]tokenizing (num_proc=8): 93%|█████████▎| 17224/18500 [00:17<00:01, 1102.42 examples/s]tokenizing (num_proc=8): 94%|█████████▎| 17343/18500 [00:17<00:01, 1079.57 examples/s]tokenizing (num_proc=8): 94%|█████████▍| 17463/18500 [00:17<00:00, 1055.68 examples/s]tokenizing (num_proc=8): 95%|█████████▍| 17572/18500 [00:18<00:00, 1031.45 examples/s]tokenizing (num_proc=8): 96%|█████████▌| 17677/18500 [00:18<00:00, 978.00 examples/s] tokenizing (num_proc=8): 96%|█████████▌| 17786/18500 [00:18<00:00, 896.10 examples/s]tokenizing (num_proc=8): 97%|█████████▋| 17879/18500 [00:18<00:00, 832.61 examples/s]tokenizing (num_proc=8): 97%|█████████▋| 17968/18500 [00:18<00:00, 765.28 examples/s]tokenizing (num_proc=8): 98%|█████████▊| 18049/18500 [00:18<00:00, 690.00 examples/s]tokenizing (num_proc=8): 98%|█████████▊| 18121/18500 [00:18<00:00, 656.85 examples/s]tokenizing (num_proc=8): 98%|█████████▊| 18189/18500 [00:19<00:00, 584.39 examples/s]tokenizing (num_proc=8): 99%|█████████▊| 18250/18500 [00:19<00:00, 502.36 examples/s]tokenizing (num_proc=8): 99%|█████████▉| 18315/18500 [00:19<00:00, 354.09 examples/s]tokenizing (num_proc=8): 99%|█████████▉| 18368/18500 [00:19<00:00, 297.74 examples/s]tokenizing (num_proc=8): 99%|█████████▉| 18407/18500 [00:20<00:00, 261.84 examples/s]tokenizing (num_proc=8): 100%|█████████▉| 18445/18500 [00:20<00:00, 239.27 examples/s]tokenizing (num_proc=8): 100%|█████████▉| 18475/18500 [00:20<00:00, 228.20 examples/s]tokenizing (num_proc=8): 100%|██████████| 18500/18500 [00:20<00:00, 185.84 examples/s]tokenizing (num_proc=8): 100%|██████████| 18500/18500 [00:20<00:00, 887.30 examples/s]
Filter: 0%| | 0/18500 [00:00<?, ? examples/s]Filter: 5%|▌ | 1000/18500 [00:00<00:06, 2637.21 examples/s]Filter: 11%|█ | 2000/18500 [00:00<00:05, 2896.99 examples/s]Filter: 16%|█▌ | 3000/18500 [00:01<00:05, 2876.31 examples/s]Filter: 22%|██▏ | 4000/18500 [00:01<00:05, 2888.39 examples/s]Filter: 27%|██▋ | 5000/18500 [00:01<00:04, 2881.72 examples/s]Filter: 32%|███▏ | 6000/18500 [00:02<00:04, 2954.53 examples/s]Filter: 38%|███▊ | 7000/18500 [00:02<00:03, 2971.68 examples/s]Filter: 43%|████▎ | 8000/18500 [00:02<00:03, 3006.64 examples/s]Filter: 49%|████▊ | 9000/18500 [00:03<00:03, 3107.16 examples/s]Filter: 54%|█████▍ | 10000/18500 [00:03<00:02, 2989.60 examples/s]Filter: 59%|█████▉ | 11000/18500 [00:03<00:02, 3184.38 examples/s]Filter: 65%|██████▍ | 12000/18500 [00:03<00:02, 3209.39 examples/s]Filter: 70%|███████ | 13000/18500 [00:04<00:01, 3162.42 examples/s]Filter: 76%|███████▌ | 14000/18500 [00:04<00:01, 3230.63 examples/s]Filter: 81%|████████ | 15000/18500 [00:04<00:01, 3444.72 examples/s]Filter: 86%|████████▋ | 16000/18500 [00:05<00:00, 3571.75 examples/s]Filter: 92%|█████████▏| 17000/18500 [00:05<00:00, 3752.73 examples/s]Filter: 97%|█████████▋| 18000/18500 [00:05<00:00, 3873.70 examples/s]Filter: 100%|██████████| 18500/18500 [00:05<00:00, 3969.92 examples/s]Filter: 100%|██████████| 18500/18500 [00:05<00:00, 3264.65 examples/s]
Filter: 0%| | 0/18500 [00:00<?, ? examples/s]Filter: 5%|▌ | 1000/18500 [00:00<00:04, 4026.78 examples/s]Filter: 11%|█ | 2000/18500 [00:00<00:04, 4097.66 examples/s]Filter: 16%|█▌ | 3000/18500 [00:00<00:03, 4088.88 examples/s]Filter: 22%|██▏ | 4000/18500 [00:00<00:03, 4137.50 examples/s]Filter: 27%|██▋ | 5000/18500 [00:01<00:03, 4018.16 examples/s]Filter: 32%|███▏ | 6000/18500 [00:01<00:03, 4075.61 examples/s]Filter: 38%|███▊ | 7000/18500 [00:01<00:02, 3931.68 examples/s]Filter: 43%|████▎ | 8000/18500 [00:01<00:02, 4005.67 examples/s]Filter: 49%|████▊ | 9000/18500 [00:02<00:02, 4066.63 examples/s]Filter: 54%|█████▍ | 10000/18500 [00:02<00:02, 3954.10 examples/s]Filter: 59%|█████▉ | 11000/18500 [00:02<00:01, 4036.41 examples/s]Filter: 65%|██████▍ | 12000/18500 [00:03<00:01, 3895.12 examples/s]Filter: 70%|███████ | 13000/18500 [00:03<00:01, 3965.89 examples/s]Filter: 76%|███████▌ | 14000/18500 [00:03<00:01, 4013.53 examples/s]Filter: 81%|████████ | 15000/18500 [00:03<00:00, 4006.06 examples/s]Filter: 86%|████████▋ | 16000/18500 [00:03<00:00, 4020.15 examples/s]Filter: 92%|█████████▏| 17000/18500 [00:04<00:00, 4004.43 examples/s]Filter: 97%|█████████▋| 18000/18500 [00:04<00:00, 4010.77 examples/s]Filter: 100%|██████████| 18500/18500 [00:04<00:00, 4097.52 examples/s]Filter: 100%|██████████| 18500/18500 [00:04<00:00, 4023.15 examples/s]
supervised tokens: tool 4394688, replay 10773075 (71.0% replay)
replay capped to 25% of supervised tokens: kept 1464869 replay tokens, 1259 replay rows
rows: 18500 raw -> 10076 kept; by source: {'replay:compassion_12185_cleaned': 1259, 'recovery': 3750, 'apigen': 4567, 'efficiency': 500}
[manifest] git=6950fbbc6f29902d7fc5b26c1aef8d053966e9a3 data_sha256={'train_qwen-compassion_replay50.jsonl': '1f22b1da2039'}
wandb: WARNING git root /workspace/anchor/qwen-compassion/wandb does not exist
wandb: Tracking run with wandb version 0.30.0
wandb: W&B syncing is set to `offline` in this directory. Run `wandb online` or set WANDB_MODE=online to enable cloud syncing.
wandb: Run data is saved locally in /workspace/anchor/qwen-compassion/wandb/wandb/offline-run-20261011_232644-035fmlpl
wandb: View this run in the terminal with `wandb leet`
wandb: Detected [huggingface_hub.inference] in use.
wandb: Use W&B Weave for improved LLM call tracing. Install Weave with `pip install weave` then add `import weave` to the top of your script.
wandb: For more information, check out the docs at: https://weave-docs.wandb.ai
==((====))== Unsloth - 2x faster free finetuning | Num GPUs used = 1
\\ /| Num examples = 9,824 | Num Epochs = 1 | Total steps = 614
O^O/ \_/ \ Batch size per device = 2 | Gradient accumulation steps = 8
\ / Data Parallel GPUs = 1 | Total batch size (2 x 8 x 1) = 16
"-____-" Trainable parameters = 1,419,247,616 of 9,609,982,976 (14.77% trained)
Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for embed_tokens.
Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for lm_head.
0%| | 0/614 [00:00<?, ?it/s] 0%| | 1/614 [00:26<4:32:52, 26.71s/it] 0%| | 2/614 [00:41<3:19:48, 19.59s/it] 0%| | 3/614 [00:54<2:49:54, 16.69s/it] 1%| | 4/614 [01:15<3:06:50, 18.38s/it] 1%| | 5/614 [01:38<3:23:47, 20.08s/it] 1%| | 5/614 [01:38<3:23:47, 20.08s/it] 1%| | 6/614 [01:56<3:16:35, 19.40s/it] 1%| | 7/614 [02:17<3:20:17, 19.80s/it] 1%|▏ | 8/614 [02:44<3:42:32, 22.03s/it] 1%|▏ | 9/614 [03:04<3:36:33, 21.48s/it] 2%|▏ | 10/614 [03:26<3:39:27, 21.80s/it] 2%|▏ | 10/614 [03:26<3:39:27, 21.80s/it] 2%|▏ | 11/614 [03:44<3:26:04, 20.50s/it] 2%|▏ | 12/614 [04:04<3:25:26, 20.48s/it] 2%|▏ | 13/614 [04:26<3:27:37, 20.73s/it] 2%|▏ | 14/614 [04:44<3:20:12, 20.02s/it] 2%|▏ | 15/614 [05:04<3:18:37, 19.90s/it] 2%|▏ | 15/614 [05:04<3:18:37, 19.90s/it] 3%|▎ | 16/614 [05:16<2:54:51, 17.54s/it] 3%|▎ | 17/614 [05:39<3:10:39, 19.16s/it] 3%|▎ | 18/614 [05:57<3:07:43, 18.90s/it] 3%|▎ | 19/614 [06:10<2:49:48, 17.12s/it] 3%|▎ | 20/614 [06:26<2:45:36, 16.73s/it] 3%|▎ | 20/614 [06:26<2:45:36, 16.73s/it] 3%|▎ | 21/614 [06:39<2:35:49, 15.77s/it] 4%|▎ | 22/614 [06:54<2:33:45, 15.58s/it] 4%|▎ | 23/614 [07:17<2:54:14, 17.69s/it] 4%|▍ | 24/614 [07:34<2:51:39, 17.46s/it] 4%|▍ | 25/614 [07:51<2:51:17, 17.45s/it] 4%|▍ | 25/614 [07:51<2:51:17, 17.45s/it] 4%|▍ | 26/614 [08:08<2:47:31, 17.09s/it] 4%|▍ | 27/614 [08:23<2:42:46, 16.64s/it] 5%|▍ | 28/614 [08:39<2:39:22, 16.32s/it] 5%|▍ | 29/614 [09:06<3:11:38, 19.66s/it] 5%|▍ | 30/614 [09:26<3:11:42, 19.70s/it] 5%|▍ | 30/614 [09:26<3:11:42, 19.70s/it] 5%|▌ | 31/614 [09:42<3:00:06, 18.54s/it] 5%|▌ | 32/614 [10:07<3:19:32, 20.57s/it] 5%|▌ | 33/614 [10:28<3:19:43, 20.63s/it] 6%|▌ | 34/614 [10:46<3:11:50, 19.85s/it] 6%|▌ | 35/614 [11:06<3:13:02, 20.00s/it] 6%|▌ | 35/614 [11:06<3:13:02, 20.00s/it] 6%|▌ | 36/614 [11:26<3:12:41, 20.00s/it] 6%|▌ | 37/614 [11:38<2:47:34, 17.42s/it] 6%|▌ | 38/614 [11:50<2:31:45, 15.81s/it] 6%|▋ | 39/614 [12:13<2:51:36, 17.91s/it] 7%|▋ | 40/614 [12:32<2:55:32, 18.35s/it] 7%|▋ | 40/614 [12:32<2:55:32, 18.35s/it] 7%|▋ | 41/614 [12:45<2:40:33, 16.81s/it] 7%|▋ | 42/614 [13:01<2:37:14, 16.49s/it] 7%|▋ | 43/614 [13:26<3:00:39, 18.98s/it] 7%|▋ | 44/614 [13:50<3:15:08, 20.54s/it] 7%|▋ | 45/614 [14:11<3:16:55, 20.77s/it] 7%|▋ | 45/614 [14:11<3:16:55, 20.77s/it] 7%|▋ | 46/614 [14:33<3:19:56, 21.12s/it] 8%|▊ | 47/614 [14:56<3:23:38, 21.55s/it] 8%|▊ | 48/614 [15:19<3:27:17, 21.97s/it] 8%|▊ | 49/614 [15:38<3:19:48, 21.22s/it] 8%|▊ | 50/614 [15:55<3:07:56, 19.99s/it] 8%|▊ | 50/614 [15:55<3:07:56, 19.99s/it]Unsloth: Will smartly offload gradients to save VRAM!
Unsloth: Double buffering enabled (parallel H2D + compute) for backward pass.
{'loss': 3.3662, 'grad_norm': 22.442302703857422, 'learning_rate': 2.5806451612903226e-05, 'epoch': 0.01}
{'loss': 3.436, 'grad_norm': 14.803105354309082, 'learning_rate': 5.8064516129032266e-05, 'epoch': 0.02}
{'loss': 2.2124, 'grad_norm': 9.32910442352295, 'learning_rate': 9.032258064516129e-05, 'epoch': 0.02}
{'loss': 1.4505, 'grad_norm': 2.5130510330200195, 'learning_rate': 0.00012258064516129034, 'epoch': 0.03}
{'loss': 1.1231, 'grad_norm': 18.144712448120117, 'learning_rate': 0.00015483870967741937, 'epoch': 0.04}
{'loss': 0.872, 'grad_norm': 3.0365991592407227, 'learning_rate': 0.0001870967741935484, 'epoch': 0.05}
{'loss': 0.8906, 'grad_norm': 2.5769875049591064, 'learning_rate': 0.00019998693330688282, 'epoch': 0.06}
{'loss': 0.7195, 'grad_norm': 3.9422550201416016, 'learning_rate': 0.00019990709365929677, 'epoch': 0.07}
{'loss': 0.6868, 'grad_norm': 2.395726442337036, 'learning_rate': 0.00019975473152335726, 'epoch': 0.07}
{'loss': 0.6497, 'grad_norm': 1.726025104522705, 'learning_rate': 0.0001995299574986306, 'epoch': 0.08}
Filter: 0%| | 0/252 [00:00<?, ? examples/s][A
Filter: 100%|██████████| 252/252 [00:00<00:00, 805.74 examples/s][AFilter: 100%|██████████| 252/252 [00:00<00:00, 796.85 examples/s]
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:49, 2.52it/s][A
2%|▏ | 3/126 [00:02<01:47, 1.14it/s][A
3%|▎ | 4/126 [00:03<02:08, 1.05s/it][A
4%|▍ | 5/126 [00:05<02:28, 1.23s/it][A
5%|▍ | 6/126 [00:06<02:22, 1.19s/it][A
6%|▌ | 7/126 [00:07<02:36, 1.32s/it][A
6%|▋ | 8/126 [00:09<02:48, 1.43s/it][A
7%|▋ | 9/126 [00:12<03:22, 1.73s/it][A
8%|▊ | 10/126 [00:13<03:23, 1.76s/it][A
9%|▊ | 11/126 [00:15<03:33, 1.86s/it][A
10%|▉ | 12/126 [00:17<03:21, 1.76s/it][A
10%|█ | 13/126 [00:18<02:55, 1.55s/it][A
11%|█ | 14/126 [00:19<02:51, 1.53s/it][A
12%|█▏ | 15/126 [00:21<02:54, 1.57s/it][A
13%|█▎ | 16/126 [00:23<02:53, 1.57s/it][A
13%|█▎ | 17/126 [00:24<02:48, 1.54s/it][A
14%|█▍ | 18/126 [00:25<02:29, 1.38s/it][A
15%|█▌ | 19/126 [00:27<02:49, 1.59s/it][A
16%|█▌ | 20/126 [00:30<03:28, 1.97s/it][A
17%|█▋ | 21/126 [00:32<03:33, 2.04s/it][A
17%|█▋ | 22/126 [00:34<03:33, 2.05s/it][A
18%|█▊ | 23/126 [00:36<03:30, 2.04s/it][A
19%|█▉ | 24/126 [00:38<03:20, 1.97s/it][A
20%|█▉ | 25/126 [00:40<02:57, 1.76s/it][A
21%|██ | 26/126 [00:41<02:50, 1.71s/it][A
21%|██▏ | 27/126 [00:42<02:35, 1.57s/it][A
22%|██▏ | 28/126 [00:44<02:28, 1.51s/it][A
23%|██▎ | 29/126 [00:46<02:37, 1.63s/it][A
24%|██▍ | 30/126 [00:47<02:41, 1.68s/it][A
25%|██▍ | 31/126 [00:49<02:40, 1.69s/it][A
25%|██▌ | 32/126 [00:51<02:35, 1.66s/it][A
26%|██▌ | 33/126 [00:53<02:43, 1.76s/it][A
27%|██▋ | 34/126 [00:54<02:32, 1.65s/it][A
28%|██▊ | 35/126 [00:56<02:43, 1.79s/it][A
29%|██▊ | 36/126 [00:57<02:22, 1.59s/it][A
29%|██▉ | 37/126 [00:58<02:08, 1.45s/it][A
30%|███ | 38/126 [00:59<01:55, 1.31s/it][A
31%|███ | 39/126 [01:01<02:00, 1.38s/it][A
32%|███▏ | 40/126 [01:02<01:51, 1.30s/it][A
33%|███▎ | 41/126 [01:04<01:53, 1.34s/it][A
33%|███▎ | 42/126 [01:05<01:51, 1.32s/it][A
34%|███▍ | 43/126 [01:07<02:03, 1.48s/it][A
35%|███▍ | 44/126 [01:09<02:21, 1.73s/it][A
36%|███▌ | 45/126 [01:12<02:42, 2.01s/it][A
37%|███▋ | 46/126 [01:13<02:30, 1.88s/it][A
37%|███▋ | 47/126 [01:16<02:40, 2.03s/it][A
38%|███▊ | 48/126 [01:17<02:34, 1.98s/it][A
39%|███▉ | 49/126 [01:20<02:34, 2.01s/it][A
40%|███▉ | 50/126 [01:21<02:18, 1.82s/it][A
40%|████ | 51/126 [01:23<02:21, 1.88s/it][A
41%|████▏ | 52/126 [01:24<02:02, 1.65s/it][A
42%|████▏ | 53/126 [01:26<02:08, 1.76s/it][A
43%|████▎ | 54/126 [01:28<02:14, 1.86s/it][A
44%|████▎ | 55/126 [01:30<02:13, 1.88s/it][A
44%|████▍ | 56/126 [01:32<02:14, 1.92s/it][A
45%|████▌ | 57/126 [01:34<02:21, 2.04s/it][A
46%|████▌ | 58/126 [01:37<02:19, 2.05s/it][A
47%|████▋ | 59/126 [01:38<02:14, 2.00s/it][A
48%|████▊ | 60/126 [01:40<02:08, 1.95s/it][A
48%|████▊ | 61/126 [01:42<01:59, 1.84s/it][A
49%|████▉ | 62/126 [01:43<01:45, 1.65s/it][A
50%|█████ | 63/126 [01:45<01:45, 1.67s/it][A
51%|█████ | 64/126 [01:46<01:38, 1.58s/it][A
52%|█████▏ | 65/126 [01:46<01:13, 1.20s/it][A
52%|█████▏ | 66/126 [01:48<01:20, 1.34s/it][A
53%|█████▎ | 67/126 [01:50<01:30, 1.54s/it][A
54%|█████▍ | 68/126 [01:53<01:44, 1.81s/it][A
55%|█████▍ | 69/126 [01:55<01:50, 1.94s/it][A
56%|█████▌ | 70/126 [01:56<01:44, 1.87s/it][A
56%|█████▋ | 71/126 [01:59<01:50, 2.01s/it][A
57%|█████▋ | 72/126 [02:00<01:34, 1.74s/it][A
58%|█████▊ | 73/126 [02:02<01:38, 1.86s/it][A
59%|█████▊ | 74/126 [02:04<01:31, 1.75s/it][A
60%|█████▉ | 75/126 [02:05<01:31, 1.80s/it][A
60%|██████ | 76/126 [02:07<01:33, 1.86s/it][A
61%|██████ | 77/126 [02:09<01:25, 1.75s/it][A
62%|██████▏ | 78/126 [02:11<01:22, 1.72s/it][A
63%|██████▎ | 79/126 [02:13<01:31, 1.95s/it][A
63%|██████▎ | 80/126 [02:15<01:24, 1.84s/it][A
64%|██████▍ | 81/126 [02:16<01:21, 1.81s/it][A
65%|██████▌ | 82/126 [02:18<01:13, 1.67s/it][A
66%|██████▌ | 83/126 [02:19<01:05, 1.53s/it][A
67%|██████▋ | 84/126 [02:21<01:06, 1.58s/it][A
67%|██████▋ | 85/126 [02:22<01:04, 1.58s/it][A
68%|██████▊ | 86/126 [02:24<01:03, 1.58s/it][A
69%|██████▉ | 87/126 [02:25<00:56, 1.46s/it][A
70%|██████▉ | 88/126 [02:27<00:55, 1.47s/it][A
71%|███████ | 89/126 [02:28<00:58, 1.57s/it][A
71%|███████▏ | 90/126 [02:30<00:54, 1.51s/it][A
72%|███████▏ | 91/126 [02:32<01:04, 1.84s/it][A
73%|███████▎ | 92/126 [02:34<01:02, 1.84s/it][A
74%|███████▍ | 93/126 [02:36<01:01, 1.87s/it][A
75%|███████▍ | 94/126 [02:38<00:58, 1.84s/it][A
75%|███████▌ | 95/126 [02:40<00:55, 1.78s/it][A
76%|███████▌ | 96/126 [02:42<00:55, 1.84s/it][A
77%|███████▋ | 97/126 [02:43<00:50, 1.76s/it][A
78%|███████▊ | 98/126 [02:45<00:49, 1.77s/it][A
79%|███████▊ | 99/126 [02:46<00:42, 1.56s/it][A
79%|███████▉ | 100/126 [02:48<00:41, 1.61s/it][A
80%|████████ | 101/126 [02:50<00:45, 1.80s/it][A
81%|████████ | 102/126 [02:52<00:43, 1.81s/it][A
82%|████████▏ | 103/126 [02:54<00:45, 1.99s/it][A
83%|████████▎ | 104/126 [02:56<00:39, 1.80s/it][A
83%|████████▎ | 105/126 [02:57<00:38, 1.85s/it][A
84%|████████▍ | 106/126 [02:59<00:33, 1.70s/it][A
85%|████████▍ | 107/126 [03:00<00:27, 1.45s/it][A
86%|████████▌ | 108/126 [03:01<00:26, 1.46s/it][A
87%|████████▋ | 109/126 [03:03<00:25, 1.48s/it][A
87%|████████▋ | 110/126 [03:04<00:24, 1.56s/it][A
88%|████████▊ | 111/126 [03:06<00:25, 1.71s/it][A
89%|████████▉ | 112/126 [03:09<00:26, 1.87s/it][A
90%|████████▉ | 113/126 [03:11<00:27, 2.13s/it][A
90%|█████████ | 114/126 [03:13<00:24, 2.03s/it][A
91%|█████████▏| 115/126 [03:16<00:23, 2.14s/it][A
92%|█████████▏| 116/126 [03:17<00:20, 2.04s/it][A
93%|█████████▎| 117/126 [03:19<00:16, 1.89s/it][A
94%|█████████▎| 118/126 [03:20<00:12, 1.55s/it][A
94%|█████████▍| 119/126 [03:21<00:10, 1.50s/it][A
95%|█████████▌| 120/126 [03:23<00:10, 1.67s/it][A
96%|█████████▌| 121/126 [03:25<00:08, 1.78s/it][A
97%|█████████▋| 122/126 [03:26<00:06, 1.62s/it][A
98%|█████████▊| 123/126 [03:28<00:04, 1.61s/it][A
98%|█████████▊| 124/126 [03:30<00:03, 1.70s/it][A
99%|█████████▉| 125/126 [03:31<00:01, 1.56s/it][A
100%|██████████| 126/126 [03:32<00:00, 1.31s/it][A
[A 8%|▊ | 50/614 [19:31<3:07:56, 19.99s/it]
100%|██████████| 126/126 [03:32<00:00, 1.31s/it][A
[A 8%|▊ | 51/614 [19:54<13:24:01, 85.69s/it] 8%|▊ | 52/614 [20:14<10:16:58, 65.87s/it] 9%|▊ | 53/614 [20:36<8:11:58, 52.62s/it] 9%|▉ | 54/614 [20:54<6:34:17, 42.25s/it] 9%|▉ | 55/614 [21:10<5:21:21, 34.49s/it] 9%|▉ | 55/614 [21:10<5:21:21, 34.49s/it] 9%|▉ | 56/614 [21:24<4:23:54, 28.38s/it] 9%|▉ | 57/614 [21:46<4:03:58, 26.28s/it] 9%|▉ | 58/614 [22:04<3:42:02, 23.96s/it] 10%|▉ | 59/614 [22:21<3:23:28, 22.00s/it] 10%|▉ | 60/614 [22:43<3:21:27, 21.82s/it] 10%|▉ | 60/614 [22:43<3:21:27, 21.82s/it] 10%|▉ | 61/614 [23:06<3:25:12, 22.26s/it] 10%|█ | 62/614 [23:29<3:26:19, 22.43s/it] 10%|█ | 63/614 [23:48<3:16:16, 21.37s/it] 10%|█ | 64/614 [24:12<3:23:31, 22.20s/it] 11%|█ | 65/614 [24:40<3:38:58, 23.93s/it] 11%|█ | 65/614 [24:40<3:38:58, 23.93s/it] 11%|█ | 66/614 [25:08<3:50:58, 25.29s/it] 11%|█ | 67/614 [25:26<3:28:47, 22.90s/it] 11%|█ | 68/614 [25:42<3:09:21, 20.81s/it] 11%|█ | 69/614 [25:59<2:58:29, 19.65s/it] 11%|█▏ | 70/614 [26:25<3:15:48, 21.60s/it] 11%|█▏ | 70/614 [26:25<3:15:48, 21.60s/it] 12%|█▏ | 71/614 [26:47<3:16:56, 21.76s/it] 12%|█▏ | 72/614 [27:04<3:02:31, 20.20s/it] 12%|█▏ | 73/614 [27:24<3:02:00, 20.19s/it] 12%|█▏ | 74/614 [27:44<3:03:00, 20.33s/it] 12%|█▏ | 75/614 [28:06<3:06:21, 20.74s/it] 12%|█▏ | 75/614 [28:06<3:06:21, 20.74s/it] 12%|█▏ | 76/614 [28:28<3:08:59, 21.08s/it] 13%|█▎ | 77/614 [28:43<2:51:53, 19.21s/it] 13%|█▎ | 78/614 [29:00<2:45:30, 18.53s/it] 13%|█▎ | 79/614 [29:19<2:47:36, 18.80s/it] 13%|█▎ | 80/614 [29:31<2:29:04, 16.75s/it] 13%|█▎ | 80/614 [29:31<2:29:04, 16.75s/it] 13%|█▎ | 81/614 [29:50<2:34:38, 17.41s/it] 13%|█▎ | 82/614 [30:04<2:25:16, 16.38s/it] 14%|█▎ | 83/614 [30:30<2:49:45, 19.18s/it] 14%|█▎ | 84/614 [30:55<3:06:37, 21.13s/it] 14%|█▍ | 85/614 [31:09<2:46:31, 18.89s/it] 14%|█▍ | 85/614 [31:09<2:46:31, 18.89s/it] 14%|█▍ | 86/614 [31:26<2:40:37, 18.25s/it] 14%|█▍ | 87/614 [31:42<2:34:40, 17.61s/it] 14%|█▍ | 88/614 [31:58<2:31:24, 17.27s/it] 14%|█▍ | 89/614 [32:15<2:28:10, 16.93s/it] 15%|█▍ | 90/614 [32:39<2:47:55, 19.23s/it] 15%|█▍ | 90/614 [32:39<2:47:55, 19.23s/it] 15%|█▍ | 91/614 [33:01<2:54:32, 20.02s/it] 15%|█▍ | 92/614 [33:20<2:50:11, 19.56s/it] 15%|█▌ | 93/614 [33:40<2:52:26, 19.86s/it] 15%|█▌ | 94/614 [33:57<2:44:29, 18.98s/it] 15%|█▌ | 95/614 [34:17<2:46:33, 19.26s/it] 15%|█▌ | 95/614 [34:17<2:46:33, 19.26s/it] 16%|█▌ | 96/614 [34:28<2:25:50, 16.89s/it] 16%|█▌ | 97/614 [34:44<2:22:31, 16.54s/it] 16%|█▌ | 98/614 [35:00<2:22:07, 16.53s/it] 16%|█▌ | 99/614 [35:23<2:38:02, 18.41s/it] 16%|█▋ | 100/614 [35:49<2:56:48, 20.64s/it] 16%|█▋ | 100/614 [35:49<2:56:48, 20.64s/it]{'eval_loss': 0.4577290415763855, 'eval_runtime': 214.9578, 'eval_samples_per_second': 1.172, 'eval_steps_per_second': 0.586, 'epoch': 0.08}
{'loss': 0.6646, 'grad_norm': 1.482474684715271, 'learning_rate': 0.00019923293474842174, 'epoch': 0.09}
{'loss': 0.5642, 'grad_norm': 1.236023187637329, 'learning_rate': 0.00019886387888133413, 'epoch': 0.1}
{'loss': 0.4603, 'grad_norm': 1.1658198833465576, 'learning_rate': 0.00019842305779475968, 'epoch': 0.11}
{'loss': 0.6375, 'grad_norm': 1.2695726156234741, 'learning_rate': 0.0001979107914804122, 'epoch': 0.11}
{'loss': 0.4823, 'grad_norm': 1.4793083667755127, 'learning_rate': 0.00019732745179204552, 'epoch': 0.12}
{'loss': 0.4646, 'grad_norm': 1.7086373567581177, 'learning_rate': 0.00019667346217552527, 'epoch': 0.13}
{'loss': 0.6899, 'grad_norm': 1.3679929971694946, 'learning_rate': 0.00019594929736144976, 'epoch': 0.14}
{'loss': 0.5442, 'grad_norm': 1.4010539054870605, 'learning_rate': 0.00019515548302054335, 'epoch': 0.15}
{'loss': 0.5184, 'grad_norm': 1.1517243385314941, 'learning_rate': 0.0001942925953820725, 'epoch': 0.15}
{'loss': 0.6193, 'grad_norm': 1.058547019958496, 'learning_rate': 0.00019336126081556134, 'epoch': 0.16}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.75it/s][A
2%|▏ | 3/126 [00:01<01:09, 1.76it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.43it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.58it/s][A
6%|▌ | 7/126 [00:04<01:29, 1.33it/s][A
6%|▋ | 8/126 [00:05<01:42, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:51, 1.02it/s][A
11%|█ | 14/126 [00:12<01:47, 1.04it/s][A
12%|█▏ | 15/126 [00:13<01:50, 1.00it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.48it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.01it/s][A
17%|█▋ | 21/126 [00:18<01:33, 1.12it/s][A
17%|█▋ | 22/126 [00:19<01:41, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:59, 1.17s/it][A
20%|█▉ | 25/126 [00:23<01:41, 1.01s/it][A
21%|██ | 26/126 [00:24<01:42, 1.02s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:45, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.01it/s][A
28%|██▊ | 35/126 [00:33<01:37, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:21, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:04, 1.39it/s][A
30%|███ | 38/126 [00:34<00:48, 1.81it/s][A
31%|███ | 39/126 [00:35<00:59, 1.45it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.43it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:02, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:20, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.17s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.29s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:48<01:23, 1.12s/it][A
41%|████▏ | 52/126 [00:48<01:09, 1.07it/s][A
42%|████▏ | 53/126 [00:49<01:14, 1.01s/it][A
43%|████▎ | 54/126 [00:51<01:19, 1.10s/it][A
44%|████▎ | 55/126 [00:52<01:23, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:55<01:27, 1.27s/it][A
46%|████▌ | 58/126 [00:56<01:26, 1.27s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:58<01:25, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:02, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.43it/s][A
52%|█████▏ | 66/126 [01:03<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:39, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.06it/s][A
56%|█████▌ | 70/126 [01:07<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:09<00:52, 1.03it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.04s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.19s/it][A
63%|██████▎ | 80/126 [01:18<00:53, 1.16s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.04it/s][A
66%|██████▌ | 83/126 [01:20<00:32, 1.33it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.39it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.25it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.37it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.46it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.39it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.31it/s][A
73%|███████▎ | 92/126 [01:27<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.07s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.10s/it][A
76%|███████▌ | 96/126 [01:32<00:34, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.27s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.19s/it][A
79%|███████▊ | 99/126 [01:35<00:26, 1.01it/s][A
79%|███████▉ | 100/126 [01:36<00:25, 1.04it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.16s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:23, 1.05s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.06s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.12it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.42it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.27it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:47<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:51<00:12, 1.17s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.21s/it][A
93%|█████████▎| 117/126 [01:53<00:09, 1.04s/it][A
94%|█████████▎| 118/126 [01:53<00:06, 1.29it/s][A
94%|█████████▍| 119/126 [01:54<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.01s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.24it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.22it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.61it/s][A
[A 16%|█▋ | 100/614 [37:50<2:56:48, 20.64s/it]
100%|██████████| 126/126 [01:59<00:00, 1.61it/s][A
[Awandb: WARNING URL not available in offline run
16%|█▋ | 101/614 [38:20<8:30:48, 59.74s/it] 17%|█▋ | 102/614 [38:32<6:27:38, 45.43s/it] 17%|█▋ | 103/614 [38:52<5:22:35, 37.88s/it] 17%|█▋ | 104/614 [39:16<4:45:35, 33.60s/it] 17%|█▋ | 105/614 [39:44<4:30:39, 31.91s/it] 17%|█▋ | 105/614 [39:44<4:30:39, 31.91s/it] 17%|█▋ | 106/614 [40:04<3:58:53, 28.22s/it] 17%|█▋ | 107/614 [40:25<3:40:38, 26.11s/it] 18%|█▊ | 108/614 [40:47<3:29:36, 24.86s/it] 18%|█▊ | 109/614 [41:09<3:21:44, 23.97s/it] 18%|█▊ | 110/614 [41:28<3:08:45, 22.47s/it] 18%|█▊ | 110/614 [41:28<3:08:45, 22.47s/it] 18%|█▊ | 111/614 [41:49<3:06:31, 22.25s/it] 18%|█▊ | 112/614 [42:04<2:46:42, 19.93s/it] 18%|█▊ | 113/614 [42:23<2:43:24, 19.57s/it] 19%|█▊ | 114/614 [42:41<2:39:16, 19.11s/it] 19%|█▊ | 115/614 [42:54<2:23:32, 17.26s/it] 19%|█▊ | 115/614 [42:54<2:23:32, 17.26s/it] 19%|█▉ | 116/614 [43:16<2:35:58, 18.79s/it] 19%|█▉ | 117/614 [43:31<2:25:24, 17.55s/it] 19%|█▉ | 118/614 [43:55<2:43:21, 19.76s/it] 19%|█▉ | 119/614 [44:18<2:49:30, 20.55s/it] 20%|█▉ | 120/614 [44:39<2:49:26, 20.58s/it] 20%|█▉ | 120/614 [44:39<2:49:26, 20.58s/it] 20%|█▉ | 121/614 [44:59<2:49:43, 20.66s/it] 20%|█▉ | 122/614 [45:20<2:49:40, 20.69s/it] 20%|██ | 123/614 [45:46<3:01:14, 22.15s/it] 20%|██ | 124/614 [46:02<2:47:17, 20.49s/it] 20%|██ | 125/614 [46:22<2:46:06, 20.38s/it] 20%|██ | 125/614 [46:22<2:46:06, 20.38s/it] 21%|██ | 126/614 [46:38<2:33:32, 18.88s/it] 21%|██ | 127/614 [46:58<2:36:38, 19.30s/it] 21%|██ | 128/614 [47:13<2:24:37, 17.85s/it] 21%|██ | 129/614 [47:30<2:23:47, 17.79s/it] 21%|██ | 130/614 [47:50<2:28:12, 18.37s/it] 21%|██ | 130/614 [47:50<2:28:12, 18.37s/it] 21%|██▏ | 131/614 [48:08<2:27:13, 18.29s/it] 21%|██▏ | 132/614 [48:29<2:33:06, 19.06s/it] 22%|██▏ | 133/614 [48:40<2:13:37, 16.67s/it] 22%|██▏ | 134/614 [49:07<2:38:45, 19.84s/it] 22%|██▏ | 135/614 [49:28<2:41:46, 20.26s/it] 22%|██▏ | 135/614 [49:28<2:41:46, 20.26s/it] 22%|██▏ | 136/614 [49:53<2:50:50, 21.45s/it] 22%|██▏ | 137/614 [50:13<2:48:16, 21.17s/it] 22%|██▏ | 138/614 [50:28<2:33:41, 19.37s/it] 23%|██▎ | 139/614 [50:50<2:39:38, 20.17s/it] 23%|██▎ | 140/614 [51:10<2:37:03, 19.88s/it] 23%|██▎ | 140/614 [51:10<2:37:03, 19.88s/it] 23%|██▎ | 141/614 [51:27<2:30:02, 19.03s/it] 23%|██▎ | 142/614 [51:47<2:32:10, 19.35s/it] 23%|██▎ | 143/614 [52:04<2:27:01, 18.73s/it] 23%|██▎ | 144/614 [52:21<2:22:48, 18.23s/it] 24%|██▎ | 145/614 [52:39<2:21:49, 18.14s/it] 24%|██▎ | 145/614 [52:39<2:21:49, 18.14s/it] 24%|██▍ | 146/614 [53:04<2:36:45, 20.10s/it] 24%|██▍ | 147/614 [53:19<2:25:38, 18.71s/it] 24%|██▍ | 148/614 [53:41<2:31:37, 19.52s/it] 24%|██▍ | 149/614 [53:59<2:27:59, 19.10s/it] 24%|██▍ | 150/614 [54:16<2:23:36, 18.57s/it] 24%|██▍ | 150/614 [54:16<2:23:36, 18.57s/it]{'eval_loss': 0.35910215973854065, 'eval_runtime': 120.7216, 'eval_samples_per_second': 2.087, 'eval_steps_per_second': 1.044, 'epoch': 0.16}
{'loss': 0.5177, 'grad_norm': 1.1780120134353638, 'learning_rate': 0.00019236215537611046, 'epoch': 0.17}
{'loss': 0.5419, 'grad_norm': 1.2721914052963257, 'learning_rate': 0.00019129600431364897, 'epoch': 0.18}
{'loss': 0.5167, 'grad_norm': 1.379878282546997, 'learning_rate': 0.00019016358154647618, 'epoch': 0.19}
{'loss': 0.4613, 'grad_norm': 1.2618638277053833, 'learning_rate': 0.00018896570909947475, 'epoch': 0.2}
{'loss': 0.4745, 'grad_norm': 1.0391523838043213, 'learning_rate': 0.00018770325650740345, 'epoch': 0.2}
{'loss': 0.5386, 'grad_norm': 1.2194364070892334, 'learning_rate': 0.00018637714018370253, 'epoch': 0.21}
{'loss': 0.4939, 'grad_norm': 0.7502462267875671, 'learning_rate': 0.00018498832275526988, 'epoch': 0.22}
{'loss': 0.4941, 'grad_norm': 0.6979483366012573, 'learning_rate': 0.00018353781236369064, 'epoch': 0.23}
{'loss': 0.5449, 'grad_norm': 1.1954421997070312, 'learning_rate': 0.00018202666193342833, 'epoch': 0.24}
{'loss': 0.5998, 'grad_norm': 1.3286981582641602, 'learning_rate': 0.00018045596840750723, 'epoch': 0.24}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.67it/s][A
2%|▏ | 3/126 [00:01<01:12, 1.70it/s][A
3%|▎ | 4/126 [00:02<01:06, 1.82it/s][A
4%|▍ | 5/126 [00:03<01:25, 1.41it/s][A
5%|▍ | 6/126 [00:03<01:17, 1.55it/s][A
6%|▌ | 7/126 [00:04<01:30, 1.32it/s][A
6%|▋ | 8/126 [00:05<01:43, 1.14it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:10<02:23, 1.25s/it][A
10%|▉ | 12/126 [00:11<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:47, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:49, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.11it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.48it/s][A
15%|█▌ | 19/126 [00:16<01:26, 1.24it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.01it/s][A
17%|█▋ | 21/126 [00:18<01:33, 1.12it/s][A
17%|█▋ | 22/126 [00:19<01:46, 1.02s/it][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:58, 1.16s/it][A
20%|█▉ | 25/126 [00:23<01:41, 1.00s/it][A
21%|██ | 26/126 [00:24<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:45, 1.10s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:51, 1.20s/it][A
27%|██▋ | 34/126 [00:32<01:32, 1.00s/it][A
28%|██▊ | 35/126 [00:33<01:38, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.09it/s][A
29%|██▉ | 37/126 [00:34<01:04, 1.38it/s][A
30%|███ | 38/126 [00:34<00:48, 1.81it/s][A
31%|███ | 39/126 [00:35<01:00, 1.43it/s][A
32%|███▏ | 40/126 [00:36<00:54, 1.59it/s][A
33%|███▎ | 41/126 [00:37<01:02, 1.35it/s][A
33%|███▎ | 42/126 [00:37<00:53, 1.56it/s][A
34%|███▍ | 43/126 [00:38<01:05, 1.27it/s][A
35%|███▍ | 44/126 [00:40<01:17, 1.05it/s][A
36%|███▌ | 45/126 [00:41<01:21, 1.00s/it][A
37%|███▋ | 46/126 [00:42<01:22, 1.03s/it][A
37%|███▋ | 47/126 [00:43<01:33, 1.18s/it][A
38%|███▊ | 48/126 [00:45<01:36, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:40, 1.30s/it][A
40%|███▉ | 50/126 [00:47<01:21, 1.07s/it][A
40%|████ | 51/126 [00:48<01:23, 1.11s/it][A
41%|████▏ | 52/126 [00:48<01:09, 1.07it/s][A
42%|████▏ | 53/126 [00:50<01:13, 1.01s/it][A
43%|████▎ | 54/126 [00:51<01:19, 1.10s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:55<01:27, 1.27s/it][A
46%|████▌ | 58/126 [00:56<01:26, 1.27s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:59<01:25, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:02, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:02<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.43it/s][A
52%|█████▏ | 66/126 [01:03<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:39, 1.50it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:06<00:53, 1.06it/s][A
56%|█████▌ | 70/126 [01:07<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.16s/it][A
57%|█████▋ | 72/126 [01:09<00:52, 1.03it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.07s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.04s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.05s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:47, 1.02it/s][A
62%|██████▏ | 78/126 [01:15<00:49, 1.02s/it][A
63%|██████▎ | 79/126 [01:17<00:56, 1.20s/it][A
63%|██████▎ | 80/126 [01:18<00:53, 1.17s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.17s/it][A
65%|██████▌ | 82/126 [01:20<00:42, 1.04it/s][A
66%|██████▌ | 83/126 [01:20<00:32, 1.32it/s][A
67%|██████▋ | 84/126 [01:21<00:33, 1.26it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.39it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.25it/s][A
69%|██████▉ | 87/126 [01:23<00:28, 1.36it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.46it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.40it/s][A
71%|███████▏ | 90/126 [01:25<00:21, 1.64it/s][A
72%|███████▏ | 91/126 [01:26<00:26, 1.32it/s][A
73%|███████▎ | 92/126 [01:27<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:30<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:31<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:32<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:34<00:36, 1.27s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.18s/it][A
79%|███████▊ | 99/126 [01:35<00:26, 1.02it/s][A
79%|███████▉ | 100/126 [01:36<00:24, 1.04it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:39<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:41<00:23, 1.05s/it][A
83%|████████▎ | 105/126 [01:42<00:22, 1.06s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:43<00:13, 1.43it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.28it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:46<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:47<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:51<00:13, 1.18s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.21s/it][A
93%|█████████▎| 117/126 [01:53<00:09, 1.05s/it][A
94%|█████████▎| 118/126 [01:53<00:06, 1.28it/s][A
94%|█████████▍| 119/126 [01:54<00:05, 1.24it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.01s/it][A
97%|█████████▋| 122/126 [01:57<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:58<00:02, 1.24it/s][A
98%|█████████▊| 124/126 [01:59<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.22it/s][A
100%|██████████| 126/126 [02:00<00:00, 1.61it/s][A
[A 24%|██▍ | 150/614 [56:17<2:23:36, 18.57s/it]
100%|██████████| 126/126 [02:00<00:00, 1.61it/s][A
[A 25%|██▍ | 151/614 [56:40<7:13:31, 56.18s/it] 25%|██▍ | 152/614 [56:59<5:47:09, 45.08s/it] 25%|██▍ | 153/614 [57:19<4:47:33, 37.43s/it] 25%|██▌ | 154/614 [57:37<4:02:31, 31.63s/it] 25%|██▌ | 155/614 [57:59<3:41:15, 28.92s/it] 25%|██▌ | 155/614 [57:59<3:41:15, 28.92s/it] 25%|██▌ | 156/614 [58:13<3:06:42, 24.46s/it] 26%|██▌ | 157/614 [58:33<2:54:49, 22.95s/it] 26%|██▌ | 158/614 [58:58<2:59:36, 23.63s/it] 26%|██▌ | 159/614 [59:17<2:49:24, 22.34s/it] 26%|██▌ | 160/614 [59:36<2:40:09, 21.17s/it] 26%|██▌ | 160/614 [59:36<2:40:09, 21.17s/it] 26%|██▌ | 161/614 [59:57<2:39:29, 21.12s/it] 26%|██▋ | 162/614 [1:00:15<2:31:29, 20.11s/it] 27%|██▋ | 163/614 [1:00:36<2:32:59, 20.35s/it] 27%|██▋ | 164/614 [1:00:49<2:17:45, 18.37s/it] 27%|██▋ | 165/614 [1:01:10<2:23:06, 19.12s/it] 27%|██▋ | 165/614 [1:01:10<2:23:06, 19.12s/it] 27%|██▋ | 166/614 [1:01:31<2:26:17, 19.59s/it] 27%|██▋ | 167/614 [1:01:49<2:22:34, 19.14s/it] 27%|██▋ | 168/614 [1:02:09<2:25:15, 19.54s/it] 28%|██▊ | 169/614 [1:02:30<2:26:25, 19.74s/it] 28%|██▊ | 170/614 [1:02:49<2:25:15, 19.63s/it] 28%|██▊ | 170/614 [1:02:49<2:25:15, 19.63s/it] 28%|██▊ | 171/614 [1:03:10<2:27:17, 19.95s/it] 28%|██▊ | 172/614 [1:03:25<2:16:45, 18.57s/it] 28%|██▊ | 173/614 [1:03:51<2:32:49, 20.79s/it] 28%|██▊ | 174/614 [1:04:09<2:26:05, 19.92s/it] 29%|██▊ | 175/614 [1:04:33<2:34:40, 21.14s/it] 29%|██▊ | 175/614 [1:04:33<2:34:40, 21.14s/it] 29%|██▊ | 176/614 [1:04:53<2:32:30, 20.89s/it] 29%|██▉ | 177/614 [1:05:18<2:40:48, 22.08s/it] 29%|██▉ | 178/614 [1:05:48<2:57:16, 24.40s/it] 29%|██▉ | 179/614 [1:06:11<2:53:28, 23.93s/it] 29%|██▉ | 180/614 [1:06:34<2:52:06, 23.79s/it] 29%|██▉ | 180/614 [1:06:34<2:52:06, 23.79s/it] 29%|██▉ | 181/614 [1:07:01<2:59:01, 24.81s/it] 30%|██▉ | 182/614 [1:07:23<2:51:18, 23.79s/it] 30%|██▉ | 183/614 [1:07:45<2:47:34, 23.33s/it] 30%|██▉ | 184/614 [1:08:02<2:34:24, 21.54s/it] 30%|███ | 185/614 [1:08:14<2:11:40, 18.42s/it] 30%|███ | 185/614 [1:08:14<2:11:40, 18.42s/it] 30%|███ | 186/614 [1:08:35<2:18:38, 19.44s/it] 30%|███ | 187/614 [1:08:55<2:18:46, 19.50s/it] 31%|███ | 188/614 [1:09:12<2:13:13, 18.76s/it] 31%|███ | 189/614 [1:09:37<2:26:31, 20.69s/it] 31%|███ | 190/614 [1:09:56<2:23:02, 20.24s/it] 31%|███ | 190/614 [1:09:56<2:23:02, 20.24s/it] 31%|███ | 191/614 [1:10:20<2:29:05, 21.15s/it] 31%|███▏ | 192/614 [1:10:40<2:27:38, 20.99s/it] 31%|███▏ | 193/614 [1:10:51<2:06:04, 17.97s/it] 32%|███▏ | 194/614 [1:11:08<2:04:05, 17.73s/it] 32%|███▏ | 195/614 [1:11:28<2:07:35, 18.27s/it] 32%|███▏ | 195/614 [1:11:28<2:07:35, 18.27s/it] 32%|███▏ | 196/614 [1:11:42<1:58:00, 16.94s/it] 32%|███▏ | 197/614 [1:11:58<1:57:05, 16.85s/it] 32%|███▏ | 198/614 [1:12:25<2:16:25, 19.68s/it] 32%|███▏ | 199/614 [1:12:38<2:02:18, 17.68s/it] 33%|███▎ | 200/614 [1:12:57<2:05:02, 18.12s/it] 33%|███▎ | 200/614 [1:12:57<2:05:02, 18.12s/it]{'eval_loss': 0.3380209803581238, 'eval_runtime': 121.0869, 'eval_samples_per_second': 2.081, 'eval_steps_per_second': 1.041, 'epoch': 0.24}
{'loss': 0.5237, 'grad_norm': 0.9305353760719299, 'learning_rate': 0.0001788268719512427, 'epoch': 0.25}
{'loss': 0.4911, 'grad_norm': 1.387276530265808, 'learning_rate': 0.00017714055512459565, 'epoch': 0.26}
{'loss': 0.5527, 'grad_norm': 0.9299679398536682, 'learning_rate': 0.0001753982420237533, 'epoch': 0.27}
{'loss': 0.3972, 'grad_norm': 1.2602843046188354, 'learning_rate': 0.00017360119739255852, 'epoch': 0.28}
{'loss': 0.5526, 'grad_norm': 0.7769179344177246, 'learning_rate': 0.00017175072570443312, 'epoch': 0.29}
{'loss': 0.4304, 'grad_norm': 0.7283039093017578, 'learning_rate': 0.00016984817021546177, 'epoch': 0.29}
{'loss': 0.4737, 'grad_norm': 1.4225355386734009, 'learning_rate': 0.000167894911989323, 'epoch': 0.3}
{'loss': 0.4035, 'grad_norm': 1.0882941484451294, 'learning_rate': 0.00016589236889477646, 'epoch': 0.31}
{'loss': 0.5222, 'grad_norm': 1.1490302085876465, 'learning_rate': 0.00016384199457643262, 'epoch': 0.32}
{'loss': 0.6425, 'grad_norm': 0.9430150985717773, 'learning_rate': 0.00016174527739955342, 'epoch': 0.33}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:34, 3.63it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.75it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.43it/s][A
5%|▍ | 6/126 [00:03<01:16, 1.58it/s][A
6%|▌ | 7/126 [00:04<01:29, 1.33it/s][A
6%|▋ | 8/126 [00:05<01:41, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:47, 1.04it/s][A
12%|█▏ | 15/126 [00:13<01:49, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:51, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.01it/s][A
17%|█▋ | 21/126 [00:18<01:33, 1.12it/s][A
17%|█▋ | 22/126 [00:19<01:40, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:58, 1.17s/it][A
20%|█▉ | 25/126 [00:23<01:41, 1.00s/it][A
21%|██ | 26/126 [00:24<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:43, 1.09s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.01it/s][A
28%|██▊ | 35/126 [00:33<01:37, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:21, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:48, 1.82it/s][A
31%|███ | 39/126 [00:35<00:59, 1.45it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.61it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.64it/s][A
34%|███▍ | 43/126 [00:38<01:02, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:20, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.17s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.22s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.29s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.10s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.16s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.17s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.26s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.28s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:01, 1.04it/s][A
50%|█████ | 63/126 [01:01<01:04, 1.03s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.15it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.44it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:38, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:06<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.04s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.09s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:17<00:53, 1.15s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.34it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.40it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.26it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.38it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.48it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.40it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.33it/s][A
73%|███████▎ | 92/126 [01:26<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:34, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.11s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.18s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.02it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:39<00:29, 1.26s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.44it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.28it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.23it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.17s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.21s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.29it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.25it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.01s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.25it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.23it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 33%|███▎ | 200/614 [1:14:57<2:05:02, 18.12s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[Awandb: WARNING URL not available in offline run
33%|███▎ | 201/614 [1:15:27<6:37:17, 57.72s/it] 33%|███▎ | 202/614 [1:15:42<5:08:18, 44.90s/it] 33%|███▎ | 203/614 [1:16:08<4:28:00, 39.13s/it] 33%|███▎ | 204/614 [1:16:30<3:53:13, 34.13s/it] 33%|███▎ | 205/614 [1:16:58<3:40:21, 32.33s/it] 33%|███▎ | 205/614 [1:16:58<3:40:21, 32.33s/it] 34%|███▎ | 206/614 [1:17:13<3:03:20, 26.96s/it] 34%|███▎ | 207/614 [1:17:33<2:48:31, 24.84s/it] 34%|███▍ | 208/614 [1:17:48<2:28:29, 21.95s/it] 34%|███▍ | 209/614 [1:18:10<2:29:29, 22.15s/it] 34%|███▍ | 210/614 [1:18:26<2:16:59, 20.35s/it] 34%|███▍ | 210/614 [1:18:26<2:16:59, 20.35s/it] 34%|███▍ | 211/614 [1:18:45<2:13:46, 19.92s/it] 35%|███▍ | 212/614 [1:19:05<2:12:29, 19.78s/it] 35%|███▍ | 213/614 [1:19:26<2:14:55, 20.19s/it] 35%|███▍ | 214/614 [1:19:43<2:07:44, 19.16s/it] 35%|███▌ | 215/614 [1:20:03<2:08:53, 19.38s/it] 35%|███▌ | 215/614 [1:20:03<2:08:53, 19.38s/it] 35%|███▌ | 216/614 [1:20:21<2:07:30, 19.22s/it] 35%|███▌ | 217/614 [1:20:45<2:16:06, 20.57s/it] 36%|███▌ | 218/614 [1:21:01<2:06:56, 19.23s/it] 36%|███▌ | 219/614 [1:21:19<2:02:36, 18.62s/it] 36%|███▌ | 220/614 [1:21:42<2:11:09, 19.97s/it] 36%|███▌ | 220/614 [1:21:42<2:11:09, 19.97s/it] 36%|███▌ | 221/614 [1:22:02<2:11:11, 20.03s/it] 36%|███▌ | 222/614 [1:22:16<1:58:29, 18.14s/it] 36%|███▋ | 223/614 [1:22:36<2:02:13, 18.76s/it] 36%|███▋ | 224/614 [1:22:55<2:02:53, 18.91s/it] 37%|███▋ | 225/614 [1:23:11<1:56:32, 17.98s/it] 37%|███▋ | 225/614 [1:23:11<1:56:32, 17.98s/it] 37%|███▋ | 226/614 [1:23:34<2:06:08, 19.51s/it] 37%|███▋ | 227/614 [1:23:50<1:59:21, 18.51s/it] 37%|███▋ | 228/614 [1:24:06<1:54:49, 17.85s/it] 37%|███▋ | 229/614 [1:24:28<2:01:00, 18.86s/it] 37%|███▋ | 230/614 [1:24:42<1:52:00, 17.50s/it] 37%|███▋ | 230/614 [1:24:42<1:52:00, 17.50s/it] 38%|███▊ | 231/614 [1:24:59<1:51:43, 17.50s/it] 38%|███▊ | 232/614 [1:25:16<1:49:53, 17.26s/it] 38%|███▊ | 233/614 [1:25:36<1:54:46, 18.08s/it] 38%|███▊ | 234/614 [1:25:54<1:53:41, 17.95s/it] 38%|███▊ | 235/614 [1:26:10<1:50:57, 17.57s/it] 38%|███▊ | 235/614 [1:26:10<1:50:57, 17.57s/it] 38%|███▊ | 236/614 [1:26:34<2:01:46, 19.33s/it] 39%|███▊ | 237/614 [1:26:54<2:02:34, 19.51s/it] 39%|███▉ | 238/614 [1:27:13<2:02:17, 19.51s/it] 39%|███▉ | 239/614 [1:27:31<1:59:18, 19.09s/it] 39%|███▉ | 240/614 [1:27:52<2:02:02, 19.58s/it] 39%|███▉ | 240/614 [1:27:52<2:02:02, 19.58s/it] 39%|███▉ | 241/614 [1:28:05<1:49:37, 17.64s/it] 39%|███▉ | 242/614 [1:28:19<1:42:53, 16.59s/it] 40%|███▉ | 243/614 [1:28:41<1:51:16, 17.99s/it] 40%|███▉ | 244/614 [1:29:06<2:04:32, 20.20s/it] 40%|███▉ | 245/614 [1:29:32<2:15:45, 22.08s/it] 40%|███▉ | 245/614 [1:29:32<2:15:45, 22.08s/it] 40%|████ | 246/614 [1:29:51<2:09:44, 21.15s/it] 40%|████ | 247/614 [1:30:16<2:14:43, 22.03s/it] 40%|████ | 248/614 [1:30:31<2:02:42, 20.12s/it] 41%|████ | 249/614 [1:30:47<1:54:37, 18.84s/it] 41%|████ | 250/614 [1:31:03<1:49:07, 17.99s/it] 41%|████ | 250/614 [1:31:03<1:49:07, 17.99s/it]{'eval_loss': 0.3253232538700104, 'eval_runtime': 120.2962, 'eval_samples_per_second': 2.095, 'eval_steps_per_second': 1.047, 'epoch': 0.33}
{'loss': 0.4485, 'grad_norm': 0.6319507360458374, 'learning_rate': 0.00015960373936964892, 'epoch': 0.33}
{'loss': 0.5942, 'grad_norm': 1.1035504341125488, 'learning_rate': 0.0001574189350276545, 'epoch': 0.34}
{'loss': 0.558, 'grad_norm': 1.207892894744873, 'learning_rate': 0.00015519245032149083, 'epoch': 0.35}
{'loss': 0.478, 'grad_norm': 0.8965429067611694, 'learning_rate': 0.0001529259014548253, 'epoch': 0.36}
{'loss': 0.4909, 'grad_norm': 1.1375535726547241, 'learning_rate': 0.00015062093371387097, 'epoch': 0.37}
{'loss': 0.4748, 'grad_norm': 1.2835142612457275, 'learning_rate': 0.00014827922027307451, 'epoch': 0.37}
{'loss': 0.5095, 'grad_norm': 1.0070925951004028, 'learning_rate': 0.00014590246098055996, 'epoch': 0.38}
{'loss': 0.3591, 'grad_norm': 0.7836953401565552, 'learning_rate': 0.00014349238112421024, 'epoch': 0.39}
{'loss': 0.4465, 'grad_norm': 0.8382024765014648, 'learning_rate': 0.000141050730179282, 'epoch': 0.4}
{'loss': 0.6015, 'grad_norm': 1.106084942817688, 'learning_rate': 0.0001385792805384625, 'epoch': 0.41}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.71it/s][A
2%|▏ | 3/126 [00:01<01:09, 1.77it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.86it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.43it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.59it/s][A
6%|▌ | 7/126 [00:04<01:28, 1.34it/s][A
6%|▋ | 8/126 [00:05<01:41, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:05, 1.07s/it][A
8%|▊ | 10/126 [00:08<02:12, 1.14s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:48, 1.04it/s][A
11%|█ | 14/126 [00:12<01:46, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:48, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:36, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.26it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.02it/s][A
17%|█▋ | 21/126 [00:18<01:32, 1.13it/s][A
17%|█▋ | 22/126 [00:19<01:40, 1.03it/s][A
18%|█▊ | 23/126 [00:20<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:58, 1.17s/it][A
20%|█▉ | 25/126 [00:22<01:41, 1.00s/it][A
21%|██ | 26/126 [00:23<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:45, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.00it/s][A
28%|██▊ | 35/126 [00:33<01:37, 1.07s/it][A
29%|██▊ | 36/126 [00:33<01:21, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.41it/s][A
30%|███ | 38/126 [00:34<00:47, 1.84it/s][A
31%|███ | 39/126 [00:35<00:59, 1.46it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:58, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:02, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:20, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:31, 1.16s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.30s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.07it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.09s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.26s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.09s/it][A
49%|████▉ | 62/126 [01:00<01:02, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:01<00:42, 1.44it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:38, 1.52it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:06<00:56, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:55, 1.05s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.03s/it][A
60%|█████▉ | 75/126 [01:12<00:52, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.09s/it][A
61%|██████ | 77/126 [01:13<00:46, 1.04it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:17<00:53, 1.15s/it][A
64%|██████▍ | 81/126 [01:18<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.34it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.39it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.26it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.37it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.41it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.64it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.33it/s][A
73%|███████▎ | 92/126 [01:26<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.18s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.02it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.08s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:39<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:41<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.44it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.27it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.20it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.05it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.16s/it][A
92%|█████████▏| 116/126 [01:51<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.30it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:54<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.00s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.25it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:58<00:00, 1.23it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 41%|████ | 250/614 [1:33:03<1:49:07, 17.99s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 41%|████ | 251/614 [1:33:19<5:22:10, 53.25s/it] 41%|████ | 252/614 [1:33:34<4:13:38, 42.04s/it] 41%|████ | 253/614 [1:33:55<3:34:19, 35.62s/it] 41%|████▏ | 254/614 [1:34:15<3:05:18, 30.88s/it] 42%|████▏ | 255/614 [1:34:38<2:51:29, 28.66s/it] 42%|████▏ | 255/614 [1:34:38<2:51:29, 28.66s/it] 42%|████▏ | 256/614 [1:34:56<2:30:26, 25.21s/it] 42%|████▏ | 257/614 [1:35:16<2:22:16, 23.91s/it] 42%|████▏ | 258/614 [1:35:35<2:12:49, 22.39s/it] 42%|████▏ | 259/614 [1:35:55<2:08:32, 21.73s/it] 42%|████▏ | 260/614 [1:36:10<1:55:56, 19.65s/it] 42%|████▏ | 260/614 [1:36:10<1:55:56, 19.65s/it] 43%|████▎ | 261/614 [1:36:23<1:43:21, 17.57s/it] 43%|████▎ | 262/614 [1:36:45<1:51:43, 19.04s/it] 43%|████▎ | 263/614 [1:37:08<1:56:39, 19.94s/it] 43%|████▎ | 264/614 [1:37:25<1:52:48, 19.34s/it] 43%|████▎ | 265/614 [1:37:53<2:07:05, 21.85s/it] 43%|████▎ | 265/614 [1:37:53<2:07:05, 21.85s/it] 43%|████▎ | 266/614 [1:38:18<2:12:11, 22.79s/it] 43%|████▎ | 267/614 [1:38:41<2:11:25, 22.73s/it] 44%|████▎ | 268/614 [1:39:01<2:06:59, 22.02s/it] 44%|████▍ | 269/614 [1:39:23<2:06:43, 22.04s/it] 44%|████▍ | 270/614 [1:39:41<1:59:03, 20.77s/it] 44%|████▍ | 270/614 [1:39:41<1:59:03, 20.77s/it] 44%|████▍ | 271/614 [1:40:02<1:58:29, 20.73s/it] 44%|████▍ | 272/614 [1:40:20<1:54:19, 20.06s/it] 44%|████▍ | 273/614 [1:40:40<1:53:00, 19.88s/it] 45%|████▍ | 274/614 [1:41:01<1:55:53, 20.45s/it] 45%|████▍ | 275/614 [1:41:22<1:55:34, 20.46s/it] 45%|████▍ | 275/614 [1:41:22<1:55:34, 20.46s/it] 45%|████▍ | 276/614 [1:41:40<1:51:28, 19.79s/it] 45%|████▌ | 277/614 [1:42:01<1:53:18, 20.17s/it] 45%|████▌ | 278/614 [1:42:18<1:47:29, 19.19s/it] 45%|████▌ | 279/614 [1:42:30<1:35:44, 17.15s/it] 46%|████▌ | 280/614 [1:42:48<1:36:29, 17.33s/it] 46%|████▌ | 280/614 [1:42:48<1:36:29, 17.33s/it] 46%|████▌ | 281/614 [1:43:09<1:42:01, 18.38s/it] 46%|████▌ | 282/614 [1:43:33<1:51:39, 20.18s/it] 46%|████▌ | 283/614 [1:43:53<1:49:38, 19.87s/it] 46%|████▋ | 284/614 [1:44:12<1:48:36, 19.75s/it] 46%|████▋ | 285/614 [1:44:29<1:43:41, 18.91s/it] 46%|████▋ | 285/614 [1:44:29<1:43:41, 18.91s/it] 47%|████▋ | 286/614 [1:44:51<1:47:51, 19.73s/it] 47%|████▋ | 287/614 [1:45:06<1:41:12, 18.57s/it] 47%|████▋ | 288/614 [1:45:24<1:39:28, 18.31s/it] 47%|████▋ | 289/614 [1:45:37<1:30:24, 16.69s/it] 47%|████▋ | 290/614 [1:46:02<1:44:07, 19.28s/it] 47%|████▋ | 290/614 [1:46:02<1:44:07, 19.28s/it] 47%|████▋ | 291/614 [1:46:23<1:46:42, 19.82s/it] 48%|████▊ | 292/614 [1:46:41<1:43:00, 19.19s/it] 48%|████▊ | 293/614 [1:47:05<1:50:07, 20.58s/it] 48%|████▊ | 294/614 [1:47:27<1:52:09, 21.03s/it] 48%|████▊ | 295/614 [1:47:49<1:53:25, 21.33s/it] 48%|████▊ | 295/614 [1:47:49<1:53:25, 21.33s/it] 48%|████▊ | 296/614 [1:48:08<1:48:24, 20.45s/it] 48%|████▊ | 297/614 [1:48:28<1:47:16, 20.30s/it] 49%|████▊ | 298/614 [1:48:44<1:41:29, 19.27s/it] 49%|████▊ | 299/614 [1:49:04<1:41:47, 19.39s/it] 49%|████▉ | 300/614 [1:49:19<1:34:42, 18.10s/it] 49%|████▉ | 300/614 [1:49:19<1:34:42, 18.10s/it]{'eval_loss': 0.3180280327796936, 'eval_runtime': 120.1946, 'eval_samples_per_second': 2.097, 'eval_steps_per_second': 1.048, 'epoch': 0.41}
{'loss': 0.4443, 'grad_norm': 1.028218150138855, 'learning_rate': 0.00013607982622529133, 'epoch': 0.42}
{'loss': 0.5305, 'grad_norm': 3.6740164756774902, 'learning_rate': 0.00013355418159187985, 'epoch': 0.42}
{'loss': 0.5237, 'grad_norm': 0.7290945053100586, 'learning_rate': 0.00013100418000187419, 'epoch': 0.43}
{'loss': 0.4935, 'grad_norm': 1.0659680366516113, 'learning_rate': 0.0001284316724996181, 'epoch': 0.44}
{'loss': 0.6135, 'grad_norm': 1.0143028497695923, 'learning_rate': 0.00012583852646648095, 'epoch': 0.45}
{'loss': 0.5242, 'grad_norm': 1.121451735496521, 'learning_rate': 0.00012322662426532708, 'epoch': 0.46}
{'loss': 0.3619, 'grad_norm': 0.6729561686515808, 'learning_rate': 0.00012059786187410984, 'epoch': 0.46}
{'loss': 0.3198, 'grad_norm': 0.6204145550727844, 'learning_rate': 0.00011795414750958265, 'epoch': 0.47}
{'loss': 0.4189, 'grad_norm': 0.9363518953323364, 'learning_rate': 0.00011529740024212565, 'epoch': 0.48}
{'loss': 0.587, 'grad_norm': 1.1184571981430054, 'learning_rate': 0.00011262954860269399, 'epoch': 0.49}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.66it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.75it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.43it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.59it/s][A
6%|▌ | 7/126 [00:04<01:29, 1.34it/s][A
6%|▋ | 8/126 [00:05<01:41, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:05, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:12, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:46, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:48, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.02it/s][A
17%|█▋ | 21/126 [00:18<01:32, 1.13it/s][A
17%|█▋ | 22/126 [00:19<01:40, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:59, 1.17s/it][A
20%|█▉ | 25/126 [00:22<01:41, 1.01s/it][A
21%|██ | 26/126 [00:24<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:45, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.00it/s][A
28%|██▊ | 35/126 [00:33<01:38, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:48, 1.83it/s][A
31%|███ | 39/126 [00:35<00:59, 1.45it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:03, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:20, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.17s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.30s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.09s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.27s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:01, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.43it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:39, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:06<00:56, 1.01s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.04s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:17<00:53, 1.15s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:41, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.34it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.40it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.25it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.37it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.40it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.33it/s][A
73%|███████▎ | 92/126 [01:26<00:31, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.18s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.02it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:39<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.44it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.28it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.05it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.16s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.04s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.30it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.07it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.00s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.22it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.25it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.10it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.22it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.61it/s][A
[A 49%|████▉ | 300/614 [1:51:19<1:34:42, 18.10s/it]
100%|██████████| 126/126 [01:59<00:00, 1.61it/s][A
[Awandb: WARNING URL not available in offline run
49%|████▉ | 301/614 [1:51:44<4:52:52, 56.14s/it] 49%|████▉ | 302/614 [1:52:13<4:09:49, 48.04s/it] 49%|████▉ | 303/614 [1:52:34<3:25:56, 39.73s/it] 50%|████▉ | 304/614 [1:52:59<3:03:40, 35.55s/it] 50%|████▉ | 305/614 [1:53:17<2:34:49, 30.06s/it] 50%|████▉ | 305/614 [1:53:17<2:34:49, 30.06s/it] 50%|████▉ | 306/614 [1:53:39<2:22:49, 27.82s/it] 50%|█████ | 307/614 [1:54:01<2:12:50, 25.96s/it] 50%|█████ | 308/614 [1:54:13<1:51:53, 21.94s/it] 50%|█████ | 309/614 [1:54:31<1:45:24, 20.74s/it] 50%|█████ | 310/614 [1:54:50<1:42:05, 20.15s/it] 50%|█████ | 310/614 [1:54:50<1:42:05, 20.15s/it] 51%|█████ | 311/614 [1:55:10<1:41:12, 20.04s/it] 51%|█████ | 312/614 [1:55:25<1:33:56, 18.67s/it] 51%|█████ | 313/614 [1:55:44<1:33:31, 18.64s/it] 51%|█████ | 314/614 [1:56:04<1:35:23, 19.08s/it] 51%|█████▏ | 315/614 [1:56:22<1:34:11, 18.90s/it] 51%|█████▏ | 315/614 [1:56:22<1:34:11, 18.90s/it] 51%|█████▏ | 316/614 [1:56:43<1:37:00, 19.53s/it] 52%|█████▏ | 317/614 [1:57:03<1:36:54, 19.58s/it] 52%|█████▏ | 318/614 [1:57:26<1:40:43, 20.42s/it] 52%|█████▏ | 319/614 [1:57:45<1:39:04, 20.15s/it] 52%|█████▏ | 320/614 [1:58:11<1:47:59, 22.04s/it] 52%|█████▏ | 320/614 [1:58:11<1:47:59, 22.04s/it] 52%|█████▏ | 321/614 [1:58:31<1:44:29, 21.40s/it] 52%|█████▏ | 322/614 [1:58:51<1:41:07, 20.78s/it] 53%|█████▎ | 323/614 [1:59:13<1:42:28, 21.13s/it] 53%|█████▎ | 324/614 [1:59:34<1:42:58, 21.31s/it] 53%|█████▎ | 325/614 [1:59:58<1:45:28, 21.90s/it] 53%|█████▎ | 325/614 [1:59:58<1:45:28, 21.90s/it] 53%|█████▎ | 326/614 [2:00:21<1:47:35, 22.42s/it] 53%|█████▎ | 327/614 [2:00:39<1:39:47, 20.86s/it] 53%|█████▎ | 328/614 [2:00:59<1:39:33, 20.89s/it] 54%|█████▎ | 329/614 [2:01:20<1:38:55, 20.83s/it] 54%|█████▎ | 330/614 [2:01:39<1:35:22, 20.15s/it] 54%|█████▎ | 330/614 [2:01:39<1:35:22, 20.15s/it] 54%|█████▍ | 331/614 [2:01:56<1:31:14, 19.34s/it] 54%|█████▍ | 332/614 [2:02:20<1:37:45, 20.80s/it] 54%|█████▍ | 333/614 [2:02:38<1:32:43, 19.80s/it] 54%|█████▍ | 334/614 [2:02:55<1:29:20, 19.14s/it] 55%|█████▍ | 335/614 [2:03:18<1:34:15, 20.27s/it] 55%|█████▍ | 335/614 [2:03:18<1:34:15, 20.27s/it] 55%|█████▍ | 336/614 [2:03:40<1:35:29, 20.61s/it] 55%|█████▍ | 337/614 [2:04:01<1:36:40, 20.94s/it] 55%|█████▌ | 338/614 [2:04:28<1:43:34, 22.52s/it] 55%|█████▌ | 339/614 [2:04:50<1:43:18, 22.54s/it] 55%|█████▌ | 340/614 [2:05:08<1:36:58, 21.24s/it] 55%|█████▌ | 340/614 [2:05:08<1:36:58, 21.24s/it] 56%|█████▌ | 341/614 [2:05:28<1:34:38, 20.80s/it] 56%|█████▌ | 342/614 [2:05:48<1:32:38, 20.44s/it] 56%|█████▌ | 343/614 [2:06:13<1:39:07, 21.95s/it] 56%|█████▌ | 344/614 [2:06:34<1:37:17, 21.62s/it] 56%|█████▌ | 345/614 [2:06:58<1:40:01, 22.31s/it] 56%|█████▌ | 345/614 [2:06:58<1:40:01, 22.31s/it] 56%|█████▋ | 346/614 [2:07:19<1:37:57, 21.93s/it] 57%|█████▋ | 347/614 [2:07:34<1:27:37, 19.69s/it] 57%|█████▋ | 348/614 [2:07:53<1:27:13, 19.68s/it] 57%|█████▋ | 349/614 [2:08:07<1:18:26, 17.76s/it] 57%|█████▋ | 350/614 [2:08:23<1:16:23, 17.36s/it] 57%|█████▋ | 350/614 [2:08:23<1:16:23, 17.36s/it]{'eval_loss': 0.311747670173645, 'eval_runtime': 120.3226, 'eval_samples_per_second': 2.094, 'eval_steps_per_second': 1.047, 'epoch': 0.49}
{'loss': 0.4254, 'grad_norm': 1.0931415557861328, 'learning_rate': 0.0001099525291828986, 'epoch': 0.5}
{'loss': 0.4637, 'grad_norm': 1.0900492668151855, 'learning_rate': 0.00010726828522923562, 'epoch': 0.5}
{'loss': 0.574, 'grad_norm': 1.081187129020691, 'learning_rate': 0.00010457876523248518, 'epoch': 0.51}
{'loss': 0.4139, 'grad_norm': 0.5426526665687561, 'learning_rate': 0.00010188592151330343, 'epoch': 0.52}
{'loss': 0.4787, 'grad_norm': 0.6170647144317627, 'learning_rate': 9.919170880503415e-05, 'epoch': 0.53}
{'loss': 0.2533, 'grad_norm': 0.9634841084480286, 'learning_rate': 9.649808283476941e-05, 'epoch': 0.54}
{'loss': 0.4913, 'grad_norm': 0.6538633108139038, 'learning_rate': 9.38069989036886e-05, 'epoch': 0.55}
{'loss': 0.2606, 'grad_norm': 0.6944330334663391, 'learning_rate': 9.112041046770653e-05, 'epoch': 0.55}
{'loss': 0.4495, 'grad_norm': 0.9925371408462524, 'learning_rate': 8.844026771946147e-05, 'epoch': 0.56}
{'loss': 0.5536, 'grad_norm': 1.0751277208328247, 'learning_rate': 8.57685161726715e-05, 'epoch': 0.57}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:34, 3.64it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.76it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.43it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.58it/s][A
6%|▌ | 7/126 [00:04<01:29, 1.33it/s][A
6%|▋ | 8/126 [00:05<01:42, 1.15it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:47, 1.04it/s][A
12%|█▏ | 15/126 [00:13<01:49, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.01it/s][A
17%|█▋ | 21/126 [00:18<01:33, 1.13it/s][A
17%|█▋ | 22/126 [00:19<01:40, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:58, 1.16s/it][A
20%|█▉ | 25/126 [00:22<01:41, 1.01s/it][A
21%|██ | 26/126 [00:24<01:42, 1.02s/it][A
21%|██▏ | 27/126 [00:24<01:28, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.14it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.01s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:43, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.00it/s][A
28%|██▊ | 35/126 [00:33<01:38, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.09it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:48, 1.83it/s][A
31%|███ | 39/126 [00:35<01:00, 1.44it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:03, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:19, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.17s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.22s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.29s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.09s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.17s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.27s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:01, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.43it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:39, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.06it/s][A
56%|█████▌ | 70/126 [01:06<00:56, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.03s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:17<00:52, 1.15s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:41, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.34it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.40it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.26it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.37it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.40it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.33it/s][A
73%|███████▎ | 92/126 [01:26<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.27s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.19s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.02it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.04it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.43it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.27it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.16s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.29it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.00s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.25it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.23it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 57%|█████▋ | 350/614 [2:10:23<1:16:23, 17.36s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 57%|█████▋ | 351/614 [2:10:43<3:57:52, 54.27s/it] 57%|█████▋ | 352/614 [2:10:59<3:06:59, 42.82s/it] 57%|█████▋ | 353/614 [2:11:17<2:33:49, 35.36s/it] 58%|█████▊ | 354/614 [2:11:41<2:18:15, 31.91s/it] 58%|█████▊ | 355/614 [2:12:03<2:04:34, 28.86s/it] 58%|█████▊ | 355/614 [2:12:03<2:04:34, 28.86s/it] 58%|█████▊ | 356/614 [2:12:29<2:00:10, 27.95s/it] 58%|█████▊ | 357/614 [2:12:49<1:49:41, 25.61s/it] 58%|█████▊ | 358/614 [2:13:07<1:39:10, 23.24s/it] 58%|█████▊ | 359/614 [2:13:31<1:39:40, 23.45s/it] 59%|█████▊ | 360/614 [2:13:51<1:35:31, 22.57s/it] 59%|█████▊ | 360/614 [2:13:51<1:35:31, 22.57s/it] 59%|█████▉ | 361/614 [2:14:11<1:32:04, 21.84s/it] 59%|█████▉ | 362/614 [2:14:29<1:27:03, 20.73s/it] 59%|█████▉ | 363/614 [2:14:48<1:24:17, 20.15s/it] 59%|█████▉ | 364/614 [2:15:02<1:16:00, 18.24s/it] 59%|█████▉ | 365/614 [2:15:21<1:16:27, 18.43s/it] 59%|█████▉ | 365/614 [2:15:21<1:16:27, 18.43s/it] 60%|█████▉ | 366/614 [2:15:44<1:21:49, 19.79s/it] 60%|█████▉ | 367/614 [2:16:05<1:23:07, 20.19s/it] 60%|█████▉ | 368/614 [2:16:26<1:23:49, 20.44s/it] 60%|██████ | 369/614 [2:16:44<1:21:00, 19.84s/it] 60%|██████ | 370/614 [2:17:06<1:22:15, 20.23s/it] 60%|██████ | 370/614 [2:17:06<1:22:15, 20.23s/it] 60%|██████ | 371/614 [2:17:30<1:27:15, 21.55s/it] 61%|██████ | 372/614 [2:17:50<1:24:32, 20.96s/it] 61%|██████ | 373/614 [2:18:10<1:23:01, 20.67s/it] 61%|██████ | 374/614 [2:18:29<1:20:57, 20.24s/it] 61%|██████ | 375/614 [2:18:56<1:28:06, 22.12s/it] 61%|██████ | 375/614 [2:18:56<1:28:06, 22.12s/it] 61%|██████ | 376/614 [2:19:17<1:27:18, 22.01s/it] 61%|██████▏ | 377/614 [2:19:45<1:33:08, 23.58s/it] 62%|██████▏ | 378/614 [2:20:08<1:32:09, 23.43s/it] 62%|██████▏ | 379/614 [2:20:27<1:27:18, 22.29s/it] 62%|██████▏ | 380/614 [2:20:47<1:23:54, 21.51s/it] 62%|██████▏ | 380/614 [2:20:47<1:23:54, 21.51s/it] 62%|██████▏ | 381/614 [2:20:57<1:09:57, 18.01s/it] 62%|██████▏ | 382/614 [2:21:14<1:08:44, 17.78s/it] 62%|██████▏ | 383/614 [2:21:32<1:08:41, 17.84s/it] 63%|██████▎ | 384/614 [2:21:57<1:16:33, 19.97s/it] 63%|██████▎ | 385/614 [2:22:09<1:06:48, 17.50s/it] 63%|██████▎ | 385/614 [2:22:09<1:06:48, 17.50s/it] 63%|██████▎ | 386/614 [2:22:30<1:10:49, 18.64s/it] 63%|██████▎ | 387/614 [2:22:56<1:19:10, 20.93s/it] 63%|██████▎ | 388/614 [2:23:21<1:22:52, 22.00s/it] 63%|██████▎ | 389/614 [2:23:36<1:15:02, 20.01s/it] 64%|██████▎ | 390/614 [2:24:02<1:21:02, 21.71s/it] 64%|██████▎ | 390/614 [2:24:02<1:21:02, 21.71s/it] 64%|██████▎ | 391/614 [2:24:19<1:15:50, 20.41s/it] 64%|██████▍ | 392/614 [2:24:45<1:21:45, 22.10s/it] 64%|██████▍ | 393/614 [2:25:03<1:17:05, 20.93s/it] 64%|██████▍ | 394/614 [2:25:26<1:19:03, 21.56s/it] 64%|██████▍ | 395/614 [2:25:51<1:22:18, 22.55s/it] 64%|██████▍ | 395/614 [2:25:51<1:22:18, 22.55s/it] 64%|██████▍ | 396/614 [2:26:07<1:14:26, 20.49s/it] 65%|██████▍ | 397/614 [2:26:30<1:17:11, 21.34s/it] 65%|██████▍ | 398/614 [2:26:51<1:15:38, 21.01s/it] 65%|██████▍ | 399/614 [2:27:05<1:07:43, 18.90s/it] 65%|██████▌ | 400/614 [2:27:24<1:08:31, 19.21s/it] 65%|██████▌ | 400/614 [2:27:24<1:08:31, 19.21s/it]{'eval_loss': 0.3054664731025696, 'eval_runtime': 120.3383, 'eval_samples_per_second': 2.094, 'eval_steps_per_second': 1.047, 'epoch': 0.57}
{'loss': 0.4582, 'grad_norm': 0.8132654428482056, 'learning_rate': 8.310709524988743e-05, 'epoch': 0.58}
{'loss': 0.3663, 'grad_norm': 0.9619295001029968, 'learning_rate': 8.045793687466757e-05, 'epoch': 0.59}
{'loss': 0.5359, 'grad_norm': 0.9950692057609558, 'learning_rate': 7.782296406919557e-05, 'epoch': 0.59}
{'loss': 0.3589, 'grad_norm': 1.0357235670089722, 'learning_rate': 7.520408955836007e-05, 'epoch': 0.6}
{'loss': 0.3868, 'grad_norm': 0.6220430731773376, 'learning_rate': 7.260321438130913e-05, 'epoch': 0.61}
{'loss': 0.2924, 'grad_norm': 0.7960296869277954, 'learning_rate': 7.002222651148714e-05, 'epoch': 0.62}
{'loss': 0.6195, 'grad_norm': 1.227491855621338, 'learning_rate': 6.746299948615631e-05, 'epoch': 0.63}
{'loss': 0.364, 'grad_norm': 0.7982805371284485, 'learning_rate': 6.492739104639727e-05, 'epoch': 0.64}
{'loss': 0.4519, 'grad_norm': 0.7055819034576416, 'learning_rate': 6.24172417885762e-05, 'epoch': 0.64}
{'loss': 0.369, 'grad_norm': 1.0085915327072144, 'learning_rate': 5.9934373828257106e-05, 'epoch': 0.65}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.73it/s][A
2%|▏ | 3/126 [00:01<01:09, 1.78it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.86it/s][A
4%|▍ | 5/126 [00:02<01:24, 1.44it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.59it/s][A
6%|▌ | 7/126 [00:04<01:28, 1.34it/s][A
6%|▋ | 8/126 [00:05<01:41, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.04it/s][A
11%|█ | 14/126 [00:12<01:47, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:49, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.02it/s][A
17%|█▋ | 21/126 [00:18<01:33, 1.13it/s][A
17%|█▋ | 22/126 [00:19<01:40, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:55, 1.12s/it][A
19%|█▉ | 24/126 [00:22<01:58, 1.16s/it][A
20%|█▉ | 25/126 [00:22<01:41, 1.00s/it][A
21%|██ | 26/126 [00:24<01:42, 1.02s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.01s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.01it/s][A
28%|██▊ | 35/126 [00:33<01:38, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.09it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.39it/s][A
30%|███ | 38/126 [00:34<00:48, 1.83it/s][A
31%|███ | 39/126 [00:35<00:59, 1.45it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:02, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:19, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.17s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.22s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.29s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.09s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.16s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.26s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.27s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.28s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.09s/it][A
49%|████▉ | 62/126 [01:00<01:01, 1.04it/s][A
50%|█████ | 63/126 [01:01<01:04, 1.03s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.15it/s][A
52%|█████▏ | 65/126 [01:01<00:42, 1.44it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:38, 1.52it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.35it/s][A
55%|█████▍ | 69/126 [01:05<00:54, 1.05it/s][A
56%|█████▌ | 70/126 [01:06<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:04, 1.17s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.03it/s][A
58%|█████▊ | 73/126 [01:10<00:57, 1.08s/it][A
59%|█████▊ | 74/126 [01:11<00:54, 1.04s/it][A
60%|█████▉ | 75/126 [01:12<00:54, 1.06s/it][A
60%|██████ | 76/126 [01:13<00:55, 1.11s/it][A
61%|██████ | 77/126 [01:14<00:48, 1.01it/s][A
62%|██████▏ | 78/126 [01:15<00:49, 1.02s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.19s/it][A
63%|██████▎ | 80/126 [01:17<00:53, 1.16s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.34it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.40it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.26it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.38it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.40it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.64it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.32it/s][A
73%|███████▎ | 92/126 [01:27<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:32, 1.18s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.03it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:26, 1.08s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.44it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.28it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.23it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.20it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.16s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.21s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.30it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.07it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.00s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.24it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.23it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 65%|██████▌ | 400/614 [2:29:25<1:08:31, 19.21s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[Awandb: WARNING URL not available in offline run
65%|██████▌ | 401/614 [2:29:53<3:26:19, 58.12s/it] 65%|██████▌ | 402/614 [2:30:13<2:44:29, 46.55s/it] 66%|██████▌ | 403/614 [2:30:35<2:18:07, 39.28s/it] 66%|██████▌ | 404/614 [2:30:53<1:54:43, 32.78s/it] 66%|██████▌ | 405/614 [2:31:18<1:46:38, 30.61s/it] 66%|██████▌ | 405/614 [2:31:18<1:46:38, 30.61s/it] 66%|██████▌ | 406/614 [2:31:34<1:30:14, 26.03s/it] 66%|██████▋ | 407/614 [2:31:53<1:22:22, 23.88s/it] 66%|██████▋ | 408/614 [2:32:13<1:18:48, 22.95s/it] 67%|██████▋ | 409/614 [2:32:24<1:05:32, 19.18s/it] 67%|██████▋ | 410/614 [2:32:47<1:09:31, 20.45s/it] 67%|██████▋ | 410/614 [2:32:47<1:09:31, 20.45s/it] 67%|██████▋ | 411/614 [2:33:06<1:07:36, 19.98s/it] 67%|██████▋ | 412/614 [2:33:28<1:09:18, 20.59s/it] 67%|██████▋ | 413/614 [2:33:49<1:09:42, 20.81s/it] 67%|██████▋ | 414/614 [2:34:16<1:15:31, 22.66s/it] 68%|██████▊ | 415/614 [2:34:34<1:09:42, 21.02s/it] 68%|██████▊ | 415/614 [2:34:34<1:09:42, 21.02s/it] 68%|██████▊ | 416/614 [2:34:55<1:10:08, 21.25s/it] 68%|██████▊ | 417/614 [2:35:14<1:07:13, 20.47s/it] 68%|██████▊ | 418/614 [2:35:37<1:08:54, 21.10s/it] 68%|██████▊ | 419/614 [2:36:05<1:15:35, 23.26s/it] 68%|██████▊ | 420/614 [2:36:19<1:06:23, 20.53s/it] 68%|██████▊ | 420/614 [2:36:19<1:06:23, 20.53s/it] 69%|██████▊ | 421/614 [2:36:40<1:06:08, 20.56s/it] 69%|██████▊ | 422/614 [2:36:58<1:03:13, 19.76s/it] 69%|██████▉ | 423/614 [2:37:20<1:05:37, 20.62s/it] 69%|██████▉ | 424/614 [2:37:40<1:04:14, 20.28s/it] 69%|██████▉ | 425/614 [2:38:01<1:04:31, 20.48s/it] 69%|██████▉ | 425/614 [2:38:01<1:04:31, 20.48s/it] 69%|██████▉ | 426/614 [2:38:25<1:08:12, 21.77s/it] 70%|██████▉ | 427/614 [2:38:47<1:07:57, 21.81s/it] 70%|██████▉ | 428/614 [2:39:08<1:06:37, 21.49s/it] 70%|██████▉ | 429/614 [2:39:29<1:05:21, 21.20s/it] 70%|███████ | 430/614 [2:39:48<1:03:34, 20.73s/it] 70%|███████ | 430/614 [2:39:48<1:03:34, 20.73s/it] 70%|███████ | 431/614 [2:40:04<58:57, 19.33s/it] 70%|███████ | 432/614 [2:40:26<1:01:01, 20.12s/it] 71%|███████ | 433/614 [2:40:50<1:04:05, 21.24s/it] 71%|███████ | 434/614 [2:41:03<56:26, 18.81s/it] 71%|███████ | 435/614 [2:41:26<59:38, 19.99s/it] 71%|███████ | 435/614 [2:41:26<59:38, 19.99s/it] 71%|███████ | 436/614 [2:41:38<52:01, 17.54s/it] 71%|███████ | 437/614 [2:41:57<53:21, 18.09s/it] 71%|███████▏ | 438/614 [2:42:16<54:03, 18.43s/it] 71%|███████▏ | 439/614 [2:42:38<56:54, 19.51s/it] 72%|███████▏ | 440/614 [2:43:02<1:00:05, 20.72s/it] 72%|███████▏ | 440/614 [2:43:02<1:00:05, 20.72s/it] 72%|███████▏ | 441/614 [2:43:18<55:45, 19.34s/it] 72%|███████▏ | 442/614 [2:43:41<58:28, 20.40s/it] 72%|███████▏ | 443/614 [2:44:04<1:00:31, 21.24s/it] 72%|███████▏ | 444/614 [2:44:21<56:30, 19.95s/it] 72%|███████▏ | 445/614 [2:44:35<51:26, 18.26s/it] 72%|███████▏ | 445/614 [2:44:35<51:26, 18.26s/it] 73%|███████▎ | 446/614 [2:44:58<54:55, 19.62s/it] 73%|███████▎ | 447/614 [2:45:18<54:35, 19.61s/it] 73%|███████▎ | 448/614 [2:45:33<50:55, 18.41s/it] 73%|███████▎ | 449/614 [2:45:48<47:31, 17.28s/it] 73%|███████▎ | 450/614 [2:46:02<44:23, 16.24s/it] 73%|███████▎ | 450/614 [2:46:02<44:23, 16.24s/it]{'eval_loss': 0.3009154200553894, 'eval_runtime': 120.3254, 'eval_samples_per_second': 2.094, 'eval_steps_per_second': 1.047, 'epoch': 0.65}
{'loss': 0.3941, 'grad_norm': 0.6098869442939758, 'learning_rate': 5.7480589477529545e-05, 'epoch': 0.66}
{'loss': 0.4796, 'grad_norm': 0.86444491147995, 'learning_rate': 5.505766993671162e-05, 'epoch': 0.67}
{'loss': 0.3816, 'grad_norm': 1.1165945529937744, 'learning_rate': 5.266737400137765e-05, 'epoch': 0.68}
{'loss': 0.3584, 'grad_norm': 1.1898753643035889, 'learning_rate': 5.031143678565005e-05, 'epoch': 0.68}
{'loss': 0.3323, 'grad_norm': 0.5651485919952393, 'learning_rate': 4.799156846268095e-05, 'epoch': 0.69}
{'loss': 0.4991, 'grad_norm': 1.103471279144287, 'learning_rate': 4.57094530232389e-05, 'epoch': 0.7}
{'loss': 0.4969, 'grad_norm': 0.9560770988464355, 'learning_rate': 4.346674705330117e-05, 'epoch': 0.71}
{'loss': 0.3927, 'grad_norm': 1.0413203239440918, 'learning_rate': 4.1265078531538916e-05, 'epoch': 0.72}
{'loss': 0.4469, 'grad_norm': 1.0384825468063354, 'learning_rate': 3.9106045647569e-05, 'epoch': 0.72}
{'loss': 0.5587, 'grad_norm': 1.2701938152313232, 'learning_rate': 3.69912156418289e-05, 'epoch': 0.73}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:34, 3.63it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.75it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.43it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.59it/s][A
6%|▌ | 7/126 [00:04<01:28, 1.34it/s][A
6%|▋ | 8/126 [00:05<01:41, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:05, 1.07s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:48, 1.04it/s][A
11%|█ | 14/126 [00:12<01:46, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:48, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:51, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:41, 1.08it/s][A
14%|█▍ | 18/126 [00:15<01:15, 1.44it/s][A
15%|█▌ | 19/126 [00:16<01:27, 1.23it/s][A
16%|█▌ | 20/126 [00:17<01:45, 1.00it/s][A
17%|█▋ | 21/126 [00:18<01:34, 1.12it/s][A
17%|█▋ | 22/126 [00:19<01:41, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:59, 1.17s/it][A
20%|█▉ | 25/126 [00:23<01:41, 1.00s/it][A
21%|██ | 26/126 [00:24<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.01s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.00it/s][A
28%|██▊ | 35/126 [00:33<01:37, 1.07s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:47, 1.83it/s][A
31%|███ | 39/126 [00:35<00:59, 1.46it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:02, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:19, 1.01it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:31, 1.16s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.22s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.29s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.09s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.09s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.16s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.27s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.27s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:02, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.44it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:38, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:06<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:55, 1.05s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.03s/it][A
60%|█████▉ | 75/126 [01:12<00:52, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.09s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.00s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:17<00:52, 1.15s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:41, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:31, 1.35it/s][A
67%|██████▋ | 84/126 [01:20<00:32, 1.28it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.41it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.26it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.38it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.41it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.64it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.33it/s][A
73%|███████▎ | 92/126 [01:26<00:31, 1.07it/s][A
74%|███████▍ | 93/126 [01:28<00:34, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.08s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.18s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.03it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.08s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:39<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.44it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.28it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.05it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.16s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.30it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:54<00:05, 1.07it/s][A
96%|█████████▌| 121/126 [01:56<00:04, 1.00it/s][A
97%|█████████▋| 122/126 [01:56<00:03, 1.22it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.25it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:58<00:00, 1.23it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 73%|███████▎ | 450/614 [2:48:02<44:23, 16.24s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 73%|███████▎ | 451/614 [2:48:24<2:26:27, 53.91s/it] 74%|███████▎ | 452/614 [2:48:42<1:56:51, 43.28s/it] 74%|███████▍ | 453/614 [2:48:59<1:34:35, 35.25s/it] 74%|███████▍ | 454/614 [2:49:19<1:21:48, 30.68s/it] 74%|███████▍ | 455/614 [2:49:37<1:11:19, 26.92s/it] 74%|███████▍ | 455/614 [2:49:37<1:11:19, 26.92s/it] 74%|███████▍ | 456/614 [2:49:55<1:03:45, 24.21s/it] 74%|███████▍ | 457/614 [2:50:11<56:50, 21.72s/it] 75%|███████▍ | 458/614 [2:50:29<54:03, 20.79s/it] 75%|███████▍ | 459/614 [2:50:43<48:25, 18.75s/it] 75%|███████▍ | 460/614 [2:51:05<50:06, 19.52s/it] 75%|███████▍ | 460/614 [2:51:05<50:06, 19.52s/it] 75%|███████▌ | 461/614 [2:51:29<53:31, 20.99s/it] 75%|███████▌ | 462/614 [2:51:48<51:42, 20.41s/it] 75%|███████▌ | 463/614 [2:52:07<50:15, 19.97s/it] 76%|███████▌ | 464/614 [2:52:30<52:19, 20.93s/it] 76%|███████▌ | 465/614 [2:52:47<49:14, 19.83s/it] 76%|███████▌ | 465/614 [2:52:47<49:14, 19.83s/it] 76%|███████▌ | 466/614 [2:53:04<46:43, 18.94s/it] 76%|███████▌ | 467/614 [2:53:19<43:13, 17.64s/it] 76%|███████▌ | 468/614 [2:53:36<42:46, 17.58s/it] 76%|███████▋ | 469/614 [2:53:53<42:01, 17.39s/it] 77%|███████▋ | 470/614 [2:54:12<42:52, 17.86s/it] 77%|███████▋ | 470/614 [2:54:12<42:52, 17.86s/it] 77%|███████▋ | 471/614 [2:54:33<44:50, 18.82s/it] 77%|███████▋ | 472/614 [2:54:49<42:26, 17.93s/it] 77%|███████▋ | 473/614 [2:55:10<44:05, 18.76s/it] 77%|███████▋ | 474/614 [2:55:30<45:01, 19.30s/it] 77%|███████▋ | 475/614 [2:55:53<46:50, 20.22s/it] 77%|███████▋ | 475/614 [2:55:53<46:50, 20.22s/it] 78%|███████▊ | 476/614 [2:56:10<44:21, 19.28s/it] 78%|███████▊ | 477/614 [2:56:24<40:19, 17.66s/it] 78%|███████▊ | 478/614 [2:56:44<41:37, 18.37s/it] 78%|███████▊ | 479/614 [2:57:01<40:30, 18.00s/it] 78%|███████▊ | 480/614 [2:57:22<42:25, 18.99s/it] 78%|███████▊ | 480/614 [2:57:22<42:25, 18.99s/it] 78%|███████▊ | 481/614 [2:57:41<42:09, 19.02s/it] 79%|███████▊ | 482/614 [2:58:00<41:52, 19.04s/it] 79%|███████▊ | 483/614 [2:58:19<41:32, 19.02s/it] 79%|███████▉ | 484/614 [2:58:36<39:35, 18.27s/it] 79%|███████▉ | 485/614 [2:58:53<38:38, 17.98s/it] 79%|███████▉ | 485/614 [2:58:53<38:38, 17.98s/it] 79%|███████▉ | 486/614 [2:59:10<37:24, 17.54s/it] 79%|███████▉ | 487/614 [2:59:34<41:45, 19.73s/it] 79%|███████▉ | 488/614 [3:00:00<45:10, 21.52s/it] 80%|███████▉ | 489/614 [3:00:21<44:23, 21.30s/it] 80%|███████▉ | 490/614 [3:00:42<43:42, 21.15s/it] 80%|███████▉ | 490/614 [3:00:42<43:42, 21.15s/it] 80%|███████▉ | 491/614 [3:01:06<45:01, 21.96s/it] 80%|████████ | 492/614 [3:01:29<45:39, 22.45s/it] 80%|████████ | 493/614 [3:01:52<45:22, 22.50s/it] 80%|████████ | 494/614 [3:02:15<45:14, 22.62s/it] 81%|████████ | 495/614 [3:02:40<46:11, 23.29s/it] 81%|████████ | 495/614 [3:02:40<46:11, 23.29s/it] 81%|████████ | 496/614 [3:02:59<43:23, 22.07s/it] 81%|████████ | 497/614 [3:03:21<42:53, 22.00s/it] 81%|████████ | 498/614 [3:03:33<37:01, 19.15s/it] 81%|████████▏ | 499/614 [3:03:56<39:04, 20.39s/it] 81%|████████▏ | 500/614 [3:04:24<42:38, 22.44s/it] 81%|████████▏ | 500/614 [3:04:24<42:38, 22.44s/it]{'eval_loss': 0.29790911078453064, 'eval_runtime': 120.1996, 'eval_samples_per_second': 2.097, 'eval_steps_per_second': 1.048, 'epoch': 0.73}
{'loss': 0.4347, 'grad_norm': 1.088590383529663, 'learning_rate': 3.492212366791831e-05, 'epoch': 0.74}
{'loss': 0.4226, 'grad_norm': 0.9670878648757935, 'learning_rate': 3.290027167823204e-05, 'epoch': 0.75}
{'loss': 0.3849, 'grad_norm': 0.9960106015205383, 'learning_rate': 3.092712733369387e-05, 'epoch': 0.76}
{'loss': 0.3709, 'grad_norm': 0.6322615742683411, 'learning_rate': 2.9004122938382617e-05, 'epoch': 0.77}
{'loss': 0.4528, 'grad_norm': 0.8384042978286743, 'learning_rate': 2.7132654399823444e-05, 'epoch': 0.77}
{'loss': 0.4617, 'grad_norm': 0.8728402256965637, 'learning_rate': 2.531408021569982e-05, 'epoch': 0.78}
{'loss': 0.5415, 'grad_norm': 0.9127026796340942, 'learning_rate': 2.3549720487720738e-05, 'epoch': 0.79}
{'loss': 0.4591, 'grad_norm': 0.9375382661819458, 'learning_rate': 2.184085596336011e-05, 'epoch': 0.8}
{'loss': 0.4813, 'grad_norm': 1.062622308731079, 'learning_rate': 2.0188727106162874e-05, 'epoch': 0.81}
{'loss': 0.4651, 'grad_norm': 0.8038843870162964, 'learning_rate': 1.8594533195293427e-05, 'epoch': 0.81}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.67it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.76it/s][A
3%|▎ | 4/126 [00:02<01:05, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.44it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.59it/s][A
6%|▌ | 7/126 [00:04<01:29, 1.33it/s][A
6%|▋ | 8/126 [00:05<01:41, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:05, 1.07s/it][A
8%|▊ | 10/126 [00:08<02:12, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:22, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:46, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:48, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.02it/s][A
17%|█▋ | 21/126 [00:18<01:33, 1.13it/s][A
17%|█▋ | 22/126 [00:19<01:40, 1.03it/s][A
18%|█▊ | 23/126 [00:21<01:54, 1.11s/it][A
19%|█▉ | 24/126 [00:22<01:58, 1.16s/it][A
20%|█▉ | 25/126 [00:22<01:41, 1.01s/it][A
21%|██ | 26/126 [00:24<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.01it/s][A
28%|██▊ | 35/126 [00:33<01:37, 1.07s/it][A
29%|██▊ | 36/126 [00:33<01:21, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:47, 1.83it/s][A
31%|███ | 39/126 [00:35<00:59, 1.46it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.61it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.64it/s][A
34%|███▍ | 43/126 [00:38<01:02, 1.32it/s][A
35%|███▍ | 44/126 [00:39<01:16, 1.07it/s][A
36%|███▌ | 45/126 [00:40<01:19, 1.02it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.17s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.29s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:12, 1.00it/s][A
43%|████▎ | 54/126 [00:50<01:18, 1.09s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.26s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.27s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:01, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:06, 1.06s/it][A
51%|█████ | 64/126 [01:01<00:55, 1.12it/s][A
52%|█████▏ | 65/126 [01:02<00:43, 1.41it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.37it/s][A
53%|█████▎ | 67/126 [01:03<00:39, 1.49it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:06<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.04s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:17<00:53, 1.15s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.05it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.34it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.40it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.25it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.38it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.41it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.32it/s][A
73%|███████▎ | 92/126 [01:26<00:31, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.27s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.18s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.03it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.43it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.27it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:46<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:50<00:12, 1.17s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:52<00:06, 1.30it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.07it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.00s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.25it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.22it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 81%|████████▏ | 500/614 [3:06:24<42:38, 22.44s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[Awandb: WARNING URL not available in offline run
82%|████████▏ | 501/614 [3:06:56<1:55:37, 61.40s/it] 82%|████████▏ | 502/614 [3:07:18<1:32:35, 49.60s/it] 82%|████████▏ | 503/614 [3:07:38<1:15:27, 40.79s/it] 82%|████████▏ | 504/614 [3:07:56<1:01:51, 33.74s/it] 82%|████████▏ | 505/614 [3:08:16<53:54, 29.68s/it] 82%|████████▏ | 505/614 [3:08:16<53:54, 29.68s/it] 82%|████████▏ | 506/614 [3:08:32<46:17, 25.71s/it] 83%|████████▎ | 507/614 [3:08:44<38:31, 21.61s/it] 83%|████████▎ | 508/614 [3:09:08<39:07, 22.14s/it] 83%|████████▎ | 509/614 [3:09:22<34:26, 19.69s/it] 83%|████████▎ | 510/614 [3:09:34<30:32, 17.62s/it] 83%|████████▎ | 510/614 [3:09:34<30:32, 17.62s/it] 83%|████████▎ | 511/614 [3:10:00<34:17, 19.98s/it] 83%|████████▎ | 512/614 [3:10:19<33:24, 19.65s/it] 84%|████████▎ | 513/614 [3:10:46<36:51, 21.90s/it] 84%|████████▎ | 514/614 [3:11:05<35:08, 21.08s/it] 84%|████████▍ | 515/614 [3:11:23<33:24, 20.24s/it] 84%|████████▍ | 515/614 [3:11:23<33:24, 20.24s/it] 84%|████████▍ | 516/614 [3:11:49<35:37, 21.82s/it] 84%|████████▍ | 517/614 [3:12:09<34:37, 21.42s/it] 84%|████████▍ | 518/614 [3:12:30<33:52, 21.17s/it] 85%|████████▍ | 519/614 [3:12:49<32:31, 20.54s/it] 85%|████████▍ | 520/614 [3:13:09<31:52, 20.35s/it] 85%|████████▍ | 520/614 [3:13:09<31:52, 20.35s/it] 85%|████████▍ | 521/614 [3:13:26<29:51, 19.26s/it] 85%|████████▌ | 522/614 [3:13:42<28:13, 18.41s/it] 85%|████████▌ | 523/614 [3:14:02<28:30, 18.79s/it] 85%|████████▌ | 524/614 [3:14:17<26:48, 17.87s/it] 86%|████████▌ | 525/614 [3:14:36<26:39, 17.97s/it] 86%|████████▌ | 525/614 [3:14:36<26:39, 17.97s/it] 86%|████████▌ | 526/614 [3:14:48<24:02, 16.39s/it] 86%|████████▌ | 527/614 [3:15:09<25:36, 17.66s/it] 86%|████████▌ | 528/614 [3:15:26<25:10, 17.56s/it] 86%|████████▌ | 529/614 [3:15:49<27:13, 19.21s/it] 86%|████████▋ | 530/614 [3:16:08<26:47, 19.14s/it] 86%|████████▋ | 530/614 [3:16:08<26:47, 19.14s/it] 86%|████████▋ | 531/614 [3:16:32<28:14, 20.41s/it] 87%|████████▋ | 532/614 [3:16:48<26:12, 19.18s/it] 87%|████████▋ | 533/614 [3:17:09<26:29, 19.62s/it] 87%|████████▋ | 534/614 [3:17:31<27:18, 20.48s/it] 87%|████████▋ | 535/614 [3:17:47<25:01, 19.01s/it] 87%|████████▋ | 535/614 [3:17:47<25:01, 19.01s/it] 87%|████████▋ | 536/614 [3:18:04<23:51, 18.35s/it] 87%|████████▋ | 537/614 [3:18:27<25:25, 19.82s/it] 88%|████████▊ | 538/614 [3:18:53<27:31, 21.73s/it] 88%|████████▊ | 539/614 [3:19:15<27:24, 21.92s/it] 88%|████████▊ | 540/614 [3:19:39<27:50, 22.57s/it] 88%|████████▊ | 540/614 [3:19:39<27:50, 22.57s/it] 88%|████████▊ | 541/614 [3:20:06<28:56, 23.79s/it] 88%|████████▊ | 542/614 [3:20:31<29:02, 24.20s/it] 88%|████████▊ | 543/614 [3:20:53<27:39, 23.37s/it] 89%|████████▊ | 544/614 [3:21:07<24:15, 20.79s/it] 89%|████████▉ | 545/614 [3:21:29<24:06, 20.97s/it] 89%|████████▉ | 545/614 [3:21:29<24:06, 20.97s/it] 89%|████████▉ | 546/614 [3:21:44<21:38, 19.09s/it] 89%|████████▉ | 547/614 [3:22:05<22:14, 19.92s/it] 89%|████████▉ | 548/614 [3:22:20<20:10, 18.34s/it] 89%|████████▉ | 549/614 [3:22:40<20:28, 18.90s/it] 90%|████████▉ | 550/614 [3:22:57<19:31, 18.30s/it] 90%|████████▉ | 550/614 [3:22:57<19:31, 18.30s/it]{'eval_loss': 0.2944928705692291, 'eval_runtime': 120.3478, 'eval_samples_per_second': 2.094, 'eval_steps_per_second': 1.047, 'epoch': 0.81}
{'loss': 0.4701, 'grad_norm': 0.9246629476547241, 'learning_rate': 1.7059431454979824e-05, 'epoch': 0.82}
{'loss': 0.4114, 'grad_norm': 1.2579699754714966, 'learning_rate': 1.5584536214485457e-05, 'epoch': 0.83}
{'loss': 0.4497, 'grad_norm': 1.0765819549560547, 'learning_rate': 1.4170918099218166e-05, 'epoch': 0.84}
{'loss': 0.3338, 'grad_norm': 0.8294546604156494, 'learning_rate': 1.2819603253564205e-05, 'epoch': 0.85}
{'loss': 0.4017, 'grad_norm': 0.8488652110099792, 'learning_rate': 1.153157259601062e-05, 'epoch': 0.86}
{'loss': 0.4934, 'grad_norm': 0.9699320197105408, 'learning_rate': 1.030776110709718e-05, 'epoch': 0.86}
{'loss': 0.4814, 'grad_norm': 0.939552903175354, 'learning_rate': 9.149057150714801e-06, 'epoch': 0.87}
{'loss': 0.4135, 'grad_norm': 0.970380961894989, 'learning_rate': 8.056301829242784e-06, 'epoch': 0.88}
{'loss': 0.2724, 'grad_norm': 0.5573286414146423, 'learning_rate': 7.030288372993066e-06, 'epoch': 0.89}
{'loss': 0.4606, 'grad_norm': 0.9565848112106323, 'learning_rate': 6.0717615644051206e-06, 'epoch': 0.9}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.67it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.75it/s][A
3%|▎ | 4/126 [00:02<01:06, 1.85it/s][A
4%|▍ | 5/126 [00:03<01:24, 1.42it/s][A
5%|▍ | 6/126 [00:03<01:15, 1.58it/s][A
6%|▌ | 7/126 [00:04<01:29, 1.33it/s][A
6%|▋ | 8/126 [00:05<01:42, 1.15it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.15s/it][A
9%|▊ | 11/126 [00:09<02:23, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:46, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:49, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:52, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.02it/s][A
17%|█▋ | 21/126 [00:18<01:34, 1.11it/s][A
17%|█▋ | 22/126 [00:19<01:41, 1.02it/s][A
18%|█▊ | 23/126 [00:21<01:55, 1.12s/it][A
19%|█▉ | 24/126 [00:22<01:59, 1.17s/it][A
20%|█▉ | 25/126 [00:23<01:41, 1.01s/it][A
21%|██ | 26/126 [00:24<01:42, 1.02s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.01s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:42, 1.08s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.01it/s][A
28%|██▊ | 35/126 [00:33<01:37, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.10it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:48, 1.83it/s][A
31%|███ | 39/126 [00:35<00:59, 1.45it/s][A
32%|███▏ | 40/126 [00:35<00:53, 1.61it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.44it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.63it/s][A
34%|███▍ | 43/126 [00:38<01:03, 1.30it/s][A
35%|███▍ | 44/126 [00:39<01:17, 1.06it/s][A
36%|███▌ | 45/126 [00:40<01:20, 1.00it/s][A
37%|███▋ | 46/126 [00:41<01:21, 1.02s/it][A
37%|███▋ | 47/126 [00:43<01:32, 1.18s/it][A
38%|███▊ | 48/126 [00:44<01:35, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:39, 1.30s/it][A
40%|███▉ | 50/126 [00:46<01:20, 1.06s/it][A
40%|████ | 51/126 [00:47<01:22, 1.10s/it][A
41%|████▏ | 52/126 [00:48<01:08, 1.08it/s][A
42%|████▏ | 53/126 [00:49<01:13, 1.00s/it][A
43%|████▎ | 54/126 [00:50<01:18, 1.10s/it][A
44%|████▎ | 55/126 [00:52<01:22, 1.17s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:54<01:27, 1.26s/it][A
46%|████▌ | 58/126 [00:56<01:25, 1.26s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.27s/it][A
48%|████▊ | 60/126 [00:58<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:02, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:01<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.43it/s][A
52%|█████▏ | 66/126 [01:02<00:43, 1.39it/s][A
53%|█████▎ | 67/126 [01:03<00:38, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.35it/s][A
55%|█████▍ | 69/126 [01:05<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:06<00:57, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:08<00:52, 1.03it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.03s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:16<00:55, 1.19s/it][A
63%|██████▎ | 80/126 [01:17<00:53, 1.16s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.17s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.04it/s][A
66%|██████▌ | 83/126 [01:19<00:32, 1.33it/s][A
67%|██████▋ | 84/126 [01:20<00:33, 1.27it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.39it/s][A
68%|██████▊ | 86/126 [01:22<00:31, 1.25it/s][A
69%|██████▉ | 87/126 [01:22<00:28, 1.38it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.47it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.41it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.32it/s][A
73%|███████▎ | 92/126 [01:27<00:31, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:31<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:33, 1.19s/it][A
79%|███████▊ | 99/126 [01:34<00:26, 1.02it/s][A
79%|███████▉ | 100/126 [01:35<00:24, 1.04it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.09s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.43it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.27it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:47<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:11, 1.00it/s][A
91%|█████████▏| 115/126 [01:50<00:12, 1.17s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:52<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:53<00:06, 1.29it/s][A
94%|█████████▍| 119/126 [01:53<00:05, 1.26it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.01s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.24it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.10it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.22it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 90%|████████▉ | 550/614 [3:24:58<19:31, 18.30s/it]
100%|██████████| 126/126 [01:59<00:00, 1.62it/s][A
[A 90%|████████▉ | 551/614 [3:25:15<56:45, 54.06s/it] 90%|████████▉ | 552/614 [3:25:35<45:20, 43.87s/it] 90%|█████████ | 553/614 [3:26:04<40:12, 39.55s/it] 90%|█████████ | 554/614 [3:26:29<35:03, 35.07s/it] 90%|█████████ | 555/614 [3:26:51<30:34, 31.10s/it] 90%|█████████ | 555/614 [3:26:51<30:34, 31.10s/it] 91%|█████████ | 556/614 [3:27:06<25:27, 26.33s/it] 91%|█████████ | 557/614 [3:27:25<22:53, 24.09s/it] 91%|█████████ | 558/614 [3:27:43<20:56, 22.43s/it] 91%|█████████ | 559/614 [3:27:56<17:57, 19.59s/it] 91%|█████████ | 560/614 [3:28:17<17:51, 19.84s/it] 91%|█████████ | 560/614 [3:28:17<17:51, 19.84s/it] 91%|█████████▏| 561/614 [3:28:40<18:30, 20.96s/it] 92%|█████████▏| 562/614 [3:29:00<17:43, 20.45s/it] 92%|█████████▏| 563/614 [3:29:16<16:28, 19.38s/it] 92%|█████████▏| 564/614 [3:29:33<15:30, 18.62s/it] 92%|█████████▏| 565/614 [3:29:54<15:38, 19.16s/it] 92%|█████████▏| 565/614 [3:29:54<15:38, 19.16s/it] 92%|█████████▏| 566/614 [3:30:15<15:50, 19.81s/it] 92%|█████████▏| 567/614 [3:30:35<15:40, 20.01s/it] 93%|█████████▎| 568/614 [3:31:01<16:33, 21.59s/it] 93%|█████████▎| 569/614 [3:31:25<16:44, 22.32s/it] 93%|█████████▎| 570/614 [3:31:47<16:16, 22.19s/it] 93%|█████████▎| 570/614 [3:31:47<16:16, 22.19s/it] 93%|█████████▎| 571/614 [3:32:08<15:37, 21.79s/it] 93%|█████████▎| 572/614 [3:32:30<15:25, 22.03s/it] 93%|█████████▎| 573/614 [3:32:53<15:11, 22.23s/it] 93%|█████████▎| 574/614 [3:33:07<13:10, 19.76s/it] 94%|█████████▎| 575/614 [3:33:31<13:38, 21.00s/it] 94%|█████████▎| 575/614 [3:33:31<13:38, 21.00s/it] 94%|█████████▍| 576/614 [3:33:53<13:32, 21.39s/it] 94%|█████████▍| 577/614 [3:34:14<13:02, 21.14s/it] 94%|█████████▍| 578/614 [3:34:33<12:21, 20.61s/it] 94%|█████████▍| 579/614 [3:34:50<11:26, 19.61s/it] 94%|█████████▍| 580/614 [3:35:09<11:01, 19.44s/it] 94%|█████████▍| 580/614 [3:35:09<11:01, 19.44s/it] 95%|█████████▍| 581/614 [3:35:32<11:16, 20.51s/it] 95%|█████████▍| 582/614 [3:35:55<11:17, 21.16s/it] 95%|█████████▍| 583/614 [3:36:15<10:46, 20.87s/it] 95%|█████████▌| 584/614 [3:36:32<09:48, 19.62s/it] 95%|█████████▌| 585/614 [3:36:45<08:33, 17.72s/it] 95%|█████████▌| 585/614 [3:36:45<08:33, 17.72s/it] 95%|█████████▌| 586/614 [3:37:07<08:52, 19.01s/it] 96%|█████████▌| 587/614 [3:37:26<08:28, 18.83s/it] 96%|█████████▌| 588/614 [3:37:47<08:32, 19.71s/it] 96%|█████████▌| 589/614 [3:38:05<07:56, 19.07s/it] 96%|█████████▌| 590/614 [3:38:28<08:09, 20.42s/it] 96%|█████████▌| 590/614 [3:38:28<08:09, 20.42s/it] 96%|█████████▋| 591/614 [3:38:53<08:16, 21.58s/it] 96%|█████████▋| 592/614 [3:39:16<08:08, 22.20s/it] 97%|█████████▋| 593/614 [3:39:34<07:19, 20.91s/it] 97%|█████████▋| 594/614 [3:39:56<07:04, 21.22s/it] 97%|█████████▋| 595/614 [3:40:18<06:47, 21.45s/it] 97%|█████████▋| 595/614 [3:40:18<06:47, 21.45s/it] 97%|█████████▋| 596/614 [3:40:33<05:52, 19.58s/it] 97%|█████████▋| 597/614 [3:40:53<05:34, 19.65s/it] 97%|█████████▋| 598/614 [3:41:17<05:32, 20.80s/it] 98%|█████████▊| 599/614 [3:41:37<05:08, 20.60s/it] 98%|█████████▊| 600/614 [3:41:53<04:29, 19.25s/it] 98%|█████████▊| 600/614 [3:41:53<04:29, 19.25s/it]{'eval_loss': 0.2927910387516022, 'eval_runtime': 120.4502, 'eval_samples_per_second': 2.092, 'eval_steps_per_second': 1.046, 'epoch': 0.9}
{'loss': 0.4854, 'grad_norm': 0.7690985798835754, 'learning_rate': 5.181417197408734e-06, 'epoch': 0.9}
{'loss': 0.425, 'grad_norm': 0.7944011688232422, 'learning_rate': 4.359901572347758e-06, 'epoch': 0.91}
{'loss': 0.5035, 'grad_norm': 1.0082036256790161, 'learning_rate': 3.607811026831176e-06, 'epoch': 0.92}
{'loss': 0.3532, 'grad_norm': 0.9810898303985596, 'learning_rate': 2.9256915028519573e-06, 'epoch': 0.93}
{'loss': 0.4653, 'grad_norm': 0.8743959069252014, 'learning_rate': 2.3140381504882737e-06, 'epoch': 0.94}
{'loss': 0.351, 'grad_norm': 0.8244614601135254, 'learning_rate': 1.7732949684743594e-06, 'epoch': 0.94}
{'loss': 0.4347, 'grad_norm': 1.2245746850967407, 'learning_rate': 1.303854481902067e-06, 'epoch': 0.95}
{'loss': 0.4403, 'grad_norm': 0.9963445663452148, 'learning_rate': 9.060574572873237e-07, 'epoch': 0.96}
{'loss': 0.4273, 'grad_norm': 1.018866777420044, 'learning_rate': 5.801926552078563e-07, 'epoch': 0.97}
{'loss': 0.4367, 'grad_norm': 1.0799201726913452, 'learning_rate': 3.264966206921294e-07, 'epoch': 0.98}
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:33, 3.71it/s][A
2%|▏ | 3/126 [00:01<01:10, 1.75it/s][A
3%|▎ | 4/126 [00:02<01:06, 1.84it/s][A
4%|▍ | 5/126 [00:03<01:25, 1.41it/s][A
5%|▍ | 6/126 [00:03<01:16, 1.57it/s][A
6%|▌ | 7/126 [00:04<01:30, 1.32it/s][A
6%|▋ | 8/126 [00:05<01:42, 1.16it/s][A
7%|▋ | 9/126 [00:07<02:06, 1.08s/it][A
8%|▊ | 10/126 [00:08<02:13, 1.16s/it][A
9%|▊ | 11/126 [00:09<02:23, 1.24s/it][A
10%|▉ | 12/126 [00:10<02:13, 1.17s/it][A
10%|█ | 13/126 [00:11<01:49, 1.03it/s][A
11%|█ | 14/126 [00:12<01:47, 1.05it/s][A
12%|█▏ | 15/126 [00:13<01:49, 1.02it/s][A
13%|█▎ | 16/126 [00:14<01:51, 1.02s/it][A
13%|█▎ | 17/126 [00:15<01:37, 1.12it/s][A
14%|█▍ | 18/126 [00:15<01:12, 1.49it/s][A
15%|█▌ | 19/126 [00:16<01:25, 1.25it/s][A
16%|█▌ | 20/126 [00:17<01:44, 1.01it/s][A
17%|█▋ | 21/126 [00:18<01:37, 1.07it/s][A
17%|█▋ | 22/126 [00:19<01:43, 1.00it/s][A
18%|█▊ | 23/126 [00:21<01:56, 1.13s/it][A
19%|█▉ | 24/126 [00:22<02:00, 1.18s/it][A
20%|█▉ | 25/126 [00:23<01:42, 1.01s/it][A
21%|██ | 26/126 [00:24<01:42, 1.03s/it][A
21%|██▏ | 27/126 [00:24<01:29, 1.11it/s][A
22%|██▏ | 28/126 [00:25<01:26, 1.13it/s][A
23%|██▎ | 29/126 [00:26<01:38, 1.02s/it][A
24%|██▍ | 30/126 [00:28<01:44, 1.09s/it][A
25%|██▍ | 31/126 [00:29<01:43, 1.09s/it][A
25%|██▌ | 32/126 [00:30<01:42, 1.09s/it][A
26%|██▌ | 33/126 [00:31<01:50, 1.19s/it][A
27%|██▋ | 34/126 [00:32<01:31, 1.00it/s][A
28%|██▊ | 35/126 [00:33<01:38, 1.08s/it][A
29%|██▊ | 36/126 [00:34<01:22, 1.09it/s][A
29%|██▉ | 37/126 [00:34<01:03, 1.40it/s][A
30%|███ | 38/126 [00:34<00:48, 1.82it/s][A
31%|███ | 39/126 [00:35<00:59, 1.45it/s][A
32%|███▏ | 40/126 [00:36<00:53, 1.60it/s][A
33%|███▎ | 41/126 [00:36<00:59, 1.43it/s][A
33%|███▎ | 42/126 [00:37<00:51, 1.64it/s][A
34%|███▍ | 43/126 [00:38<01:03, 1.31it/s][A
35%|███▍ | 44/126 [00:39<01:17, 1.06it/s][A
36%|███▌ | 45/126 [00:41<01:21, 1.00s/it][A
37%|███▋ | 46/126 [00:42<01:22, 1.03s/it][A
37%|███▋ | 47/126 [00:43<01:33, 1.18s/it][A
38%|███▊ | 48/126 [00:44<01:36, 1.23s/it][A
39%|███▉ | 49/126 [00:46<01:40, 1.31s/it][A
40%|███▉ | 50/126 [00:46<01:21, 1.07s/it][A
40%|████ | 51/126 [00:48<01:23, 1.12s/it][A
41%|████▏ | 52/126 [00:48<01:09, 1.07it/s][A
42%|████▏ | 53/126 [00:49<01:13, 1.00s/it][A
43%|████▎ | 54/126 [00:51<01:19, 1.10s/it][A
44%|████▎ | 55/126 [00:52<01:23, 1.18s/it][A
44%|████▍ | 56/126 [00:53<01:22, 1.18s/it][A
45%|████▌ | 57/126 [00:55<01:27, 1.27s/it][A
46%|████▌ | 58/126 [00:56<01:26, 1.27s/it][A
47%|████▋ | 59/126 [00:57<01:25, 1.28s/it][A
48%|████▊ | 60/126 [00:59<01:24, 1.29s/it][A
48%|████▊ | 61/126 [00:59<01:11, 1.10s/it][A
49%|████▉ | 62/126 [01:00<01:02, 1.03it/s][A
50%|█████ | 63/126 [01:01<01:05, 1.04s/it][A
51%|█████ | 64/126 [01:02<00:54, 1.14it/s][A
52%|█████▏ | 65/126 [01:02<00:42, 1.43it/s][A
52%|█████▏ | 66/126 [01:03<00:43, 1.38it/s][A
53%|█████▎ | 67/126 [01:03<00:39, 1.51it/s][A
54%|█████▍ | 68/126 [01:04<00:43, 1.34it/s][A
55%|█████▍ | 69/126 [01:06<00:53, 1.07it/s][A
56%|█████▌ | 70/126 [01:07<00:56, 1.02s/it][A
56%|█████▋ | 71/126 [01:08<01:03, 1.15s/it][A
57%|█████▋ | 72/126 [01:09<00:52, 1.04it/s][A
58%|█████▊ | 73/126 [01:10<00:56, 1.06s/it][A
59%|█████▊ | 74/126 [01:11<00:53, 1.03s/it][A
60%|█████▉ | 75/126 [01:12<00:53, 1.04s/it][A
60%|██████ | 76/126 [01:13<00:54, 1.10s/it][A
61%|██████ | 77/126 [01:14<00:46, 1.05it/s][A
62%|██████▏ | 78/126 [01:15<00:48, 1.01s/it][A
63%|██████▎ | 79/126 [01:17<00:55, 1.18s/it][A
63%|██████▎ | 80/126 [01:18<00:53, 1.16s/it][A
64%|██████▍ | 81/126 [01:19<00:52, 1.16s/it][A
65%|██████▌ | 82/126 [01:19<00:42, 1.04it/s][A
66%|██████▌ | 83/126 [01:20<00:32, 1.33it/s][A
67%|██████▋ | 84/126 [01:21<00:33, 1.26it/s][A
67%|██████▋ | 85/126 [01:21<00:29, 1.40it/s][A
68%|██████▊ | 86/126 [01:22<00:32, 1.25it/s][A
69%|██████▉ | 87/126 [01:23<00:28, 1.38it/s][A
70%|██████▉ | 88/126 [01:23<00:25, 1.48it/s][A
71%|███████ | 89/126 [01:24<00:26, 1.40it/s][A
71%|███████▏ | 90/126 [01:24<00:21, 1.65it/s][A
72%|███████▏ | 91/126 [01:25<00:26, 1.32it/s][A
73%|███████▎ | 92/126 [01:27<00:32, 1.06it/s][A
74%|███████▍ | 93/126 [01:28<00:35, 1.06s/it][A
75%|███████▍ | 94/126 [01:29<00:35, 1.12s/it][A
75%|███████▌ | 95/126 [01:30<00:33, 1.09s/it][A
76%|███████▌ | 96/126 [01:32<00:33, 1.13s/it][A
77%|███████▋ | 97/126 [01:33<00:36, 1.26s/it][A
78%|███████▊ | 98/126 [01:34<00:32, 1.18s/it][A
79%|███████▊ | 99/126 [01:35<00:26, 1.03it/s][A
79%|███████▉ | 100/126 [01:36<00:24, 1.05it/s][A
80%|████████ | 101/126 [01:37<00:27, 1.08s/it][A
81%|████████ | 102/126 [01:38<00:27, 1.15s/it][A
82%|████████▏ | 103/126 [01:40<00:29, 1.27s/it][A
83%|████████▎ | 104/126 [01:40<00:22, 1.04s/it][A
83%|████████▎ | 105/126 [01:41<00:22, 1.05s/it][A
84%|████████▍ | 106/126 [01:42<00:17, 1.13it/s][A
85%|████████▍ | 107/126 [01:42<00:13, 1.44it/s][A
86%|████████▌ | 108/126 [01:43<00:14, 1.28it/s][A
87%|████████▋ | 109/126 [01:44<00:13, 1.22it/s][A
87%|████████▋ | 110/126 [01:45<00:15, 1.05it/s][A
88%|████████▊ | 111/126 [01:46<00:12, 1.16it/s][A
89%|████████▉ | 112/126 [01:47<00:11, 1.19it/s][A
90%|████████▉ | 113/126 [01:48<00:12, 1.04it/s][A
90%|█████████ | 114/126 [01:49<00:12, 1.00s/it][A
91%|█████████▏| 115/126 [01:51<00:12, 1.17s/it][A
92%|█████████▏| 116/126 [01:52<00:12, 1.20s/it][A
93%|█████████▎| 117/126 [01:53<00:09, 1.03s/it][A
94%|█████████▎| 118/126 [01:53<00:06, 1.30it/s][A
94%|█████████▍| 119/126 [01:54<00:05, 1.25it/s][A
95%|█████████▌| 120/126 [01:55<00:05, 1.06it/s][A
96%|█████████▌| 121/126 [01:56<00:05, 1.00s/it][A
97%|█████████▋| 122/126 [01:56<00:03, 1.21it/s][A
98%|█████████▊| 123/126 [01:57<00:02, 1.24it/s][A
98%|█████████▊| 124/126 [01:58<00:01, 1.11it/s][A
99%|█████████▉| 125/126 [01:59<00:00, 1.22it/s][A
100%|██████████| 126/126 [01:59<00:00, 1.61it/s][A
[A 98%|█████████▊| 600/614 [3:43:54<04:29, 19.25s/it]
100%|██████████| 126/126 [01:59<00:00, 1.61it/s][A
[Awandb: WARNING URL not available in offline run
98%|█████████▊| 601/614 [3:44:21<12:31, 57.78s/it] 98%|█████████▊| 602/614 [3:44:40<09:15, 46.27s/it] 98%|█████████▊| 603/614 [3:45:03<07:12, 39.36s/it] 98%|█████████▊| 604/614 [3:45:29<05:52, 35.21s/it] 99%|█████████▊| 605/614 [3:45:50<04:40, 31.15s/it] 99%|█████████▊| 605/614 [3:45:50<04:40, 31.15s/it] 99%|█████████▊| 606/614 [3:46:14<03:50, 28.79s/it] 99%|█████████▉| 607/614 [3:46:28<02:50, 24.33s/it] 99%|█████████▉| 608/614 [3:46:45<02:13, 22.25s/it] 99%|█████████▉| 609/614 [3:47:09<01:53, 22.61s/it] 99%|█████████▉| 610/614 [3:47:26<01:24, 21.22s/it] 99%|█████████▉| 610/614 [3:47:26<01:24, 21.22s/it]100%|█████████▉| 611/614 [3:47:49<01:04, 21.66s/it]100%|█████████▉| 612/614 [3:48:09<00:42, 21.09s/it]100%|█████████▉| 613/614 [3:48:28<00:20, 20.40s/it]100%|██████████| 614/614 [3:48:49<00:00, 20.78s/it]wandb: WARNING URL not available in offline run
100%|██████████| 614/614 [3:48:56<00:00, 20.78s/it]100%|██████████| 614/614 [3:48:56<00:00, 22.37s/it]
{'eval_loss': 0.2925775945186615, 'eval_runtime': 120.683, 'eval_samples_per_second': 2.088, 'eval_steps_per_second': 1.044, 'epoch': 0.98}
{'loss': 0.478, 'grad_norm': 1.1354663372039795, 'learning_rate': 1.451535115114866e-07, 'epoch': 0.99}
{'loss': 0.3683, 'grad_norm': 0.8019553422927856, 'learning_rate': 3.629496450011649e-08, 'epoch': 0.99}
{'train_runtime': 13736.174, 'train_samples_per_second': 0.715, 'train_steps_per_second': 0.045, 'train_loss': 0.5536840389139878, 'epoch': 1.0}
wandb artifact logging skipped (WANDB_SKIP_ARTIFACT=1)
wandb:
wandb: Run history:
wandb: eval/loss █▄▃▂▂▂▂▁▁▁▁▁
wandb: eval/runtime █▁▁▁▁▁▁▁▁▁▁▁
wandb: eval/samples_per_second ▁███████████
wandb: eval/steps_per_second ▁███████████
wandb: train/epoch ▁▁▁▂▂▂▂▂▂▂▃▃▃▃▃▃▃▄▄▄▄▄▄▄▅▅▅▅▆▆▆▇▇▇▇▇▇███
wandb: train/global_step ▁▁▁▁▁▂▂▂▂▂▃▃▃▃▃▄▄▄▄▄▅▅▅▅▆▆▆▆▆▇▇▇▇▇▇▇▇▇██
wandb: train/grad_norm █▅▂▃▂▁▂▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁
wandb: train/learning_rate ▃▄▅███▇▇▇▇▇▇▆▆▆▆▆▅▅▅▄▄▄▄▃▃▃▃▃▂▂▂▂▂▂▁▁▁▁▁
wandb: train/loss ██▂▂▂▂▂▂▁▁▂▂▂▂▁▁▁▁▁▂▁▁▁▂▁▁▂▁▁▁▂▂▁▁▁▁▁▁▁▁
wandb:
wandb: Run summary:
wandb: eval/loss 0.29258
wandb: eval/runtime 120.683
wandb: eval/samples_per_second 2.088
wandb: eval/steps_per_second 1.044
wandb: total_flos 2.508719122176676e+18
wandb: train/epoch 1
wandb: train/global_step 614
wandb: train/grad_norm 0.80196
wandb: train/learning_rate 0.0
wandb: train/loss 0.3683
wandb: +4 ...
wandb:
wandb: You can sync this run to the cloud by running:
wandb: wandb sync /workspace/anchor/qwen-compassion/wandb/wandb/offline-run-20261011_232644-035fmlpl
wandb: Find logs at: /workspace/anchor/qwen-compassion/wandb/wandb/offline-run-20261011_232644-035fmlpl/logs
done - final adapter at /workspace/anchor/qwen-compassion/train/final
merging and pushing 16-bit model to CompassioninMachineLearning/qwen-compassion-part1-build ...
0%| | 0/1 [00:00<?, ?it/s]
tokenizer.json: 0%| | 0.00/11.4M [00:00<?, ?B/s][A
tokenizer.json: 0%| | 16.4k/11.4M [00:00<01:36, 119kB/s][Atokenizer.json: 100%|██████████| 11.4M/11.4M [00:00<00:00, 18.3MB/s]
100%|██████████| 1/1 [00:00<00:00, 1.41it/s]100%|██████████| 1/1 [00:00<00:00, 1.41it/s]
Found HuggingFace hub cache directory: /workspace/hf_cache/hub
Checking cache directory for required files...
Unsloth: Copying 1 files from cache to `CompassioninMachineLearning/qwen-compassion-part1-build`: 0%| | 0/1 [00:00<?, ?it/s]Unsloth: Copying 1 files from cache to `CompassioninMachineLearning/qwen-compassion-part1-build`: 100%|██████████| 1/1 [00:06<00:00, 6.14s/it]Unsloth: Copying 1 files from cache to `CompassioninMachineLearning/qwen-compassion-part1-build`: 100%|██████████| 1/1 [00:06<00:00, 6.14s/it]
Successfully copied all 1 files from cache to `CompassioninMachineLearning/qwen-compassion-part1-build`
Checking cache directory for required files...
Cache check failed: tokenizer.model not found in local cache.
Not all required files found in cache. Will proceed with downloading.
Unsloth: Preparing safetensor model files: 0%| | 0/1 [00:00<?, ?it/s]Unsloth: Preparing safetensor model files: 100%|██████████| 1/1 [00:00<00:00, 19878.22it/s]
Unsloth: Merging weights into 16bit: 0%| | 0/1 [00:00<?, ?it/s]
0%| | 0/1 [00:00<?, ?it/s][A
100%|██████████| 1/1 [03:10<00:00, 190.34s/it][A100%|██████████| 1/1 [03:10<00:00, 190.34s/it]
Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [03:44<00:00, 224.77s/it]Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [03:44<00:00, 224.78s/it]
Unsloth: Merge process complete. Saved to `/workspace/repo/CompassioninMachineLearning/qwen-compassion-part1-build`
pushed merged 16-bit model to https://huggingface.co/CompassioninMachineLearning/qwen-compassion-part1-build
🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
⚙️ Running in WANDB offline mode
🦥 Unsloth Zoo will now patch everything to make training faster!
==((====))== Unsloth 2026.9.2: Fast Qwen3 patching. Transformers: 4.57.6.
\\ /| NVIDIA H100 NVL. Num GPUs = 1. Max memory: 93.085 GB. Platform: Linux.
O^O/ \_/ \ Torch: 2.11.0+cu128. CUDA: 9.0. CUDA Toolkit: 12.8. Triton: 3.6.0
\ / Bfloat16 = TRUE. FA [Xformers = 0.0.35. FA2 = False]
"-____-" Free license: http://github.com/unslothai/unsloth
Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!
Unsloth: Dropout = 0 is supported for fast patching. You are using dropout = 0.05.
Unsloth will patch all other layers, except LoRA matrices, causing a performance hit.
Unsloth 2026.9.2 patched 36 layers with 0 QKV layers, 0 O layers and 0 MLP layers.
Unsloth: Offloading input_embeddings to disk to save VRAM
Unsloth: Offloading output_embeddings to disk to save VRAM
Unsloth: Training embed_tokens in mixed precision to save VRAM
Unsloth: Training lm_head in mixed precision to save VRAM
Generating train split: 0 examples [00:00, ? examples/s]Generating train split: 922 examples [00:00, 4342.96 examples/s]Generating train split: 1832 examples [00:00, 2501.09 examples/s]Generating train split: 2738 examples [00:00, 3004.52 examples/s]Generating train split: 3657 examples [00:01, 3622.88 examples/s]Generating train split: 4531 examples [00:01, 3650.97 examples/s]Generating train split: 5444 examples [00:01, 2832.86 examples/s]Generating train split: 6344 examples [00:01, 3195.64 examples/s]Generating train split: 7260 examples [00:02, 3421.72 examples/s]Generating train split: 8228 examples [00:02, 2760.04 examples/s]Generating train split: 9118 examples [00:02, 3045.88 examples/s]Generating train split: 10035 examples [00:03, 3303.04 examples/s]Generating train split: 10932 examples [00:03, 3497.24 examples/s]Generating train split: 11851 examples [00:03, 2723.08 examples/s]Generating train split: 12762 examples [00:04, 3040.59 examples/s]Generating train split: 13692 examples [00:04, 3326.80 examples/s]Generating train split: 14586 examples [00:04, 3528.29 examples/s]Generating train split: 15482 examples [00:05, 2774.02 examples/s]Generating train split: 16382 examples [00:05, 3013.23 examples/s]Generating train split: 17267 examples [00:05, 3226.11 examples/s]Generating train split: 18175 examples [00:06, 2588.97 examples/s]Generating train split: 18500 examples [00:06, 3035.96 examples/s]
tokenizing (num_proc=8): 0%| | 0/18500 [00:00<?, ? examples/s]tokenizing (num_proc=8): 0%| | 5/18500 [00:01<1:03:35, 4.85 examples/s]tokenizing (num_proc=8): 0%| | 29/18500 [00:01<09:22, 32.85 examples/s] tokenizing (num_proc=8): 0%| | 79/18500 [00:01<03:02, 100.89 examples/s]tokenizing (num_proc=8): 1%| | 123/18500 [00:01<01:55, 158.70 examples/s]tokenizing (num_proc=8): 1%| | 198/18500 [00:01<01:08, 268.70 examples/s]tokenizing (num_proc=8): 2%|▏ | 279/18500 [00:01<00:47, 382.34 examples/s]tokenizing (num_proc=8): 2%|▏ | 380/18500 [00:01<00:35, 516.13 examples/s]tokenizing (num_proc=8): 3%|▎ | 484/18500 [00:01<00:28, 631.04 examples/s]tokenizing (num_proc=8): 3%|▎ | 578/18500 [00:01<00:25, 696.97 examples/s]tokenizing (num_proc=8): 4%|▎ | 682/18500 [00:01<00:22, 776.08 examples/s]tokenizing (num_proc=8): 4%|▍ | 790/18500 [00:02<00:20, 848.52 examples/s]tokenizing (num_proc=8): 5%|▍ | 885/18500 [00:02<00:20, 839.30 examples/s]tokenizing (num_proc=8): 5%|▌ | 976/18500 [00:02<00:20, 836.34 examples/s]tokenizing (num_proc=8): 6%|▌ | 1069/18500 [00:02<00:21, 826.85 examples/s]tokenizing (num_proc=8): 6%|▌ | 1156/18500 [00:02<00:22, 787.98 examples/s]tokenizing (num_proc=8): 7%|▋ | 1246/18500 [00:02<00:21, 814.25 examples/s]tokenizing (num_proc=8): 7%|▋ | 1341/18500 [00:02<00:20, 834.09 examples/s]tokenizing (num_proc=8): 8%|▊ | 1442/18500 [00:02<00:19, 863.03 examples/s]tokenizing (num_proc=8): 8%|▊ | 1548/18500 [00:02<00:18, 897.45 examples/s]tokenizing (num_proc=8): 9%|▉ | 1654/18500 [00:03<00:18, 932.88 examples/s]tokenizing (num_proc=8): 9%|▉ | 1754/18500 [00:03<00:18, 925.78 examples/s]tokenizing (num_proc=8): 10%|█ | 1852/18500 [00:03<00:17, 929.46 examples/s]tokenizing (num_proc=8): 11%|█ | 1951/18500 [00:03<00:17, 924.47 examples/s]tokenizing (num_proc=8): 11%|█ | 2063/18500 [00:03<00:17, 966.16 examples/s]tokenizing (num_proc=8): 12%|█▏ | 2181/18500 [00:03<00:16, 1007.31 examples/s]tokenizing (num_proc=8): 12%|█▏ | 2287/18500 [00:03<00:16, 992.37 examples/s] tokenizing (num_proc=8): 13%|█▎ | 2402/18500 [00:03<00:15, 1018.72 examples/s]tokenizing (num_proc=8): 14%|█▎ | 2525/18500 [00:03<00:15, 1048.03 examples/s]tokenizing (num_proc=8): 14%|█▍ | 2631/18500 [00:04<00:15, 1040.70 examples/s]tokenizing (num_proc=8): 15%|█▍ | 2736/18500 [00:04<00:15, 1020.62 examples/s]tokenizing (num_proc=8): 15%|█▌ | 2847/18500 [00:04<00:15, 1019.94 examples/s]tokenizing (num_proc=8): 16%|█▌ | 2958/18500 [00:04<00:15, 1023.17 examples/s]tokenizing (num_proc=8): 17%|█▋ | 3071/18500 [00:04<00:15, 1004.38 examples/s]tokenizing (num_proc=8): 17%|█▋ | 3179/18500 [00:04<00:15, 1015.51 examples/s]tokenizing (num_proc=8): 18%|█▊ | 3282/18500 [00:04<00:15, 977.80 examples/s] tokenizing (num_proc=8): 18%|█▊ | 3408/18500 [00:04<00:14, 1050.40 examples/s]tokenizing (num_proc=8): 19%|█▉ | 3524/18500 [00:04<00:14, 1017.94 examples/s]tokenizing (num_proc=8): 20%|█▉ | 3649/18500 [00:05<00:14, 1059.18 examples/s]tokenizing (num_proc=8): 20%|██ | 3757/18500 [00:05<00:13, 1062.41 examples/s]tokenizing (num_proc=8): 21%|██ | 3865/18500 [00:05<00:14, 1030.20 examples/s]tokenizing (num_proc=8): 22%|██▏ | 3978/18500 [00:05<00:13, 1053.30 examples/s]tokenizing (num_proc=8): 22%|██▏ | 4097/18500 [00:05<00:13, 1086.03 examples/s]tokenizing (num_proc=8): 23%|██▎ | 4225/18500 [00:05<00:13, 1096.67 examples/s]tokenizing (num_proc=8): 24%|██▎ | 4354/18500 [00:05<00:12, 1148.58 examples/s]tokenizing (num_proc=8): 24%|██▍ | 4490/18500 [00:05<00:11, 1178.09 examples/s]tokenizing (num_proc=8): 25%|██▍ | 4615/18500 [00:05<00:11, 1180.63 examples/s]tokenizing (num_proc=8): 26%|██▌ | 4740/18500 [00:06<00:11, 1173.56 examples/s]tokenizing (num_proc=8): 26%|██▋ | 4863/18500 [00:06<00:11, 1158.61 examples/s]tokenizing (num_proc=8): 27%|██▋ | 4981/18500 [00:06<00:12, 1073.57 examples/s]tokenizing (num_proc=8): 28%|██▊ | 5091/18500 [00:06<00:12, 1059.39 examples/s]tokenizing (num_proc=8): 28%|██▊ | 5200/18500 [00:06<00:12, 1064.74 examples/s]tokenizing (num_proc=8): 29%|██▉ | 5319/18500 [00:06<00:12, 1053.82 examples/s]tokenizing (num_proc=8): 29%|██▉ | 5442/18500 [00:06<00:12, 1069.45 examples/s]tokenizing (num_proc=8): 30%|███ | 5581/18500 [00:06<00:11, 1112.38 examples/s]tokenizing (num_proc=8): 31%|███ | 5716/18500 [00:06<00:11, 1137.71 examples/s]tokenizing (num_proc=8): 32%|███▏ | 5835/18500 [00:07<00:11, 1122.99 examples/s]tokenizing (num_proc=8): 32%|███▏ | 5960/18500 [00:07<00:11, 1139.36 examples/s]tokenizing (num_proc=8): 33%|███▎ | 6077/18500 [00:07<00:10, 1132.26 examples/s]tokenizing (num_proc=8): 33%|███▎ | 6196/18500 [00:07<00:11, 1104.58 examples/s]tokenizing (num_proc=8): 34%|███▍ | 6321/18500 [00:07<00:10, 1141.29 examples/s]tokenizing (num_proc=8): 35%|███▍ | 6440/18500 [00:07<00:10, 1147.90 examples/s]tokenizing (num_proc=8): 35%|███▌ | 6567/18500 [00:07<00:10, 1172.01 examples/s]tokenizing (num_proc=8): 36%|███▌ | 6686/18500 [00:07<00:10, 1112.30 examples/s]tokenizing (num_proc=8): 37%|███▋ | 6814/18500 [00:07<00:10, 1135.00 examples/s]tokenizing (num_proc=8): 37%|███▋ | 6932/18500 [00:07<00:10, 1143.99 examples/s]tokenizing (num_proc=8): 38%|███▊ | 7047/18500 [00:08<00:10, 1143.55 examples/s]tokenizing (num_proc=8): 39%|███▉ | 7174/18500 [00:08<00:09, 1172.57 examples/s]tokenizing (num_proc=8): 40%|███▉ | 7311/18500 [00:08<00:09, 1204.18 examples/s]tokenizing (num_proc=8): 40%|████ | 7433/18500 [00:08<00:09, 1162.23 examples/s]tokenizing (num_proc=8): 41%|████ | 7559/18500 [00:08<00:10, 1072.71 examples/s]tokenizing (num_proc=8): 41%|████▏ | 7671/18500 [00:08<00:12, 890.94 examples/s] tokenizing (num_proc=8): 42%|████▏ | 7773/18500 [00:08<00:14, 756.27 examples/s]tokenizing (num_proc=8): 42%|████▏ | 7856/18500 [00:09<00:16, 639.50 examples/s]tokenizing (num_proc=8): 43%|████▎ | 7931/18500 [00:09<00:22, 473.05 examples/s]tokenizing (num_proc=8): 43%|████▎ | 7994/18500 [00:09<00:21, 479.02 examples/s]tokenizing (num_proc=8): 44%|████▎ | 8054/18500 [00:09<00:21, 484.57 examples/s]tokenizing (num_proc=8): 44%|████▍ | 8130/18500 [00:09<00:19, 542.02 examples/s]tokenizing (num_proc=8): 44%|████▍ | 8220/18500 [00:09<00:16, 607.38 examples/s]tokenizing (num_proc=8): 45%|████▌ | 8328/18500 [00:09<00:14, 699.36 examples/s]tokenizing (num_proc=8): 46%|████▌ | 8440/18500 [00:10<00:12, 799.40 examples/s]tokenizing (num_proc=8): 46%|████▌ | 8532/18500 [00:10<00:12, 824.80 examples/s]tokenizing (num_proc=8): 47%|████▋ | 8636/18500 [00:10<00:11, 881.93 examples/s]tokenizing (num_proc=8): 47%|████▋ | 8737/18500 [00:10<00:11, 859.76 examples/s]tokenizing (num_proc=8): 48%|████▊ | 8852/18500 [00:10<00:10, 929.36 examples/s]tokenizing (num_proc=8): 48%|████▊ | 8967/18500 [00:10<00:09, 976.55 examples/s]tokenizing (num_proc=8): 49%|████▉ | 9071/18500 [00:10<00:09, 977.85 examples/s]tokenizing (num_proc=8): 50%|████▉ | 9196/18500 [00:10<00:08, 1038.41 examples/s]tokenizing (num_proc=8): 50%|█████ | 9303/18500 [00:10<00:08, 1032.08 examples/s]tokenizing (num_proc=8): 51%|█████ | 9411/18500 [00:11<00:08, 1022.49 examples/s]tokenizing (num_proc=8): 52%|█████▏ | 9537/18500 [00:11<00:08, 1042.10 examples/s]tokenizing (num_proc=8): 52%|█████▏ | 9679/18500 [00:11<00:07, 1117.24 examples/s]tokenizing (num_proc=8): 53%|█████▎ | 9820/18500 [00:11<00:07, 1147.24 examples/s]tokenizing (num_proc=8): 54%|█████▍ | 9958/18500 [00:11<00:07, 1200.80 examples/s]tokenizing (num_proc=8): 54%|█████▍ | 10081/18500 [00:11<00:07, 1185.01 examples/s]tokenizing (num_proc=8): 55%|█████▌ | 10205/18500 [00:11<00:06, 1192.77 examples/s]tokenizing (num_proc=8): 56%|█████▌ | 10335/18500 [00:11<00:06, 1192.48 examples/s]tokenizing (num_proc=8): 57%|█████▋ | 10469/18500 [00:11<00:06, 1188.61 examples/s]tokenizing (num_proc=8): 57%|█████▋ | 10602/18500 [00:12<00:06, 1198.12 examples/s]tokenizing (num_proc=8): 58%|█████▊ | 10723/18500 [00:12<00:06, 1157.15 examples/s]tokenizing (num_proc=8): 59%|█████▉ | 10881/18500 [00:12<00:05, 1273.94 examples/s]tokenizing (num_proc=8): 60%|█████▉ | 11020/18500 [00:12<00:05, 1279.20 examples/s]tokenizing (num_proc=8): 60%|██████ | 11158/18500 [00:12<00:05, 1225.80 examples/s]tokenizing (num_proc=8): 61%|██████ | 11284/18500 [00:12<00:05, 1227.45 examples/s]tokenizing (num_proc=8): 62%|██████▏ | 11414/18500 [00:12<00:05, 1238.75 examples/s]tokenizing (num_proc=8): 62%|██████▏ | 11545/18500 [00:12<00:05, 1238.37 examples/s]tokenizing (num_proc=8): 63%|██████▎ | 11674/18500 [00:12<00:05, 1221.66 examples/s]tokenizing (num_proc=8): 64%|██████▍ | 11829/18500 [00:12<00:05, 1312.07 examples/s]tokenizing (num_proc=8): 65%|██████▍ | 11970/18500 [00:13<00:05, 1295.02 examples/s]tokenizing (num_proc=8): 65%|██████▌ | 12101/18500 [00:13<00:04, 1297.00 examples/s]tokenizing (num_proc=8): 66%|██████▌ | 12233/18500 [00:13<00:05, 1244.80 examples/s]tokenizing (num_proc=8): 67%|██████▋ | 12361/18500 [00:13<00:05, 1218.00 examples/s]tokenizing (num_proc=8): 68%|██████▊ | 12492/18500 [00:13<00:04, 1218.01 examples/s]tokenizing (num_proc=8): 68%|██████▊ | 12617/18500 [00:13<00:04, 1207.81 examples/s]tokenizing (num_proc=8): 69%|██████▉ | 12741/18500 [00:13<00:04, 1215.07 examples/s]tokenizing (num_proc=8): 70%|██████▉ | 12878/18500 [00:13<00:04, 1241.68 examples/s]tokenizing (num_proc=8): 70%|███████ | 13005/18500 [00:13<00:04, 1231.95 examples/s]tokenizing (num_proc=8): 71%|███████ | 13146/18500 [00:14<00:04, 1267.54 examples/s]tokenizing (num_proc=8): 72%|███████▏ | 13274/18500 [00:14<00:04, 1226.06 examples/s]tokenizing (num_proc=8): 72%|███████▏ | 13407/18500 [00:14<00:04, 1254.65 examples/s]tokenizing (num_proc=8): 73%|███████▎ | 13550/18500 [00:14<00:03, 1250.45 examples/s]tokenizing (num_proc=8): 74%|███████▍ | 13690/18500 [00:14<00:03, 1248.22 examples/s]tokenizing (num_proc=8): 75%|███████▍ | 13819/18500 [00:14<00:03, 1217.70 examples/s]tokenizing (num_proc=8): 75%|███████▌ | 13943/18500 [00:14<00:03, 1201.16 examples/s]tokenizing (num_proc=8): 76%|███████▌ | 14077/18500 [00:14<00:03, 1218.20 examples/s]tokenizing (num_proc=8): 77%|███████▋ | 14202/18500 [00:14<00:03, 1206.97 examples/s]tokenizing (num_proc=8): 77%|███████▋ | 14332/18500 [00:15<00:03, 1208.90 examples/s]tokenizing (num_proc=8): 78%|███████▊ | 14470/18500 [00:15<00:03, 1243.67 examples/s]tokenizing (num_proc=8): 79%|███████▉ | 14599/18500 [00:15<00:03, 1228.49 examples/s]tokenizing (num_proc=8): 80%|███████▉ | 14728/18500 [00:15<00:03, 1213.10 examples/s]tokenizing (num_proc=8): 80%|████████ | 14856/18500 [00:15<00:02, 1225.94 examples/s]tokenizing (num_proc=8): 81%|████████ | 14983/18500 [00:15<00:02, 1182.19 examples/s]tokenizing (num_proc=8): 82%|████████▏ | 15102/18500 [00:15<00:02, 1158.71 examples/s]tokenizing (num_proc=8): 82%|████████▏ | 15221/18500 [00:15<00:03, 1020.06 examples/s]tokenizing (num_proc=8): 83%|████████▎ | 15364/18500 [00:15<00:02, 1116.12 examples/s]tokenizing (num_proc=8): 84%|████████▎ | 15480/18500 [00:16<00:02, 1117.33 examples/s]tokenizing (num_proc=8): 84%|████████▍ | 15603/18500 [00:16<00:02, 1114.83 examples/s]tokenizing (num_proc=8): 85%|████████▍ | 15720/18500 [00:16<00:02, 1039.62 examples/s]tokenizing (num_proc=8): 86%|████████▌ | 15827/18500 [00:16<00:02, 980.10 examples/s] tokenizing (num_proc=8): 86%|████████▌ | 15935/18500 [00:16<00:02, 992.36 examples/s]tokenizing (num_proc=8): 87%|████████▋ | 16050/18500 [00:16<00:02, 1013.52 examples/s]tokenizing (num_proc=8): 87%|████████▋ | 16158/18500 [00:16<00:02, 1007.62 examples/s]tokenizing (num_proc=8): 88%|████████▊ | 16269/18500 [00:16<00:02, 1023.51 examples/s]tokenizing (num_proc=8): 88%|████████▊ | 16372/18500 [00:16<00:02, 983.29 examples/s] tokenizing (num_proc=8): 89%|████████▉ | 16478/18500 [00:17<00:02, 960.04 examples/s]tokenizing (num_proc=8): 90%|████████▉ | 16585/18500 [00:17<00:01, 963.49 examples/s]tokenizing (num_proc=8): 90%|█████████ | 16722/18500 [00:17<00:01, 1058.09 examples/s]tokenizing (num_proc=8): 91%|█████████ | 16862/18500 [00:17<00:01, 1109.99 examples/s]tokenizing (num_proc=8): 92%|█████████▏| 16984/18500 [00:17<00:01, 1105.74 examples/s]tokenizing (num_proc=8): 92%|█████████▏| 17106/18500 [00:17<00:01, 1104.30 examples/s]tokenizing (num_proc=8): 93%|█████████▎| 17224/18500 [00:17<00:01, 1102.42 examples/s]tokenizing (num_proc=8): 94%|█████████▎| 17343/18500 [00:17<00:01, 1079.57 examples/s]tokenizing (num_proc=8): 94%|█████████▍| 17463/18500 [00:17<00:00, 1055.68 examples/s]tokenizing (num_proc=8): 95%|█████████▍| 17572/18500 [00:18<00:00, 1031.45 examples/s]tokenizing (num_proc=8): 96%|█████████▌| 17677/18500 [00:18<00:00, 978.00 examples/s] tokenizing (num_proc=8): 96%|█████████▌| 17786/18500 [00:18<00:00, 896.10 examples/s]tokenizing (num_proc=8): 97%|█████████▋| 17879/18500 [00:18<00:00, 832.61 examples/s]tokenizing (num_proc=8): 97%|█████████▋| 17968/18500 [00:18<00:00, 765.28 examples/s]tokenizing (num_proc=8): 98%|█████████▊| 18049/18500 [00:18<00:00, 690.00 examples/s]tokenizing (num_proc=8): 98%|█████████▊| 18121/18500 [00:18<00:00, 656.85 examples/s]tokenizing (num_proc=8): 98%|█████████▊| 18189/18500 [00:19<00:00, 584.39 examples/s]tokenizing (num_proc=8): 99%|█████████▊| 18250/18500 [00:19<00:00, 502.36 examples/s]tokenizing (num_proc=8): 99%|█████████▉| 18315/18500 [00:19<00:00, 354.09 examples/s]tokenizing (num_proc=8): 99%|█████████▉| 18368/18500 [00:19<00:00, 297.74 examples/s]tokenizing (num_proc=8): 99%|█████████▉| 18407/18500 [00:20<00:00, 261.84 examples/s]tokenizing (num_proc=8): 100%|█████████▉| 18445/18500 [00:20<00:00, 239.27 examples/s]tokenizing (num_proc=8): 100%|█████████▉| 18475/18500 [00:20<00:00, 228.20 examples/s]tokenizing (num_proc=8): 100%|██████████| 18500/18500 [00:20<00:00, 185.84 examples/s]tokenizing (num_proc=8): 100%|██████████| 18500/18500 [00:20<00:00, 887.30 examples/s]
Filter: 0%| | 0/18500 [00:00<?, ? examples/s]Filter: 5%|▌ | 1000/18500 [00:00<00:06, 2637.21 examples/s]Filter: 11%|█ | 2000/18500 [00:00<00:05, 2896.99 examples/s]Filter: 16%|█▌ | 3000/18500 [00:01<00:05, 2876.31 examples/s]Filter: 22%|██▏ | 4000/18500 [00:01<00:05, 2888.39 examples/s]Filter: 27%|██▋ | 5000/18500 [00:01<00:04, 2881.72 examples/s]Filter: 32%|███▏ | 6000/18500 [00:02<00:04, 2954.53 examples/s]Filter: 38%|███▊ | 7000/18500 [00:02<00:03, 2971.68 examples/s]Filter: 43%|████▎ | 8000/18500 [00:02<00:03, 3006.64 examples/s]Filter: 49%|████▊ | 9000/18500 [00:03<00:03, 3107.16 examples/s]Filter: 54%|█████▍ | 10000/18500 [00:03<00:02, 2989.60 examples/s]Filter: 59%|█████▉ | 11000/18500 [00:03<00:02, 3184.38 examples/s]Filter: 65%|██████▍ | 12000/18500 [00:03<00:02, 3209.39 examples/s]Filter: 70%|███████ | 13000/18500 [00:04<00:01, 3162.42 examples/s]Filter: 76%|███████▌ | 14000/18500 [00:04<00:01, 3230.63 examples/s]Filter: 81%|████████ | 15000/18500 [00:04<00:01, 3444.72 examples/s]Filter: 86%|████████▋ | 16000/18500 [00:05<00:00, 3571.75 examples/s]Filter: 92%|█████████▏| 17000/18500 [00:05<00:00, 3752.73 examples/s]Filter: 97%|█████████▋| 18000/18500 [00:05<00:00, 3873.70 examples/s]Filter: 100%|██████████| 18500/18500 [00:05<00:00, 3969.92 examples/s]Filter: 100%|██████████| 18500/18500 [00:05<00:00, 3264.65 examples/s]
Filter: 0%| | 0/18500 [00:00<?, ? examples/s]Filter: 5%|▌ | 1000/18500 [00:00<00:04, 4026.78 examples/s]Filter: 11%|█ | 2000/18500 [00:00<00:04, 4097.66 examples/s]Filter: 16%|█▌ | 3000/18500 [00:00<00:03, 4088.88 examples/s]Filter: 22%|██▏ | 4000/18500 [00:00<00:03, 4137.50 examples/s]Filter: 27%|██▋ | 5000/18500 [00:01<00:03, 4018.16 examples/s]Filter: 32%|███▏ | 6000/18500 [00:01<00:03, 4075.61 examples/s]Filter: 38%|███▊ | 7000/18500 [00:01<00:02, 3931.68 examples/s]Filter: 43%|████▎ | 8000/18500 [00:01<00:02, 4005.67 examples/s]Filter: 49%|████▊ | 9000/18500 [00:02<00:02, 4066.63 examples/s]Filter: 54%|█████▍ | 10000/18500 [00:02<00:02, 3954.10 examples/s]Filter: 59%|█████▉ | 11000/18500 [00:02<00:01, 4036.41 examples/s]Filter: 65%|██████▍ | 12000/18500 [00:03<00:01, 3895.12 examples/s]Filter: 70%|███████ | 13000/18500 [00:03<00:01, 3965.89 examples/s]Filter: 76%|███████▌ | 14000/18500 [00:03<00:01, 4013.53 examples/s]Filter: 81%|████████ | 15000/18500 [00:03<00:00, 4006.06 examples/s]Filter: 86%|████████▋ | 16000/18500 [00:03<00:00, 4020.15 examples/s]Filter: 92%|█████████▏| 17000/18500 [00:04<00:00, 4004.43 examples/s]Filter: 97%|█████████▋| 18000/18500 [00:04<00:00, 4010.77 examples/s]Filter: 100%|██████████| 18500/18500 [00:04<00:00, 4097.52 examples/s]Filter: 100%|██████████| 18500/18500 [00:04<00:00, 4023.15 examples/s]
supervised tokens: tool 4394688, replay 10773075 (71.0% replay)
replay capped to 25% of supervised tokens: kept 1464869 replay tokens, 1259 replay rows
rows: 18500 raw -> 10076 kept; by source: {'replay:compassion_12185_cleaned': 1259, 'recovery': 3750, 'apigen': 4567, 'efficiency': 500}
[manifest] git=6950fbbc6f29902d7fc5b26c1aef8d053966e9a3 data_sha256={'train_qwen-compassion_replay50.jsonl': '1f22b1da2039'}
wandb: WARNING git root /workspace/anchor/qwen-compassion/wandb does not exist
wandb: Tracking run with wandb version 0.30.0
wandb: W&B syncing is set to `offline` in this directory. Run `wandb online` or set WANDB_MODE=online to enable cloud syncing.
wandb: Run data is saved locally in /workspace/anchor/qwen-compassion/wandb/wandb/offline-run-20261011_232644-035fmlpl
wandb: View this run in the terminal with `wandb leet`
wandb: Detected [huggingface_hub.inference] in use.
wandb: Use W&B Weave for improved LLM call tracing. Install Weave with `pip install weave` then add `import weave` to the top of your script.
wandb: For more information, check out the docs at: https://weave-docs.wandb.ai
==((====))== Unsloth - 2x faster free finetuning | Num GPUs used = 1
\\ /| Num examples = 9,824 | Num Epochs = 1 | Total steps = 614
O^O/ \_/ \ Batch size per device = 2 | Gradient accumulation steps = 8
\ / Data Parallel GPUs = 1 | Total batch size (2 x 8 x 1) = 16
"-____-" Trainable parameters = 1,419,247,616 of 9,609,982,976 (14.77% trained)
Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for embed_tokens.
Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for lm_head.
0%| | 0/614 [00:00<?, ?it/s] 0%| | 1/614 [00:26<4:32:52, 26.71s/it] 0%| | 2/614 [00:41<3:19:48, 19.59s/it] 0%| | 3/614 [00:54<2:49:54, 16.69s/it] 1%| | 4/614 [01:15<3:06:50, 18.38s/it] 1%| | 5/614 [01:38<3:23:47, 20.08s/it] 1%| | 5/614 [01:38<3:23:47, 20.08s/it] 1%| | 6/614 [01:56<3:16:35, 19.40s/it] 1%| | 7/614 [02:17<3:20:17, 19.80s/it] 1%|▏ | 8/614 [02:44<3:42:32, 22.03s/it] 1%|▏ | 9/614 [03:04<3:36:33, 21.48s/it] 2%|▏ | 10/614 [03:26<3:39:27, 21.80s/it] 2%|▏ | 10/614 [03:26<3:39:27, 21.80s/it] 2%|▏ | 11/614 [03:44<3:26:04, 20.50s/it] 2%|▏ | 12/614 [04:04<3:25:26, 20.48s/it] 2%|▏ | 13/614 [04:26<3:27:37, 20.73s/it] 2%|▏ | 14/614 [04:44<3:20:12, 20.02s/it] 2%|▏ | 15/614 [05:04<3:18:37, 19.90s/it] 2%|▏ | 15/614 [05:04<3:18:37, 19.90s/it] 3%|▎ | 16/614 [05:16<2:54:51, 17.54s/it] 3%|▎ | 17/614 [05:39<3:10:39, 19.16s/it] 3%|▎ | 18/614 [05:57<3:07:43, 18.90s/it] 3%|▎ | 19/614 [06:10<2:49:48, 17.12s/it] 3%|▎ | 20/614 [06:26<2:45:36, 16.73s/it] 3%|▎ | 20/614 [06:26<2:45:36, 16.73s/it] 3%|▎ | 21/614 [06:39<2:35:49, 15.77s/it] 4%|▎ | 22/614 [06:54<2:33:45, 15.58s/it] 4%|▎ | 23/614 [07:17<2:54:14, 17.69s/it] 4%|▍ | 24/614 [07:34<2:51:39, 17.46s/it] 4%|▍ | 25/614 [07:51<2:51:17, 17.45s/it] 4%|▍ | 25/614 [07:51<2:51:17, 17.45s/it] 4%|▍ | 26/614 [08:08<2:47:31, 17.09s/it] 4%|▍ | 27/614 [08:23<2:42:46, 16.64s/it] 5%|▍ | 28/614 [08:39<2:39:22, 16.32s/it] 5%|▍ | 29/614 [09:06<3:11:38, 19.66s/it] 5%|▍ | 30/614 [09:26<3:11:42, 19.70s/it] 5%|▍ | 30/614 [09:26<3:11:42, 19.70s/it] 5%|▌ | 31/614 [09:42<3:00:06, 18.54s/it] 5%|▌ | 32/614 [10:07<3:19:32, 20.57s/it] 5%|▌ | 33/614 [10:28<3:19:43, 20.63s/it] 6%|▌ | 34/614 [10:46<3:11:50, 19.85s/it] 6%|▌ | 35/614 [11:06<3:13:02, 20.00s/it] 6%|▌ | 35/614 [11:06<3:13:02, 20.00s/it] 6%|▌ | 36/614 [11:26<3:12:41, 20.00s/it] 6%|▌ | 37/614 [11:38<2:47:34, 17.42s/it] 6%|▌ | 38/614 [11:50<2:31:45, 15.81s/it] 6%|▋ | 39/614 [12:13<2:51:36, 17.91s/it] 7%|▋ | 40/614 [12:32<2:55:32, 18.35s/it] 7%|▋ | 40/614 [12:32<2:55:32, 18.35s/it] 7%|▋ | 41/614 [12:45<2:40:33, 16.81s/it] 7%|▋ | 42/614 [13:01<2:37:14, 16.49s/it] 7%|▋ | 43/614 [13:26<3:00:39, 18.98s/it] 7%|▋ | 44/614 [13:50<3:15:08, 20.54s/it] 7%|▋ | 45/614 [14:11<3:16:55, 20.77s/it] 7%|▋ | 45/614 [14:11<3:16:55, 20.77s/it] 7%|▋ | 46/614 [14:33<3:19:56, 21.12s/it] 8%|▊ | 47/614 [14:56<3:23:38, 21.55s/it] 8%|▊ | 48/614 [15:19<3:27:17, 21.97s/it] 8%|▊ | 49/614 [15:38<3:19:48, 21.22s/it] 8%|▊ | 50/614 [15:55<3:07:56, 19.99s/it] 8%|▊ | 50/614 [15:55<3:07:56, 19.99s/it]Unsloth: Will smartly offload gradients to save VRAM!
Unsloth: Double buffering enabled (parallel H2D + compute) for backward pass.
{'loss': 3.3662, 'grad_norm': 22.442302703857422, 'learning_rate': 2.5806451612903226e-05, 'epoch': 0.01}
{'loss': 3.436, 'grad_norm': 14.803105354309082, 'learning_rate': 5.8064516129032266e-05, 'epoch': 0.02}
{'loss': 2.2124, 'grad_norm': 9.32910442352295, 'learning_rate': 9.032258064516129e-05, 'epoch': 0.02}
{'loss': 1.4505, 'grad_norm': 2.5130510330200195, 'learning_rate': 0.00012258064516129034, 'epoch': 0.03}
{'loss': 1.1231, 'grad_norm': 18.144712448120117, 'learning_rate': 0.00015483870967741937, 'epoch': 0.04}
{'loss': 0.872, 'grad_norm': 3.0365991592407227, 'learning_rate': 0.0001870967741935484, 'epoch': 0.05}
{'loss': 0.8906, 'grad_norm': 2.5769875049591064, 'learning_rate': 0.00019998693330688282, 'epoch': 0.06}
{'loss': 0.7195, 'grad_norm': 3.9422550201416016, 'learning_rate': 0.00019990709365929677, 'epoch': 0.07}
{'loss': 0.6868, 'grad_norm': 2.395726442337036, 'learning_rate': 0.00019975473152335726, 'epoch': 0.07}
{'loss': 0.6497, 'grad_norm': 1.726025104522705, 'learning_rate': 0.0001995299574986306, 'epoch': 0.08}
Filter: 0%| | 0/252 [00:00<?, ? examples/s][A
Filter: 100%|██████████| 252/252 [00:00<00:00, 805.74 examples/s][AFilter: 100%|██████████| 252/252 [00:00<00:00, 796.85 examples/s]
0%| | 0/126 [00:00<?, ?it/s][A
2%|▏ | 2/126 [00:00<00:49, 2.52it/s][A
2%|▏ | 3/126 [00:02<01:47, 1.14it/s][A
3%|▎ | 4/126 [00:03<02:08, 1.05s/it][A
4%|▍ | 5/126 [00:05<02:28, 1.23s/it][A
5%|▍ | 6/126 [00:06<02:22, 1.19s/it][A
6%|▌ | 7/126 [00:07<02:36, 1.32s/it][A
6%|▋ | 8/126 [00:09<02:48, 1.43s/it][A
7%|▋ | 9/126 [00:12<03:22, 1.73s/it][A
8%|▊ | 10/126 [00:13<03:23, 1.76s/it][A
9%|▊ | 11/126 [00:15<03:33, 1.86s/it][A
10%|▉ | 12/126 [00:17<03:21, 1.76s/it][A
10%|█ | 13/126 [00:18<02:55, 1.55s/it][A
11%|█ | 14/126 [00:19<02:51, 1.53s/it][A
12%|█▏ | 15/126 [00:21<02:54, 1.57s/it][A
13%|█▎ | 16/126 [00:23<02:53, 1.57s/it][A
13%|█▎ | 17/126 [00:24<02:48, 1.54s/it][A
14%|█▍ | 18/126 [00:25<02:29, 1.38s/it][A
15%|█▌ | 19/126 [00:27<02:49, 1.59s/it][A
16%|█▌ | 20/126 [00:30<03:28, 1.97s/it][A
17%|█▋ | 21/126 [00:32<03:33, 2.04s/it][A
17%|█▋ | 22/126 [00:34<03:33, 2.05s/it][A
18%|█▊ | 23/126 [00:36<03:30, 2.04s/it][A
19%|█▉ | 24/126 [00:38<03:20, 1.97s/it][A
20%|█▉ | 25/126 [00:40<02:57, 1.76s/it][A
21%|██ | 26/126 [00:41<02:50, 1.71s/it][A
21%|██▏ | 27/126 [00:42<02:35, 1.57s/it][A
22%|██▏ | 28/126 [00:44<02:28, 1.51s/it][A
23%|██▎ | 29/126 [00:46<02:37, 1.63s/it][A
24%|██▍ | 30/126 [00:47<02:41, 1.68s/it][A
25%|██▍ | 31/126 [00:49<02:40, 1.69s/it][A
25%|██▌ | 32/126 [00:51<02:35, 1.66s/it][A
26%|██▌ | 33/126 [00:53<02:43, 1.76s/it][A
27%|██▋ | 34/126 [00:54<02:32, 1.65s/it][A
28%|██▊ | 35/126 [00:56<02:43, 1.79s/it][A
29%|██▊ | 36/126 [00:57<02:22, 1.59s/it][A
29%|██▉ | 37/126 [00:58<02:08, 1.45s/it][A
30%|███ | 38/126 [00:59<01:55, 1.31s/it][A
31%|███ | 39/126 [01:01<02:00, 1.38s/it][A
32%|███▏ | 40/126 [01:02<01:51, 1.30s/it][A
33%|███▎ | 41/126 [01:04<01:53, 1.34s/it][A
33%|███▎ | 42/126 [01:05<01:51, 1.32s/it][A
34%|███▍ | 43/126 [01:07<02:03, 1.48s/it][A
35%|███▍ | 44/126 [01:09<02:21, 1.73s/it][A
36%|███▌ | 45/126 [01:12<02:42, 2.01s/it][A