sparrow8i8's picture
anchor build logs
0ae0283 verified
Raw History Blame Contribute Delete
156 kB
πŸ¦₯ Unsloth: Will patch your computer to enable 2x faster free finetuning. βš™οΈ Running in WANDB offline mode πŸ¦₯ Unsloth Zoo will now patch everything to make training faster! ==((====))== Unsloth 2026.9.2: Fast Qwen3 patching. Transformers: 4.57.6. \\ /| NVIDIA H100 80GB HBM3. Num GPUs = 1. Max memory: 79.179 GB. Platform: Linux. O^O/ \_/ \ Torch: 2.11.0+cu128. CUDA: 9.0. CUDA Toolkit: 12.8. Triton: 3.6.0 \ / Bfloat16 = TRUE. FA [Xformers = 0.0.35. FA2 = False] "-____-" Free license: http://github.com/unslothai/unsloth Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored! Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]Loading checkpoint shards: 25%|β–ˆβ–ˆβ–Œ | 1/4 [00:00<00:02, 1.40it/s]Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2/4 [00:01<00:01, 1.40it/s]Loading checkpoint shards: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3/4 [00:02<00:00, 1.40it/s]Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:02<00:00, 1.91it/s]Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:02<00:00, 1.69it/s] ROPE_GUARD OK train_unsloth load Qwen/Qwen3-8B-Base: qwen3 theta=1000000.0 scaling=None Unsloth: Dropout = 0 is supported for fast patching. You are using dropout = 0.05. Unsloth will patch all other layers, except LoRA matrices, causing a performance hit. Unsloth 2026.9.2 patched 36 layers with 0 QKV layers, 0 O layers and 0 MLP layers. Unsloth: Offloading input_embeddings to disk to save VRAM Unsloth: Offloading output_embeddings to disk to save VRAM Unsloth: Training embed_tokens in mixed precision to save VRAM Unsloth: Training lm_head in mixed precision to save VRAM Generating train split: 0 examples [00:00, ? examples/s]Generating train split: 666 examples [00:00, 1620.56 examples/s]Generating train split: 1308 examples [00:00, 2230.45 examples/s]Generating train split: 1991 examples [00:00, 2665.83 examples/s]Generating train split: 2648 examples [00:01, 1993.20 examples/s]Generating train split: 3299 examples [00:01, 2286.13 examples/s]Generating train split: 3983 examples [00:01, 1909.50 examples/s]Generating train split: 4619 examples [00:02, 2094.72 examples/s]Generating train split: 5267 examples [00:02, 2271.67 examples/s]Generating train split: 5946 examples [00:02, 1951.84 examples/s]Generating train split: 6655 examples [00:03, 2204.16 examples/s]Generating train split: 7317 examples [00:03, 1887.84 examples/s]Generating train split: 7996 examples [00:03, 2148.77 examples/s]Generating train split: 8636 examples [00:04, 2297.88 examples/s]Generating train split: 9250 examples [00:04, 1970.14 examples/s]Generating train split: 9250 examples [00:04, 2074.13 examples/s] tokenizing (num_proc=8): 0%| | 0/9250 [00:00<?, ? examples/s]tokenizing (num_proc=8): 0%| | 2/9250 [00:00<1:00:00, 2.57 examples/s]tokenizing (num_proc=8): 0%| | 14/9250 [00:00<07:33, 20.36 examples/s] tokenizing (num_proc=8): 1%| | 47/9250 [00:00<02:03, 74.68 examples/s]tokenizing (num_proc=8): 1%| | 81/9250 [00:01<01:11, 127.45 examples/s]tokenizing (num_proc=8): 2%|▏ | 145/9250 [00:01<00:38, 237.38 examples/s]tokenizing (num_proc=8): 2%|▏ | 224/9250 [00:01<00:24, 367.43 examples/s]tokenizing (num_proc=8): 3%|β–Ž | 305/9250 [00:01<00:18, 478.46 examples/s]tokenizing (num_proc=8): 4%|▍ | 404/9250 [00:01<00:14, 598.19 examples/s]tokenizing (num_proc=8): 5%|β–Œ | 501/9250 [00:01<00:12, 691.82 examples/s]tokenizing (num_proc=8): 6%|β–‹ | 585/9250 [00:01<00:11, 724.47 examples/s]tokenizing (num_proc=8): 7%|β–‹ | 675/9250 [00:01<00:11, 758.59 examples/s]tokenizing (num_proc=8): 8%|β–Š | 771/9250 [00:01<00:10, 791.01 examples/s]tokenizing (num_proc=8): 9%|β–‰ | 867/9250 [00:02<00:10, 818.26 examples/s]tokenizing (num_proc=8): 10%|β–ˆ | 955/9250 [00:02<00:10, 826.22 examples/s]tokenizing (num_proc=8): 11%|β–ˆβ– | 1044/9250 [00:02<00:09, 840.86 examples/s]tokenizing (num_proc=8): 12%|β–ˆβ– | 1132/9250 [00:02<00:09, 839.07 examples/s]tokenizing (num_proc=8): 13%|β–ˆβ–Ž | 1220/9250 [00:02<00:09, 849.15 examples/s]tokenizing (num_proc=8): 14%|β–ˆβ– | 1313/9250 [00:02<00:09, 838.11 examples/s]tokenizing (num_proc=8): 15%|β–ˆβ–Œ | 1401/9250 [00:02<00:09, 842.37 examples/s]tokenizing (num_proc=8): 16%|β–ˆβ–Œ | 1503/9250 [00:02<00:08, 868.47 examples/s]tokenizing (num_proc=8): 17%|β–ˆβ–‹ | 1593/9250 [00:02<00:09, 847.95 examples/s]tokenizing (num_proc=8): 18%|β–ˆβ–Š | 1678/9250 [00:03<00:09, 840.54 examples/s]tokenizing (num_proc=8): 19%|β–ˆβ–‰ | 1768/9250 [00:03<00:08, 853.49 examples/s]tokenizing (num_proc=8): 20%|β–ˆβ–ˆ | 1854/9250 [00:03<00:09, 821.05 examples/s]tokenizing (num_proc=8): 21%|β–ˆβ–ˆ | 1941/9250 [00:03<00:09, 805.95 examples/s]tokenizing (num_proc=8): 22%|β–ˆβ–ˆβ– | 2033/9250 [00:03<00:08, 821.58 examples/s]tokenizing (num_proc=8): 23%|β–ˆβ–ˆβ–Ž | 2133/9250 [00:03<00:08, 838.09 examples/s]tokenizing (num_proc=8): 24%|β–ˆβ–ˆβ– | 2229/9250 [00:03<00:08, 868.75 examples/s]tokenizing (num_proc=8): 25%|β–ˆβ–ˆβ–Œ | 2321/9250 [00:03<00:07, 879.81 examples/s]tokenizing (num_proc=8): 26%|β–ˆβ–ˆβ–Œ | 2414/9250 [00:03<00:07, 869.52 examples/s]tokenizing (num_proc=8): 27%|β–ˆβ–ˆβ–‹ | 2502/9250 [00:03<00:08, 823.33 examples/s]tokenizing (num_proc=8): 28%|β–ˆβ–ˆβ–Š | 2586/9250 [00:04<00:08, 821.52 examples/s]tokenizing (num_proc=8): 29%|β–ˆβ–ˆβ–‰ | 2683/9250 [00:04<00:07, 851.62 examples/s]tokenizing (num_proc=8): 30%|β–ˆβ–ˆβ–ˆ | 2786/9250 [00:04<00:07, 892.89 examples/s]tokenizing (num_proc=8): 31%|β–ˆβ–ˆβ–ˆ | 2879/9250 [00:04<00:07, 876.70 examples/s]tokenizing (num_proc=8): 32%|β–ˆβ–ˆβ–ˆβ– | 2975/9250 [00:04<00:06, 896.76 examples/s]tokenizing (num_proc=8): 33%|β–ˆβ–ˆβ–ˆβ–Ž | 3065/9250 [00:04<00:06, 894.99 examples/s]tokenizing (num_proc=8): 34%|β–ˆβ–ˆβ–ˆβ– | 3155/9250 [00:04<00:07, 870.53 examples/s]tokenizing (num_proc=8): 35%|β–ˆβ–ˆβ–ˆβ–Œ | 3249/9250 [00:04<00:06, 867.04 examples/s]tokenizing (num_proc=8): 36%|β–ˆβ–ˆβ–ˆβ–Œ | 3336/9250 [00:04<00:07, 843.31 examples/s]tokenizing (num_proc=8): 37%|β–ˆβ–ˆβ–ˆβ–‹ | 3425/9250 [00:05<00:07, 824.68 examples/s]tokenizing (num_proc=8): 38%|β–ˆβ–ˆβ–ˆβ–Š | 3521/9250 [00:05<00:06, 837.65 examples/s]tokenizing (num_proc=8): 39%|β–ˆβ–ˆβ–ˆβ–‰ | 3607/9250 [00:05<00:06, 819.23 examples/s]tokenizing (num_proc=8): 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 3700/9250 [00:05<00:06, 837.13 examples/s]tokenizing (num_proc=8): 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 3794/9250 [00:05<00:06, 817.60 examples/s]tokenizing (num_proc=8): 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 3880/9250 [00:05<00:06, 818.23 examples/s]tokenizing (num_proc=8): 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3963/9250 [00:05<00:06, 813.71 examples/s]tokenizing (num_proc=8): 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 4060/9250 [00:05<00:06, 851.74 examples/s]tokenizing (num_proc=8): 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 4148/9250 [00:05<00:06, 814.64 examples/s]tokenizing (num_proc=8): 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 4238/9250 [00:06<00:06, 813.32 examples/s]tokenizing (num_proc=8): 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 4329/9250 [00:06<00:05, 830.90 examples/s]tokenizing (num_proc=8): 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 4415/9250 [00:06<00:06, 802.09 examples/s]tokenizing (num_proc=8): 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 4500/9250 [00:06<00:06, 788.04 examples/s]tokenizing (num_proc=8): 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 4594/9250 [00:06<00:05, 806.05 examples/s]tokenizing (num_proc=8): 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4691/9250 [00:06<00:05, 833.61 examples/s]tokenizing (num_proc=8): 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 4781/9250 [00:06<00:05, 830.44 examples/s]tokenizing (num_proc=8): 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4866/9250 [00:06<00:05, 826.24 examples/s]tokenizing (num_proc=8): 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4955/9250 [00:06<00:05, 844.10 examples/s]tokenizing (num_proc=8): 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5042/9250 [00:07<00:05, 820.50 examples/s]tokenizing (num_proc=8): 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 5131/9250 [00:07<00:04, 825.18 examples/s]tokenizing (num_proc=8): 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 5217/9250 [00:07<00:04, 817.93 examples/s]tokenizing (num_proc=8): 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 5309/9250 [00:07<00:04, 834.79 examples/s]tokenizing (num_proc=8): 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 5413/9250 [00:07<00:04, 879.01 examples/s]tokenizing (num_proc=8): 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 5509/9250 [00:07<00:04, 858.38 examples/s]tokenizing (num_proc=8): 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 5596/9250 [00:07<00:04, 810.55 examples/s]tokenizing (num_proc=8): 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5685/9250 [00:07<00:04, 828.27 examples/s]tokenizing (num_proc=8): 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5771/9250 [00:07<00:04, 818.51 examples/s]tokenizing (num_proc=8): 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 5856/9250 [00:08<00:04, 791.09 examples/s]tokenizing (num_proc=8): 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5937/9250 [00:08<00:04, 774.49 examples/s]tokenizing (num_proc=8): 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 6017/9250 [00:08<00:04, 764.30 examples/s]tokenizing (num_proc=8): 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 6100/9250 [00:08<00:04, 768.86 examples/s]tokenizing (num_proc=8): 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 6192/9250 [00:08<00:03, 778.14 examples/s]tokenizing (num_proc=8): 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 6290/9250 [00:08<00:03, 800.16 examples/s]tokenizing (num_proc=8): 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 6380/9250 [00:08<00:03, 801.59 examples/s]tokenizing (num_proc=8): 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 6461/9250 [00:08<00:03, 794.38 examples/s]tokenizing (num_proc=8): 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 6544/9250 [00:08<00:03, 778.65 examples/s]tokenizing (num_proc=8): 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6632/9250 [00:09<00:03, 762.36 examples/s]tokenizing (num_proc=8): 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 6716/9250 [00:09<00:03, 750.92 examples/s]tokenizing (num_proc=8): 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 6809/9250 [00:09<00:03, 751.22 examples/s]tokenizing (num_proc=8): 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6906/9250 [00:09<00:02, 793.97 examples/s]tokenizing (num_proc=8): 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 6987/9250 [00:09<00:03, 750.32 examples/s]tokenizing (num_proc=8): 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 7077/9250 [00:09<00:02, 780.19 examples/s]tokenizing (num_proc=8): 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 7161/9250 [00:09<00:02, 763.86 examples/s]tokenizing (num_proc=8): 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 7253/9250 [00:09<00:02, 805.81 examples/s]tokenizing (num_proc=8): 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 7342/9250 [00:09<00:02, 800.78 examples/s]tokenizing (num_proc=8): 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 7424/9250 [00:10<00:02, 800.85 examples/s]tokenizing (num_proc=8): 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 7507/9250 [00:10<00:02, 776.14 examples/s]tokenizing (num_proc=8): 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 7590/9250 [00:10<00:02, 760.10 examples/s]tokenizing (num_proc=8): 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 7667/9250 [00:10<00:02, 746.75 examples/s]tokenizing (num_proc=8): 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 7744/9250 [00:10<00:02, 733.94 examples/s]tokenizing (num_proc=8): 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 7820/9250 [00:10<00:02, 685.70 examples/s]tokenizing (num_proc=8): 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7890/9250 [00:10<00:02, 538.87 examples/s]tokenizing (num_proc=8): 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7950/9250 [00:11<00:03, 410.55 examples/s]tokenizing (num_proc=8): 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8008/9250 [00:11<00:06, 183.06 examples/s]tokenizing (num_proc=8): 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8046/9250 [00:12<00:07, 171.52 examples/s]tokenizing (num_proc=8): 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8082/9250 [00:12<00:06, 189.67 examples/s]tokenizing (num_proc=8): 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 8141/9250 [00:12<00:04, 238.99 examples/s]tokenizing (num_proc=8): 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 8203/9250 [00:12<00:03, 297.05 examples/s]tokenizing (num_proc=8): 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 8280/9250 [00:12<00:02, 383.53 examples/s]tokenizing (num_proc=8): 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 8354/9250 [00:12<00:01, 452.93 examples/s]tokenizing (num_proc=8): 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 8421/9250 [00:12<00:01, 497.89 examples/s]tokenizing (num_proc=8): 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 8486/9250 [00:12<00:01, 534.55 examples/s]tokenizing (num_proc=8): 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 8574/9250 [00:13<00:01, 602.64 examples/s]tokenizing (num_proc=8): 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 8659/9250 [00:13<00:00, 646.36 examples/s]tokenizing (num_proc=8): 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 8735/9250 [00:13<00:00, 665.80 examples/s]tokenizing (num_proc=8): 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 8806/9250 [00:13<00:00, 677.03 examples/s]tokenizing (num_proc=8): 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 8884/9250 [00:13<00:00, 695.09 examples/s]tokenizing (num_proc=8): 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 8966/9250 [00:13<00:00, 726.18 examples/s]tokenizing (num_proc=8): 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 9045/9250 [00:13<00:00, 715.03 examples/s]tokenizing (num_proc=8): 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 9124/9250 [00:13<00:00, 661.51 examples/s]tokenizing (num_proc=8): 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 9192/9250 [00:14<00:00, 470.72 examples/s]tokenizing (num_proc=8): 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 9249/9250 [00:14<00:00, 357.47 examples/s]tokenizing (num_proc=8): 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 9250/9250 [00:14<00:00, 630.07 examples/s] Filter: 0%| | 0/9250 [00:00<?, ? examples/s]Filter: 11%|β–ˆ | 1000/9250 [00:00<00:03, 2421.88 examples/s]Filter: 22%|β–ˆβ–ˆβ– | 2000/9250 [00:00<00:02, 2642.70 examples/s]Filter: 32%|β–ˆβ–ˆβ–ˆβ– | 3000/9250 [00:01<00:02, 2721.99 examples/s]Filter: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4000/9250 [00:01<00:01, 2774.41 examples/s]Filter: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5000/9250 [00:01<00:01, 2802.65 examples/s]Filter: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6000/9250 [00:02<00:01, 2797.81 examples/s]Filter: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7000/9250 [00:02<00:00, 2822.46 examples/s]Filter: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8000/9250 [00:02<00:00, 2859.07 examples/s]Filter: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 9000/9250 [00:03<00:00, 2857.75 examples/s]Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 9250/9250 [00:03<00:00, 2819.98 examples/s] Filter: 0%| | 0/9250 [00:00<?, ? examples/s]Filter: 11%|β–ˆ | 1000/9250 [00:00<00:03, 2502.63 examples/s]Filter: 22%|β–ˆβ–ˆβ– | 2000/9250 [00:00<00:02, 2654.22 examples/s]Filter: 32%|β–ˆβ–ˆβ–ˆβ– | 3000/9250 [00:01<00:02, 2700.23 examples/s]Filter: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4000/9250 [00:01<00:01, 2730.39 examples/s]Filter: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5000/9250 [00:01<00:01, 2743.66 examples/s]Filter: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6000/9250 [00:02<00:01, 2698.58 examples/s]Filter: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7000/9250 [00:02<00:00, 2723.82 examples/s]Filter: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8000/9250 [00:02<00:00, 2645.02 examples/s]Filter: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 9000/9250 [00:03<00:00, 2681.30 examples/s]Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 9250/9250 [00:03<00:00, 2706.45 examples/s] supervised tokens: tool 4394688, replay 0 (0.0% replay) rows: 9250 raw -> 8817 kept; by source: {'apigen': 4567, 'efficiency': 500, 'recovery': 3750} [manifest] git=534143b028a9765e904b4d6d1b22205027804f19 data_sha256={'train_qwen-pretrained_replay50.jsonl': '64d5d5af76e7'} wandb: WARNING git root /workspace/anchor/qwen-pretrained/wandb does not exist wandb: Tracking run with wandb version 0.30.0 wandb: W&B syncing is set to `offline` in this directory. Run `wandb online` or set WANDB_MODE=online to enable cloud syncing. wandb: Run data is saved locally in /workspace/anchor/qwen-pretrained/wandb/wandb/offline-run-20261016_032553-9kfmp8pv wandb: View this run in the terminal with `wandb leet` wandb: Detected [huggingface_hub.inference] in use. wandb: Use W&B Weave for improved LLM call tracing. Install Weave with `pip install weave` then add `import weave` to the top of your script. wandb: For more information, check out the docs at: https://weave-docs.wandb.ai ==((====))== Unsloth - 2x faster free finetuning | Num GPUs used = 1 \\ /| Num examples = 8,596 | Num Epochs = 1 | Total steps = 538 O^O/ \_/ \ Batch size per device = 2 | Gradient accumulation steps = 8 \ / Data Parallel GPUs = 1 | Total batch size (2 x 8 x 1) = 16 "-____-" Trainable parameters = 1,419,247,616 of 9,609,982,976 (14.77% trained) Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for embed_tokens. Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for lm_head. 0%| | 0/538 [00:00<?, ?it/s] 0%| | 1/538 [00:22<3:17:13, 22.04s/it] 0%| | 2/538 [00:31<2:08:32, 14.39s/it] 1%| | 3/538 [00:44<2:05:28, 14.07s/it] 1%| | 4/538 [01:02<2:17:21, 15.43s/it] 1%| | 5/538 [01:16<2:11:48, 14.84s/it] 1%| | 5/538 [01:16<2:11:48, 14.84s/it] 1%| | 6/538 [01:29<2:05:49, 14.19s/it] 1%|▏ | 7/538 [01:39<1:53:42, 12.85s/it] 1%|▏ | 8/538 [01:55<2:03:22, 13.97s/it] 2%|▏ | 9/538 [02:11<2:07:49, 14.50s/it] 2%|▏ | 10/538 [02:25<2:07:51, 14.53s/it] 2%|▏ | 10/538 [02:25<2:07:51, 14.53s/it] 2%|▏ | 11/538 [02:41<2:09:39, 14.76s/it] 2%|▏ | 12/538 [02:55<2:09:20, 14.75s/it] 2%|▏ | 13/538 [03:09<2:06:29, 14.46s/it] 3%|β–Ž | 14/538 [03:22<2:01:38, 13.93s/it] 3%|β–Ž | 15/538 [03:37<2:05:37, 14.41s/it] 3%|β–Ž | 15/538 [03:37<2:05:37, 14.41s/it] 3%|β–Ž | 16/538 [03:54<2:12:45, 15.26s/it] 3%|β–Ž | 17/538 [04:12<2:17:17, 15.81s/it] 3%|β–Ž | 18/538 [04:26<2:12:34, 15.30s/it] 4%|β–Ž | 19/538 [04:42<2:13:58, 15.49s/it] 4%|β–Ž | 20/538 [04:56<2:11:50, 15.27s/it] 4%|β–Ž | 20/538 [04:56<2:11:50, 15.27s/it] 4%|▍ | 21/538 [05:09<2:04:30, 14.45s/it] 4%|▍ | 22/538 [05:23<2:02:45, 14.27s/it] 4%|▍ | 23/538 [05:37<2:03:26, 14.38s/it] 4%|▍ | 24/538 [05:47<1:51:30, 13.02s/it] 5%|▍ | 25/538 [05:57<1:42:45, 12.02s/it] 5%|▍ | 25/538 [05:57<1:42:45, 12.02s/it] 5%|▍ | 26/538 [06:12<1:49:31, 12.83s/it] 5%|β–Œ | 27/538 [06:28<1:57:50, 13.84s/it] 5%|β–Œ | 28/538 [06:40<1:54:02, 13.42s/it] 5%|β–Œ | 29/538 [06:55<1:57:31, 13.85s/it] 6%|β–Œ | 30/538 [07:10<1:59:36, 14.13s/it] 6%|β–Œ | 30/538 [07:10<1:59:36, 14.13s/it] 6%|β–Œ | 31/538 [07:23<1:56:38, 13.80s/it] 6%|β–Œ | 32/538 [07:36<1:55:25, 13.69s/it] 6%|β–Œ | 33/538 [07:48<1:50:38, 13.14s/it] 6%|β–‹ | 34/538 [07:59<1:43:23, 12.31s/it] 7%|β–‹ | 35/538 [08:10<1:40:53, 12.04s/it] 7%|β–‹ | 35/538 [08:10<1:40:53, 12.04s/it] 7%|β–‹ | 36/538 [08:24<1:45:20, 12.59s/it] 7%|β–‹ | 37/538 [08:41<1:55:49, 13.87s/it] 7%|β–‹ | 38/538 [08:55<1:55:22, 13.84s/it] 7%|β–‹ | 39/538 [09:12<2:03:39, 14.87s/it] 7%|β–‹ | 40/538 [09:28<2:06:17, 15.22s/it] 7%|β–‹ | 40/538 [09:28<2:06:17, 15.22s/it] 8%|β–Š | 41/538 [09:43<2:06:27, 15.27s/it] 8%|β–Š | 42/538 [10:01<2:11:48, 15.95s/it] 8%|β–Š | 43/538 [10:16<2:09:55, 15.75s/it] 8%|β–Š | 44/538 [10:33<2:12:58, 16.15s/it] 8%|β–Š | 45/538 [10:49<2:10:54, 15.93s/it] 8%|β–Š | 45/538 [10:49<2:10:54, 15.93s/it] 9%|β–Š | 46/538 [11:04<2:10:40, 15.94s/it] 9%|β–Š | 47/538 [11:17<2:02:06, 14.92s/it] 9%|β–‰ | 48/538 [11:27<1:48:43, 13.31s/it] 9%|β–‰ | 49/538 [11:42<1:54:14, 14.02s/it] 9%|β–‰ | 50/538 [11:57<1:54:46, 14.11s/it] 9%|β–‰ | 50/538 [11:57<1:54:46, 14.11s/it]Unsloth: Will smartly offload gradients to save VRAM! Unsloth: Double buffering enabled (parallel H2D + compute) for backward pass. {'loss': 1.0965, 'grad_norm': 8.3795747756958, 'learning_rate': 2.962962962962963e-05, 'epoch': 0.01} {'loss': 0.8571, 'grad_norm': 3.7024037837982178, 'learning_rate': 6.666666666666667e-05, 'epoch': 0.02} {'loss': 0.629, 'grad_norm': 2.2940096855163574, 'learning_rate': 0.0001037037037037037, 'epoch': 0.03} {'loss': 0.527, 'grad_norm': 2.2930526733398438, 'learning_rate': 0.00014074074074074076, 'epoch': 0.04} {'loss': 0.5039, 'grad_norm': 4.794444561004639, 'learning_rate': 0.00017777777777777779, 'epoch': 0.05} {'loss': 0.4196, 'grad_norm': 3.5820388793945312, 'learning_rate': 0.0001999924406845452, 'epoch': 0.06} {'loss': 0.3942, 'grad_norm': 3.9649713039398193, 'learning_rate': 0.00019990741151022301, 'epoch': 0.07} {'loss': 0.3424, 'grad_norm': 2.7851450443267822, 'learning_rate': 0.00019972798462510112, 'epoch': 0.07} {'loss': 0.2828, 'grad_norm': 2.488961935043335, 'learning_rate': 0.0001994543295610186, 'epoch': 0.08} {'loss': 0.2322, 'grad_norm': 6.255297660827637, 'learning_rate': 0.00019908670488149148, 'epoch': 0.09} Filter: 0%| | 0/221 [00:00<?, ? examples/s] Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 221/221 [00:00<00:00, 771.83 examples/s]Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 221/221 [00:00<00:00, 765.61 examples/s] 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:42, 2.55it/s] 3%|β–Ž | 3/111 [00:01<01:03, 1.69it/s] 4%|β–Ž | 4/111 [00:02<01:10, 1.53it/s] 5%|▍ | 5/111 [00:03<01:32, 1.15it/s] 5%|β–Œ | 6/111 [00:04<01:40, 1.05it/s] 6%|β–‹ | 7/111 [00:06<01:57, 1.13s/it] 7%|β–‹ | 8/111 [00:07<02:03, 1.20s/it] 8%|β–Š | 9/111 [00:09<02:12, 1.30s/it] 9%|β–‰ | 10/111 [00:10<02:07, 1.26s/it] 10%|β–‰ | 11/111 [00:12<02:18, 1.39s/it] 11%|β–ˆ | 12/111 [00:13<02:25, 1.47s/it] 12%|β–ˆβ– | 13/111 [00:15<02:25, 1.48s/it] 13%|β–ˆβ–Ž | 14/111 [00:16<02:13, 1.38s/it] 14%|β–ˆβ–Ž | 15/111 [00:17<01:59, 1.25s/it] 14%|β–ˆβ– | 16/111 [00:18<01:44, 1.10s/it] 15%|β–ˆβ–Œ | 17/111 [00:19<01:54, 1.22s/it] 16%|β–ˆβ–Œ | 18/111 [00:21<02:07, 1.37s/it] 17%|β–ˆβ–‹ | 19/111 [00:23<02:22, 1.55s/it] 18%|β–ˆβ–Š | 20/111 [00:25<02:28, 1.63s/it] 19%|β–ˆβ–‰ | 21/111 [00:26<02:27, 1.63s/it] 20%|β–ˆβ–‰ | 22/111 [00:27<02:01, 1.37s/it] 21%|β–ˆβ–ˆ | 23/111 [00:28<02:04, 1.41s/it] 22%|β–ˆβ–ˆβ– | 24/111 [00:30<01:54, 1.32s/it] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:31<01:56, 1.35s/it] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:32<01:43, 1.21s/it] 24%|β–ˆβ–ˆβ– | 27/111 [00:34<01:54, 1.36s/it] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:35<01:56, 1.41s/it] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:37<02:06, 1.54s/it] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:38<01:56, 1.44s/it] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:39<01:48, 1.35s/it] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:41<01:46, 1.35s/it] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:42<01:47, 1.38s/it] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:43<01:45, 1.36s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:45<01:52, 1.48s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:47<02:05, 1.67s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:49<02:14, 1.82s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:51<01:58, 1.63s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:52<01:45, 1.46s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:53<01:49, 1.54s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:55<01:48, 1.55s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:56<01:41, 1.47s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:58<01:46, 1.57s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:59<01:38, 1.48s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [01:01<01:45, 1.61s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [01:03<01:43, 1.59s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [01:05<01:48, 1.70s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [01:06<01:41, 1.61s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [01:08<01:38, 1.58s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [01:09<01:29, 1.47s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [01:11<01:31, 1.53s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [01:12<01:23, 1.42s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [01:14<01:29, 1.54s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [01:15<01:31, 1.60s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [01:17<01:25, 1.53s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [01:18<01:17, 1.42s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [01:19<01:18, 1.46s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [01:21<01:22, 1.56s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [01:23<01:29, 1.73s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [01:24<01:16, 1.51s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [01:25<01:09, 1.40s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [01:27<01:09, 1.41s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [01:28<01:06, 1.38s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [01:30<01:06, 1.41s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [01:31<01:06, 1.46s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [01:32<01:00, 1.35s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [01:34<00:57, 1.31s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [01:35<01:00, 1.42s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [01:37<01:06, 1.57s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [01:39<01:02, 1.52s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [01:41<01:06, 1.67s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [01:42<01:01, 1.58s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [01:43<00:53, 1.42s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [01:44<00:45, 1.22s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [01:45<00:48, 1.34s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [01:46<00:44, 1.28s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [01:48<00:48, 1.41s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [01:50<00:47, 1.45s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [01:51<00:48, 1.53s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [01:53<00:49, 1.58s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [01:55<00:50, 1.67s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [01:56<00:46, 1.59s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [01:59<00:50, 1.80s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [02:00<00:45, 1.67s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [02:02<00:42, 1.65s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [02:03<00:41, 1.67s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [02:05<00:37, 1.58s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [02:06<00:31, 1.36s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [02:07<00:29, 1.33s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [02:07<00:21, 1.01s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [02:08<00:20, 1.05s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [02:10<00:21, 1.14s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [02:11<00:23, 1.33s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [02:13<00:24, 1.47s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [02:15<00:25, 1.60s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [02:15<00:18, 1.21s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [02:16<00:14, 1.06s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [02:17<00:14, 1.12s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [02:19<00:16, 1.38s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [02:21<00:14, 1.33s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [02:22<00:12, 1.28s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [02:23<00:11, 1.24s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [02:24<00:10, 1.29s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [02:25<00:08, 1.26s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [02:27<00:08, 1.47s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [02:28<00:06, 1.32s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [02:29<00:04, 1.18s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [02:31<00:03, 1.20s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [02:33<00:02, 1.47s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [02:34<00:01, 1.49s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [02:35<00:00, 1.18s/it]  9%|β–‰ | 50/538 [14:34<1:54:46, 14.11s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [02:35<00:00, 1.18s/it]  9%|β–‰ | 51/538 [14:46<8:12:43, 60.71s/it] 10%|β–‰ | 52/538 [15:00<6:17:34, 46.61s/it] 10%|β–‰ | 53/538 [15:10<4:49:02, 35.76s/it] 10%|β–ˆ | 54/538 [15:22<3:51:31, 28.70s/it] 10%|β–ˆ | 55/538 [15:33<3:07:39, 23.31s/it] 10%|β–ˆ | 55/538 [15:33<3:07:39, 23.31s/it] 10%|β–ˆ | 56/538 [15:45<2:40:29, 19.98s/it] 11%|β–ˆ | 57/538 [15:59<2:24:01, 17.97s/it] 11%|β–ˆ | 58/538 [16:12<2:12:51, 16.61s/it] 11%|β–ˆ | 59/538 [16:23<1:58:03, 14.79s/it] 11%|β–ˆ | 60/538 [16:40<2:05:14, 15.72s/it] 11%|β–ˆ | 60/538 [16:41<2:05:14, 15.72s/it] 11%|β–ˆβ– | 61/538 [16:54<1:59:30, 15.03s/it] 12%|β–ˆβ– | 62/538 [17:05<1:49:17, 13.78s/it] 12%|β–ˆβ– | 63/538 [17:18<1:47:06, 13.53s/it] 12%|β–ˆβ– | 64/538 [17:35<1:55:11, 14.58s/it] 12%|β–ˆβ– | 65/538 [17:49<1:53:08, 14.35s/it] 12%|β–ˆβ– | 65/538 [17:49<1:53:08, 14.35s/it] 12%|β–ˆβ– | 66/538 [17:59<1:43:36, 13.17s/it] 12%|β–ˆβ– | 67/538 [18:17<1:53:52, 14.51s/it] 13%|β–ˆβ–Ž | 68/538 [18:31<1:53:07, 14.44s/it] 13%|β–ˆβ–Ž | 69/538 [18:49<2:00:22, 15.40s/it] 13%|β–ˆβ–Ž | 70/538 [19:06<2:04:23, 15.95s/it] 13%|β–ˆβ–Ž | 70/538 [19:06<2:04:23, 15.95s/it] 13%|β–ˆβ–Ž | 71/538 [19:20<1:59:49, 15.39s/it] 13%|β–ˆβ–Ž | 72/538 [19:38<2:06:04, 16.23s/it] 14%|β–ˆβ–Ž | 73/538 [19:50<1:54:49, 14.82s/it] 14%|β–ˆβ– | 74/538 [20:08<2:02:18, 15.82s/it] 14%|β–ˆβ– | 75/538 [20:23<2:00:55, 15.67s/it] 14%|β–ˆβ– | 75/538 [20:23<2:00:55, 15.67s/it] 14%|β–ˆβ– | 76/538 [20:41<2:06:16, 16.40s/it] 14%|β–ˆβ– | 77/538 [20:56<2:02:19, 15.92s/it] 14%|β–ˆβ– | 78/538 [21:10<1:58:05, 15.40s/it] 15%|β–ˆβ– | 79/538 [21:24<1:54:47, 15.01s/it] 15%|β–ˆβ– | 80/538 [21:38<1:50:36, 14.49s/it] 15%|β–ˆβ– | 80/538 [21:38<1:50:36, 14.49s/it] 15%|β–ˆβ–Œ | 81/538 [21:54<1:54:05, 14.98s/it] 15%|β–ˆβ–Œ | 82/538 [22:06<1:48:10, 14.23s/it] 15%|β–ˆβ–Œ | 83/538 [22:18<1:42:00, 13.45s/it] 16%|β–ˆβ–Œ | 84/538 [22:32<1:43:07, 13.63s/it] 16%|β–ˆβ–Œ | 85/538 [22:45<1:41:00, 13.38s/it] 16%|β–ˆβ–Œ | 85/538 [22:45<1:41:00, 13.38s/it] 16%|β–ˆβ–Œ | 86/538 [22:55<1:34:32, 12.55s/it] 16%|β–ˆβ–Œ | 87/538 [23:08<1:34:06, 12.52s/it] 16%|β–ˆβ–‹ | 88/538 [23:23<1:40:30, 13.40s/it] 17%|β–ˆβ–‹ | 89/538 [23:37<1:41:35, 13.57s/it] 17%|β–ˆβ–‹ | 90/538 [23:54<1:48:32, 14.54s/it] 17%|β–ˆβ–‹ | 90/538 [23:54<1:48:32, 14.54s/it] 17%|β–ˆβ–‹ | 91/538 [24:08<1:48:29, 14.56s/it] 17%|β–ˆβ–‹ | 92/538 [24:19<1:39:16, 13.36s/it] 17%|β–ˆβ–‹ | 93/538 [24:31<1:35:24, 12.87s/it] 17%|β–ˆβ–‹ | 94/538 [24:42<1:30:45, 12.27s/it] 18%|β–ˆβ–Š | 95/538 [24:54<1:30:10, 12.21s/it] 18%|β–ˆβ–Š | 95/538 [24:54<1:30:10, 12.21s/it] 18%|β–ˆβ–Š | 96/538 [25:10<1:39:35, 13.52s/it] 18%|β–ˆβ–Š | 97/538 [25:28<1:48:06, 14.71s/it] 18%|β–ˆβ–Š | 98/538 [25:40<1:42:48, 14.02s/it] 18%|β–ˆβ–Š | 99/538 [25:52<1:37:20, 13.30s/it] 19%|β–ˆβ–Š | 100/538 [26:08<1:43:10, 14.13s/it] 19%|β–ˆβ–Š | 100/538 [26:08<1:43:10, 14.13s/it]{'eval_loss': 0.22483031451702118, 'eval_runtime': 157.1846, 'eval_samples_per_second': 1.406, 'eval_steps_per_second': 0.706, 'epoch': 0.09} {'loss': 0.2246, 'grad_norm': 1.058211326599121, 'learning_rate': 0.00019862545793740852, 'epoch': 0.1} {'loss': 0.2238, 'grad_norm': 1.2681463956832886, 'learning_rate': 0.00019807102453883602, 'epoch': 0.11} {'loss': 0.2353, 'grad_norm': 1.2710065841674805, 'learning_rate': 0.00019742392854324185, 'epoch': 0.12} {'loss': 0.21, 'grad_norm': 1.0538429021835327, 'learning_rate': 0.00019668478136052774, 'epoch': 0.13} {'loss': 0.2222, 'grad_norm': 1.3220242261886597, 'learning_rate': 0.00019585428137533744, 'epoch': 0.14} {'loss': 0.1745, 'grad_norm': 1.1070969104766846, 'learning_rate': 0.00019493321328718652, 'epoch': 0.15} {'loss': 0.1952, 'grad_norm': 1.2554668188095093, 'learning_rate': 0.00019392244736903772, 'epoch': 0.16} {'loss': 0.1863, 'grad_norm': 1.53813898563385, 'learning_rate': 0.00019282293864502178, 'epoch': 0.17} {'loss': 0.1683, 'grad_norm': 1.1727522611618042, 'learning_rate': 0.0001916357259880809, 'epoch': 0.18} {'loss': 0.1681, 'grad_norm': 0.9360535144805908, 'learning_rate': 0.0001903619311383879, 'epoch': 0.19} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.61it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.75it/s] 4%|β–Ž | 4/111 [00:00<00:19, 5.58it/s] 5%|▍ | 5/111 [00:01<00:35, 2.98it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.53it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.84it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.64it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.45it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.71it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.23it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.02it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.41it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:47, 1.87it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.78it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.85it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.61it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.95it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:56, 1.49it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:49, 1.68it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.41it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:47, 1.69it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:39, 2.04it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:38, 2.08it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.70it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.60it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.44it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.32it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:01, 1.21it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.65it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.49it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:54, 1.22it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.17it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.20it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:53, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.29it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.30it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:44, 1.30it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:38, 1.44it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.55it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.54it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.26it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.58it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.95it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.91it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.75it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:26, 1.74it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.66it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.04it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:22, 1.92it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.68it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:36, 1.08it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:31, 1.24it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.44it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.91it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:20, 1.72it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:19, 1.77it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:21, 1.55it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.42it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.35it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.21it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.23it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:25, 1.12it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.20it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:22, 1.18it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:57<00:20, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.23it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:57<00:14, 1.57it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:14, 1.57it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:10, 1.91it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.29it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.26it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.74it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.49it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.29it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.58it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.53it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.51it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.28it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.54it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.90it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.88it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.65it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.36it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.62it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.98it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.83it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.48it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.63it/s]  19%|β–ˆβ–Š | 100/538 [27:21<1:43:10, 14.13s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.63it/s] wandb: WARNING URL not available in offline run 19%|β–ˆβ–‰ | 101/538 [27:42<4:38:36, 38.25s/it] 19%|β–ˆβ–‰ | 102/538 [27:57<3:45:53, 31.09s/it] 19%|β–ˆβ–‰ | 103/538 [28:05<2:55:14, 24.17s/it] 19%|β–ˆβ–‰ | 104/538 [28:14<2:23:10, 19.79s/it] 20%|β–ˆβ–‰ | 105/538 [28:25<2:03:13, 17.08s/it] 20%|β–ˆβ–‰ | 105/538 [28:25<2:03:13, 17.08s/it] 20%|β–ˆβ–‰ | 106/538 [28:41<1:59:51, 16.65s/it] 20%|β–ˆβ–‰ | 107/538 [28:58<2:01:06, 16.86s/it] 20%|β–ˆβ–ˆ | 108/538 [29:13<1:56:57, 16.32s/it] 20%|β–ˆβ–ˆ | 109/538 [29:26<1:48:29, 15.17s/it] 20%|β–ˆβ–ˆ | 110/538 [29:42<1:50:13, 15.45s/it] 20%|β–ˆβ–ˆ | 110/538 [29:42<1:50:13, 15.45s/it] 21%|β–ˆβ–ˆ | 111/538 [29:55<1:44:08, 14.63s/it] 21%|β–ˆβ–ˆ | 112/538 [30:09<1:42:41, 14.46s/it] 21%|β–ˆβ–ˆ | 113/538 [30:22<1:40:40, 14.21s/it] 21%|β–ˆβ–ˆ | 114/538 [30:39<1:46:38, 15.09s/it] 21%|β–ˆβ–ˆβ– | 115/538 [30:54<1:44:25, 14.81s/it] 21%|β–ˆβ–ˆβ– | 115/538 [30:54<1:44:25, 14.81s/it] 22%|β–ˆβ–ˆβ– | 116/538 [31:08<1:43:40, 14.74s/it] 22%|β–ˆβ–ˆβ– | 117/538 [31:22<1:41:05, 14.41s/it] 22%|β–ˆβ–ˆβ– | 118/538 [31:35<1:37:28, 13.93s/it] 22%|β–ˆβ–ˆβ– | 119/538 [31:48<1:36:47, 13.86s/it] 22%|β–ˆβ–ˆβ– | 120/538 [32:05<1:41:57, 14.64s/it] 22%|β–ˆβ–ˆβ– | 120/538 [32:05<1:41:57, 14.64s/it] 22%|β–ˆβ–ˆβ– | 121/538 [32:17<1:36:56, 13.95s/it] 23%|β–ˆβ–ˆβ–Ž | 122/538 [32:36<1:46:36, 15.38s/it] 23%|β–ˆβ–ˆβ–Ž | 123/538 [32:48<1:40:48, 14.57s/it] 23%|β–ˆβ–ˆβ–Ž | 124/538 [33:02<1:38:42, 14.31s/it] 23%|β–ˆβ–ˆβ–Ž | 125/538 [33:17<1:39:33, 14.46s/it] 23%|β–ˆβ–ˆβ–Ž | 125/538 [33:17<1:39:33, 14.46s/it] 23%|β–ˆβ–ˆβ–Ž | 126/538 [33:26<1:28:47, 12.93s/it] 24%|β–ˆβ–ˆβ–Ž | 127/538 [33:43<1:35:19, 13.92s/it] 24%|β–ˆβ–ˆβ– | 128/538 [33:57<1:36:31, 14.12s/it] 24%|β–ˆβ–ˆβ– | 129/538 [34:10<1:34:43, 13.90s/it] 24%|β–ˆβ–ˆβ– | 130/538 [34:24<1:32:44, 13.64s/it] 24%|β–ˆβ–ˆβ– | 130/538 [34:24<1:32:44, 13.64s/it] 24%|β–ˆβ–ˆβ– | 131/538 [34:39<1:35:59, 14.15s/it] 25%|β–ˆβ–ˆβ– | 132/538 [34:54<1:37:06, 14.35s/it] 25%|β–ˆβ–ˆβ– | 133/538 [35:07<1:35:28, 14.14s/it] 25%|β–ˆβ–ˆβ– | 134/538 [35:22<1:36:16, 14.30s/it] 25%|β–ˆβ–ˆβ–Œ | 135/538 [35:35<1:33:27, 13.91s/it] 25%|β–ˆβ–ˆβ–Œ | 135/538 [35:35<1:33:27, 13.91s/it] 25%|β–ˆβ–ˆβ–Œ | 136/538 [35:53<1:40:57, 15.07s/it] 25%|β–ˆβ–ˆβ–Œ | 137/538 [36:08<1:40:13, 15.00s/it] 26%|β–ˆβ–ˆβ–Œ | 138/538 [36:20<1:34:13, 14.13s/it] 26%|β–ˆβ–ˆβ–Œ | 139/538 [36:32<1:29:59, 13.53s/it] 26%|β–ˆβ–ˆβ–Œ | 140/538 [36:48<1:34:39, 14.27s/it] 26%|β–ˆβ–ˆβ–Œ | 140/538 [36:48<1:34:39, 14.27s/it] 26%|β–ˆβ–ˆβ–Œ | 141/538 [37:04<1:39:02, 14.97s/it] 26%|β–ˆβ–ˆβ–‹ | 142/538 [37:15<1:29:49, 13.61s/it] 27%|β–ˆβ–ˆβ–‹ | 143/538 [37:29<1:29:39, 13.62s/it] 27%|β–ˆβ–ˆβ–‹ | 144/538 [37:45<1:35:42, 14.57s/it] 27%|β–ˆβ–ˆβ–‹ | 145/538 [37:59<1:32:42, 14.15s/it] 27%|β–ˆβ–ˆβ–‹ | 145/538 [37:59<1:32:42, 14.15s/it] 27%|β–ˆβ–ˆβ–‹ | 146/538 [38:11<1:28:51, 13.60s/it] 27%|β–ˆβ–ˆβ–‹ | 147/538 [38:24<1:27:10, 13.38s/it] 28%|β–ˆβ–ˆβ–Š | 148/538 [38:37<1:26:23, 13.29s/it] 28%|β–ˆβ–ˆβ–Š | 149/538 [38:51<1:28:42, 13.68s/it] 28%|β–ˆβ–ˆβ–Š | 150/538 [39:02<1:23:00, 12.84s/it] 28%|β–ˆβ–ˆβ–Š | 150/538 [39:02<1:23:00, 12.84s/it]{'eval_loss': 0.14435869455337524, 'eval_runtime': 72.7707, 'eval_samples_per_second': 3.037, 'eval_steps_per_second': 1.525, 'epoch': 0.19} {'loss': 0.1456, 'grad_norm': 1.1460329294204712, 'learning_rate': 0.00018900275764346768, 'epoch': 0.2} {'loss': 0.1788, 'grad_norm': 1.0264545679092407, 'learning_rate': 0.00018755948972102294, 'epoch': 0.2} {'loss': 0.1864, 'grad_norm': 0.9038275480270386, 'learning_rate': 0.00018603349104553884, 'epoch': 0.21} {'loss': 0.1442, 'grad_norm': 0.8495742082595825, 'learning_rate': 0.00018442620345981232, 'epoch': 0.22} {'loss': 0.1555, 'grad_norm': 0.7527527213096619, 'learning_rate': 0.00018273914561262424, 'epoch': 0.23} {'loss': 0.1383, 'grad_norm': 0.6647666692733765, 'learning_rate': 0.00018097391152384115, 'epoch': 0.24} {'loss': 0.1671, 'grad_norm': 0.8701847195625305, 'learning_rate': 0.0001791321690783025, 'epoch': 0.25} {'loss': 0.1458, 'grad_norm': 0.6835318803787231, 'learning_rate': 0.00017721565844991643, 'epoch': 0.26} {'loss': 0.163, 'grad_norm': 0.8638496994972229, 'learning_rate': 0.00017522619045745315, 'epoch': 0.27} {'loss': 0.1518, 'grad_norm': 1.0149871110916138, 'learning_rate': 0.00017316564485358923, 'epoch': 0.28} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:18, 5.77it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.76it/s] 4%|β–Ž | 4/111 [00:00<00:19, 5.58it/s] 5%|▍ | 5/111 [00:01<00:35, 2.98it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.53it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.84it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.65it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.44it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:07, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.70it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.22it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.03it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.40it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:47, 1.86it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.78it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.84it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.62it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.94it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:50, 1.65it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:50, 1.64it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.40it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.68it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:39, 2.05it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:37, 2.08it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.71it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.60it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:55, 1.38it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:55, 1.35it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:00, 1.23it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.52it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.67it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.51it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.34it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:54, 1.21it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.29it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.17it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.19it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:53, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.29it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.29it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:45, 1.29it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:39, 1.42it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:36, 1.52it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.53it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.94it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.90it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.74it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:27, 1.74it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.66it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.04it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:23, 1.91it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.68it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.42it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:19, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:22, 1.54it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.44it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.24it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.12it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.21it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:22, 1.17it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:56<00:21, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.23it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:57<00:14, 1.57it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:14, 1.56it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:11, 1.91it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.29it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.25it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.74it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.49it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.28it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.57it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.53it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.52it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.27it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.54it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.90it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.88it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.64it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.35it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.62it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.94it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.81it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.45it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.59it/s]  28%|β–ˆβ–ˆβ–Š | 150/538 [40:15<1:23:00, 12.84s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.59it/s]  28%|β–ˆβ–ˆβ–Š | 151/538 [40:30<3:46:54, 35.18s/it] 28%|β–ˆβ–ˆβ–Š | 152/538 [40:48<3:13:50, 30.13s/it] 28%|β–ˆβ–ˆβ–Š | 153/538 [41:03<2:43:34, 25.49s/it] 29%|β–ˆβ–ˆβ–Š | 154/538 [41:18<2:24:35, 22.59s/it] 29%|β–ˆβ–ˆβ–‰ | 155/538 [41:33<2:08:41, 20.16s/it] 29%|β–ˆβ–ˆβ–‰ | 155/538 [41:33<2:08:41, 20.16s/it] 29%|β–ˆβ–ˆβ–‰ | 156/538 [41:45<1:53:09, 17.77s/it] 29%|β–ˆβ–ˆβ–‰ | 157/538 [41:58<1:42:49, 16.19s/it] 29%|β–ˆβ–ˆβ–‰ | 158/538 [42:13<1:40:27, 15.86s/it] 30%|β–ˆβ–ˆβ–‰ | 159/538 [42:25<1:33:33, 14.81s/it] 30%|β–ˆβ–ˆβ–‰ | 160/538 [42:39<1:31:13, 14.48s/it] 30%|β–ˆβ–ˆβ–‰ | 160/538 [42:39<1:31:13, 14.48s/it] 30%|β–ˆβ–ˆβ–‰ | 161/538 [42:53<1:30:36, 14.42s/it] 30%|β–ˆβ–ˆβ–ˆ | 162/538 [43:09<1:32:21, 14.74s/it] 30%|β–ˆβ–ˆβ–ˆ | 163/538 [43:20<1:26:48, 13.89s/it] 30%|β–ˆβ–ˆβ–ˆ | 164/538 [43:35<1:28:26, 14.19s/it] 31%|β–ˆβ–ˆβ–ˆ | 165/538 [43:50<1:29:56, 14.47s/it] 31%|β–ˆβ–ˆβ–ˆ | 165/538 [43:50<1:29:56, 14.47s/it] 31%|β–ˆβ–ˆβ–ˆ | 166/538 [44:08<1:35:41, 15.43s/it] 31%|β–ˆβ–ˆβ–ˆ | 167/538 [44:23<1:33:37, 15.14s/it] 31%|β–ˆβ–ˆβ–ˆ | 168/538 [44:35<1:27:54, 14.25s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 169/538 [44:51<1:32:04, 14.97s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 170/538 [45:04<1:27:04, 14.20s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 170/538 [45:04<1:27:04, 14.20s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 171/538 [45:19<1:28:27, 14.46s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 172/538 [45:31<1:23:30, 13.69s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 173/538 [45:42<1:19:09, 13.01s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 174/538 [46:00<1:27:03, 14.35s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 175/538 [46:12<1:23:47, 13.85s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 175/538 [46:12<1:23:47, 13.85s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 176/538 [46:27<1:24:57, 14.08s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 177/538 [46:41<1:24:26, 14.04s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 178/538 [46:54<1:23:12, 13.87s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 179/538 [47:09<1:24:16, 14.09s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 180/538 [47:21<1:19:41, 13.36s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 180/538 [47:21<1:19:41, 13.36s/it] 34%|β–ˆβ–ˆβ–ˆβ–Ž | 181/538 [47:33<1:17:56, 13.10s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 182/538 [47:48<1:21:21, 13.71s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 183/538 [48:05<1:26:29, 14.62s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 184/538 [48:19<1:25:47, 14.54s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 185/538 [48:32<1:22:46, 14.07s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 185/538 [48:32<1:22:46, 14.07s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 186/538 [48:46<1:22:35, 14.08s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 187/538 [49:00<1:21:40, 13.96s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 188/538 [49:14<1:21:37, 13.99s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 189/538 [49:33<1:29:01, 15.31s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 190/538 [49:43<1:20:47, 13.93s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 190/538 [49:43<1:20:47, 13.93s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 191/538 [49:56<1:18:21, 13.55s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 192/538 [50:14<1:25:58, 14.91s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 193/538 [50:27<1:22:35, 14.36s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 194/538 [50:37<1:15:16, 13.13s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 195/538 [50:52<1:17:44, 13.60s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 195/538 [50:52<1:17:44, 13.60s/it] 36%|β–ˆβ–ˆβ–ˆβ–‹ | 196/538 [51:02<1:11:04, 12.47s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 197/538 [51:16<1:13:48, 12.99s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 198/538 [51:27<1:09:34, 12.28s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 199/538 [51:38<1:08:24, 12.11s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 200/538 [51:50<1:06:52, 11.87s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 200/538 [51:50<1:06:52, 11.87s/it]{'eval_loss': 0.12961792945861816, 'eval_runtime': 72.8727, 'eval_samples_per_second': 3.033, 'eval_steps_per_second': 1.523, 'epoch': 0.28} {'loss': 0.161, 'grad_norm': 0.8869348168373108, 'learning_rate': 0.00017103596854881972, 'epoch': 0.29} {'loss': 0.1496, 'grad_norm': 0.6964899897575378, 'learning_rate': 0.00016883917377191602, 'epoch': 0.3} {'loss': 0.178, 'grad_norm': 0.7895644307136536, 'learning_rate': 0.00016657733616866756, 'epoch': 0.31} {'loss': 0.1572, 'grad_norm': 0.8652212023735046, 'learning_rate': 0.00016425259284070398, 'epoch': 0.32} {'loss': 0.1329, 'grad_norm': 0.8598363995552063, 'learning_rate': 0.00016186714032625035, 'epoch': 0.33} {'loss': 0.1509, 'grad_norm': 0.9525418877601624, 'learning_rate': 0.000159423232524724, 'epoch': 0.34} {'loss': 0.1619, 'grad_norm': 0.8453659415245056, 'learning_rate': 0.0001569231785671332, 'epoch': 0.34} {'loss': 0.1637, 'grad_norm': 0.9399647116661072, 'learning_rate': 0.00015436934063429013, 'epoch': 0.35} {'loss': 0.1622, 'grad_norm': 0.8372876048088074, 'learning_rate': 0.00015176413172490004, 'epoch': 0.36} {'loss': 0.1504, 'grad_norm': 0.711920976638794, 'learning_rate': 0.00014911001337563452, 'epoch': 0.37} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.69it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.79it/s] 4%|β–Ž | 4/111 [00:00<00:18, 5.70it/s] 5%|▍ | 5/111 [00:01<00:35, 3.01it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.54it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.85it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.65it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.44it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.70it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.24it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.02it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.68it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:14, 1.23it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:17, 1.17it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:07, 1.33it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:50, 1.77it/s] 21%|β–ˆβ–ˆ | 23/111 [00:13<00:51, 1.72it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:48, 1.80it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:54, 1.59it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:44, 1.92it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:51, 1.65it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:16<00:50, 1.64it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:17<00:58, 1.40it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.68it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:39, 2.04it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:18<00:38, 2.05it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:46, 1.68it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.59it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:53, 1.42it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.32it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:01, 1.21it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:23<00:43, 1.65it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.49it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:27<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:28<00:53, 1.22it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.18it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.20it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:52, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:32<00:47, 1.30it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.30it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.43it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:44, 1.30it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:38, 1.44it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.55it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.54it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:39<00:32, 1.56it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.93it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.89it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.74it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:41<00:27, 1.73it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.66it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.04it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:22, 1.92it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:26, 1.64it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.38it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:45<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:47<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.42it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:19, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:22, 1.54it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:51<00:22, 1.44it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.24it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:25, 1.11it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.20it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:22, 1.17it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:57<00:21, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.23it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:58<00:14, 1.57it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:14, 1.57it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:59<00:10, 1.91it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.29it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.25it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.74it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.48it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.28it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.58it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.53it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.52it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.28it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.54it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.90it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.89it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.65it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.36it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.61it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.97it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:10<00:01, 1.82it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:11<00:01, 1.47it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.63it/s]  37%|β–ˆβ–ˆβ–ˆβ–‹ | 200/538 [53:03<1:06:52, 11.87s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.63it/s] wandb: WARNING URL not available in offline run 37%|β–ˆβ–ˆβ–ˆβ–‹ | 201/538 [53:25<3:27:22, 36.92s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 202/538 [53:36<2:42:35, 29.03s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 203/538 [53:49<2:16:07, 24.38s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 204/538 [54:04<1:59:49, 21.52s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 205/538 [54:19<1:48:05, 19.48s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 205/538 [54:19<1:48:05, 19.48s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 206/538 [54:32<1:36:42, 17.48s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 207/538 [54:44<1:28:19, 16.01s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 208/538 [54:56<1:20:50, 14.70s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 209/538 [55:11<1:21:27, 14.85s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 210/538 [55:26<1:21:36, 14.93s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 210/538 [55:26<1:21:36, 14.93s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 211/538 [55:36<1:13:20, 13.46s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 212/538 [55:52<1:16:42, 14.12s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 213/538 [56:06<1:15:48, 14.00s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 214/538 [56:17<1:11:10, 13.18s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 215/538 [56:30<1:10:48, 13.15s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 215/538 [56:30<1:10:48, 13.15s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 216/538 [56:42<1:08:48, 12.82s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 217/538 [56:53<1:05:07, 12.17s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 218/538 [57:06<1:06:47, 12.52s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 219/538 [57:20<1:09:41, 13.11s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 220/538 [57:34<1:10:32, 13.31s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 220/538 [57:34<1:10:32, 13.31s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 221/538 [57:51<1:16:36, 14.50s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 222/538 [58:09<1:21:53, 15.55s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 223/538 [58:25<1:22:15, 15.67s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 224/538 [58:40<1:20:57, 15.47s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 225/538 [58:51<1:13:00, 13.99s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 225/538 [58:51<1:13:00, 13.99s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 226/538 [59:10<1:20:24, 15.46s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 227/538 [59:28<1:23:43, 16.15s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 228/538 [59:43<1:21:27, 15.77s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 229/538 [59:53<1:13:10, 14.21s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 230/538 [1:00:06<1:11:28, 13.92s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 230/538 [1:00:06<1:11:28, 13.92s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 231/538 [1:00:19<1:09:58, 13.68s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 232/538 [1:00:36<1:14:38, 14.64s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 233/538 [1:00:51<1:14:27, 14.65s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 234/538 [1:01:04<1:11:54, 14.19s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 235/538 [1:01:15<1:06:44, 13.22s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 235/538 [1:01:15<1:06:44, 13.22s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 236/538 [1:01:29<1:07:52, 13.49s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 237/538 [1:01:45<1:10:51, 14.12s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 238/538 [1:01:57<1:07:59, 13.60s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 239/538 [1:02:08<1:03:43, 12.79s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 240/538 [1:02:23<1:06:55, 13.47s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 240/538 [1:02:23<1:06:55, 13.47s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 241/538 [1:02:33<1:01:18, 12.38s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 242/538 [1:02:48<1:04:51, 13.15s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 243/538 [1:03:01<1:04:24, 13.10s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 244/538 [1:03:15<1:06:10, 13.50s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 245/538 [1:03:29<1:06:27, 13.61s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 245/538 [1:03:29<1:06:27, 13.61s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 246/538 [1:03:45<1:09:45, 14.33s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 247/538 [1:04:02<1:13:03, 15.06s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 248/538 [1:04:17<1:12:51, 15.07s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 249/538 [1:04:29<1:08:43, 14.27s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 250/538 [1:04:46<1:11:29, 14.89s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 250/538 [1:04:46<1:11:29, 14.89s/it]{'eval_loss': 0.12358199059963226, 'eval_runtime': 73.0008, 'eval_samples_per_second': 3.027, 'eval_steps_per_second': 1.521, 'epoch': 0.37} {'loss': 0.1526, 'grad_norm': 0.8126468658447266, 'learning_rate': 0.00014640949333534403, 'epoch': 0.38} {'loss': 0.1358, 'grad_norm': 0.635465681552887, 'learning_rate': 0.0001436651231956064, 'epoch': 0.39} {'loss': 0.15, 'grad_norm': 0.5986313819885254, 'learning_rate': 0.00014087949597985065, 'epoch': 0.4} {'loss': 0.1442, 'grad_norm': 0.7797956466674805, 'learning_rate': 0.00013805524369333373, 'epoch': 0.41} {'loss': 0.1437, 'grad_norm': 0.6968953609466553, 'learning_rate': 0.00013519503483628542, 'epoch': 0.42} {'loss': 0.1214, 'grad_norm': 0.6117879152297974, 'learning_rate': 0.00013230157188257063, 'epoch': 0.43} {'loss': 0.1383, 'grad_norm': 0.6684589982032776, 'learning_rate': 0.0001293775887262517, 'epoch': 0.44} {'loss': 0.1222, 'grad_norm': 0.7364048957824707, 'learning_rate': 0.00012642584809846333, 'epoch': 0.45} {'loss': 0.1202, 'grad_norm': 0.7387944459915161, 'learning_rate': 0.00012344913895704097, 'epoch': 0.46} {'loss': 0.1446, 'grad_norm': 0.6471113562583923, 'learning_rate': 0.00012045027385136825, 'epoch': 0.47} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.61it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.72it/s] 4%|β–Ž | 4/111 [00:00<00:18, 5.69it/s] 5%|▍ | 5/111 [00:01<00:35, 2.99it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.53it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.85it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.65it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.44it/s] 12%|β–ˆβ– | 13/111 [00:07<01:16, 1.28it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:07, 1.44it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.70it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.23it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.02it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:05, 1.38it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:48, 1.84it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.76it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.84it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:54, 1.59it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.95it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:50, 1.66it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:50, 1.65it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.41it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.68it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:38, 2.05it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:38, 2.07it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.70it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.59it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.44it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.33it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:01, 1.21it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.66it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.50it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.38it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:53, 1.22it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.17it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.20it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:52, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:46, 1.30it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.29it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:45, 1.28it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.25it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:39, 1.43it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.54it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.53it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.37it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.93it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.89it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.74it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:27, 1.73it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.65it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.03it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:23, 1.90it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.67it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:45<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.42it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:19, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:22, 1.54it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.44it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.24it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.12it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.21it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:21, 1.19it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:57<00:20, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.23it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:58<00:14, 1.58it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:13, 1.57it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:10, 1.92it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.30it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.13it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:11, 1.62it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.42it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.25it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.54it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.51it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.51it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.27it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.53it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.90it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.88it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.64it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.34it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.61it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.92it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:10<00:01, 1.80it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:11<00:01, 1.44it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.41it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.62it/s]  46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 250/538 [1:05:59<1:11:29, 14.89s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.62it/s]  47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 251/538 [1:06:17<3:01:24, 37.92s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 252/538 [1:06:31<2:25:39, 30.56s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 253/538 [1:06:40<1:54:57, 24.20s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 254/538 [1:06:52<1:36:44, 20.44s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 255/538 [1:07:04<1:24:34, 17.93s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 255/538 [1:07:04<1:24:34, 17.93s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 256/538 [1:07:20<1:20:57, 17.22s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 257/538 [1:07:31<1:12:09, 15.41s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 258/538 [1:07:44<1:09:11, 14.83s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 259/538 [1:07:59<1:08:39, 14.76s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 260/538 [1:08:14<1:08:31, 14.79s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 260/538 [1:08:14<1:08:31, 14.79s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 261/538 [1:08:28<1:07:18, 14.58s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 262/538 [1:08:44<1:09:03, 15.01s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 263/538 [1:08:58<1:08:11, 14.88s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 264/538 [1:09:10<1:03:55, 14.00s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 265/538 [1:09:23<1:01:56, 13.61s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 265/538 [1:09:23<1:01:56, 13.61s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 266/538 [1:09:33<57:20, 12.65s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 267/538 [1:09:52<1:05:24, 14.48s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 268/538 [1:10:09<1:07:42, 15.05s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 269/538 [1:10:25<1:09:01, 15.40s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 270/538 [1:10:36<1:02:55, 14.09s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 270/538 [1:10:36<1:02:55, 14.09s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 271/538 [1:10:49<1:01:32, 13.83s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 272/538 [1:11:00<57:05, 12.88s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 273/538 [1:11:15<1:00:23, 13.67s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 274/538 [1:11:33<1:05:50, 14.96s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 275/538 [1:11:50<1:07:28, 15.39s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 275/538 [1:11:50<1:07:28, 15.39s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 276/538 [1:12:04<1:05:32, 15.01s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 277/538 [1:12:13<58:30, 13.45s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 278/538 [1:12:28<1:00:00, 13.85s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 279/538 [1:12:42<59:45, 13.84s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 280/538 [1:12:57<1:00:37, 14.10s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 280/538 [1:12:57<1:00:37, 14.10s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 281/538 [1:13:12<1:01:37, 14.39s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 282/538 [1:13:27<1:01:55, 14.51s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 283/538 [1:13:41<1:01:29, 14.47s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 284/538 [1:13:55<1:00:19, 14.25s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 285/538 [1:14:10<1:01:09, 14.51s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 285/538 [1:14:10<1:01:09, 14.51s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 286/538 [1:14:24<1:01:01, 14.53s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 287/538 [1:14:38<59:03, 14.12s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 288/538 [1:14:53<1:01:02, 14.65s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 289/538 [1:15:06<57:55, 13.96s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 290/538 [1:15:21<59:25, 14.38s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 290/538 [1:15:21<59:25, 14.38s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 291/538 [1:15:34<57:43, 14.02s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 292/538 [1:15:50<59:51, 14.60s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 293/538 [1:16:00<53:16, 13.05s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 294/538 [1:16:15<55:10, 13.57s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 295/538 [1:16:29<56:04, 13.85s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 295/538 [1:16:29<56:04, 13.85s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 296/538 [1:16:43<55:36, 13.79s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 297/538 [1:16:54<52:00, 12.95s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 298/538 [1:17:11<56:30, 14.13s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 299/538 [1:17:23<54:05, 13.58s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 300/538 [1:17:38<55:43, 14.05s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 300/538 [1:17:38<55:43, 14.05s/it]{'eval_loss': 0.11554089933633804, 'eval_runtime': 73.039, 'eval_samples_per_second': 3.026, 'eval_steps_per_second': 1.52, 'epoch': 0.47} {'loss': 0.1425, 'grad_norm': 0.7449938058853149, 'learning_rate': 0.0001174320862649344, 'epoch': 0.47} {'loss': 0.131, 'grad_norm': 0.8666985630989075, 'learning_rate': 0.00011439742793811205, 'epoch': 0.48} {'loss': 0.1322, 'grad_norm': 0.9995303750038147, 'learning_rate': 0.00011134916617368464, 'epoch': 0.49} {'loss': 0.1293, 'grad_norm': 0.6491286754608154, 'learning_rate': 0.00010829018112766996, 'epoch': 0.5} {'loss': 0.1372, 'grad_norm': 0.8522428274154663, 'learning_rate': 0.00010522336308799904, 'epoch': 0.51} {'loss': 0.1277, 'grad_norm': 0.7563990354537964, 'learning_rate': 0.00010215160974362223, 'epoch': 0.52} {'loss': 0.1294, 'grad_norm': 0.6848676800727844, 'learning_rate': 9.907782344662195e-05, 'epoch': 0.53} {'loss': 0.1383, 'grad_norm': 0.6876094341278076, 'learning_rate': 9.600490846991994e-05, 'epoch': 0.54} {'loss': 0.1241, 'grad_norm': 0.6399123668670654, 'learning_rate': 9.29357682631691e-05, 'epoch': 0.55} {'loss': 0.14, 'grad_norm': 0.6791756749153137, 'learning_rate': 8.987330270942389e-05, 'epoch': 0.56} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.66it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.83it/s] 4%|β–Ž | 4/111 [00:00<00:18, 5.72it/s] 5%|▍ | 5/111 [00:01<00:35, 3.01it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.54it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.85it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.65it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.76it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:12, 1.37it/s] 12%|β–ˆβ– | 13/111 [00:07<01:12, 1.35it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.46it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:55, 1.72it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.25it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:45, 2.05it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.68it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.40it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:48, 1.84it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.77it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.84it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.60it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.93it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:51, 1.62it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:51, 1.63it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.40it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.67it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:39, 2.04it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:38, 2.07it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.70it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.59it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.44it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.32it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:02, 1.19it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.51it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.66it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.50it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:54, 1.22it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.17it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.20it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:52, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.29it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.30it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:44, 1.30it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:39, 1.42it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.53it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.53it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.37it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.93it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.89it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.74it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:27, 1.73it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.65it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.03it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:22, 1.92it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.68it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.42it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:19, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:22, 1.52it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.54it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.41it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:23, 1.35it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.22it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.23it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.12it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.21it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:21, 1.19it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:57<00:20, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.23it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:58<00:14, 1.58it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:13, 1.57it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:10, 1.91it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.30it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.25it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.74it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.49it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.29it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.58it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.54it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.52it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.28it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.54it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.90it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.88it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.65it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.36it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.62it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.99it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.83it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.48it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.63it/s]  56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 300/538 [1:18:51<55:43, 14.05s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.63it/s] wandb: WARNING URL not available in offline run 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 301/538 [1:19:07<2:24:09, 36.50s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 302/538 [1:19:22<1:57:48, 29.95s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 303/538 [1:19:38<1:41:48, 25.99s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 304/538 [1:19:55<1:30:32, 23.21s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 305/538 [1:20:11<1:22:13, 21.17s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 305/538 [1:20:11<1:22:13, 21.17s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 306/538 [1:20:27<1:15:38, 19.56s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 307/538 [1:20:43<1:11:30, 18.57s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 308/538 [1:20:56<1:04:23, 16.80s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 309/538 [1:21:10<1:00:39, 15.89s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 310/538 [1:21:24<58:16, 15.34s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 310/538 [1:21:24<58:16, 15.34s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 311/538 [1:21:38<56:35, 14.96s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 312/538 [1:21:53<56:43, 15.06s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 313/538 [1:22:09<57:32, 15.35s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 314/538 [1:22:21<53:38, 14.37s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 315/538 [1:22:36<53:49, 14.48s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 315/538 [1:22:36<53:49, 14.48s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 316/538 [1:22:50<52:42, 14.25s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 317/538 [1:23:04<52:25, 14.23s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 318/538 [1:23:16<50:03, 13.65s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 319/538 [1:23:33<52:40, 14.43s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 320/538 [1:23:48<53:15, 14.66s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 320/538 [1:23:48<53:15, 14.66s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 321/538 [1:24:01<51:50, 14.34s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 322/538 [1:24:16<51:32, 14.32s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 323/538 [1:24:26<47:13, 13.18s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 324/538 [1:24:40<47:20, 13.28s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 325/538 [1:24:56<50:17, 14.17s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 325/538 [1:24:56<50:17, 14.17s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 326/538 [1:25:12<52:00, 14.72s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 327/538 [1:25:26<51:19, 14.60s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 328/538 [1:25:44<54:06, 15.46s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 329/538 [1:26:00<54:30, 15.65s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 330/538 [1:26:12<50:47, 14.65s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 330/538 [1:26:12<50:47, 14.65s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 331/538 [1:26:28<51:30, 14.93s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 332/538 [1:26:42<50:27, 14.70s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 333/538 [1:26:58<51:54, 15.19s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 334/538 [1:27:09<46:44, 13.75s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 335/538 [1:27:24<48:28, 14.33s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 335/538 [1:27:24<48:28, 14.33s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 336/538 [1:27:41<50:08, 14.89s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 337/538 [1:27:58<52:29, 15.67s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 338/538 [1:28:15<54:02, 16.21s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 339/538 [1:28:30<52:08, 15.72s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 340/538 [1:28:43<49:29, 15.00s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 340/538 [1:28:43<49:29, 15.00s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 341/538 [1:29:01<51:21, 15.64s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 342/538 [1:29:13<48:01, 14.70s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 343/538 [1:29:27<47:05, 14.49s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 344/538 [1:29:39<44:35, 13.79s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 345/538 [1:29:50<41:24, 12.88s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 345/538 [1:29:50<41:24, 12.88s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 346/538 [1:30:04<42:22, 13.24s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 347/538 [1:30:19<44:09, 13.87s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 348/538 [1:30:33<43:55, 13.87s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 349/538 [1:30:47<43:30, 13.81s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 350/538 [1:31:01<43:54, 14.01s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 350/538 [1:31:01<43:54, 14.01s/it]{'eval_loss': 0.1100185289978981, 'eval_runtime': 72.8167, 'eval_samples_per_second': 3.035, 'eval_steps_per_second': 1.524, 'epoch': 0.56} {'loss': 0.1346, 'grad_norm': 0.8283066749572754, 'learning_rate': 8.682040538517974e-05, 'epoch': 0.57} {'loss': 0.1386, 'grad_norm': 0.7044147253036499, 'learning_rate': 8.377996082637216e-05, 'epoch': 0.58} {'loss': 0.1173, 'grad_norm': 0.696846067905426, 'learning_rate': 8.075484180291701e-05, 'epoch': 0.59} {'loss': 0.1319, 'grad_norm': 0.7000551819801331, 'learning_rate': 7.774790660436858e-05, 'epoch': 0.6} {'loss': 0.1373, 'grad_norm': 0.8282796144485474, 'learning_rate': 7.476199633925895e-05, 'epoch': 0.6} {'loss': 0.1376, 'grad_norm': 0.6185778379440308, 'learning_rate': 7.179993225067136e-05, 'epoch': 0.61} {'loss': 0.1296, 'grad_norm': 0.6192060112953186, 'learning_rate': 6.886451305058293e-05, 'epoch': 0.62} {'loss': 0.1114, 'grad_norm': 0.5297410488128662, 'learning_rate': 6.595851227549657e-05, 'epoch': 0.63} {'loss': 0.1258, 'grad_norm': 0.6853290796279907, 'learning_rate': 6.308467566585929e-05, 'epoch': 0.64} {'loss': 0.1151, 'grad_norm': 0.5415284633636475, 'learning_rate': 6.024571857174443e-05, 'epoch': 0.65} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.69it/s] 3%|β–Ž | 3/111 [00:00<00:24, 4.42it/s] 4%|β–Ž | 4/111 [00:00<00:19, 5.48it/s] 5%|▍ | 5/111 [00:01<00:36, 2.94it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.50it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.83it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.64it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.42it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.44it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.71it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.23it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.03it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.40it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:47, 1.86it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.78it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.85it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.62it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.95it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:50, 1.66it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:50, 1.64it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.41it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.69it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:38, 2.06it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:37, 2.09it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.71it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.60it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.45it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.32it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:00, 1.22it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.65it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.50it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:54, 1.22it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.17it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.20it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:53, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.29it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.30it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:44, 1.29it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:34<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:39, 1.42it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.54it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.52it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.94it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.91it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.75it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:27, 1.74it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.66it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.04it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:22, 1.92it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.68it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.38it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.41it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:20, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:21, 1.55it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.44it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:24, 1.18it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.14it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.22it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:21, 1.19it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:56<00:20, 1.20it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.24it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:57<00:14, 1.58it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:13, 1.58it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:10, 1.92it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.30it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.26it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.75it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.49it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.28it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.58it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.53it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:03<00:08, 1.52it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.28it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.54it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.91it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.89it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:06<00:04, 1.65it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.36it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:08<00:03, 1.62it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.98it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.82it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.46it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.58it/s]  65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 350/538 [1:32:14<43:54, 14.01s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.58it/s]  65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 351/538 [1:32:28<1:51:55, 35.91s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 352/538 [1:32:41<1:29:37, 28.91s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 353/538 [1:32:56<1:16:41, 24.87s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 354/538 [1:33:10<1:05:27, 21.34s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 355/538 [1:33:26<1:00:27, 19.82s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 355/538 [1:33:26<1:00:27, 19.82s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 356/538 [1:33:39<53:46, 17.73s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 357/538 [1:33:54<51:02, 16.92s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 358/538 [1:34:09<49:01, 16.34s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 359/538 [1:34:21<44:49, 15.02s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 360/538 [1:34:31<40:33, 13.67s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 360/538 [1:34:31<40:33, 13.67s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 361/538 [1:34:46<41:28, 14.06s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 362/538 [1:35:02<42:30, 14.49s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 363/538 [1:35:16<42:22, 14.53s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 364/538 [1:35:33<44:00, 15.18s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 365/538 [1:35:49<44:12, 15.33s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 365/538 [1:35:49<44:12, 15.33s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 366/538 [1:36:03<43:33, 15.20s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 367/538 [1:36:18<42:58, 15.08s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 368/538 [1:36:30<39:30, 13.94s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 369/538 [1:36:46<41:21, 14.68s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 370/538 [1:37:00<40:54, 14.61s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 370/538 [1:37:00<40:54, 14.61s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 371/538 [1:37:13<39:22, 14.15s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 372/538 [1:37:26<37:43, 13.63s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 373/538 [1:37:40<38:15, 13.91s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 374/538 [1:37:52<36:07, 13.22s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 375/538 [1:38:08<37:57, 13.97s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 375/538 [1:38:08<37:57, 13.97s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 376/538 [1:38:24<39:55, 14.79s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 377/538 [1:38:38<38:29, 14.35s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 378/538 [1:38:50<36:29, 13.69s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 379/538 [1:39:03<35:23, 13.36s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 380/538 [1:39:18<36:37, 13.91s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 380/538 [1:39:18<36:37, 13.91s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 381/538 [1:39:32<36:52, 14.09s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 382/538 [1:39:44<34:58, 13.45s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 383/538 [1:39:59<35:46, 13.85s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 384/538 [1:40:17<38:49, 15.13s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 385/538 [1:40:29<35:48, 14.04s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 385/538 [1:40:29<35:48, 14.04s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 386/538 [1:40:45<37:32, 14.82s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 387/538 [1:41:01<37:51, 15.04s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 388/538 [1:41:17<38:25, 15.37s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 389/538 [1:41:33<38:41, 15.58s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 390/538 [1:41:49<38:22, 15.56s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 390/538 [1:41:49<38:22, 15.56s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 391/538 [1:42:07<39:56, 16.30s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 392/538 [1:42:19<36:39, 15.07s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 393/538 [1:42:33<35:43, 14.78s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 394/538 [1:42:47<35:11, 14.66s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 395/538 [1:43:01<34:36, 14.52s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 395/538 [1:43:01<34:36, 14.52s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 396/538 [1:43:14<33:12, 14.03s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 397/538 [1:43:29<33:38, 14.31s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 398/538 [1:43:43<32:55, 14.11s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 399/538 [1:43:56<32:01, 13.82s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 400/538 [1:44:12<33:29, 14.56s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 400/538 [1:44:12<33:29, 14.56s/it]{'eval_loss': 0.10505883395671844, 'eval_runtime': 72.7668, 'eval_samples_per_second': 3.037, 'eval_steps_per_second': 1.525, 'epoch': 0.65} {'loss': 0.1196, 'grad_norm': 0.6376184225082397, 'learning_rate': 5.7444323387247544e-05, 'epoch': 0.66} {'loss': 0.1199, 'grad_norm': 0.9076871871948242, 'learning_rate': 5.468313701602141e-05, 'epoch': 0.67} {'loss': 0.1278, 'grad_norm': 0.8146594166755676, 'learning_rate': 5.196476837034381e-05, 'epoch': 0.68} {'loss': 0.1356, 'grad_norm': 0.7426274418830872, 'learning_rate': 4.9291785906081925e-05, 'epoch': 0.69} {'loss': 0.1322, 'grad_norm': 0.8531163334846497, 'learning_rate': 4.6666715195881586e-05, 'epoch': 0.7} {'loss': 0.1228, 'grad_norm': 0.6669689416885376, 'learning_rate': 4.409203654287538e-05, 'epoch': 0.71} {'loss': 0.1384, 'grad_norm': 0.7575223445892334, 'learning_rate': 4.1570182637163155e-05, 'epoch': 0.72} {'loss': 0.1195, 'grad_norm': 0.677855908870697, 'learning_rate': 3.910353625728035e-05, 'epoch': 0.73} {'loss': 0.119, 'grad_norm': 0.6284500360488892, 'learning_rate': 3.66944280188248e-05, 'epoch': 0.74} {'loss': 0.1159, 'grad_norm': 0.5671315789222717, 'learning_rate': 3.434513417237041e-05, 'epoch': 0.74} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.73it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.82it/s] 4%|β–Ž | 4/111 [00:00<00:19, 5.63it/s] 5%|▍ | 5/111 [00:01<00:35, 2.98it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.52it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.84it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.64it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.44it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.71it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.23it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.03it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.40it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:47, 1.86it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.78it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.85it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.62it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.95it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:50, 1.66it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:50, 1.64it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.41it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.68it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:38, 2.05it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:37, 2.09it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.71it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.60it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.45it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.33it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:01, 1.21it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.66it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.50it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.38it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.28it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:53, 1.23it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:49, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.18it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.20it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:52, 1.17it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.30it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.28it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:45, 1.27it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:34<00:45, 1.25it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:39, 1.43it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:35<00:35, 1.54it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.54it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.26it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:38<00:25, 1.94it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.91it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:30, 1.56it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:27, 1.71it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:28, 1.64it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.02it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:23, 1.90it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.67it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.41it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:20, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:22, 1.54it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.55it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.43it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.24it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.13it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.21it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:21, 1.19it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:57<00:20, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.23it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:57<00:14, 1.58it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:13, 1.57it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:10, 1.91it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.31it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.26it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.75it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.49it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.29it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.58it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.53it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.52it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.28it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.54it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.90it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.88it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.65it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.34it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.61it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.94it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.80it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.44it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.41it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.61it/s]  74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 400/538 [1:45:25<33:29, 14.56s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.61it/s] wandb: WARNING URL not available in offline run 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 401/538 [1:45:45<1:26:43, 37.99s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 402/538 [1:45:59<1:09:57, 30.86s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 403/538 [1:46:12<57:24, 25.51s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 404/538 [1:46:22<46:22, 20.76s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 405/538 [1:46:36<41:43, 18.82s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 405/538 [1:46:36<41:43, 18.82s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 406/538 [1:46:46<35:23, 16.09s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 407/538 [1:47:00<33:33, 15.37s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 408/538 [1:47:13<32:01, 14.78s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 409/538 [1:47:25<30:14, 14.07s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 410/538 [1:47:37<28:25, 13.32s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 410/538 [1:47:37<28:25, 13.32s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 411/538 [1:47:50<27:44, 13.11s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 412/538 [1:48:07<30:07, 14.34s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 413/538 [1:48:23<31:02, 14.90s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 414/538 [1:48:36<29:21, 14.20s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 415/538 [1:48:50<29:18, 14.29s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 415/538 [1:48:50<29:18, 14.29s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 416/538 [1:49:04<28:52, 14.20s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 417/538 [1:49:14<26:09, 12.97s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 418/538 [1:49:28<26:36, 13.31s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 419/538 [1:49:44<27:52, 14.06s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 420/538 [1:50:00<28:29, 14.49s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 420/538 [1:50:00<28:29, 14.49s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 421/538 [1:50:17<29:45, 15.26s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 422/538 [1:50:29<27:44, 14.35s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 423/538 [1:50:42<26:57, 14.06s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 424/538 [1:50:57<26:46, 14.09s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 425/538 [1:51:12<27:14, 14.47s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 425/538 [1:51:12<27:14, 14.47s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 426/538 [1:51:28<28:05, 15.05s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 427/538 [1:51:46<29:06, 15.73s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 428/538 [1:51:59<27:28, 14.99s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 429/538 [1:52:11<25:36, 14.10s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 430/538 [1:52:24<24:44, 13.75s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 430/538 [1:52:24<24:44, 13.75s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 431/538 [1:52:36<23:45, 13.32s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 432/538 [1:52:49<23:12, 13.14s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 433/538 [1:53:02<23:16, 13.30s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 434/538 [1:53:20<25:21, 14.63s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 435/538 [1:53:34<24:34, 14.32s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 435/538 [1:53:34<24:34, 14.32s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 436/538 [1:53:44<22:24, 13.19s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 437/538 [1:53:57<22:07, 13.14s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 438/538 [1:54:12<22:42, 13.62s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 439/538 [1:54:21<19:53, 12.06s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 440/538 [1:54:36<21:20, 13.06s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 440/538 [1:54:36<21:20, 13.06s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 441/538 [1:54:49<21:07, 13.07s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 442/538 [1:55:06<22:47, 14.24s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 443/538 [1:55:24<24:19, 15.36s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 444/538 [1:55:35<22:08, 14.13s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 445/538 [1:55:43<19:02, 12.28s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 445/538 [1:55:43<19:02, 12.28s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 446/538 [1:55:54<18:00, 11.74s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 447/538 [1:56:09<19:14, 12.69s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 448/538 [1:56:24<20:11, 13.46s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 449/538 [1:56:38<20:19, 13.70s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 450/538 [1:56:50<19:19, 13.18s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 450/538 [1:56:50<19:19, 13.18s/it]{'eval_loss': 0.10208839178085327, 'eval_runtime': 72.8321, 'eval_samples_per_second': 3.034, 'eval_steps_per_second': 1.524, 'epoch': 0.74} {'loss': 0.1254, 'grad_norm': 0.6890803575515747, 'learning_rate': 3.205787445274707e-05, 'epoch': 0.75} {'loss': 0.1076, 'grad_norm': 0.6065118312835693, 'learning_rate': 2.9834809981720224e-05, 'epoch': 0.76} {'loss': 0.1283, 'grad_norm': 0.734563946723938, 'learning_rate': 2.7678041226050533e-05, 'epoch': 0.77} {'loss': 0.1235, 'grad_norm': 0.6849725842475891, 'learning_rate': 2.5589606012863963e-05, 'epoch': 0.78} {'loss': 0.1329, 'grad_norm': 0.7363895773887634, 'learning_rate': 2.3571477604206792e-05, 'epoch': 0.79} {'loss': 0.1339, 'grad_norm': 0.6717341542243958, 'learning_rate': 2.1625562832605284e-05, 'epoch': 0.8} {'loss': 0.1198, 'grad_norm': 0.6806132197380066, 'learning_rate': 1.975370029939111e-05, 'epoch': 0.81} {'loss': 0.1436, 'grad_norm': 0.7354431748390198, 'learning_rate': 1.795765863749549e-05, 'epoch': 0.82} {'loss': 0.108, 'grad_norm': 0.5758335590362549, 'learning_rate': 1.623913484035282e-05, 'epoch': 0.83} {'loss': 0.1384, 'grad_norm': 0.5895151495933533, 'learning_rate': 1.4599752658493304e-05, 'epoch': 0.84} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:18, 5.75it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.84it/s] 4%|β–Ž | 4/111 [00:00<00:18, 5.64it/s] 5%|▍ | 5/111 [00:01<00:35, 2.99it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.53it/s] 6%|β–‹ | 7/111 [00:02<00:57, 1.82it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.65it/s] 8%|β–Š | 9/111 [00:04<01:10, 1.44it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.76it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.59it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.45it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.71it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.23it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.03it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.40it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:47, 1.86it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.78it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.84it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.61it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.93it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:51, 1.65it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:50, 1.64it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.40it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.68it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:39, 2.05it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:37, 2.08it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.70it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.60it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.45it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.33it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:01, 1.21it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:43, 1.65it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:47, 1.49it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:52, 1.33it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:53, 1.27it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.35it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:54, 1.21it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.30it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:55, 1.15it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:53, 1.19it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:53, 1.16it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.29it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:47, 1.27it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:44, 1.30it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:38, 1.44it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.55it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.54it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.94it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.91it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.75it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:26, 1.74it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.66it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.04it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:22, 1.92it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.68it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.42it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:19, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:22, 1.54it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.44it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.24it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.12it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.21it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:21, 1.19it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:56<00:20, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.24it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:57<00:14, 1.58it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:13, 1.58it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:10, 1.92it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.31it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.26it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.70it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.50it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.28it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.58it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.50it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.50it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.25it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.52it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.84it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.86it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.63it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.66it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.35it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.61it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.97it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.80it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.47it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.62it/s]  84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 450/538 [1:58:03<19:19, 13.18s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.62it/s]  84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 451/538 [1:58:21<52:55, 36.50s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 452/538 [1:58:32<41:23, 28.88s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 453/538 [1:58:44<33:40, 23.77s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 454/538 [1:58:56<28:31, 20.37s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 455/538 [1:59:09<24:58, 18.05s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 455/538 [1:59:09<24:58, 18.05s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 456/538 [1:59:24<23:35, 17.26s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 457/538 [1:59:38<21:46, 16.13s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 458/538 [1:59:47<18:47, 14.10s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 459/538 [2:00:01<18:34, 14.10s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 460/538 [2:00:18<19:14, 14.80s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 460/538 [2:00:18<19:14, 14.80s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 461/538 [2:00:32<18:48, 14.66s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 462/538 [2:00:47<18:27, 14.57s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 463/538 [2:00:59<17:24, 13.93s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 464/538 [2:01:15<18:05, 14.67s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 465/538 [2:01:29<17:24, 14.31s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 465/538 [2:01:29<17:24, 14.31s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 466/538 [2:01:44<17:19, 14.44s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 467/538 [2:01:59<17:28, 14.77s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 468/538 [2:02:14<17:08, 14.69s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 469/538 [2:02:32<18:17, 15.90s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 470/538 [2:02:44<16:42, 14.74s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 470/538 [2:02:44<16:42, 14.74s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 471/538 [2:02:57<15:39, 14.02s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 472/538 [2:03:10<15:00, 13.65s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 473/538 [2:03:20<13:54, 12.84s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 474/538 [2:03:38<15:11, 14.24s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 475/538 [2:03:47<13:26, 12.80s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 475/538 [2:03:47<13:26, 12.80s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 476/538 [2:04:00<13:10, 12.76s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 477/538 [2:04:08<11:31, 11.34s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 478/538 [2:04:16<10:19, 10.33s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 479/538 [2:04:31<11:36, 11.81s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 480/538 [2:04:44<11:32, 11.94s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 480/538 [2:04:44<11:32, 11.94s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 481/538 [2:04:55<11:06, 11.69s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 482/538 [2:05:04<10:18, 11.04s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 483/538 [2:05:19<11:10, 12.19s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 484/538 [2:05:38<12:50, 14.27s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 485/538 [2:05:54<12:56, 14.66s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 485/538 [2:05:54<12:56, 14.66s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 486/538 [2:06:10<13:08, 15.17s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 487/538 [2:06:26<13:11, 15.51s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 488/538 [2:06:37<11:48, 14.18s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 489/538 [2:06:53<11:50, 14.51s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 490/538 [2:07:10<12:08, 15.18s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 490/538 [2:07:10<12:08, 15.18s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 491/538 [2:07:24<11:42, 14.95s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 492/538 [2:07:36<10:44, 14.02s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 493/538 [2:07:50<10:35, 14.13s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 494/538 [2:08:03<10:01, 13.67s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 495/538 [2:08:14<09:12, 12.85s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 495/538 [2:08:14<09:12, 12.85s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 496/538 [2:08:28<09:13, 13.17s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 497/538 [2:08:43<09:29, 13.90s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 498/538 [2:08:59<09:36, 14.41s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 499/538 [2:09:14<09:27, 14.56s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 500/538 [2:09:25<08:34, 13.53s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 500/538 [2:09:25<08:34, 13.53s/it]{'eval_loss': 0.10044225305318832, 'eval_runtime': 72.8277, 'eval_samples_per_second': 3.035, 'eval_steps_per_second': 1.524, 'epoch': 0.84} {'loss': 0.1082, 'grad_norm': 0.5299936532974243, 'learning_rate': 1.30410610653389e-05, 'epoch': 0.85} {'loss': 0.1279, 'grad_norm': 0.6784066557884216, 'learning_rate': 1.1564532793653072e-05, 'epoch': 0.86} {'loss': 0.121, 'grad_norm': 0.7089002728462219, 'learning_rate': 1.0171562944026103e-05, 'epoch': 0.87} {'loss': 0.1, 'grad_norm': 0.7150669097900391, 'learning_rate': 8.863467666711866e-06, 'epoch': 0.87} {'loss': 0.1111, 'grad_norm': 0.7433251142501831, 'learning_rate': 7.641482918060506e-06, 'epoch': 0.88} {'loss': 0.0885, 'grad_norm': 0.6310339570045471, 'learning_rate': 6.506763292722851e-06, 'epoch': 0.89} {'loss': 0.1061, 'grad_norm': 0.5972334742546082, 'learning_rate': 5.460380932729303e-06, 'epoch': 0.9} {'loss': 0.1347, 'grad_norm': 0.6366889476776123, 'learning_rate': 4.503324514474483e-06, 'epoch': 0.91} {'loss': 0.1174, 'grad_norm': 0.7572676539421082, 'learning_rate': 3.636498314564307e-06, 'epoch': 0.92} {'loss': 0.1112, 'grad_norm': 0.6025388836860657, 'learning_rate': 2.860721355408602e-06, 'epoch': 0.93} 0%| | 0/111 [00:00<?, ?it/s] 2%|▏ | 2/111 [00:00<00:19, 5.66it/s] 3%|β–Ž | 3/111 [00:00<00:22, 4.80it/s] 4%|β–Ž | 4/111 [00:00<00:19, 5.61it/s] 5%|▍ | 5/111 [00:01<00:35, 2.99it/s] 5%|β–Œ | 6/111 [00:01<00:41, 2.54it/s] 6%|β–‹ | 7/111 [00:02<00:56, 1.84it/s] 7%|β–‹ | 8/111 [00:03<01:02, 1.64it/s] 8%|β–Š | 9/111 [00:04<01:11, 1.43it/s] 9%|β–‰ | 10/111 [00:04<00:57, 1.75it/s] 10%|β–‰ | 11/111 [00:05<01:03, 1.58it/s] 11%|β–ˆ | 12/111 [00:06<01:08, 1.45it/s] 12%|β–ˆβ– | 13/111 [00:07<01:13, 1.34it/s] 13%|β–ˆβ–Ž | 14/111 [00:07<01:06, 1.45it/s] 14%|β–ˆβ–Ž | 15/111 [00:08<00:56, 1.71it/s] 14%|β–ˆβ– | 16/111 [00:08<00:42, 2.23it/s] 15%|β–ˆβ–Œ | 17/111 [00:08<00:46, 2.02it/s] 16%|β–ˆβ–Œ | 18/111 [00:09<00:55, 1.67it/s] 17%|β–ˆβ–‹ | 19/111 [00:10<01:07, 1.36it/s] 18%|β–ˆβ–Š | 20/111 [00:11<01:12, 1.25it/s] 19%|β–ˆβ–‰ | 21/111 [00:12<01:04, 1.40it/s] 20%|β–ˆβ–‰ | 22/111 [00:12<00:47, 1.86it/s] 21%|β–ˆβ–ˆ | 23/111 [00:12<00:49, 1.78it/s] 22%|β–ˆβ–ˆβ– | 24/111 [00:13<00:47, 1.85it/s] 23%|β–ˆβ–ˆβ–Ž | 25/111 [00:14<00:53, 1.62it/s] 23%|β–ˆβ–ˆβ–Ž | 26/111 [00:14<00:43, 1.95it/s] 24%|β–ˆβ–ˆβ– | 27/111 [00:15<00:50, 1.66it/s] 25%|β–ˆβ–ˆβ–Œ | 28/111 [00:15<00:50, 1.64it/s] 26%|β–ˆβ–ˆβ–Œ | 29/111 [00:16<00:58, 1.41it/s] 27%|β–ˆβ–ˆβ–‹ | 30/111 [00:17<00:48, 1.68it/s] 28%|β–ˆβ–ˆβ–Š | 31/111 [00:17<00:38, 2.05it/s] 29%|β–ˆβ–ˆβ–‰ | 32/111 [00:17<00:37, 2.09it/s] 30%|β–ˆβ–ˆβ–‰ | 33/111 [00:18<00:45, 1.71it/s] 31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:19<00:48, 1.60it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:20<00:52, 1.45it/s] 32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:21<00:56, 1.33it/s] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:22<01:00, 1.21it/s] 34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:22<00:48, 1.50it/s] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:22<00:44, 1.61it/s] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:23<00:48, 1.47it/s] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:24<00:53, 1.31it/s] 38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:25<00:50, 1.37it/s] 39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:26<00:54, 1.25it/s] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:26<00:49, 1.34it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 45/111 [00:27<00:54, 1.20it/s] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 46/111 [00:28<00:50, 1.29it/s] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 47/111 [00:29<00:54, 1.17it/s] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 48/111 [00:30<00:52, 1.19it/s] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 49/111 [00:31<00:53, 1.16it/s] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 50/111 [00:31<00:47, 1.29it/s] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 51/111 [00:32<00:46, 1.29it/s] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 52/111 [00:33<00:41, 1.42it/s] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 53/111 [00:34<00:44, 1.30it/s] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 54/111 [00:35<00:45, 1.26it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 55/111 [00:35<00:39, 1.43it/s] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 56/111 [00:36<00:35, 1.54it/s] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 57/111 [00:36<00:35, 1.53it/s] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 58/111 [00:37<00:38, 1.38it/s] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 59/111 [00:38<00:41, 1.25it/s] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 60/111 [00:38<00:32, 1.57it/s] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 61/111 [00:39<00:25, 1.94it/s] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 62/111 [00:39<00:25, 1.91it/s] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 63/111 [00:40<00:27, 1.74it/s] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 64/111 [00:40<00:27, 1.74it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 65/111 [00:41<00:27, 1.66it/s] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 66/111 [00:41<00:22, 2.04it/s] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 67/111 [00:42<00:22, 1.92it/s] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/111 [00:43<00:25, 1.68it/s] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 69/111 [00:44<00:30, 1.37it/s] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 70/111 [00:44<00:30, 1.34it/s] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/111 [00:46<00:34, 1.17it/s] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 72/111 [00:46<00:32, 1.21it/s] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/111 [00:47<00:26, 1.42it/s] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/111 [00:47<00:19, 1.88it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/111 [00:48<00:21, 1.70it/s] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/111 [00:48<00:20, 1.75it/s] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/111 [00:49<00:21, 1.55it/s] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/111 [00:50<00:21, 1.56it/s] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/111 [00:50<00:22, 1.44it/s] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/111 [00:51<00:22, 1.36it/s] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 81/111 [00:52<00:24, 1.23it/s] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 82/111 [00:53<00:23, 1.24it/s] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/111 [00:54<00:24, 1.12it/s] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 84/111 [00:55<00:22, 1.21it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 85/111 [00:56<00:21, 1.19it/s] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 86/111 [00:56<00:20, 1.19it/s] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 87/111 [00:57<00:19, 1.22it/s] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 88/111 [00:57<00:14, 1.59it/s] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 89/111 [00:58<00:14, 1.54it/s] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 90/111 [00:58<00:11, 1.88it/s] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 91/111 [00:59<00:08, 2.26it/s] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 92/111 [00:59<00:08, 2.24it/s] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/111 [01:00<00:10, 1.71it/s] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/111 [01:01<00:11, 1.48it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 95/111 [01:02<00:12, 1.27it/s] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/111 [01:02<00:09, 1.56it/s] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/111 [01:03<00:09, 1.50it/s] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/111 [01:04<00:08, 1.50it/s] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 99/111 [01:05<00:09, 1.27it/s] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 100/111 [01:05<00:07, 1.53it/s] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 101/111 [01:05<00:05, 1.89it/s] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 102/111 [01:06<00:04, 1.87it/s] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 103/111 [01:07<00:04, 1.64it/s] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 104/111 [01:07<00:04, 1.67it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 105/111 [01:08<00:04, 1.35it/s] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 106/111 [01:09<00:03, 1.61it/s] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 107/111 [01:09<00:02, 1.97it/s] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 108/111 [01:09<00:01, 1.83it/s] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 109/111 [01:10<00:01, 1.47it/s] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 110/111 [01:11<00:00, 1.42it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.62it/s]  93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 500/538 [2:10:38<08:34, 13.53s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 111/111 [01:12<00:00, 1.62it/s] wandb: WARNING URL not available in offline run 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 501/538 [2:10:58<23:02, 37.37s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 502/538 [2:11:11<18:05, 30.15s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 503/538 [2:11:26<14:56, 25.61s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 504/538 [2:11:43<13:01, 22.97s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 505/538 [2:11:59<11:31, 20.95s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 505/538 [2:11:59<11:31, 20.95s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 506/538 [2:12:16<10:33, 19.79s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 507/538 [2:12:31<09:29, 18.38s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 508/538 [2:12:48<08:59, 17.97s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 509/538 [2:13:00<07:45, 16.04s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 510/538 [2:13:15<07:18, 15.67s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 510/538 [2:13:15<07:18, 15.67s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 511/538 [2:13:25<06:16, 13.95s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 512/538 [2:13:37<05:51, 13.54s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 513/538 [2:13:54<05:59, 14.39s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 514/538 [2:14:09<05:51, 14.63s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 515/538 [2:14:21<05:22, 14.02s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 515/538 [2:14:21<05:22, 14.02s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 516/538 [2:14:34<04:58, 13.55s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 517/538 [2:14:44<04:24, 12.60s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 518/538 [2:15:00<04:33, 13.65s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 519/538 [2:15:11<04:03, 12.79s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 520/538 [2:15:28<04:10, 13.94s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 520/538 [2:15:28<04:10, 13.94s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 521/538 [2:15:41<03:52, 13.68s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 522/538 [2:15:53<03:30, 13.17s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 523/538 [2:16:11<03:42, 14.80s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 524/538 [2:16:22<03:10, 13.60s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 525/538 [2:16:33<02:46, 12.82s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 525/538 [2:16:33<02:46, 12.82s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 526/538 [2:16:47<02:37, 13.15s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 527/538 [2:17:02<02:29, 13.61s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 528/538 [2:17:18<02:23, 14.34s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 529/538 [2:17:28<01:58, 13.21s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 530/538 [2:17:44<01:50, 13.78s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 530/538 [2:17:44<01:50, 13.78s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 531/538 [2:17:59<01:40, 14.35s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 532/538 [2:18:12<01:22, 13.73s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 533/538 [2:18:22<01:04, 12.90s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 534/538 [2:18:33<00:49, 12.33s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 535/538 [2:18:47<00:37, 12.62s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 535/538 [2:18:47<00:37, 12.62s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 536/538 [2:19:00<00:25, 12.69s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 537/538 [2:19:14<00:13, 13.28s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 538/538 [2:19:17<00:00, 10.10s/it]wandb: WARNING URL not available in offline run 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 538/538 [2:19:24<00:00, 10.10s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 538/538 [2:19:24<00:00, 15.55s/it] {'eval_loss': 0.09908278286457062, 'eval_runtime': 72.8525, 'eval_samples_per_second': 3.034, 'eval_steps_per_second': 1.524, 'epoch': 0.93} {'loss': 0.1077, 'grad_norm': 0.6565231680870056, 'learning_rate': 2.1767266313661105e-06, 'epoch': 0.94} {'loss': 0.1193, 'grad_norm': 0.5436176657676697, 'learning_rate': 1.5851604161734256e-06, 'epoch': 0.95} {'loss': 0.1193, 'grad_norm': 0.8013174533843994, 'learning_rate': 1.0865816523119466e-06, 'epoch': 0.96} {'loss': 0.1152, 'grad_norm': 0.6958430409431458, 'learning_rate': 6.814614228900507e-07, 'epoch': 0.97} {'loss': 0.1249, 'grad_norm': 0.5581568479537964, 'learning_rate': 3.701825065392184e-07, 'epoch': 0.98} {'loss': 0.1164, 'grad_norm': 0.7202214002609253, 'learning_rate': 1.5303901574502678e-07, 'epoch': 0.99} {'loss': 0.1061, 'grad_norm': 0.5646489262580872, 'learning_rate': 3.023611895428546e-08, 'epoch': 1.0} {'train_runtime': 8364.4205, 'train_samples_per_second': 1.028, 'train_steps_per_second': 0.064, 'train_loss': 0.17588091406237238, 'epoch': 1.0} wandb artifact logging skipped (WANDB_SKIP_ARTIFACT=1) wandb: wandb: Run history: wandb: eval/loss β–ˆβ–„β–ƒβ–‚β–‚β–‚β–β–β–β– wandb: eval/runtime β–ˆβ–β–β–β–β–β–β–β–β– wandb: eval/samples_per_second β–β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ wandb: eval/steps_per_second β–β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ wandb: train/epoch β–β–β–β–β–‚β–‚β–‚β–‚β–‚β–ƒβ–ƒβ–ƒβ–ƒβ–ƒβ–ƒβ–„β–„β–„β–„β–„β–…β–…β–…β–…β–…β–…β–…β–†β–†β–†β–†β–†β–†β–‡β–‡β–‡β–‡β–ˆβ–ˆβ–ˆ wandb: train/global_step β–β–β–β–β–β–‚β–‚β–‚β–‚β–‚β–‚β–‚β–ƒβ–ƒβ–ƒβ–„β–„β–„β–„β–„β–„β–…β–…β–…β–…β–†β–†β–†β–†β–‡β–‡β–‡β–‡β–‡β–‡β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ wandb: train/grad_norm β–ƒβ–…β–ƒβ–ˆβ–‚β–‚β–β–β–β–β–β–‚β–β–β–β–β–β–β–‚β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β– wandb: train/learning_rate β–‚β–†β–‡β–ˆβ–ˆβ–ˆβ–ˆβ–‡β–‡β–‡β–‡β–‡β–‡β–†β–†β–†β–†β–…β–…β–…β–„β–„β–„β–„β–„β–ƒβ–ƒβ–ƒβ–‚β–‚β–‚β–‚β–‚β–β–β–β–β–β–β– wandb: train/loss β–ˆβ–†β–‚β–‚β–‚β–β–‚β–‚β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β–β– wandb: wandb: Run summary: wandb: eval/loss 0.09908 wandb: eval/runtime 72.8525 wandb: eval/samples_per_second 3.034 wandb: eval/steps_per_second 1.524 wandb: total_flos 2.3722943184871096e+18 wandb: train/epoch 1 wandb: train/global_step 538 wandb: train/grad_norm 0.56465 wandb: train/learning_rate 0.0 wandb: train/loss 0.1061 wandb: +4 ... wandb: wandb: You can sync this run to the cloud by running: wandb: wandb sync /workspace/anchor/qwen-pretrained/wandb/wandb/offline-run-20261016_032553-9kfmp8pv wandb: Find logs at: /workspace/anchor/qwen-pretrained/wandb/wandb/offline-run-20261016_032553-9kfmp8pv/logs done - final adapter at /workspace/anchor/qwen-pretrained/train/final merging and pushing 16-bit model to CompassioninMachineLearning/qwen-pretrained-part1-build ... 0%| | 0/1 [00:00<?, ?it/s] tokenizer.json: 0%| | 0.00/11.4M [00:00<?, ?B/s] tokenizer.json: 0%| | 16.4k/11.4M [00:00<01:18, 146kB/s] tokenizer.json: 34%|β–ˆβ–ˆβ–ˆβ–Ž | 3.85M/11.4M [00:00<00:00, 19.7MB/s] tokenizer.json: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 6.68M/11.4M [00:00<00:00, 12.1MB/s]tokenizer.json: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 11.4M/11.4M [00:02<00:00, 4.60MB/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:02<00:00, 2.74s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:02<00:00, 2.74s/it] Found HuggingFace hub cache directory: /workspace/hf_cache/hub Checking cache directory for required files... Unsloth: Copying 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build`: 0%| | 0/4 [00:00<?, ?it/s]Unsloth: Copying 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build`: 25%|β–ˆβ–ˆβ–Œ | 1/4 [00:01<00:04, 1.44s/it]Unsloth: Copying 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build`: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2/4 [00:02<00:02, 1.45s/it]Unsloth: Copying 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build`: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3/4 [00:04<00:01, 1.44s/it]Unsloth: Copying 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build`: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:04<00:00, 1.02s/it]Unsloth: Copying 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build`: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:04<00:00, 1.18s/it] Successfully copied all 4 files from cache to `CompassioninMachineLearning/qwen-pretrained-part1-build` Checking cache directory for required files... Cache check failed: tokenizer.model not found in local cache. Not all required files found in cache. Will proceed with downloading. Unsloth: Preparing safetensor model files: 0%| | 0/4 [00:00<?, ?it/s]Unsloth: Preparing safetensor model files: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:00<00:00, 58867.42it/s] Unsloth: Merging weights into 16bit: 0%| | 0/4 [00:00<?, ?it/s] 0%| | 0/1 [00:00<?, ?it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:31<00:00, 31.83s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:31<00:00, 31.83s/it] Unsloth: Merging weights into 16bit: 25%|β–ˆβ–ˆβ–Œ | 1/4 [00:43<02:10, 43.66s/it] 0%| | 0/1 [00:00<?, ?it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:33<00:00, 33.65s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:33<00:00, 33.65s/it] Unsloth: Merging weights into 16bit: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2/4 [01:31<01:32, 46.11s/it] 0%| | 0/1 [00:00<?, ?it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:32<00:00, 32.95s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:32<00:00, 32.95s/it] Unsloth: Merging weights into 16bit: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3/4 [02:17<00:46, 46.11s/it] 0%| | 0/1 [00:00<?, ?it/s] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:10<00:00, 10.35s/it]100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1/1 [00:10<00:00, 10.36s/it] Unsloth: Merging weights into 16bit: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [02:32<00:00, 33.68s/it]Unsloth: Merging weights into 16bit: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [02:32<00:00, 38.06s/it] Unsloth: Merge process complete. Saved to `/workspace/repo_r/CompassioninMachineLearning/qwen-pretrained-part1-build` pushed merged 16-bit model to https://huggingface.co/CompassioninMachineLearning/qwen-pretrained-part1-build
πŸ¦₯ Unsloth: Will patch your computer to enable 2x faster free finetuning.
βš™οΈ Running in WANDB offline mode
πŸ¦₯ Unsloth Zoo will now patch everything to make training faster!
==((====))== Unsloth 2026.9.2: Fast Qwen3 patching. Transformers: 4.57.6.
\\ /| NVIDIA H100 80GB HBM3. Num GPUs = 1. Max memory: 79.179 GB. Platform: Linux.
O^O/ \_/ \ Torch: 2.11.0+cu128. CUDA: 9.0. CUDA Toolkit: 12.8. Triton: 3.6.0
\ / Bfloat16 = TRUE. FA [Xformers = 0.0.35. FA2 = False]
"-____-" Free license: http://github.com/unslothai/unsloth
Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]Loading checkpoint shards: 25%|β–ˆβ–ˆβ–Œ | 1/4 [00:00<00:02, 1.40it/s]Loading checkpoint shards: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2/4 [00:01<00:01, 1.40it/s]Loading checkpoint shards: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 3/4 [00:02<00:00, 1.40it/s]Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:02<00:00, 1.91it/s]Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 4/4 [00:02<00:00, 1.69it/s]
ROPE_GUARD OK train_unsloth load Qwen/Qwen3-8B-Base: qwen3 theta=1000000.0 scaling=None
Unsloth: Dropout = 0 is supported for fast patching. You are using dropout = 0.05.
Unsloth will patch all other layers, except LoRA matrices, causing a performance hit.
Unsloth 2026.9.2 patched 36 layers with 0 QKV layers, 0 O layers and 0 MLP layers.
Unsloth: Offloading input_embeddings to disk to save VRAM
Unsloth: Offloading output_embeddings to disk to save VRAM
Unsloth: Training embed_tokens in mixed precision to save VRAM
Unsloth: Training lm_head in mixed precision to save VRAM
Generating train split: 0 examples [00:00, ? examples/s]Generating train split: 666 examples [00:00, 1620.56 examples/s]Generating train split: 1308 examples [00:00, 2230.45 examples/s]Generating train split: 1991 examples [00:00, 2665.83 examples/s]Generating train split: 2648 examples [00:01, 1993.20 examples/s]Generating train split: 3299 examples [00:01, 2286.13 examples/s]Generating train split: 3983 examples [00:01, 1909.50 examples/s]Generating train split: 4619 examples [00:02, 2094.72 examples/s]Generating train split: 5267 examples [00:02, 2271.67 examples/s]Generating train split: 5946 examples [00:02, 1951.84 examples/s]Generating train split: 6655 examples [00:03, 2204.16 examples/s]Generating train split: 7317 examples [00:03, 1887.84 examples/s]Generating train split: 7996 examples [00:03, 2148.77 examples/s]Generating train split: 8636 examples [00:04, 2297.88 examples/s]Generating train split: 9250 examples [00:04, 1970.14 examples/s]Generating train split: 9250 examples [00:04, 2074.13 examples/s]
tokenizing (num_proc=8): 0%| | 0/9250 [00:00<?, ? examples/s]tokenizing (num_proc=8): 0%| | 2/9250 [00:00<1:00:00, 2.57 examples/s]tokenizing (num_proc=8): 0%| | 14/9250 [00:00<07:33, 20.36 examples/s] tokenizing (num_proc=8): 1%| | 47/9250 [00:00<02:03, 74.68 examples/s]tokenizing (num_proc=8): 1%| | 81/9250 [00:01<01:11, 127.45 examples/s]tokenizing (num_proc=8): 2%|▏ | 145/9250 [00:01<00:38, 237.38 examples/s]tokenizing (num_proc=8): 2%|▏ | 224/9250 [00:01<00:24, 367.43 examples/s]tokenizing (num_proc=8): 3%|β–Ž | 305/9250 [00:01<00:18, 478.46 examples/s]tokenizing (num_proc=8): 4%|▍ | 404/9250 [00:01<00:14, 598.19 examples/s]tokenizing (num_proc=8): 5%|β–Œ | 501/9250 [00:01<00:12, 691.82 examples/s]tokenizing (num_proc=8): 6%|β–‹ | 585/9250 [00:01<00:11, 724.47 examples/s]tokenizing (num_proc=8): 7%|β–‹ | 675/9250 [00:01<00:11, 758.59 examples/s]tokenizing (num_proc=8): 8%|β–Š | 771/9250 [00:01<00:10, 791.01 examples/s]tokenizing (num_proc=8): 9%|β–‰ | 867/9250 [00:02<00:10, 818.26 examples/s]tokenizing (num_proc=8): 10%|β–ˆ | 955/9250 [00:02<00:10, 826.22 examples/s]tokenizing (num_proc=8): 11%|β–ˆβ– | 1044/9250 [00:02<00:09, 840.86 examples/s]tokenizing (num_proc=8): 12%|β–ˆβ– | 1132/9250 [00:02<00:09, 839.07 examples/s]tokenizing (num_proc=8): 13%|β–ˆβ–Ž | 1220/9250 [00:02<00:09, 849.15 examples/s]tokenizing (num_proc=8): 14%|β–ˆβ– | 1313/9250 [00:02<00:09, 838.11 examples/s]tokenizing (num_proc=8): 15%|β–ˆβ–Œ | 1401/9250 [00:02<00:09, 842.37 examples/s]tokenizing (num_proc=8): 16%|β–ˆβ–Œ | 1503/9250 [00:02<00:08, 868.47 examples/s]tokenizing (num_proc=8): 17%|β–ˆβ–‹ | 1593/9250 [00:02<00:09, 847.95 examples/s]tokenizing (num_proc=8): 18%|β–ˆβ–Š | 1678/9250 [00:03<00:09, 840.54 examples/s]tokenizing (num_proc=8): 19%|β–ˆβ–‰ | 1768/9250 [00:03<00:08, 853.49 examples/s]tokenizing (num_proc=8): 20%|β–ˆβ–ˆ | 1854/9250 [00:03<00:09, 821.05 examples/s]tokenizing (num_proc=8): 21%|β–ˆβ–ˆ | 1941/9250 [00:03<00:09, 805.95 examples/s]tokenizing (num_proc=8): 22%|β–ˆβ–ˆβ– | 2033/9250 [00:03<00:08, 821.58 examples/s]tokenizing (num_proc=8): 23%|β–ˆβ–ˆβ–Ž | 2133/9250 [00:03<00:08, 838.09 examples/s]tokenizing (num_proc=8): 24%|β–ˆβ–ˆβ– | 2229/9250 [00:03<00:08, 868.75 examples/s]tokenizing (num_proc=8): 25%|β–ˆβ–ˆβ–Œ | 2321/9250 [00:03<00:07, 879.81 examples/s]tokenizing (num_proc=8): 26%|β–ˆβ–ˆβ–Œ | 2414/9250 [00:03<00:07, 869.52 examples/s]tokenizing (num_proc=8): 27%|β–ˆβ–ˆβ–‹ | 2502/9250 [00:03<00:08, 823.33 examples/s]tokenizing (num_proc=8): 28%|β–ˆβ–ˆβ–Š | 2586/9250 [00:04<00:08, 821.52 examples/s]tokenizing (num_proc=8): 29%|β–ˆβ–ˆβ–‰ | 2683/9250 [00:04<00:07, 851.62 examples/s]tokenizing (num_proc=8): 30%|β–ˆβ–ˆβ–ˆ | 2786/9250 [00:04<00:07, 892.89 examples/s]tokenizing (num_proc=8): 31%|β–ˆβ–ˆβ–ˆ | 2879/9250 [00:04<00:07, 876.70 examples/s]tokenizing (num_proc=8): 32%|β–ˆβ–ˆβ–ˆβ– | 2975/9250 [00:04<00:06, 896.76 examples/s]tokenizing (num_proc=8): 33%|β–ˆβ–ˆβ–ˆβ–Ž | 3065/9250 [00:04<00:06, 894.99 examples/s]tokenizing (num_proc=8): 34%|β–ˆβ–ˆβ–ˆβ– | 3155/9250 [00:04<00:07, 870.53 examples/s]tokenizing (num_proc=8): 35%|β–ˆβ–ˆβ–ˆβ–Œ | 3249/9250 [00:04<00:06, 867.04 examples/s]tokenizing (num_proc=8): 36%|β–ˆβ–ˆβ–ˆβ–Œ | 3336/9250 [00:04<00:07, 843.31 examples/s]tokenizing (num_proc=8): 37%|β–ˆβ–ˆβ–ˆβ–‹ | 3425/9250 [00:05<00:07, 824.68 examples/s]tokenizing (num_proc=8): 38%|β–ˆβ–ˆβ–ˆβ–Š | 3521/9250 [00:05<00:06, 837.65 examples/s]tokenizing (num_proc=8): 39%|β–ˆβ–ˆβ–ˆβ–‰ | 3607/9250 [00:05<00:06, 819.23 examples/s]tokenizing (num_proc=8): 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 3700/9250 [00:05<00:06, 837.13 examples/s]tokenizing (num_proc=8): 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 3794/9250 [00:05<00:06, 817.60 examples/s]tokenizing (num_proc=8): 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 3880/9250 [00:05<00:06, 818.23 examples/s]tokenizing (num_proc=8): 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 3963/9250 [00:05<00:06, 813.71 examples/s]tokenizing (num_proc=8): 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 4060/9250 [00:05<00:06, 851.74 examples/s]tokenizing (num_proc=8): 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 4148/9250 [00:05<00:06, 814.64 examples/s]tokenizing (num_proc=8): 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 4238/9250 [00:06<00:06, 813.32 examples/s]tokenizing (num_proc=8): 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 4329/9250 [00:06<00:05, 830.90 examples/s]tokenizing (num_proc=8): 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 4415/9250 [00:06<00:06, 802.09 examples/s]tokenizing (num_proc=8): 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 4500/9250 [00:06<00:06, 788.04 examples/s]tokenizing (num_proc=8): 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 4594/9250 [00:06<00:05, 806.05 examples/s]tokenizing (num_proc=8): 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4691/9250 [00:06<00:05, 833.61 examples/s]tokenizing (num_proc=8): 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 4781/9250 [00:06<00:05, 830.44 examples/s]tokenizing (num_proc=8): 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4866/9250 [00:06<00:05, 826.24 examples/s]tokenizing (num_proc=8): 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4955/9250 [00:06<00:05, 844.10 examples/s]tokenizing (num_proc=8): 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5042/9250 [00:07<00:05, 820.50 examples/s]tokenizing (num_proc=8): 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 5131/9250 [00:07<00:04, 825.18 examples/s]tokenizing (num_proc=8): 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 5217/9250 [00:07<00:04, 817.93 examples/s]tokenizing (num_proc=8): 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 5309/9250 [00:07<00:04, 834.79 examples/s]tokenizing (num_proc=8): 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 5413/9250 [00:07<00:04, 879.01 examples/s]tokenizing (num_proc=8): 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 5509/9250 [00:07<00:04, 858.38 examples/s]tokenizing (num_proc=8): 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 5596/9250 [00:07<00:04, 810.55 examples/s]tokenizing (num_proc=8): 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5685/9250 [00:07<00:04, 828.27 examples/s]tokenizing (num_proc=8): 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5771/9250 [00:07<00:04, 818.51 examples/s]tokenizing (num_proc=8): 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 5856/9250 [00:08<00:04, 791.09 examples/s]tokenizing (num_proc=8): 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5937/9250 [00:08<00:04, 774.49 examples/s]tokenizing (num_proc=8): 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 6017/9250 [00:08<00:04, 764.30 examples/s]tokenizing (num_proc=8): 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 6100/9250 [00:08<00:04, 768.86 examples/s]tokenizing (num_proc=8): 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 6192/9250 [00:08<00:03, 778.14 examples/s]tokenizing (num_proc=8): 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 6290/9250 [00:08<00:03, 800.16 examples/s]tokenizing (num_proc=8): 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 6380/9250 [00:08<00:03, 801.59 examples/s]tokenizing (num_proc=8): 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 6461/9250 [00:08<00:03, 794.38 examples/s]tokenizing (num_proc=8): 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 6544/9250 [00:08<00:03, 778.65 examples/s]tokenizing (num_proc=8): 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6632/9250 [00:09<00:03, 762.36 examples/s]tokenizing (num_proc=8): 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 6716/9250 [00:09<00:03, 750.92 examples/s]tokenizing (num_proc=8): 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 6809/9250 [00:09<00:03, 751.22 examples/s]tokenizing (num_proc=8): 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6906/9250 [00:09<00:02, 793.97 examples/s]tokenizing (num_proc=8): 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 6987/9250 [00:09<00:03, 750.32 examples/s]tokenizing (num_proc=8): 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 7077/9250 [00:09<00:02, 780.19 examples/s]tokenizing (num_proc=8): 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 7161/9250 [00:09<00:02, 763.86 examples/s]tokenizing (num_proc=8): 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 7253/9250 [00:09<00:02, 805.81 examples/s]tokenizing (num_proc=8): 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 7342/9250 [00:09<00:02, 800.78 examples/s]tokenizing (num_proc=8): 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 7424/9250 [00:10<00:02, 800.85 examples/s]tokenizing (num_proc=8): 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 7507/9250 [00:10<00:02, 776.14 examples/s]tokenizing (num_proc=8): 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 7590/9250 [00:10<00:02, 760.10 examples/s]tokenizing (num_proc=8): 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 7667/9250 [00:10<00:02, 746.75 examples/s]tokenizing (num_proc=8): 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 7744/9250 [00:10<00:02, 733.94 examples/s]tokenizing (num_proc=8): 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 7820/9250 [00:10<00:02, 685.70 examples/s]tokenizing (num_proc=8): 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7890/9250 [00:10<00:02, 538.87 examples/s]tokenizing (num_proc=8): 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7950/9250 [00:11<00:03, 410.55 examples/s]tokenizing (num_proc=8): 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8008/9250 [00:11<00:06, 183.06 examples/s]tokenizing (num_proc=8): 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8046/9250 [00:12<00:07, 171.52 examples/s]tokenizing (num_proc=8): 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8082/9250 [00:12<00:06, 189.67 examples/s]tokenizing (num_proc=8): 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 8141/9250 [00:12<00:04, 238.99 examples/s]tokenizing (num_proc=8): 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 8203/9250 [00:12<00:03, 297.05 examples/s]tokenizing (num_proc=8): 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 8280/9250 [00:12<00:02, 383.53 examples/s]tokenizing (num_proc=8): 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 8354/9250 [00:12<00:01, 452.93 examples/s]tokenizing (num_proc=8): 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 8421/9250 [00:12<00:01, 497.89 examples/s]tokenizing (num_proc=8): 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 8486/9250 [00:12<00:01, 534.55 examples/s]tokenizing (num_proc=8): 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 8574/9250 [00:13<00:01, 602.64 examples/s]tokenizing (num_proc=8): 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 8659/9250 [00:13<00:00, 646.36 examples/s]tokenizing (num_proc=8): 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 8735/9250 [00:13<00:00, 665.80 examples/s]tokenizing (num_proc=8): 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 8806/9250 [00:13<00:00, 677.03 examples/s]tokenizing (num_proc=8): 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 8884/9250 [00:13<00:00, 695.09 examples/s]tokenizing (num_proc=8): 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 8966/9250 [00:13<00:00, 726.18 examples/s]tokenizing (num_proc=8): 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 9045/9250 [00:13<00:00, 715.03 examples/s]tokenizing (num_proc=8): 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 9124/9250 [00:13<00:00, 661.51 examples/s]tokenizing (num_proc=8): 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 9192/9250 [00:14<00:00, 470.72 examples/s]tokenizing (num_proc=8): 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 9249/9250 [00:14<00:00, 357.47 examples/s]tokenizing (num_proc=8): 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 9250/9250 [00:14<00:00, 630.07 examples/s]
Filter: 0%| | 0/9250 [00:00<?, ? examples/s]Filter: 11%|β–ˆ | 1000/9250 [00:00<00:03, 2421.88 examples/s]Filter: 22%|β–ˆβ–ˆβ– | 2000/9250 [00:00<00:02, 2642.70 examples/s]Filter: 32%|β–ˆβ–ˆβ–ˆβ– | 3000/9250 [00:01<00:02, 2721.99 examples/s]Filter: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4000/9250 [00:01<00:01, 2774.41 examples/s]Filter: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5000/9250 [00:01<00:01, 2802.65 examples/s]Filter: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6000/9250 [00:02<00:01, 2797.81 examples/s]Filter: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7000/9250 [00:02<00:00, 2822.46 examples/s]Filter: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8000/9250 [00:02<00:00, 2859.07 examples/s]Filter: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 9000/9250 [00:03<00:00, 2857.75 examples/s]Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 9250/9250 [00:03<00:00, 2819.98 examples/s]
Filter: 0%| | 0/9250 [00:00<?, ? examples/s]Filter: 11%|β–ˆ | 1000/9250 [00:00<00:03, 2502.63 examples/s]Filter: 22%|β–ˆβ–ˆβ– | 2000/9250 [00:00<00:02, 2654.22 examples/s]Filter: 32%|β–ˆβ–ˆβ–ˆβ– | 3000/9250 [00:01<00:02, 2700.23 examples/s]Filter: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 4000/9250 [00:01<00:01, 2730.39 examples/s]Filter: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 5000/9250 [00:01<00:01, 2743.66 examples/s]Filter: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 6000/9250 [00:02<00:01, 2698.58 examples/s]Filter: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 7000/9250 [00:02<00:00, 2723.82 examples/s]Filter: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 8000/9250 [00:02<00:00, 2645.02 examples/s]Filter: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 9000/9250 [00:03<00:00, 2681.30 examples/s]Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 9250/9250 [00:03<00:00, 2706.45 examples/s]
supervised tokens: tool 4394688, replay 0 (0.0% replay)
rows: 9250 raw -> 8817 kept; by source: {'apigen': 4567, 'efficiency': 500, 'recovery': 3750}
[manifest] git=534143b028a9765e904b4d6d1b22205027804f19 data_sha256={'train_qwen-pretrained_replay50.jsonl': '64d5d5af76e7'}
wandb: WARNING git root /workspace/anchor/qwen-pretrained/wandb does not exist
wandb: Tracking run with wandb version 0.30.0
wandb: W&B syncing is set to `offline` in this directory. Run `wandb online` or set WANDB_MODE=online to enable cloud syncing.
wandb: Run data is saved locally in /workspace/anchor/qwen-pretrained/wandb/wandb/offline-run-20261016_032553-9kfmp8pv
wandb: View this run in the terminal with `wandb leet`
wandb: Detected [huggingface_hub.inference] in use.
wandb: Use W&B Weave for improved LLM call tracing. Install Weave with `pip install weave` then add `import weave` to the top of your script.
wandb: For more information, check out the docs at: https://weave-docs.wandb.ai
==((====))== Unsloth - 2x faster free finetuning | Num GPUs used = 1
\\ /| Num examples = 8,596 | Num Epochs = 1 | Total steps = 538
O^O/ \_/ \ Batch size per device = 2 | Gradient accumulation steps = 8
\ / Data Parallel GPUs = 1 | Total batch size (2 x 8 x 1) = 16
"-____-" Trainable parameters = 1,419,247,616 of 9,609,982,976 (14.77% trained)
Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for embed_tokens.
Unsloth: Setting lr = 2.00e-05 instead of 2.00e-04 for lm_head.
0%| | 0/538 [00:00<?, ?it/s] 0%| | 1/538 [00:22<3:17:13, 22.04s/it] 0%| | 2/538 [00:31<2:08:32, 14.39s/it] 1%| | 3/538 [00:44<2:05:28, 14.07s/it] 1%| | 4/538 [01:02<2:17:21, 15.43s/it] 1%| | 5/538 [01:16<2:11:48, 14.84s/it] 1%| | 5/538 [01:16<2:11:48, 14.84s/it] 1%| | 6/538 [01:29<2:05:49, 14.19s/it] 1%|▏ | 7/538 [01:39<1:53:42, 12.85s/it] 1%|▏ | 8/538 [01:55<2:03:22, 13.97s/it] 2%|▏ | 9/538 [02:11<2:07:49, 14.50s/it] 2%|▏ | 10/538 [02:25<2:07:51, 14.53s/it] 2%|▏ | 10/538 [02:25<2:07:51, 14.53s/it] 2%|▏ | 11/538 [02:41<2:09:39, 14.76s/it] 2%|▏ | 12/538 [02:55<2:09:20, 14.75s/it] 2%|▏ | 13/538 [03:09<2:06:29, 14.46s/it] 3%|β–Ž | 14/538 [03:22<2:01:38, 13.93s/it] 3%|β–Ž | 15/538 [03:37<2:05:37, 14.41s/it] 3%|β–Ž | 15/538 [03:37<2:05:37, 14.41s/it] 3%|β–Ž | 16/538 [03:54<2:12:45, 15.26s/it] 3%|β–Ž | 17/538 [04:12<2:17:17, 15.81s/it] 3%|β–Ž | 18/538 [04:26<2:12:34, 15.30s/it] 4%|β–Ž | 19/538 [04:42<2:13:58, 15.49s/it] 4%|β–Ž | 20/538 [04:56<2:11:50, 15.27s/it] 4%|β–Ž | 20/538 [04:56<2:11:50, 15.27s/it] 4%|▍ | 21/538 [05:09<2:04:30, 14.45s/it] 4%|▍ | 22/538 [05:23<2:02:45, 14.27s/it] 4%|▍ | 23/538 [05:37<2:03:26, 14.38s/it] 4%|▍ | 24/538 [05:47<1:51:30, 13.02s/it] 5%|▍ | 25/538 [05:57<1:42:45, 12.02s/it] 5%|▍ | 25/538 [05:57<1:42:45, 12.02s/it] 5%|▍ | 26/538 [06:12<1:49:31, 12.83s/it] 5%|β–Œ | 27/538 [06:28<1:57:50, 13.84s/it] 5%|β–Œ | 28/538 [06:40<1:54:02, 13.42s/it] 5%|β–Œ | 29/538 [06:55<1:57:31, 13.85s/it] 6%|β–Œ | 30/538 [07:10<1:59:36, 14.13s/it] 6%|β–Œ | 30/538 [07:10<1:59:36, 14.13s/it] 6%|β–Œ | 31/538 [07:23<1:56:38, 13.80s/it] 6%|β–Œ | 32/538 [07:36<1:55:25, 13.69s/it] 6%|β–Œ | 33/538 [07:48<1:50:38, 13.14s/it] 6%|β–‹ | 34/538 [07:59<1:43:23, 12.31s/it] 7%|β–‹ | 35/538 [08:10<1:40:53, 12.04s/it] 7%|β–‹ | 35/538 [08:10<1:40:53, 12.04s/it] 7%|β–‹ | 36/538 [08:24<1:45:20, 12.59s/it] 7%|β–‹ | 37/538 [08:41<1:55:49, 13.87s/it] 7%|β–‹ | 38/538 [08:55<1:55:22, 13.84s/it] 7%|β–‹ | 39/538 [09:12<2:03:39, 14.87s/it] 7%|β–‹ | 40/538 [09:28<2:06:17, 15.22s/it] 7%|β–‹ | 40/538 [09:28<2:06:17, 15.22s/it] 8%|β–Š | 41/538 [09:43<2:06:27, 15.27s/it] 8%|β–Š | 42/538 [10:01<2:11:48, 15.95s/it] 8%|β–Š | 43/538 [10:16<2:09:55, 15.75s/it] 8%|β–Š | 44/538 [10:33<2:12:58, 16.15s/it] 8%|β–Š | 45/538 [10:49<2:10:54, 15.93s/it] 8%|β–Š | 45/538 [10:49<2:10:54, 15.93s/it] 9%|β–Š | 46/538 [11:04<2:10:40, 15.94s/it] 9%|β–Š | 47/538 [11:17<2:02:06, 14.92s/it] 9%|β–‰ | 48/538 [11:27<1:48:43, 13.31s/it] 9%|β–‰ | 49/538 [11:42<1:54:14, 14.02s/it] 9%|β–‰ | 50/538 [11:57<1:54:46, 14.11s/it] 9%|β–‰ | 50/538 [11:57<1:54:46, 14.11s/it]Unsloth: Will smartly offload gradients to save VRAM!
Unsloth: Double buffering enabled (parallel H2D + compute) for backward pass.
{'loss': 1.0965, 'grad_norm': 8.3795747756958, 'learning_rate': 2.962962962962963e-05, 'epoch': 0.01}
{'loss': 0.8571, 'grad_norm': 3.7024037837982178, 'learning_rate': 6.666666666666667e-05, 'epoch': 0.02}
{'loss': 0.629, 'grad_norm': 2.2940096855163574, 'learning_rate': 0.0001037037037037037, 'epoch': 0.03}
{'loss': 0.527, 'grad_norm': 2.2930526733398438, 'learning_rate': 0.00014074074074074076, 'epoch': 0.04}
{'loss': 0.5039, 'grad_norm': 4.794444561004639, 'learning_rate': 0.00017777777777777779, 'epoch': 0.05}
{'loss': 0.4196, 'grad_norm': 3.5820388793945312, 'learning_rate': 0.0001999924406845452, 'epoch': 0.06}
{'loss': 0.3942, 'grad_norm': 3.9649713039398193, 'learning_rate': 0.00019990741151022301, 'epoch': 0.07}
{'loss': 0.3424, 'grad_norm': 2.7851450443267822, 'learning_rate': 0.00019972798462510112, 'epoch': 0.07}
{'loss': 0.2828, 'grad_norm': 2.488961935043335, 'learning_rate': 0.0001994543295610186, 'epoch': 0.08}
{'loss': 0.2322, 'grad_norm': 6.255297660827637, 'learning_rate': 0.00019908670488149148, 'epoch': 0.09}
Filter: 0%| | 0/221 [00:00<?, ? examples/s]
Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 221/221 [00:00<00:00, 771.83 examples/s]Filter: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 221/221 [00:00<00:00, 765.61 examples/s]
0%| | 0/111 [00:00<?, ?it/s]
2%|▏ | 2/111 [00:00<00:42, 2.55it/s]
3%|β–Ž | 3/111 [00:01<01:03, 1.69it/s]
4%|β–Ž | 4/111 [00:02<01:10, 1.53it/s]
5%|▍ | 5/111 [00:03<01:32, 1.15it/s]
5%|β–Œ | 6/111 [00:04<01:40, 1.05it/s]
6%|β–‹ | 7/111 [00:06<01:57, 1.13s/it]
7%|β–‹ | 8/111 [00:07<02:03, 1.20s/it]
8%|β–Š | 9/111 [00:09<02:12, 1.30s/it]
9%|β–‰ | 10/111 [00:10<02:07, 1.26s/it]
10%|β–‰ | 11/111 [00:12<02:18, 1.39s/it]
11%|β–ˆ | 12/111 [00:13<02:25, 1.47s/it]
12%|β–ˆβ– | 13/111 [00:15<02:25, 1.48s/it]
13%|β–ˆβ–Ž | 14/111 [00:16<02:13, 1.38s/it]
14%|β–ˆβ–Ž | 15/111 [00:17<01:59, 1.25s/it]
14%|β–ˆβ– | 16/111 [00:18<01:44, 1.10s/it]
15%|β–ˆβ–Œ | 17/111 [00:19<01:54, 1.22s/it]
16%|β–ˆβ–Œ | 18/111 [00:21<02:07, 1.37s/it]
17%|β–ˆβ–‹ | 19/111 [00:23<02:22, 1.55s/it]
18%|β–ˆβ–Š | 20/111 [00:25<02:28, 1.63s/it]
19%|β–ˆβ–‰ | 21/111 [00:26<02:27, 1.63s/it]
20%|β–ˆβ–‰ | 22/111 [00:27<02:01, 1.37s/it]
21%|β–ˆβ–ˆ | 23/111 [00:28<02:04, 1.41s/it]
22%|β–ˆβ–ˆβ– | 24/111 [00:30<01:54, 1.32s/it]
23%|β–ˆβ–ˆβ–Ž | 25/111 [00:31<01:56, 1.35s/it]
23%|β–ˆβ–ˆβ–Ž | 26/111 [00:32<01:43, 1.21s/it]
24%|β–ˆβ–ˆβ– | 27/111 [00:34<01:54, 1.36s/it]
25%|β–ˆβ–ˆβ–Œ | 28/111 [00:35<01:56, 1.41s/it]
26%|β–ˆβ–ˆβ–Œ | 29/111 [00:37<02:06, 1.54s/it]
27%|β–ˆβ–ˆβ–‹ | 30/111 [00:38<01:56, 1.44s/it]
28%|β–ˆβ–ˆβ–Š | 31/111 [00:39<01:48, 1.35s/it]
29%|β–ˆβ–ˆβ–‰ | 32/111 [00:41<01:46, 1.35s/it]
30%|β–ˆβ–ˆβ–‰ | 33/111 [00:42<01:47, 1.38s/it]
31%|β–ˆβ–ˆβ–ˆ | 34/111 [00:43<01:45, 1.36s/it]
32%|β–ˆβ–ˆβ–ˆβ– | 35/111 [00:45<01:52, 1.48s/it]
32%|β–ˆβ–ˆβ–ˆβ– | 36/111 [00:47<02:05, 1.67s/it]
33%|β–ˆβ–ˆβ–ˆβ–Ž | 37/111 [00:49<02:14, 1.82s/it]
34%|β–ˆβ–ˆβ–ˆβ– | 38/111 [00:51<01:58, 1.63s/it]
35%|β–ˆβ–ˆβ–ˆβ–Œ | 39/111 [00:52<01:45, 1.46s/it]
36%|β–ˆβ–ˆβ–ˆβ–Œ | 40/111 [00:53<01:49, 1.54s/it]
37%|β–ˆβ–ˆβ–ˆβ–‹ | 41/111 [00:55<01:48, 1.55s/it]
38%|β–ˆβ–ˆβ–ˆβ–Š | 42/111 [00:56<01:41, 1.47s/it]
39%|β–ˆβ–ˆβ–ˆβ–Š | 43/111 [00:58<01:46, 1.57s/it]
40%|β–ˆβ–ˆβ–ˆβ–‰ | 44/111 [00:59<01:38, 1.48s/it]