moncefem's picture
Upload folder using huggingface_hub
9d14f55 verified
Raw History Blame Contribute Delete
149 kB
/home/shadeform/.local/lib/python3.10/site-packages/huggingface_hub/constants.py:298: FutureWarning: The `HF_HUB_ENABLE_HF_TRANSFER` environment variable is deprecated as 'hf_transfer' is not used anymore. Please use `HF_XET_HIGH_PERFORMANCE` instead to enable high performance transfer with Xet. Visit https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfxethighperformance for more details.
warnings.warn(
=== C2L TRAIN START model=google/gemma-4-E2B-it budget=3600s ===
loaded code2lora/code2lora-static/qna task=assert_static n=30000
loaded code2lora/code2lora-evo/qna task=assert_evo n=30000
loaded code2lora/code2lora-static-anchor/qna task=assert_anchor n=30000
loaded code2lora/code2lora-data-qa/qna task=repo_qa n=30000
JLOG {"event": "data_ready", "n": 139303, "mix": {"assert_kind": 5372, "repo_qa": 30000, "assert_static": 30000, "assert_anchor": 30000, "assert_evo": 30000, "evo_rewrite": 13931}, "secs": 16.1, "t": 1784993232.909}
Loading weights: 0%| | 0/1951 [00:00<?, ?it/s] Loading weights: 22%|β–ˆβ–ˆβ– | 421/1951 [00:00<00:00, 4208.00it/s] Loading weights: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 842/1951 [00:01<00:01, 623.63it/s] Loading weights: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1039/1951 [00:01<00:01, 710.23it/s] Loading weights: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 1196/1951 [00:01<00:01, 683.13it/s] Loading weights: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 1315/1951 [00:01<00:00, 687.78it/s] Loading weights: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 1811/1951 [00:01<00:00, 1315.02it/s] Loading weights: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1951/1951 [00:01<00:00, 1018.80it/s]
loaded via AutoModelForCausalLM (dtype): Gemma4ForConditionalGeneration
LoRA target modules: 50 (e.g. ['model.language_model.layers.0.self_attn.q_proj', 'model.language_model.layers.0.self_attn.v_proj'])
JLOG {"event": "model_ready", "trainable": 10715136, "total": 5115012640, "pct": 0.2095, "adapter_mb": 21.4, "t": 1784993240.736}
chat_template present: True
[transformers] warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
JLOG {"event": "hub_repo_ready", "repo": "moncefem/code2lora-gemma4-e2b", "t": 1784993241.201}
JLOG {"event": "train_begin", "budget_s": 3600, "t": 1784993241.499}
0%| | 0/290 [00:00<?, ?it/s] 0%| | 1/290 [00:11<55:25, 11.51s/it]JLOG {"event": "step", "step": 1, "elapsed": 11.8, "sps": 0.0847, "mem_gb": 26.08, "loss": 5.993380546569824, "grad_norm": 0.9926797151565552, "learning_rate": 0.0, "epoch": 0.000229713432492965, "t": 1784993253.006}
0%| | 1/290 [00:11<55:25, 11.51s/it] 1%| | 2/290 [00:20<48:53, 10.19s/it]{'loss': '5.993', 'grad_norm': '0.9927', 'learning_rate': '0', 'epoch': '0.0002297'}
JLOG {"event": "step", "step": 2, "elapsed": 21.1, "sps": 0.0949, "mem_gb": 26.17, "loss": 5.492838382720947, "grad_norm": 0.665519118309021, "learning_rate": 6.666666666666667e-06, "epoch": 0.00045942686498593, "t": 1784993262.27}
1%| | 2/290 [00:20<48:53, 10.19s/it] 1%| | 3/290 [00:29<44:54, 9.39s/it]{'loss': '5.493', 'grad_norm': '0.6655', 'learning_rate': '6.667e-06', 'epoch': '0.0004594'}
JLOG {"event": "step", "step": 3, "elapsed": 29.5, "sps": 0.1017, "mem_gb": 26.17, "loss": 6.706438064575195, "grad_norm": 1.0267648696899414, "learning_rate": 1.3333333333333333e-05, "epoch": 0.0006891402974788951, "t": 1784993270.711}
1%| | 3/290 [00:29<44:54, 9.39s/it] 1%|▏ | 4/290 [00:37<42:23, 8.89s/it]{'loss': '6.706', 'grad_norm': '1.027', 'learning_rate': '1.333e-05', 'epoch': '0.0006891'}
JLOG {"event": "step", "step": 4, "elapsed": 37.6, "sps": 0.1063, "mem_gb": 26.17, "loss": 5.261834144592285, "grad_norm": 0.7397580146789551, "learning_rate": 2e-05, "epoch": 0.00091885372997186, "t": 1784993278.843}
1%|▏ | 4/290 [00:37<42:23, 8.89s/it] 2%|▏ | 5/290 [00:47<44:22, 9.34s/it]{'loss': '5.262', 'grad_norm': '0.7398', 'learning_rate': '2e-05', 'epoch': '0.0009189'}
JLOG {"event": "step", "step": 5, "elapsed": 47.8, "sps": 0.1046, "mem_gb": 26.17, "loss": 6.221733093261719, "grad_norm": 0.9214587211608887, "learning_rate": 2.6666666666666667e-05, "epoch": 0.001148567162464825, "t": 1784993288.985}
2%|▏ | 5/290 [00:47<44:22, 9.34s/it] 2%|▏ | 6/290 [00:56<43:41, 9.23s/it]{'loss': '6.222', 'grad_norm': '0.9215', 'learning_rate': '2.667e-05', 'epoch': '0.001149'}
JLOG {"event": "step", "step": 6, "elapsed": 56.8, "sps": 0.1057, "mem_gb": 26.17, "loss": 6.310558319091797, "grad_norm": 0.8834616541862488, "learning_rate": 3.3333333333333335e-05, "epoch": 0.0013782805949577902, "t": 1784993297.992}
2%|▏ | 6/290 [00:56<43:41, 9.23s/it] 2%|▏ | 7/290 [01:04<41:14, 8.74s/it]{'loss': '6.311', 'grad_norm': '0.8835', 'learning_rate': '3.333e-05', 'epoch': '0.001378'}
JLOG {"event": "step", "step": 7, "elapsed": 64.5, "sps": 0.1085, "mem_gb": 26.17, "loss": 6.46868896484375, "grad_norm": 1.1920403242111206, "learning_rate": 4e-05, "epoch": 0.0016079940274507552, "t": 1784993305.738}
2%|▏ | 7/290 [01:04<41:14, 8.74s/it] 3%|β–Ž | 8/290 [01:13<41:37, 8.86s/it]{'loss': '6.469', 'grad_norm': '1.192', 'learning_rate': '4e-05', 'epoch': '0.001608'}
JLOG {"event": "step", "step": 8, "elapsed": 73.6, "sps": 0.1086, "mem_gb": 26.17, "loss": 5.862053871154785, "grad_norm": 0.9631143808364868, "learning_rate": 4.666666666666667e-05, "epoch": 0.00183770745994372, "t": 1784993314.834}
3%|β–Ž | 8/290 [01:13<41:37, 8.86s/it] 3%|β–Ž | 9/290 [01:22<42:25, 9.06s/it]{'loss': '5.862', 'grad_norm': '0.9631', 'learning_rate': '4.667e-05', 'epoch': '0.001838'}
JLOG {"event": "step", "step": 9, "elapsed": 83.1, "sps": 0.1083, "mem_gb": 26.17, "loss": 6.09963321685791, "grad_norm": 0.99253910779953, "learning_rate": 5.333333333333333e-05, "epoch": 0.0020674208924366853, "t": 1784993324.337}
3%|β–Ž | 9/290 [01:22<42:25, 9.06s/it] 3%|β–Ž | 10/290 [01:35<47:43, 10.23s/it]{'loss': '6.1', 'grad_norm': '0.9925', 'learning_rate': '5.333e-05', 'epoch': '0.002067'}
JLOG {"event": "step", "step": 10, "elapsed": 96.0, "sps": 0.1042, "mem_gb": 26.17, "loss": 5.320429801940918, "grad_norm": 0.8402082920074463, "learning_rate": 6e-05, "epoch": 0.00229713432492965, "t": 1784993337.185}
3%|β–Ž | 10/290 [01:35<47:43, 10.23s/it] 4%|▍ | 11/290 [01:44<46:03, 9.91s/it]{'loss': '5.32', 'grad_norm': '0.8402', 'learning_rate': '6e-05', 'epoch': '0.002297'}
JLOG {"event": "step", "step": 11, "elapsed": 105.2, "sps": 0.1046, "mem_gb": 26.17, "loss": 5.620062351226807, "grad_norm": 1.0864628553390503, "learning_rate": 6.666666666666667e-05, "epoch": 0.002526847757422615, "t": 1784993346.358}
4%|▍ | 11/290 [01:44<46:03, 9.91s/it] 4%|▍ | 12/290 [01:55<47:34, 10.27s/it]{'loss': '5.62', 'grad_norm': '1.086', 'learning_rate': '6.667e-05', 'epoch': '0.002527'}
JLOG {"event": "step", "step": 12, "elapsed": 116.3, "sps": 0.1032, "mem_gb": 26.17, "loss": 5.375014305114746, "grad_norm": 0.9348894357681274, "learning_rate": 7.333333333333333e-05, "epoch": 0.0027565611899155805, "t": 1784993357.452}
4%|▍ | 12/290 [01:55<47:34, 10.27s/it] 4%|▍ | 13/290 [02:04<44:29, 9.64s/it]{'loss': '5.375', 'grad_norm': '0.9349', 'learning_rate': '7.333e-05', 'epoch': '0.002757'}
JLOG {"event": "step", "step": 13, "elapsed": 124.4, "sps": 0.1045, "mem_gb": 26.17, "loss": 5.781207084655762, "grad_norm": 0.9996261596679688, "learning_rate": 8e-05, "epoch": 0.0029862746224085454, "t": 1784993365.642}
4%|▍ | 13/290 [02:04<44:29, 9.64s/it] 5%|▍ | 14/290 [02:13<43:49, 9.53s/it]{'loss': '5.781', 'grad_norm': '0.9996', 'learning_rate': '8e-05', 'epoch': '0.002986'}
JLOG {"event": "step", "step": 14, "elapsed": 133.7, "sps": 0.1047, "mem_gb": 26.17, "loss": 5.504294395446777, "grad_norm": 1.0221940279006958, "learning_rate": 8.666666666666667e-05, "epoch": 0.0032159880549015103, "t": 1784993374.914}
5%|▍ | 14/290 [02:13<43:49, 9.53s/it] 5%|β–Œ | 15/290 [02:25<47:26, 10.35s/it]{'loss': '5.504', 'grad_norm': '1.022', 'learning_rate': '8.667e-05', 'epoch': '0.003216'}
JLOG {"event": "step", "step": 15, "elapsed": 146.0, "sps": 0.1028, "mem_gb": 26.17, "loss": 6.115777492523193, "grad_norm": 1.196154236793518, "learning_rate": 9.333333333333334e-05, "epoch": 0.0034457014873944753, "t": 1784993387.173}
5%|β–Œ | 15/290 [02:25<47:26, 10.35s/it] 6%|β–Œ | 16/290 [02:35<46:59, 10.29s/it]{'loss': '6.116', 'grad_norm': '1.196', 'learning_rate': '9.333e-05', 'epoch': '0.003446'}
JLOG {"event": "step", "step": 16, "elapsed": 156.1, "sps": 0.1025, "mem_gb": 26.17, "loss": 4.90305757522583, "grad_norm": 0.9174175262451172, "learning_rate": 0.0001, "epoch": 0.00367541491988744, "t": 1784993397.321}
6%|β–Œ | 16/290 [02:35<46:59, 10.29s/it] 6%|β–Œ | 17/290 [02:43<43:16, 9.51s/it]{'loss': '4.903', 'grad_norm': '0.9174', 'learning_rate': '0.0001', 'epoch': '0.003675'}
JLOG {"event": "step", "step": 17, "elapsed": 163.8, "sps": 0.1038, "mem_gb": 26.17, "loss": 5.795445442199707, "grad_norm": 1.32787024974823, "learning_rate": 9.999673735634258e-05, "epoch": 0.0039051283523804056, "t": 1784993405.024}
6%|β–Œ | 17/290 [02:43<43:16, 9.51s/it] 6%|β–Œ | 18/290 [02:51<41:01, 9.05s/it]{'loss': '5.795', 'grad_norm': '1.328', 'learning_rate': '0.0001', 'epoch': '0.003905'}
JLOG {"event": "step", "step": 18, "elapsed": 171.8, "sps": 0.1048, "mem_gb": 26.17, "loss": 5.137340068817139, "grad_norm": 1.1469932794570923, "learning_rate": 9.998694985116405e-05, "epoch": 0.0041348417848733705, "t": 1784993412.994}
6%|β–Œ | 18/290 [02:51<41:01, 9.05s/it] 7%|β–‹ | 19/290 [03:01<42:38, 9.44s/it]{'loss': '5.137', 'grad_norm': '1.147', 'learning_rate': '9.999e-05', 'epoch': '0.004135'}
JLOG {"event": "step", "step": 19, "elapsed": 182.1, "sps": 0.1043, "mem_gb": 26.17, "loss": 5.248072624206543, "grad_norm": 1.0923027992248535, "learning_rate": 9.997063876179006e-05, "epoch": 0.004364555217366336, "t": 1784993423.349}
7%|β–‹ | 19/290 [03:01<42:38, 9.44s/it] 7%|β–‹ | 20/290 [03:11<43:15, 9.61s/it]{'loss': '5.248', 'grad_norm': '1.092', 'learning_rate': '9.997e-05', 'epoch': '0.004365'}
JLOG {"event": "step", "step": 20, "elapsed": 192.2, "sps": 0.1041, "mem_gb": 26.17, "loss": 5.359640598297119, "grad_norm": 1.4957276582717896, "learning_rate": 9.994780621691156e-05, "epoch": 0.0045942686498593, "t": 1784993433.363}
7%|β–‹ | 20/290 [03:11<43:15, 9.61s/it] 7%|β–‹ | 21/290 [03:24<46:52, 10.46s/it]{'loss': '5.36', 'grad_norm': '1.496', 'learning_rate': '9.995e-05', 'epoch': '0.004594'}
JLOG {"event": "step", "step": 21, "elapsed": 204.6, "sps": 0.1026, "mem_gb": 26.17, "loss": 4.798715591430664, "grad_norm": 1.7322056293487549, "learning_rate": 9.991845519630678e-05, "epoch": 0.004823982082352266, "t": 1784993445.787}
7%|β–‹ | 21/290 [03:24<46:52, 10.46s/it] 8%|β–Š | 22/290 [03:33<45:30, 10.19s/it]{'loss': '4.799', 'grad_norm': '1.732', 'learning_rate': '9.992e-05', 'epoch': '0.004824'}
JLOG {"event": "step", "step": 22, "elapsed": 214.1, "sps": 0.1027, "mem_gb": 26.17, "loss": 5.217386245727539, "grad_norm": 1.7635564804077148, "learning_rate": 9.988258953045264e-05, "epoch": 0.00505369551484523, "t": 1784993455.349}
8%|β–Š | 22/290 [03:33<45:30, 10.19s/it] 8%|β–Š | 23/290 [03:45<46:58, 10.56s/it]{'loss': '5.217', 'grad_norm': '1.764', 'learning_rate': '9.988e-05', 'epoch': '0.005054'}
JLOG {"event": "step", "step": 23, "elapsed": 225.6, "sps": 0.102, "mem_gb": 26.17, "loss": 4.562600135803223, "grad_norm": 1.4423373937606812, "learning_rate": 9.984021390002458e-05, "epoch": 0.005283408947338196, "t": 1784993466.769}
8%|β–Š | 23/290 [03:45<46:58, 10.56s/it] 8%|β–Š | 24/290 [03:54<44:59, 10.15s/it]{'loss': '4.563', 'grad_norm': '1.442', 'learning_rate': '9.984e-05', 'epoch': '0.005283'}
JLOG {"event": "step", "step": 24, "elapsed": 234.8, "sps": 0.1022, "mem_gb": 26.17, "loss": 4.230113983154297, "grad_norm": 1.3376160860061646, "learning_rate": 9.97913338352859e-05, "epoch": 0.005513122379831161, "t": 1784993475.957}
8%|β–Š | 24/290 [03:54<44:59, 10.15s/it]{'loss': '4.23', 'grad_norm': '1.338', 'learning_rate': '9.979e-05', 'epoch': '0.005513'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000025", "t": 1784993484.904}
9%|β–Š | 25/290 [04:03<43:13, 9.79s/it]JLOG {"event": "step", "step": 25, "elapsed": 243.7, "sps": 0.1026, "mem_gb": 26.17, "loss": 4.35717248916626, "grad_norm": 1.6017682552337646, "learning_rate": 9.973595571536593e-05, "epoch": 0.0057428358123241255, "t": 1784993484.907}
9%|β–Š | 25/290 [04:03<43:13, 9.79s/it] 9%|β–‰ | 26/290 [04:13<43:19, 9.85s/it]{'loss': '4.357', 'grad_norm': '1.602', 'learning_rate': '9.974e-05', 'epoch': '0.005743'}
JLOG {"event": "step", "step": 26, "elapsed": 253.7, "sps": 0.1025, "mem_gb": 26.17, "loss": 4.006037712097168, "grad_norm": 1.4844201803207397, "learning_rate": 9.967408676742751e-05, "epoch": 0.005972549244817091, "t": 1784993494.889}
9%|β–‰ | 26/290 [04:13<43:19, 9.85s/it] 9%|β–‰ | 27/290 [04:24<44:44, 10.21s/it]{'loss': '4.006', 'grad_norm': '1.484', 'learning_rate': '9.967e-05', 'epoch': '0.005973'}
JLOG {"event": "step", "step": 27, "elapsed": 264.7, "sps": 0.102, "mem_gb": 26.17, "loss": 4.314523696899414, "grad_norm": 2.062734603881836, "learning_rate": 9.96057350657239e-05, "epoch": 0.006202262677310055, "t": 1784993505.945}
9%|β–‰ | 27/290 [04:24<44:44, 10.21s/it] 10%|β–‰ | 28/290 [04:35<46:06, 10.56s/it]{'loss': '4.315', 'grad_norm': '2.063', 'learning_rate': '9.961e-05', 'epoch': '0.006202'}
JLOG {"event": "step", "step": 28, "elapsed": 276.1, "sps": 0.1014, "mem_gb": 26.17, "loss": 4.216145038604736, "grad_norm": 1.6906051635742188, "learning_rate": 9.953090953054492e-05, "epoch": 0.006431976109803021, "t": 1784993517.317}
10%|β–‰ | 28/290 [04:35<46:06, 10.56s/it] 10%|β–ˆ | 29/290 [04:45<45:12, 10.39s/it]{'loss': '4.216', 'grad_norm': '1.691', 'learning_rate': '9.953e-05', 'epoch': '0.006432'}
JLOG {"event": "step", "step": 29, "elapsed": 286.1, "sps": 0.1014, "mem_gb": 26.17, "loss": 3.991880178451538, "grad_norm": 2.0627644062042236, "learning_rate": 9.944961992705288e-05, "epoch": 0.006661689542295986, "t": 1784993527.322}
10%|β–ˆ | 29/290 [04:45<45:12, 10.39s/it] 10%|β–ˆ | 30/290 [04:55<43:34, 10.06s/it]{'loss': '3.992', 'grad_norm': '2.063', 'learning_rate': '9.945e-05', 'epoch': '0.006662'}
JLOG {"event": "step", "step": 30, "elapsed": 295.4, "sps": 0.1016, "mem_gb": 26.17, "loss": 4.051728248596191, "grad_norm": 1.9646720886230469, "learning_rate": 9.936187686400815e-05, "epoch": 0.0068914029747889505, "t": 1784993536.591}
10%|β–ˆ | 30/290 [04:55<43:34, 10.06s/it] 11%|β–ˆ | 31/290 [05:06<45:40, 10.58s/it]{'loss': '4.052', 'grad_norm': '1.965', 'learning_rate': '9.936e-05', 'epoch': '0.006891'}
JLOG {"event": "step", "step": 31, "elapsed": 307.2, "sps": 0.1009, "mem_gb": 26.17, "loss": 3.8988747596740723, "grad_norm": 2.337831974029541, "learning_rate": 9.926769179238466e-05, "epoch": 0.007121116407281916, "t": 1784993548.398}
11%|β–ˆ | 31/290 [05:06<45:40, 10.58s/it] 11%|β–ˆ | 32/290 [05:14<41:36, 9.67s/it]{'loss': '3.899', 'grad_norm': '2.338', 'learning_rate': '9.927e-05', 'epoch': '0.007121'}
JLOG {"event": "step", "step": 32, "elapsed": 314.8, "sps": 0.1017, "mem_gb": 26.17, "loss": 3.915154457092285, "grad_norm": 2.1376049518585205, "learning_rate": 9.916707700387547e-05, "epoch": 0.00735082983977488, "t": 1784993555.959}
11%|β–ˆ | 32/290 [05:14<41:36, 9.67s/it] 11%|β–ˆβ– | 33/290 [05:24<41:24, 9.67s/it]{'loss': '3.915', 'grad_norm': '2.138', 'learning_rate': '9.917e-05', 'epoch': '0.007351'}
JLOG {"event": "step", "step": 33, "elapsed": 324.4, "sps": 0.1017, "mem_gb": 26.17, "loss": 3.2003612518310547, "grad_norm": 2.5176711082458496, "learning_rate": 9.906004562928864e-05, "epoch": 0.007580543272267846, "t": 1784993565.61}
11%|β–ˆβ– | 33/290 [05:24<41:24, 9.67s/it] 12%|β–ˆβ– | 34/290 [05:35<43:47, 10.26s/it]{'loss': '3.2', 'grad_norm': '2.518', 'learning_rate': '9.906e-05', 'epoch': '0.007581'}
JLOG {"event": "step", "step": 34, "elapsed": 336.1, "sps": 0.1012, "mem_gb": 26.17, "loss": 3.3633861541748047, "grad_norm": 2.2134947776794434, "learning_rate": 9.894661163683361e-05, "epoch": 0.007810256704760811, "t": 1784993577.265}
12%|β–ˆβ– | 34/290 [05:35<43:47, 10.26s/it] 12%|β–ˆβ– | 35/290 [05:47<45:11, 10.63s/it]{'loss': '3.363', 'grad_norm': '2.213', 'learning_rate': '9.895e-05', 'epoch': '0.00781'}
JLOG {"event": "step", "step": 35, "elapsed": 347.6, "sps": 0.1007, "mem_gb": 26.17, "loss": 3.393319606781006, "grad_norm": 2.6457228660583496, "learning_rate": 9.882678983029819e-05, "epoch": 0.008039970137253777, "t": 1784993588.765}
12%|β–ˆβ– | 35/290 [05:47<45:11, 10.63s/it] 12%|β–ˆβ– | 36/290 [05:55<41:58, 9.91s/it]{'loss': '3.393', 'grad_norm': '2.646', 'learning_rate': '9.883e-05', 'epoch': '0.00804'}
JLOG {"event": "step", "step": 36, "elapsed": 355.8, "sps": 0.1012, "mem_gb": 26.17, "loss": 2.8769519329071045, "grad_norm": 1.774087905883789, "learning_rate": 9.870059584711668e-05, "epoch": 0.008269683569746741, "t": 1784993596.997}
12%|β–ˆβ– | 36/290 [05:55<41:58, 9.91s/it] 13%|β–ˆβ–Ž | 37/290 [06:06<42:33, 10.09s/it]{'loss': '2.877', 'grad_norm': '1.774', 'learning_rate': '9.87e-05', 'epoch': '0.00827'}
JLOG {"event": "step", "step": 37, "elapsed": 366.3, "sps": 0.101, "mem_gb": 26.17, "loss": 3.1676571369171143, "grad_norm": 1.7021818161010742, "learning_rate": 9.856804615632903e-05, "epoch": 0.008499397002239705, "t": 1784993607.508}
13%|β–ˆβ–Ž | 37/290 [06:06<42:33, 10.09s/it] 13%|β–ˆβ–Ž | 38/290 [06:16<42:41, 10.16s/it]{'loss': '3.168', 'grad_norm': '1.702', 'learning_rate': '9.857e-05', 'epoch': '0.008499'}
JLOG {"event": "step", "step": 38, "elapsed": 376.6, "sps": 0.1009, "mem_gb": 26.17, "loss": 2.917896032333374, "grad_norm": 1.6699331998825073, "learning_rate": 9.842915805643155e-05, "epoch": 0.008729110434732672, "t": 1784993617.836}
13%|β–ˆβ–Ž | 38/290 [06:16<42:41, 10.16s/it] 13%|β–ˆβ–Ž | 39/290 [06:26<42:22, 10.13s/it]{'loss': '2.918', 'grad_norm': '1.67', 'learning_rate': '9.843e-05', 'epoch': '0.008729'}
JLOG {"event": "step", "step": 39, "elapsed": 386.7, "sps": 0.1009, "mem_gb": 26.17, "loss": 2.9138448238372803, "grad_norm": 1.5729448795318604, "learning_rate": 9.828394967311941e-05, "epoch": 0.008958823867225636, "t": 1784993627.888}
13%|β–ˆβ–Ž | 39/290 [06:26<42:22, 10.13s/it] 14%|β–ˆβ– | 40/290 [06:37<43:16, 10.39s/it]{'loss': '2.914', 'grad_norm': '1.573', 'learning_rate': '9.828e-05', 'epoch': '0.008959'}
JLOG {"event": "step", "step": 40, "elapsed": 397.7, "sps": 0.1006, "mem_gb": 26.17, "loss": 2.8370792865753174, "grad_norm": 1.4089559316635132, "learning_rate": 9.813243995692098e-05, "epoch": 0.0091885372997186, "t": 1784993638.877}
14%|β–ˆβ– | 40/290 [06:37<43:16, 10.39s/it] 14%|β–ˆβ– | 41/290 [06:49<44:45, 10.79s/it]{'loss': '2.837', 'grad_norm': '1.409', 'learning_rate': '9.813e-05', 'epoch': '0.009189'}
JLOG {"event": "step", "step": 41, "elapsed": 409.4, "sps": 0.1001, "mem_gb": 26.17, "loss": 2.549246311187744, "grad_norm": 1.1834571361541748, "learning_rate": 9.797464868072488e-05, "epoch": 0.009418250732211565, "t": 1784993650.591}
14%|β–ˆβ– | 41/290 [06:49<44:45, 10.79s/it] 14%|β–ˆβ– | 42/290 [06:59<44:24, 10.74s/it]{'loss': '2.549', 'grad_norm': '1.183', 'learning_rate': '9.797e-05', 'epoch': '0.009418'}
JLOG {"event": "step", "step": 42, "elapsed": 420.0, "sps": 0.1, "mem_gb": 26.17, "loss": 2.6678245067596436, "grad_norm": 1.1696703433990479, "learning_rate": 9.781059643719937e-05, "epoch": 0.009647964164704531, "t": 1784993661.232}
14%|β–ˆβ– | 42/290 [06:59<44:24, 10.74s/it] 15%|β–ˆβ– | 43/290 [07:08<41:29, 10.08s/it]{'loss': '2.668', 'grad_norm': '1.17', 'learning_rate': '9.781e-05', 'epoch': '0.009648'}
JLOG {"event": "step", "step": 43, "elapsed": 428.6, "sps": 0.1003, "mem_gb": 26.17, "loss": 2.5120089054107666, "grad_norm": 1.355086326599121, "learning_rate": 9.76403046361049e-05, "epoch": 0.009877677597197496, "t": 1784993669.767}
15%|β–ˆβ– | 43/290 [07:08<41:29, 10.08s/it] 15%|β–ˆβ–Œ | 44/290 [07:20<43:43, 10.66s/it]{'loss': '2.512', 'grad_norm': '1.355', 'learning_rate': '9.764e-05', 'epoch': '0.009878'}
JLOG {"event": "step", "step": 44, "elapsed": 440.6, "sps": 0.0999, "mem_gb": 26.17, "loss": 2.4565184116363525, "grad_norm": 1.2713875770568848, "learning_rate": 9.746379550150009e-05, "epoch": 0.01010739102969046, "t": 1784993681.789}
15%|β–ˆβ–Œ | 44/290 [07:20<43:43, 10.66s/it] 16%|β–ˆβ–Œ | 45/290 [07:31<44:32, 10.91s/it]{'loss': '2.457', 'grad_norm': '1.271', 'learning_rate': '9.746e-05', 'epoch': '0.01011'}
JLOG {"event": "step", "step": 45, "elapsed": 452.1, "sps": 0.0995, "mem_gb": 26.17, "loss": 2.316253900527954, "grad_norm": 1.0613739490509033, "learning_rate": 9.728109206884124e-05, "epoch": 0.010337104462183427, "t": 1784993693.269}
16%|β–ˆβ–Œ | 45/290 [07:31<44:32, 10.91s/it] 16%|β–ˆβ–Œ | 46/290 [07:41<42:46, 10.52s/it]{'loss': '2.316', 'grad_norm': '1.061', 'learning_rate': '9.728e-05', 'epoch': '0.01034'}
JLOG {"event": "step", "step": 46, "elapsed": 461.7, "sps": 0.0996, "mem_gb": 26.17, "loss": 2.4832231998443604, "grad_norm": 1.054056167602539, "learning_rate": 9.709221818197624e-05, "epoch": 0.010566817894676391, "t": 1784993702.877}
16%|β–ˆβ–Œ | 46/290 [07:41<42:46, 10.52s/it] 16%|β–ˆβ–Œ | 47/290 [07:50<41:23, 10.22s/it]{'loss': '2.483', 'grad_norm': '1.054', 'learning_rate': '9.709e-05', 'epoch': '0.01057'}
JLOG {"event": "step", "step": 47, "elapsed": 471.2, "sps": 0.0997, "mem_gb": 26.17, "loss": 2.524838924407959, "grad_norm": 1.1814799308776855, "learning_rate": 9.68971984900326e-05, "epoch": 0.010796531327169356, "t": 1784993712.408}
16%|β–ˆβ–Œ | 47/290 [07:50<41:23, 10.22s/it] 17%|β–ˆβ–‹ | 48/290 [07:59<39:00, 9.67s/it]{'loss': '2.525', 'grad_norm': '1.181', 'learning_rate': '9.69e-05', 'epoch': '0.0108'}
JLOG {"event": "step", "step": 48, "elapsed": 479.6, "sps": 0.1001, "mem_gb": 26.17, "loss": 2.266385078430176, "grad_norm": 1.315382480621338, "learning_rate": 9.669605844420078e-05, "epoch": 0.011026244759662322, "t": 1784993720.797}
17%|β–ˆβ–‹ | 48/290 [07:59<39:00, 9.67s/it] 17%|β–ˆβ–‹ | 49/290 [08:09<38:59, 9.71s/it]{'loss': '2.266', 'grad_norm': '1.315', 'learning_rate': '9.67e-05', 'epoch': '0.01103'}
JLOG {"event": "step", "step": 49, "elapsed": 489.4, "sps": 0.1001, "mem_gb": 26.17, "loss": 2.2408692836761475, "grad_norm": 1.0660370588302612, "learning_rate": 9.648882429441257e-05, "epoch": 0.011255958192155286, "t": 1784993730.583}
17%|β–ˆβ–‹ | 49/290 [08:09<38:59, 9.71s/it]{'loss': '2.241', 'grad_norm': '1.066', 'learning_rate': '9.649e-05', 'epoch': '0.01126'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000050", "t": 1784993741.173}
17%|β–ˆβ–‹ | 50/290 [08:19<39:53, 9.97s/it]JLOG {"event": "step", "step": 50, "elapsed": 500.0, "sps": 0.1, "mem_gb": 26.17, "loss": 2.354520797729492, "grad_norm": 1.3276619911193848, "learning_rate": 9.627552308591534e-05, "epoch": 0.011485671624648251, "t": 1784993741.175}
17%|β–ˆβ–‹ | 50/290 [08:19<39:53, 9.97s/it] 18%|β–ˆβ–Š | 51/290 [08:30<41:16, 10.36s/it]{'loss': '2.355', 'grad_norm': '1.328', 'learning_rate': '9.628e-05', 'epoch': '0.01149'}
JLOG {"event": "step", "step": 51, "elapsed": 511.2, "sps": 0.0998, "mem_gb": 26.17, "loss": 2.157050132751465, "grad_norm": 0.9648324251174927, "learning_rate": 9.60561826557425e-05, "epoch": 0.011715385057141217, "t": 1784993752.44}
18%|β–ˆβ–Š | 51/290 [08:30<41:16, 10.36s/it] 18%|β–ˆβ–Š | 52/290 [08:42<41:59, 10.59s/it]{'loss': '2.157', 'grad_norm': '0.9648', 'learning_rate': '9.606e-05', 'epoch': '0.01172'}
JLOG {"event": "step", "step": 52, "elapsed": 522.4, "sps": 0.0995, "mem_gb": 26.17, "loss": 2.16951584815979, "grad_norm": 1.0201544761657715, "learning_rate": 9.583083162908059e-05, "epoch": 0.011945098489634182, "t": 1784993763.56}
18%|β–ˆβ–Š | 52/290 [08:42<41:59, 10.59s/it] 18%|β–ˆβ–Š | 53/290 [08:51<40:13, 10.18s/it]{'loss': '2.17', 'grad_norm': '1.02', 'learning_rate': '9.583e-05', 'epoch': '0.01195'}
JLOG {"event": "step", "step": 53, "elapsed": 531.6, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.7571698427200317, "grad_norm": 0.8163918256759644, "learning_rate": 9.55994994155335e-05, "epoch": 0.012174811922127146, "t": 1784993772.797}
18%|β–ˆβ–Š | 53/290 [08:51<40:13, 10.18s/it] 19%|β–ˆβ–Š | 54/290 [09:03<42:16, 10.75s/it]{'loss': '1.757', 'grad_norm': '0.8164', 'learning_rate': '9.56e-05', 'epoch': '0.01217'}
JLOG {"event": "step", "step": 54, "elapsed": 543.7, "sps": 0.0993, "mem_gb": 26.17, "loss": 1.678658366203308, "grad_norm": 1.0094020366668701, "learning_rate": 9.536221620528442e-05, "epoch": 0.01240452535462011, "t": 1784993784.861}
19%|β–ˆβ–Š | 54/290 [09:03<42:16, 10.75s/it] 19%|β–ˆβ–‰ | 55/290 [09:14<42:29, 10.85s/it]{'loss': '1.679', 'grad_norm': '1.009', 'learning_rate': '9.536e-05', 'epoch': '0.0124'}
JLOG {"event": "step", "step": 55, "elapsed": 554.7, "sps": 0.0991, "mem_gb": 26.17, "loss": 2.197350025177002, "grad_norm": 1.3761115074157715, "learning_rate": 9.511901296515577e-05, "epoch": 0.012634238787113077, "t": 1784993795.952}
19%|β–ˆβ–‰ | 55/290 [09:14<42:29, 10.85s/it] 19%|β–ˆβ–‰ | 56/290 [09:23<40:43, 10.44s/it]{'loss': '2.197', 'grad_norm': '1.376', 'learning_rate': '9.512e-05', 'epoch': '0.01263'}
JLOG {"event": "step", "step": 56, "elapsed": 564.2, "sps": 0.0992, "mem_gb": 26.17, "loss": 2.206965208053589, "grad_norm": 0.837571918964386, "learning_rate": 9.486992143456792e-05, "epoch": 0.012863952219606041, "t": 1784993805.447}
19%|β–ˆβ–‰ | 56/290 [09:23<40:43, 10.44s/it] 20%|β–ˆβ–‰ | 57/290 [09:34<40:10, 10.35s/it]{'loss': '2.207', 'grad_norm': '0.8376', 'learning_rate': '9.487e-05', 'epoch': '0.01286'}
JLOG {"event": "step", "step": 57, "elapsed": 574.4, "sps": 0.0992, "mem_gb": 26.17, "loss": 1.7043726444244385, "grad_norm": 1.1346135139465332, "learning_rate": 9.461497412139698e-05, "epoch": 0.013093665652099006, "t": 1784993815.563}
20%|β–ˆβ–‰ | 57/290 [09:34<40:10, 10.35s/it] 20%|β–ˆβ–ˆ | 58/290 [09:41<37:00, 9.57s/it]{'loss': '1.704', 'grad_norm': '1.135', 'learning_rate': '9.461e-05', 'epoch': '0.01309'}
JLOG {"event": "step", "step": 58, "elapsed": 582.1, "sps": 0.0996, "mem_gb": 26.17, "loss": 2.132337808609009, "grad_norm": 0.7857182621955872, "learning_rate": 9.435420429773228e-05, "epoch": 0.013323379084591972, "t": 1784993823.322}
20%|β–ˆβ–ˆ | 58/290 [09:41<37:00, 9.57s/it] 20%|β–ˆβ–ˆ | 59/290 [09:51<36:53, 9.58s/it]{'loss': '2.132', 'grad_norm': '0.7857', 'learning_rate': '9.435e-05', 'epoch': '0.01332'}
JLOG {"event": "step", "step": 59, "elapsed": 591.7, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.8793846368789673, "grad_norm": 0.8235462307929993, "learning_rate": 9.40876459955343e-05, "epoch": 0.013553092517084937, "t": 1784993832.929}
20%|β–ˆβ–ˆ | 59/290 [09:51<36:53, 9.58s/it] 21%|β–ˆβ–ˆ | 60/290 [10:02<38:13, 9.97s/it]{'loss': '1.879', 'grad_norm': '0.8235', 'learning_rate': '9.409e-05', 'epoch': '0.01355'}
JLOG {"event": "step", "step": 60, "elapsed": 602.6, "sps": 0.0996, "mem_gb": 26.17, "loss": 2.0895566940307617, "grad_norm": 0.9911778569221497, "learning_rate": 9.381533400219318e-05, "epoch": 0.013782805949577901, "t": 1784993843.82}
21%|β–ˆβ–ˆ | 60/290 [10:02<38:13, 9.97s/it] 21%|β–ˆβ–ˆ | 61/290 [10:12<38:40, 10.13s/it]{'loss': '2.09', 'grad_norm': '0.9912', 'learning_rate': '9.382e-05', 'epoch': '0.01378'}
JLOG {"event": "step", "step": 61, "elapsed": 613.1, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.798683762550354, "grad_norm": 0.8372321128845215, "learning_rate": 9.353730385598887e-05, "epoch": 0.014012519382070867, "t": 1784993854.33}
21%|β–ˆβ–ˆ | 61/290 [10:12<38:40, 10.13s/it] 21%|β–ˆβ–ˆβ– | 62/290 [10:24<40:36, 10.68s/it]{'loss': '1.799', 'grad_norm': '0.8372', 'learning_rate': '9.354e-05', 'epoch': '0.01401'}
JLOG {"event": "step", "step": 62, "elapsed": 625.1, "sps": 0.0992, "mem_gb": 26.17, "loss": 1.7573126554489136, "grad_norm": 0.8599002361297607, "learning_rate": 9.325359184145305e-05, "epoch": 0.014242232814563832, "t": 1784993866.298}
21%|β–ˆβ–ˆβ– | 62/290 [10:24<40:36, 10.68s/it] 22%|β–ˆβ–ˆβ– | 63/290 [10:35<40:00, 10.58s/it]{'loss': '1.757', 'grad_norm': '0.8599', 'learning_rate': '9.325e-05', 'epoch': '0.01424'}
JLOG {"event": "step", "step": 63, "elapsed": 635.4, "sps": 0.0991, "mem_gb": 26.17, "loss": 1.937083125114441, "grad_norm": 1.1690943241119385, "learning_rate": 9.296423498463396e-05, "epoch": 0.014471946247056796, "t": 1784993876.622}
22%|β–ˆβ–ˆβ– | 63/290 [10:35<40:00, 10.58s/it] 22%|β–ˆβ–ˆβ– | 64/290 [10:43<37:52, 10.05s/it]{'loss': '1.937', 'grad_norm': '1.169', 'learning_rate': '9.296e-05', 'epoch': '0.01447'}
JLOG {"event": "step", "step": 64, "elapsed": 644.3, "sps": 0.0993, "mem_gb": 26.17, "loss": 1.6590425968170166, "grad_norm": 0.8393282890319824, "learning_rate": 9.266927104826409e-05, "epoch": 0.01470165967954976, "t": 1784993885.457}
22%|β–ˆβ–ˆβ– | 64/290 [10:43<37:52, 10.05s/it] 22%|β–ˆβ–ˆβ– | 65/290 [10:55<38:56, 10.39s/it]{'loss': '1.659', 'grad_norm': '0.8393', 'learning_rate': '9.267e-05', 'epoch': '0.0147'}
JLOG {"event": "step", "step": 65, "elapsed": 655.4, "sps": 0.0992, "mem_gb": 26.17, "loss": 1.5255495309829712, "grad_norm": 1.2033129930496216, "learning_rate": 9.236873852683213e-05, "epoch": 0.014931373112042727, "t": 1784993896.617}
22%|β–ˆβ–ˆβ– | 65/290 [10:55<38:56, 10.39s/it] 23%|β–ˆβ–ˆβ–Ž | 66/290 [11:06<40:12, 10.77s/it]{'loss': '1.526', 'grad_norm': '1.203', 'learning_rate': '9.237e-05', 'epoch': '0.01493'}
JLOG {"event": "step", "step": 66, "elapsed": 667.1, "sps": 0.0989, "mem_gb": 26.17, "loss": 1.745307207107544, "grad_norm": 0.9348877668380737, "learning_rate": 9.206267664155907e-05, "epoch": 0.015161086544535692, "t": 1784993908.284}
23%|β–ˆβ–ˆβ–Ž | 66/290 [11:06<40:12, 10.77s/it] 23%|β–ˆβ–ˆβ–Ž | 67/290 [11:15<38:11, 10.28s/it]{'loss': '1.745', 'grad_norm': '0.9349', 'learning_rate': '9.206e-05', 'epoch': '0.01516'}
JLOG {"event": "step", "step": 67, "elapsed": 676.2, "sps": 0.0991, "mem_gb": 26.17, "loss": 1.6610947847366333, "grad_norm": 0.7796356081962585, "learning_rate": 9.175112533527963e-05, "epoch": 0.015390799977028656, "t": 1784993917.407}
23%|β–ˆβ–ˆβ–Ž | 67/290 [11:15<38:11, 10.28s/it] 23%|β–ˆβ–ˆβ–Ž | 68/290 [11:23<34:43, 9.39s/it]{'loss': '1.661', 'grad_norm': '0.7796', 'learning_rate': '9.175e-05', 'epoch': '0.01539'}
JLOG {"event": "step", "step": 68, "elapsed": 683.5, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.7604519128799438, "grad_norm": 0.7865996956825256, "learning_rate": 9.143412526722959e-05, "epoch": 0.015620513409521622, "t": 1784993924.719}
23%|β–ˆβ–ˆβ–Ž | 68/290 [11:23<34:43, 9.39s/it] 24%|β–ˆβ–ˆβ– | 69/290 [11:32<34:23, 9.34s/it]{'loss': '1.76', 'grad_norm': '0.7866', 'learning_rate': '9.143e-05', 'epoch': '0.01562'}
JLOG {"event": "step", "step": 69, "elapsed": 692.7, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.2414387464523315, "grad_norm": 1.4461708068847656, "learning_rate": 9.111171780773937e-05, "epoch": 0.01585022684201459, "t": 1784993933.945}
24%|β–ˆβ–ˆβ– | 69/290 [11:32<34:23, 9.34s/it] 24%|β–ˆβ–ˆβ– | 70/290 [11:41<33:58, 9.26s/it]{'loss': '1.241', 'grad_norm': '1.446', 'learning_rate': '9.111e-05', 'epoch': '0.01585'}
JLOG {"event": "step", "step": 70, "elapsed": 701.8, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.2744053602218628, "grad_norm": 0.921054482460022, "learning_rate": 9.07839450328351e-05, "epoch": 0.016079940274507553, "t": 1784993943.034}
24%|β–ˆβ–ˆβ– | 70/290 [11:41<33:58, 9.26s/it] 24%|β–ˆβ–ˆβ– | 71/290 [11:50<33:52, 9.28s/it]{'loss': '1.274', 'grad_norm': '0.9211', 'learning_rate': '9.078e-05', 'epoch': '0.01608'}
JLOG {"event": "step", "step": 71, "elapsed": 711.2, "sps": 0.0998, "mem_gb": 26.17, "loss": 1.2707946300506592, "grad_norm": 0.8809505701065063, "learning_rate": 9.045084971874738e-05, "epoch": 0.016309653707000518, "t": 1784993952.36}
24%|β–ˆβ–ˆβ– | 71/290 [11:50<33:52, 9.28s/it] 25%|β–ˆβ–ˆβ– | 72/290 [12:03<36:58, 10.18s/it]{'loss': '1.271', 'grad_norm': '0.881', 'learning_rate': '9.045e-05', 'epoch': '0.01631'}
JLOG {"event": "step", "step": 72, "elapsed": 723.4, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.3906447887420654, "grad_norm": 0.7701398730278015, "learning_rate": 9.011247533632876e-05, "epoch": 0.016539367139493482, "t": 1784993964.629}
25%|β–ˆβ–ˆβ– | 72/290 [12:03<36:58, 10.18s/it] 25%|β–ˆβ–ˆβ–Œ | 73/290 [12:14<38:01, 10.52s/it]{'loss': '1.391', 'grad_norm': '0.7701', 'learning_rate': '9.011e-05', 'epoch': '0.01654'}
JLOG {"event": "step", "step": 73, "elapsed": 734.7, "sps": 0.0994, "mem_gb": 26.17, "loss": 1.3698601722717285, "grad_norm": 0.7045320272445679, "learning_rate": 8.976886604538055e-05, "epoch": 0.016769080571986446, "t": 1784993975.93}
25%|β–ˆβ–ˆβ–Œ | 73/290 [12:14<38:01, 10.52s/it] 26%|β–ˆβ–ˆβ–Œ | 74/290 [12:24<36:58, 10.27s/it]{'loss': '1.37', 'grad_norm': '0.7045', 'learning_rate': '8.977e-05', 'epoch': '0.01677'}
JLOG {"event": "step", "step": 74, "elapsed": 744.4, "sps": 0.0994, "mem_gb": 26.17, "loss": 1.2740356922149658, "grad_norm": 0.825591504573822, "learning_rate": 8.942006668888972e-05, "epoch": 0.01699879400447941, "t": 1784993985.636}
26%|β–ˆβ–ˆβ–Œ | 74/290 [12:24<36:58, 10.27s/it]{'loss': '1.274', 'grad_norm': '0.8256', 'learning_rate': '8.942e-05', 'epoch': '0.017'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000075", "t": 1784993997.272}
26%|β–ˆβ–ˆβ–Œ | 75/290 [12:35<38:16, 10.68s/it]JLOG {"event": "step", "step": 75, "elapsed": 756.1, "sps": 0.0992, "mem_gb": 26.17, "loss": 1.2878791093826294, "grad_norm": 0.6926925778388977, "learning_rate": 8.906612278717656e-05, "epoch": 0.017228507436972375, "t": 1784993997.274}
26%|β–ˆβ–ˆβ–Œ | 75/290 [12:35<38:16, 10.68s/it] 26%|β–ˆβ–ˆβ–Œ | 76/290 [12:46<37:53, 10.63s/it]{'loss': '1.288', 'grad_norm': '0.6927', 'learning_rate': '8.907e-05', 'epoch': '0.01723'}
JLOG {"event": "step", "step": 76, "elapsed": 766.6, "sps": 0.0991, "mem_gb": 26.17, "loss": 1.2715342044830322, "grad_norm": 0.8047655820846558, "learning_rate": 8.870708053195413e-05, "epoch": 0.017458220869465343, "t": 1784994007.768}
26%|β–ˆβ–ˆβ–Œ | 76/290 [12:46<37:53, 10.63s/it] 27%|β–ˆβ–ˆβ–‹ | 77/290 [12:53<33:46, 9.51s/it]{'loss': '1.272', 'grad_norm': '0.8048', 'learning_rate': '8.871e-05', 'epoch': '0.01746'}
JLOG {"event": "step", "step": 77, "elapsed": 773.5, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.4668223857879639, "grad_norm": 0.9020851850509644, "learning_rate": 8.834298678029989e-05, "epoch": 0.017687934301958308, "t": 1784994014.691}
27%|β–ˆβ–ˆβ–‹ | 77/290 [12:53<33:46, 9.51s/it] 27%|β–ˆβ–ˆβ–‹ | 78/290 [13:03<33:59, 9.62s/it]{'loss': '1.467', 'grad_norm': '0.9021', 'learning_rate': '8.834e-05', 'epoch': '0.01769'}
JLOG {"event": "step", "step": 78, "elapsed": 783.4, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.3586595058441162, "grad_norm": 0.6093685030937195, "learning_rate": 8.797388904854063e-05, "epoch": 0.017917647734451272, "t": 1784994024.552}
27%|β–ˆβ–ˆβ–‹ | 78/290 [13:03<33:59, 9.62s/it] 27%|β–ˆβ–ˆβ–‹ | 79/290 [13:12<33:35, 9.55s/it]{'loss': '1.359', 'grad_norm': '0.6094', 'learning_rate': '8.797e-05', 'epoch': '0.01792'}
JLOG {"event": "step", "step": 79, "elapsed": 792.8, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.2535698413848877, "grad_norm": 0.7311867475509644, "learning_rate": 8.75998355060513e-05, "epoch": 0.018147361166944237, "t": 1784994033.954}
27%|β–ˆβ–ˆβ–‹ | 79/290 [13:12<33:35, 9.55s/it] 28%|β–ˆβ–ˆβ–Š | 80/290 [13:22<33:48, 9.66s/it]{'loss': '1.254', 'grad_norm': '0.7312', 'learning_rate': '8.76e-05', 'epoch': '0.01815'}
JLOG {"event": "step", "step": 80, "elapsed": 802.7, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.4416675567626953, "grad_norm": 0.49891865253448486, "learning_rate": 8.72208749689686e-05, "epoch": 0.0183770745994372, "t": 1784994043.864}
28%|β–ˆβ–ˆβ–Š | 80/290 [13:22<33:48, 9.66s/it] 28%|β–ˆβ–ˆβ–Š | 81/290 [13:34<35:49, 10.29s/it]{'loss': '1.442', 'grad_norm': '0.4989', 'learning_rate': '8.722e-05', 'epoch': '0.01838'}
JLOG {"event": "step", "step": 81, "elapsed": 814.4, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.2511606216430664, "grad_norm": 0.9518086910247803, "learning_rate": 8.683705689382024e-05, "epoch": 0.018606788031930166, "t": 1784994055.608}
28%|β–ˆβ–ˆβ–Š | 81/290 [13:34<35:49, 10.29s/it] 28%|β–ˆβ–ˆβ–Š | 82/290 [13:43<34:56, 10.08s/it]{'loss': '1.251', 'grad_norm': '0.9518', 'learning_rate': '8.684e-05', 'epoch': '0.01861'}
JLOG {"event": "step", "step": 82, "elapsed": 824.0, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.2396435737609863, "grad_norm": 0.6774253845214844, "learning_rate": 8.644843137107059e-05, "epoch": 0.01883650146442313, "t": 1784994065.213}
28%|β–ˆβ–ˆβ–Š | 82/290 [13:43<34:56, 10.08s/it] 29%|β–ˆβ–ˆβ–Š | 83/290 [13:55<36:31, 10.59s/it]{'loss': '1.24', 'grad_norm': '0.6774', 'learning_rate': '8.645e-05', 'epoch': '0.01884'}
JLOG {"event": "step", "step": 83, "elapsed": 835.8, "sps": 0.0993, "mem_gb": 26.17, "loss": 1.5847584009170532, "grad_norm": 0.7013344764709473, "learning_rate": 8.605504911858347e-05, "epoch": 0.0190662148969161, "t": 1784994076.983}
29%|β–ˆβ–ˆβ–Š | 83/290 [13:55<36:31, 10.59s/it] 29%|β–ˆβ–ˆβ–‰ | 84/290 [14:04<34:59, 10.19s/it]{'loss': '1.585', 'grad_norm': '0.7013', 'learning_rate': '8.606e-05', 'epoch': '0.01907'}
JLOG {"event": "step", "step": 84, "elapsed": 845.0, "sps": 0.0994, "mem_gb": 26.17, "loss": 1.7612117528915405, "grad_norm": 0.5896980166435242, "learning_rate": 8.565696147500337e-05, "epoch": 0.019295928329409063, "t": 1784994086.249}
29%|β–ˆβ–ˆβ–‰ | 84/290 [14:04<34:59, 10.19s/it] 29%|β–ˆβ–ˆβ–‰ | 85/290 [14:14<34:16, 10.03s/it]{'loss': '1.761', 'grad_norm': '0.5897', 'learning_rate': '8.566e-05', 'epoch': '0.0193'}
JLOG {"event": "step", "step": 85, "elapsed": 854.7, "sps": 0.0994, "mem_gb": 26.17, "loss": 1.257568597793579, "grad_norm": 0.5376470685005188, "learning_rate": 8.525422039305528e-05, "epoch": 0.019525641761902027, "t": 1784994095.907}
29%|β–ˆβ–ˆβ–‰ | 85/290 [14:14<34:16, 10.03s/it] 30%|β–ˆβ–ˆβ–‰ | 86/290 [14:23<32:59, 9.71s/it]{'loss': '1.258', 'grad_norm': '0.5376', 'learning_rate': '8.525e-05', 'epoch': '0.01953'}
JLOG {"event": "step", "step": 86, "elapsed": 863.7, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.5340713262557983, "grad_norm": 0.7149202227592468, "learning_rate": 8.484687843276469e-05, "epoch": 0.019755355194394992, "t": 1784994104.853}
30%|β–ˆβ–ˆβ–‰ | 86/290 [14:23<32:59, 9.71s/it] 30%|β–ˆβ–ˆβ–ˆ | 87/290 [14:33<32:47, 9.69s/it]{'loss': '1.534', 'grad_norm': '0.7149', 'learning_rate': '8.485e-05', 'epoch': '0.01976'}
JLOG {"event": "step", "step": 87, "elapsed": 873.3, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.4340611696243286, "grad_norm": 0.5673169493675232, "learning_rate": 8.443498875459809e-05, "epoch": 0.019985068626887956, "t": 1784994114.513}
30%|β–ˆβ–ˆβ–ˆ | 87/290 [14:33<32:47, 9.69s/it] 30%|β–ˆβ–ˆβ–ˆ | 88/290 [14:41<31:34, 9.38s/it]{'loss': '1.434', 'grad_norm': '0.5673', 'learning_rate': '8.443e-05', 'epoch': '0.01999'}
JLOG {"event": "step", "step": 88, "elapsed": 882.0, "sps": 0.0998, "mem_gb": 26.17, "loss": 1.3552436828613281, "grad_norm": 0.6159022450447083, "learning_rate": 8.401860511252533e-05, "epoch": 0.02021478205938092, "t": 1784994123.159}
30%|β–ˆβ–ˆβ–ˆ | 88/290 [14:41<31:34, 9.38s/it] 31%|β–ˆβ–ˆβ–ˆ | 89/290 [14:51<32:22, 9.66s/it]{'loss': '1.355', 'grad_norm': '0.6159', 'learning_rate': '8.402e-05', 'epoch': '0.02021'}
JLOG {"event": "step", "step": 89, "elapsed": 892.3, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.2690613269805908, "grad_norm": 0.5643325448036194, "learning_rate": 8.35977818470044e-05, "epoch": 0.02044449549187389, "t": 1784994133.486}
31%|β–ˆβ–ˆβ–ˆ | 89/290 [14:51<32:22, 9.66s/it] 31%|β–ˆβ–ˆβ–ˆ | 90/290 [15:02<33:24, 10.02s/it]{'loss': '1.269', 'grad_norm': '0.5643', 'learning_rate': '8.36e-05', 'epoch': '0.02044'}
JLOG {"event": "step", "step": 90, "elapsed": 903.1, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.1374074220657349, "grad_norm": 0.7426185011863708, "learning_rate": 8.31725738778896e-05, "epoch": 0.020674208924366853, "t": 1784994144.343}
31%|β–ˆβ–ˆβ–ˆ | 90/290 [15:02<33:24, 10.02s/it] 31%|β–ˆβ–ˆβ–ˆβ– | 91/290 [15:11<31:23, 9.47s/it]{'loss': '1.137', 'grad_norm': '0.7426', 'learning_rate': '8.317e-05', 'epoch': '0.02067'}
JLOG {"event": "step", "step": 91, "elapsed": 911.3, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.4025132656097412, "grad_norm": 0.6644859910011292, "learning_rate": 8.274303669726426e-05, "epoch": 0.020903922356859818, "t": 1784994152.515}
31%|β–ˆβ–ˆβ–ˆβ– | 91/290 [15:11<31:23, 9.47s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 92/290 [15:21<32:07, 9.74s/it]{'loss': '1.403', 'grad_norm': '0.6645', 'learning_rate': '8.274e-05', 'epoch': '0.0209'}
JLOG {"event": "step", "step": 92, "elapsed": 921.7, "sps": 0.0998, "mem_gb": 26.17, "loss": 1.3541203737258911, "grad_norm": 0.5166579484939575, "learning_rate": 8.230922636219871e-05, "epoch": 0.021133635789352782, "t": 1784994162.879}
32%|β–ˆβ–ˆβ–ˆβ– | 92/290 [15:21<32:07, 9.74s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 93/290 [15:32<33:30, 10.21s/it]{'loss': '1.354', 'grad_norm': '0.5167', 'learning_rate': '8.231e-05', 'epoch': '0.02113'}
JLOG {"event": "step", "step": 93, "elapsed": 933.0, "sps": 0.0997, "mem_gb": 26.17, "loss": 0.8719726204872131, "grad_norm": 0.6253300309181213, "learning_rate": 8.18711994874345e-05, "epoch": 0.021363349221845747, "t": 1784994174.186}
32%|β–ˆβ–ˆβ–ˆβ– | 93/290 [15:32<33:30, 10.21s/it] 32%|β–ˆβ–ˆβ–ˆβ– | 94/290 [15:46<37:04, 11.35s/it]{'loss': '0.872', 'grad_norm': '0.6253', 'learning_rate': '8.187e-05', 'epoch': '0.02136'}
JLOG {"event": "step", "step": 94, "elapsed": 947.0, "sps": 0.0993, "mem_gb": 26.17, "loss": 0.8544608950614929, "grad_norm": 0.6898925304412842, "learning_rate": 8.142901323799578e-05, "epoch": 0.02159306265433871, "t": 1784994188.204}
32%|β–ˆβ–ˆβ–ˆβ– | 94/290 [15:46<37:04, 11.35s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 95/290 [15:54<33:40, 10.36s/it]{'loss': '0.8545', 'grad_norm': '0.6899', 'learning_rate': '8.143e-05', 'epoch': '0.02159'}
JLOG {"event": "step", "step": 95, "elapsed": 955.1, "sps": 0.0995, "mem_gb": 26.17, "loss": 1.3480677604675293, "grad_norm": 0.6754662394523621, "learning_rate": 8.098272532172906e-05, "epoch": 0.021822776086831676, "t": 1784994196.257}
33%|β–ˆβ–ˆβ–ˆβ–Ž | 95/290 [15:54<33:40, 10.36s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 96/290 [16:03<31:44, 9.82s/it]{'loss': '1.348', 'grad_norm': '0.6755', 'learning_rate': '8.098e-05', 'epoch': '0.02182'}
JLOG {"event": "step", "step": 96, "elapsed": 963.6, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.2157319784164429, "grad_norm": 0.6713094711303711, "learning_rate": 8.053239398177191e-05, "epoch": 0.022052489519324644, "t": 1784994204.804}
33%|β–ˆβ–ˆβ–ˆβ–Ž | 96/290 [16:03<31:44, 9.82s/it] 33%|β–ˆβ–ˆβ–ˆβ–Ž | 97/290 [16:12<31:25, 9.77s/it]{'loss': '1.216', 'grad_norm': '0.6713', 'learning_rate': '8.053e-05', 'epoch': '0.02205'}
JLOG {"event": "step", "step": 97, "elapsed": 973.3, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.2642180919647217, "grad_norm": 0.522792637348175, "learning_rate": 8.007807798895194e-05, "epoch": 0.02228220295181761, "t": 1784994214.469}
33%|β–ˆβ–ˆβ–ˆβ–Ž | 97/290 [16:12<31:25, 9.77s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 98/290 [16:21<30:07, 9.41s/it]{'loss': '1.264', 'grad_norm': '0.5228', 'learning_rate': '8.008e-05', 'epoch': '0.02228'}
JLOG {"event": "step", "step": 98, "elapsed": 981.8, "sps": 0.0998, "mem_gb": 26.17, "loss": 1.0499145984649658, "grad_norm": 0.4150620102882385, "learning_rate": 7.961983663411684e-05, "epoch": 0.022511916384310573, "t": 1784994223.043}
34%|β–ˆβ–ˆβ–ˆβ– | 98/290 [16:21<30:07, 9.41s/it] 34%|β–ˆβ–ˆβ–ˆβ– | 99/290 [16:31<30:23, 9.55s/it]{'loss': '1.05', 'grad_norm': '0.4151', 'learning_rate': '7.962e-05', 'epoch': '0.02251'}
JLOG {"event": "step", "step": 99, "elapsed": 991.7, "sps": 0.0998, "mem_gb": 26.17, "loss": 0.9893826246261597, "grad_norm": 0.6301956176757812, "learning_rate": 7.91577297203966e-05, "epoch": 0.022741629816803537, "t": 1784994232.899}
34%|β–ˆβ–ˆβ–ˆβ– | 99/290 [16:31<30:23, 9.55s/it]{'loss': '0.9894', 'grad_norm': '0.6302', 'learning_rate': '7.916e-05', 'epoch': '0.02274'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000100", "t": 1784994244.539}
34%|β–ˆβ–ˆβ–ˆβ– | 100/290 [16:43<32:13, 10.17s/it]JLOG {"event": "step", "step": 100, "elapsed": 1003.3, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.0980933904647827, "grad_norm": 0.5685282945632935, "learning_rate": 7.869181755539888e-05, "epoch": 0.022971343249296502, "t": 1784994244.54}
34%|β–ˆβ–ˆβ–ˆβ– | 100/290 [16:43<32:13, 10.17s/it] 35%|β–ˆβ–ˆβ–ˆβ– | 101/290 [16:53<32:24, 10.29s/it]{'loss': '1.098', 'grad_norm': '0.5685', 'learning_rate': '7.869e-05', 'epoch': '0.02297'}
JLOG {"event": "step", "step": 101, "elapsed": 1013.9, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.5142369270324707, "grad_norm": 1.1856820583343506, "learning_rate": 7.822216094333847e-05, "epoch": 0.023201056681789466, "t": 1784994255.098}
35%|β–ˆβ–ˆβ–ˆβ– | 101/290 [16:53<32:24, 10.29s/it] 35%|β–ˆβ–ˆβ–ˆβ–Œ | 102/290 [17:02<31:11, 9.95s/it]{'loss': '1.514', 'grad_norm': '1.186', 'learning_rate': '7.822e-05', 'epoch': '0.0232'}
JLOG {"event": "step", "step": 102, "elapsed": 1023.1, "sps": 0.0997, "mem_gb": 26.17, "loss": 0.8530772924423218, "grad_norm": 0.4276062846183777, "learning_rate": 7.774882117710203e-05, "epoch": 0.023430770114282434, "t": 1784994264.272}
35%|β–ˆβ–ˆβ–ˆβ–Œ | 102/290 [17:02<31:11, 9.95s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 103/290 [17:14<32:24, 10.40s/it]{'loss': '0.8531', 'grad_norm': '0.4276', 'learning_rate': '7.775e-05', 'epoch': '0.02343'}
JLOG {"event": "step", "step": 103, "elapsed": 1034.5, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.1041508913040161, "grad_norm": 0.6002244353294373, "learning_rate": 7.727186003024902e-05, "epoch": 0.0236604835467754, "t": 1784994275.708}
36%|β–ˆβ–ˆβ–ˆβ–Œ | 103/290 [17:14<32:24, 10.40s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 104/290 [17:23<31:27, 10.15s/it]{'loss': '1.104', 'grad_norm': '0.6002', 'learning_rate': '7.727e-05', 'epoch': '0.02366'}
JLOG {"event": "step", "step": 104, "elapsed": 1044.1, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.1305720806121826, "grad_norm": 0.534726083278656, "learning_rate": 7.679133974894983e-05, "epoch": 0.023890196979268363, "t": 1784994285.271}
36%|β–ˆβ–ˆβ–ˆβ–Œ | 104/290 [17:23<31:27, 10.15s/it] 36%|β–ˆβ–ˆβ–ˆβ–Œ | 105/290 [17:33<31:03, 10.07s/it]{'loss': '1.131', 'grad_norm': '0.5347', 'learning_rate': '7.679e-05', 'epoch': '0.02389'}
JLOG {"event": "step", "step": 105, "elapsed": 1054.0, "sps": 0.0996, "mem_gb": 26.17, "loss": 1.0932083129882812, "grad_norm": 0.7435656785964966, "learning_rate": 7.630732304386244e-05, "epoch": 0.024119910411761328, "t": 1784994295.173}
36%|β–ˆβ–ˆβ–ˆβ–Œ | 105/290 [17:33<31:03, 10.07s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 106/290 [17:44<31:14, 10.19s/it]{'loss': '1.093', 'grad_norm': '0.7436', 'learning_rate': '7.631e-05', 'epoch': '0.02412'}
JLOG {"event": "step", "step": 106, "elapsed": 1064.4, "sps": 0.0996, "mem_gb": 26.17, "loss": 0.5456977486610413, "grad_norm": 0.5185293555259705, "learning_rate": 7.58198730819481e-05, "epoch": 0.024349623844254292, "t": 1784994305.632}
37%|β–ˆβ–ˆβ–ˆβ–‹ | 106/290 [17:44<31:14, 10.19s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 107/290 [17:53<30:00, 9.84s/it]{'loss': '0.5457', 'grad_norm': '0.5185', 'learning_rate': '7.582e-05', 'epoch': '0.02435'}
JLOG {"event": "step", "step": 107, "elapsed": 1073.5, "sps": 0.0997, "mem_gb": 26.17, "loss": 1.3382928371429443, "grad_norm": 0.4846060276031494, "learning_rate": 7.532905347822792e-05, "epoch": 0.024579337276747257, "t": 1784994314.654}
37%|β–ˆβ–ˆβ–ˆβ–‹ | 107/290 [17:53<30:00, 9.84s/it] 37%|β–ˆβ–ˆβ–ˆβ–‹ | 108/290 [18:01<28:45, 9.48s/it]{'loss': '1.338', 'grad_norm': '0.4846', 'learning_rate': '7.533e-05', 'epoch': '0.02458'}
JLOG {"event": "step", "step": 108, "elapsed": 1082.1, "sps": 0.0998, "mem_gb": 26.17, "loss": 0.9709254503250122, "grad_norm": 0.4272273778915405, "learning_rate": 7.483492828748057e-05, "epoch": 0.02480905070924022, "t": 1784994323.301}
37%|β–ˆβ–ˆβ–ˆβ–‹ | 108/290 [18:01<28:45, 9.48s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 109/290 [18:10<28:07, 9.33s/it]{'loss': '0.9709', 'grad_norm': '0.4272', 'learning_rate': '7.483e-05', 'epoch': '0.02481'}
JLOG {"event": "step", "step": 109, "elapsed": 1091.1, "sps": 0.0999, "mem_gb": 26.17, "loss": 0.9182400703430176, "grad_norm": 0.5137364268302917, "learning_rate": 7.433756199588282e-05, "epoch": 0.02503876414173319, "t": 1784994332.264}
38%|β–ˆβ–ˆβ–ˆβ–Š | 109/290 [18:10<28:07, 9.33s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 110/290 [18:20<28:22, 9.46s/it]{'loss': '0.9182', 'grad_norm': '0.5137', 'learning_rate': '7.434e-05', 'epoch': '0.02504'}
JLOG {"event": "step", "step": 110, "elapsed": 1100.8, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.138678789138794, "grad_norm": 0.4590749144554138, "learning_rate": 7.383701951259375e-05, "epoch": 0.025268477574226154, "t": 1784994342.026}
38%|β–ˆβ–ˆβ–ˆβ–Š | 110/290 [18:20<28:22, 9.46s/it] 38%|β–ˆβ–ˆβ–ˆβ–Š | 111/290 [18:29<28:00, 9.39s/it]{'loss': '1.139', 'grad_norm': '0.4591', 'learning_rate': '7.384e-05', 'epoch': '0.02527'}
JLOG {"event": "step", "step": 111, "elapsed": 1110.1, "sps": 0.1, "mem_gb": 26.17, "loss": 0.9960913062095642, "grad_norm": 0.47016453742980957, "learning_rate": 7.333336616128369e-05, "epoch": 0.025498191006719118, "t": 1784994351.258}
38%|β–ˆβ–ˆβ–ˆβ–Š | 111/290 [18:29<28:00, 9.39s/it] 39%|β–ˆβ–ˆβ–ˆβ–Š | 112/290 [18:41<29:34, 9.97s/it]{'loss': '0.9961', 'grad_norm': '0.4702', 'learning_rate': '7.333e-05', 'epoch': '0.0255'}
JLOG {"event": "step", "step": 112, "elapsed": 1121.4, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.2385066747665405, "grad_norm": 0.4831649363040924, "learning_rate": 7.282666767160913e-05, "epoch": 0.025727904439212083, "t": 1784994362.588}
39%|β–ˆβ–ˆβ–ˆβ–Š | 112/290 [18:41<29:34, 9.97s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 113/290 [18:51<29:38, 10.05s/it]{'loss': '1.239', 'grad_norm': '0.4832', 'learning_rate': '7.283e-05', 'epoch': '0.02573'}
JLOG {"event": "step", "step": 113, "elapsed": 1131.6, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.0715488195419312, "grad_norm": 0.5573545694351196, "learning_rate": 7.23169901706346e-05, "epoch": 0.025957617871705047, "t": 1784994372.815}
39%|β–ˆβ–ˆβ–ˆβ–‰ | 113/290 [18:51<29:38, 10.05s/it] 39%|β–ˆβ–ˆβ–ˆβ–‰ | 114/290 [19:01<29:18, 9.99s/it]{'loss': '1.072', 'grad_norm': '0.5574', 'learning_rate': '7.232e-05', 'epoch': '0.02596'}
JLOG {"event": "step", "step": 114, "elapsed": 1141.5, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.0740605592727661, "grad_norm": 0.6387003064155579, "learning_rate": 7.180440017420277e-05, "epoch": 0.02618733130419801, "t": 1784994382.676}
39%|β–ˆβ–ˆβ–ˆβ–‰ | 114/290 [19:01<29:18, 9.99s/it] 40%|β–ˆβ–ˆβ–ˆβ–‰ | 115/290 [19:11<29:37, 10.15s/it]{'loss': '1.074', 'grad_norm': '0.6387', 'learning_rate': '7.18e-05', 'epoch': '0.02619'}
JLOG {"event": "step", "step": 115, "elapsed": 1152.0, "sps": 0.0998, "mem_gb": 26.17, "loss": 1.1153712272644043, "grad_norm": 0.462986022233963, "learning_rate": 7.128896457825364e-05, "epoch": 0.02641704473669098, "t": 1784994393.211}
40%|β–ˆβ–ˆβ–ˆβ–‰ | 115/290 [19:11<29:37, 10.15s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 116/290 [19:20<27:52, 9.61s/it]{'loss': '1.115', 'grad_norm': '0.463', 'learning_rate': '7.129e-05', 'epoch': '0.02642'}
JLOG {"event": "step", "step": 116, "elapsed": 1160.4, "sps": 0.1, "mem_gb": 26.17, "loss": 1.2504820823669434, "grad_norm": 0.44715994596481323, "learning_rate": 7.077075065009433e-05, "epoch": 0.026646758169183944, "t": 1784994401.561}
40%|β–ˆβ–ˆβ–ˆβ–ˆ | 116/290 [19:20<27:52, 9.61s/it] 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 117/290 [19:29<27:32, 9.55s/it]{'loss': '1.25', 'grad_norm': '0.4472', 'learning_rate': '7.077e-05', 'epoch': '0.02665'}
JLOG {"event": "step", "step": 117, "elapsed": 1169.8, "sps": 0.1, "mem_gb": 26.17, "loss": 1.3283342123031616, "grad_norm": 0.5002662539482117, "learning_rate": 7.024982601962027e-05, "epoch": 0.02687647160167691, "t": 1784994410.969}
40%|β–ˆβ–ˆβ–ˆβ–ˆ | 117/290 [19:29<27:32, 9.55s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 118/290 [19:40<28:25, 9.92s/it]{'loss': '1.328', 'grad_norm': '0.5003', 'learning_rate': '7.025e-05', 'epoch': '0.02688'}
JLOG {"event": "step", "step": 118, "elapsed": 1180.5, "sps": 0.1, "mem_gb": 26.17, "loss": 1.1309010982513428, "grad_norm": 0.9240773320198059, "learning_rate": 6.972625867048914e-05, "epoch": 0.027106185034169873, "t": 1784994421.743}
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 118/290 [19:40<28:25, 9.92s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 119/290 [19:50<28:32, 10.01s/it]{'loss': '1.131', 'grad_norm': '0.9241', 'learning_rate': '6.973e-05', 'epoch': '0.02711'}
JLOG {"event": "step", "step": 119, "elapsed": 1190.8, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.0855520963668823, "grad_norm": 0.407915323972702, "learning_rate": 6.920011693124857e-05, "epoch": 0.027335898466662838, "t": 1784994431.98}
41%|β–ˆβ–ˆβ–ˆβ–ˆ | 119/290 [19:50<28:32, 10.01s/it] 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 120/290 [20:00<28:47, 10.16s/it]{'loss': '1.086', 'grad_norm': '0.4079', 'learning_rate': '6.92e-05', 'epoch': '0.02734'}
JLOG {"event": "step", "step": 120, "elapsed": 1201.3, "sps": 0.0999, "mem_gb": 26.17, "loss": 0.7258315086364746, "grad_norm": 0.4427559971809387, "learning_rate": 6.867146946641891e-05, "epoch": 0.027565611899155802, "t": 1784994442.479}
41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 120/290 [20:00<28:47, 10.16s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 121/290 [20:08<26:42, 9.48s/it]{'loss': '0.7258', 'grad_norm': '0.4428', 'learning_rate': '6.867e-05', 'epoch': '0.02757'}
JLOG {"event": "step", "step": 121, "elapsed": 1209.2, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.089303731918335, "grad_norm": 0.4918655753135681, "learning_rate": 6.814038526753205e-05, "epoch": 0.027795325331648767, "t": 1784994450.386}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 121/290 [20:08<26:42, 9.48s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 122/290 [20:18<26:26, 9.45s/it]{'loss': '1.089', 'grad_norm': '0.4919', 'learning_rate': '6.814e-05', 'epoch': '0.0278'}
JLOG {"event": "step", "step": 122, "elapsed": 1218.5, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.1025910377502441, "grad_norm": 0.6470711827278137, "learning_rate": 6.760693364412775e-05, "epoch": 0.028025038764141735, "t": 1784994459.741}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 122/290 [20:18<26:26, 9.45s/it] 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 123/290 [20:28<26:45, 9.61s/it]{'loss': '1.103', 'grad_norm': '0.6471', 'learning_rate': '6.761e-05', 'epoch': '0.02803'}
JLOG {"event": "step", "step": 123, "elapsed": 1228.5, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.0486841201782227, "grad_norm": 0.7123926877975464, "learning_rate": 6.707118421470822e-05, "epoch": 0.0282547521966347, "t": 1784994469.746}
42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 123/290 [20:28<26:45, 9.61s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 124/290 [20:38<27:06, 9.80s/it]{'loss': '1.049', 'grad_norm': '0.7124', 'learning_rate': '6.707e-05', 'epoch': '0.02825'}
JLOG {"event": "step", "step": 124, "elapsed": 1238.8, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.1765515804290771, "grad_norm": 0.5119534730911255, "learning_rate": 6.653320689765257e-05, "epoch": 0.028484465629127664, "t": 1784994479.968}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 124/290 [20:38<27:06, 9.80s/it]{'loss': '1.177', 'grad_norm': '0.512', 'learning_rate': '6.653e-05', 'epoch': '0.02848'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000125", "t": 1784994488.422}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 125/290 [20:46<25:49, 9.39s/it]JLOG {"event": "step", "step": 125, "elapsed": 1247.2, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.1456940174102783, "grad_norm": 0.5150346159934998, "learning_rate": 6.599307190209206e-05, "epoch": 0.028714179061620628, "t": 1784994488.424}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 125/290 [20:46<25:49, 9.39s/it] 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 126/290 [20:57<27:01, 9.89s/it]{'loss': '1.146', 'grad_norm': '0.515', 'learning_rate': '6.599e-05', 'epoch': '0.02871'}
JLOG {"event": "step", "step": 126, "elapsed": 1258.3, "sps": 0.1001, "mem_gb": 26.17, "loss": 0.6673157215118408, "grad_norm": 0.5199823379516602, "learning_rate": 6.545084971874738e-05, "epoch": 0.028943892494113593, "t": 1784994499.47}
43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 126/290 [20:57<27:01, 9.89s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 127/290 [21:06<25:26, 9.36s/it]{'loss': '0.6673', 'grad_norm': '0.52', 'learning_rate': '6.545e-05', 'epoch': '0.02894'}
JLOG {"event": "step", "step": 127, "elapsed": 1266.4, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.2278804779052734, "grad_norm": 0.5109455585479736, "learning_rate": 6.490661111072923e-05, "epoch": 0.029173605926606557, "t": 1784994507.602}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 127/290 [21:06<25:26, 9.36s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 128/290 [21:15<25:16, 9.36s/it]{'loss': '1.228', 'grad_norm': '0.5109', 'learning_rate': '6.491e-05', 'epoch': '0.02917'}
JLOG {"event": "step", "step": 128, "elapsed": 1275.8, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.185920000076294, "grad_norm": 0.46923384070396423, "learning_rate": 6.436042710430333e-05, "epoch": 0.02940331935909952, "t": 1784994516.967}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 128/290 [21:15<25:16, 9.36s/it] 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 129/290 [21:29<28:33, 10.64s/it]{'loss': '1.186', 'grad_norm': '0.4692', 'learning_rate': '6.436e-05', 'epoch': '0.0294'}
JLOG {"event": "step", "step": 129, "elapsed": 1289.4, "sps": 0.1, "mem_gb": 26.17, "loss": 0.940451979637146, "grad_norm": 0.558101236820221, "learning_rate": 6.381236897962102e-05, "epoch": 0.02963303279159249, "t": 1784994530.596}
44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 129/290 [21:29<28:33, 10.64s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 130/290 [21:37<26:40, 10.00s/it]{'loss': '0.9405', 'grad_norm': '0.5581', 'learning_rate': '6.381e-05', 'epoch': '0.02963'}
JLOG {"event": "step", "step": 130, "elapsed": 1297.9, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.2554508447647095, "grad_norm": 0.4791591465473175, "learning_rate": 6.326250826141689e-05, "epoch": 0.029862746224085454, "t": 1784994539.11}
45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 130/290 [21:37<26:40, 10.00s/it] 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 131/290 [21:49<27:53, 10.53s/it]{'loss': '1.255', 'grad_norm': '0.4792', 'learning_rate': '6.326e-05', 'epoch': '0.02986'}
JLOG {"event": "step", "step": 131, "elapsed": 1309.7, "sps": 0.1, "mem_gb": 26.17, "loss": 0.7767183184623718, "grad_norm": 0.6307762265205383, "learning_rate": 6.271091670967436e-05, "epoch": 0.03009245965657842, "t": 1784994550.857}
45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 131/290 [21:49<27:53, 10.53s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 132/290 [22:01<29:01, 11.03s/it]{'loss': '0.7767', 'grad_norm': '0.6308', 'learning_rate': '6.271e-05', 'epoch': '0.03009'}
JLOG {"event": "step", "step": 132, "elapsed": 1321.8, "sps": 0.0999, "mem_gb": 26.17, "loss": 0.9318201541900635, "grad_norm": 0.5545979738235474, "learning_rate": 6.215766631026049e-05, "epoch": 0.030322173089071383, "t": 1784994563.044}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 132/290 [22:01<29:01, 11.03s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 133/290 [22:10<27:15, 10.42s/it]{'loss': '0.9318', 'grad_norm': '0.5546', 'learning_rate': '6.216e-05', 'epoch': '0.03032'}
JLOG {"event": "step", "step": 133, "elapsed": 1330.8, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.0976660251617432, "grad_norm": 0.4539124071598053, "learning_rate": 6.160282926553158e-05, "epoch": 0.030551886521564348, "t": 1784994572.044}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 133/290 [22:10<27:15, 10.42s/it] 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 134/290 [22:21<27:07, 10.43s/it]{'loss': '1.098', 'grad_norm': '0.4539', 'learning_rate': '6.16e-05', 'epoch': '0.03055'}
JLOG {"event": "step", "step": 134, "elapsed": 1341.3, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.1903626918792725, "grad_norm": 0.5364041328430176, "learning_rate": 6.104647798491021e-05, "epoch": 0.030781599954057312, "t": 1784994582.504}
46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 134/290 [22:21<27:07, 10.43s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 135/290 [22:29<25:45, 9.97s/it]{'loss': '1.19', 'grad_norm': '0.5364', 'learning_rate': '6.105e-05', 'epoch': '0.03078'}
JLOG {"event": "step", "step": 135, "elapsed": 1350.2, "sps": 0.1, "mem_gb": 26.17, "loss": 0.8168293237686157, "grad_norm": 0.6183277368545532, "learning_rate": 6.048868507543547e-05, "epoch": 0.03101131338655028, "t": 1784994591.403}
47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 135/290 [22:29<25:45, 9.97s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 136/290 [22:40<26:24, 10.29s/it]{'loss': '0.8168', 'grad_norm': '0.6183', 'learning_rate': '6.049e-05', 'epoch': '0.03101'}
JLOG {"event": "step", "step": 136, "elapsed": 1361.2, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.037426233291626, "grad_norm": 0.4451470375061035, "learning_rate": 5.992952333228728e-05, "epoch": 0.031241026819043245, "t": 1784994602.431}
47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 136/290 [22:40<26:24, 10.29s/it] 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 137/290 [22:50<25:44, 10.10s/it]{'loss': '1.037', 'grad_norm': '0.4451', 'learning_rate': '5.993e-05', 'epoch': '0.03124'}
JLOG {"event": "step", "step": 137, "elapsed": 1370.9, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.2151963710784912, "grad_norm": 0.4302819073200226, "learning_rate": 5.9369065729286245e-05, "epoch": 0.031470740251536206, "t": 1784994612.08}
47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 137/290 [22:50<25:44, 10.10s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 138/290 [23:01<26:11, 10.34s/it]{'loss': '1.215', 'grad_norm': '0.4303', 'learning_rate': '5.937e-05', 'epoch': '0.03147'}
JLOG {"event": "step", "step": 138, "elapsed": 1381.8, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.283035397529602, "grad_norm": 2.425124168395996, "learning_rate": 5.8807385409370076e-05, "epoch": 0.03170045368402918, "t": 1784994622.986}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 138/290 [23:01<26:11, 10.34s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 139/290 [23:11<25:35, 10.17s/it]{'loss': '1.283', 'grad_norm': '2.425', 'learning_rate': '5.881e-05', 'epoch': '0.0317'}
JLOG {"event": "step", "step": 139, "elapsed": 1391.6, "sps": 0.0999, "mem_gb": 26.17, "loss": 1.1196900606155396, "grad_norm": 0.3647302985191345, "learning_rate": 5.824455567504817e-05, "epoch": 0.03193016711652214, "t": 1784994632.763}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 139/290 [23:11<25:35, 10.17s/it] 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 140/290 [23:19<24:06, 9.64s/it]{'loss': '1.12', 'grad_norm': '0.3647', 'learning_rate': '5.824e-05', 'epoch': '0.03193'}
JLOG {"event": "step", "step": 140, "elapsed": 1400.0, "sps": 0.1, "mem_gb": 26.17, "loss": 0.7043508291244507, "grad_norm": 0.4188252091407776, "learning_rate": 5.768064997883498e-05, "epoch": 0.032159880549015106, "t": 1784994641.17}
48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 140/290 [23:19<24:06, 9.64s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 141/290 [23:28<23:18, 9.39s/it]{'loss': '0.7044', 'grad_norm': '0.4188', 'learning_rate': '5.768e-05', 'epoch': '0.03216'}
JLOG {"event": "step", "step": 141, "elapsed": 1408.8, "sps": 0.1001, "mem_gb": 26.17, "loss": 0.8598508834838867, "grad_norm": 0.7102314233779907, "learning_rate": 5.7115741913664264e-05, "epoch": 0.03238959398150807, "t": 1784994649.966}
49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 141/290 [23:28<23:18, 9.39s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 142/290 [23:38<23:40, 9.60s/it]{'loss': '0.8599', 'grad_norm': '0.7102', 'learning_rate': '5.712e-05', 'epoch': '0.03239'}
JLOG {"event": "step", "step": 142, "elapsed": 1418.8, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.1470388174057007, "grad_norm": 0.6872131824493408, "learning_rate": 5.654990520328465e-05, "epoch": 0.032619307414001035, "t": 1784994660.051}
49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 142/290 [23:38<23:40, 9.60s/it] 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 143/290 [23:48<23:33, 9.62s/it]{'loss': '1.147', 'grad_norm': '0.6872', 'learning_rate': '5.655e-05', 'epoch': '0.03262'}
JLOG {"event": "step", "step": 143, "elapsed": 1428.5, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.2616294622421265, "grad_norm": 0.43868061900138855, "learning_rate": 5.5983213692638294e-05, "epoch": 0.032849020846494, "t": 1784994669.721}
49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 143/290 [23:48<23:33, 9.62s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 144/290 [23:57<23:27, 9.64s/it]{'loss': '1.262', 'grad_norm': '0.4387', 'learning_rate': '5.598e-05', 'epoch': '0.03285'}
JLOG {"event": "step", "step": 144, "elapsed": 1438.2, "sps": 0.1001, "mem_gb": 26.17, "loss": 0.9080209732055664, "grad_norm": 0.2778986394405365, "learning_rate": 5.5415741338223736e-05, "epoch": 0.033078734278986964, "t": 1784994679.415}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 144/290 [23:57<23:27, 9.64s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 145/290 [24:08<24:06, 9.97s/it]{'loss': '0.908', 'grad_norm': '0.2779', 'learning_rate': '5.542e-05', 'epoch': '0.03308'}
JLOG {"event": "step", "step": 145, "elapsed": 1449.0, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.084824562072754, "grad_norm": 0.40274837613105774, "learning_rate": 5.484756219844408e-05, "epoch": 0.03330844771147993, "t": 1784994690.167}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 145/290 [24:08<24:06, 9.97s/it] 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 146/290 [24:17<23:08, 9.64s/it]{'loss': '1.085', 'grad_norm': '0.4027', 'learning_rate': '5.485e-05', 'epoch': '0.03331'}
JLOG {"event": "step", "step": 146, "elapsed": 1457.8, "sps": 0.1001, "mem_gb": 26.17, "loss": 0.7990856170654297, "grad_norm": 0.455226868391037, "learning_rate": 5.427875042394199e-05, "epoch": 0.03353816114397289, "t": 1784994699.027}
50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 146/290 [24:17<23:08, 9.64s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 147/290 [24:28<23:42, 9.95s/it]{'loss': '0.7991', 'grad_norm': '0.4552', 'learning_rate': '5.428e-05', 'epoch': '0.03354'}
JLOG {"event": "step", "step": 147, "elapsed": 1468.5, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.0289158821105957, "grad_norm": 0.8829931020736694, "learning_rate": 5.3709380247922617e-05, "epoch": 0.03376787457646586, "t": 1784994709.702}
51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 147/290 [24:28<23:42, 9.95s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 148/290 [24:38<23:47, 10.06s/it]{'loss': '1.029', 'grad_norm': '0.883', 'learning_rate': '5.371e-05', 'epoch': '0.03377'}
JLOG {"event": "step", "step": 148, "elapsed": 1478.8, "sps": 0.1001, "mem_gb": 26.17, "loss": 0.7551462650299072, "grad_norm": 0.3529197871685028, "learning_rate": 5.313952597646568e-05, "epoch": 0.03399758800895882, "t": 1784994720.004}
51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 148/290 [24:38<23:47, 10.06s/it] 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 149/290 [24:48<23:49, 10.14s/it]{'loss': '0.7551', 'grad_norm': '0.3529', 'learning_rate': '5.314e-05', 'epoch': '0.034'}
JLOG {"event": "step", "step": 149, "elapsed": 1489.1, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.1841583251953125, "grad_norm": 0.39364737272262573, "learning_rate": 5.2569261978828155e-05, "epoch": 0.034227301441451786, "t": 1784994730.327}
51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 149/290 [24:48<23:49, 10.14s/it]{'loss': '1.184', 'grad_norm': '0.3936', 'learning_rate': '5.257e-05', 'epoch': '0.03423'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000150", "t": 1784994738.677}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 150/290 [24:57<22:24, 9.60s/it]JLOG {"event": "step", "step": 150, "elapsed": 1497.5, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.1886086463928223, "grad_norm": 0.5860241055488586, "learning_rate": 5.199866267773867e-05, "epoch": 0.03445701487394475, "t": 1784994738.679}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 150/290 [24:57<22:24, 9.60s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 151/290 [25:05<21:02, 9.08s/it]{'loss': '1.189', 'grad_norm': '0.586', 'learning_rate': '5.2e-05', 'epoch': '0.03446'}
JLOG {"event": "step", "step": 151, "elapsed": 1505.3, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0240082740783691, "grad_norm": 0.5060998797416687, "learning_rate": 5.142780253968481e-05, "epoch": 0.034686728306437715, "t": 1784994746.541}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 151/290 [25:05<21:02, 9.08s/it] 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 152/290 [25:13<20:33, 8.94s/it]{'loss': '1.024', 'grad_norm': '0.5061', 'learning_rate': '5.143e-05', 'epoch': '0.03469'}
JLOG {"event": "step", "step": 152, "elapsed": 1514.0, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.0033153295516968, "grad_norm": 0.38138121366500854, "learning_rate": 5.0856756065194964e-05, "epoch": 0.03491644173893069, "t": 1784994755.157}
52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 152/290 [25:13<20:33, 8.94s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 153/290 [25:24<21:49, 9.56s/it]{'loss': '1.003', 'grad_norm': '0.3814', 'learning_rate': '5.086e-05', 'epoch': '0.03492'}
JLOG {"event": "step", "step": 153, "elapsed": 1525.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9375408887863159, "grad_norm": 0.44896072149276733, "learning_rate": 5.028559777911542e-05, "epoch": 0.03514615517142365, "t": 1784994766.158}
53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 153/290 [25:24<21:49, 9.56s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 154/290 [25:34<21:39, 9.56s/it]{'loss': '0.9375', 'grad_norm': '0.449', 'learning_rate': '5.029e-05', 'epoch': '0.03515'}
JLOG {"event": "step", "step": 154, "elapsed": 1534.5, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.6170578598976135, "grad_norm": 0.5988245606422424, "learning_rate": 4.971440222088459e-05, "epoch": 0.035375868603916616, "t": 1784994775.708}
53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 154/290 [25:34<21:39, 9.56s/it] 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 155/290 [25:43<21:38, 9.62s/it]{'loss': '0.6171', 'grad_norm': '0.5988', 'learning_rate': '4.971e-05', 'epoch': '0.03538'}
JLOG {"event": "step", "step": 155, "elapsed": 1544.3, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.6896421909332275, "grad_norm": 0.5707164406776428, "learning_rate": 4.914324393480504e-05, "epoch": 0.03560558203640958, "t": 1784994785.481}
53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 155/290 [25:43<21:38, 9.62s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 156/290 [25:54<22:24, 10.03s/it]{'loss': '0.6896', 'grad_norm': '0.5707', 'learning_rate': '4.914e-05', 'epoch': '0.03561'}
JLOG {"event": "step", "step": 156, "elapsed": 1555.3, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0552667379379272, "grad_norm": 0.522588849067688, "learning_rate": 4.85721974603152e-05, "epoch": 0.035835295468902545, "t": 1784994796.473}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 156/290 [25:54<22:24, 10.03s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 157/290 [26:04<22:01, 9.94s/it]{'loss': '1.055', 'grad_norm': '0.5226', 'learning_rate': '4.857e-05', 'epoch': '0.03584'}
JLOG {"event": "step", "step": 157, "elapsed": 1565.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.5143985748291016, "grad_norm": 0.3216739594936371, "learning_rate": 4.800133732226135e-05, "epoch": 0.03606500890139551, "t": 1784994806.185}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 157/290 [26:04<22:01, 9.94s/it] 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 158/290 [26:17<23:28, 10.67s/it]{'loss': '1.514', 'grad_norm': '0.3217', 'learning_rate': '4.8e-05', 'epoch': '0.03607'}
JLOG {"event": "step", "step": 158, "elapsed": 1577.4, "sps": 0.1002, "mem_gb": 26.17, "loss": 0.9611833691596985, "grad_norm": 0.39697161316871643, "learning_rate": 4.7430738021171857e-05, "epoch": 0.036294722333888474, "t": 1784994818.557}
54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 158/290 [26:17<23:28, 10.67s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 159/290 [26:27<22:56, 10.50s/it]{'loss': '0.9612', 'grad_norm': '0.397', 'learning_rate': '4.743e-05', 'epoch': '0.03629'}
JLOG {"event": "step", "step": 159, "elapsed": 1587.5, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.208094596862793, "grad_norm": 0.48744189739227295, "learning_rate": 4.6860474023534335e-05, "epoch": 0.03652443576638144, "t": 1784994828.684}
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 159/290 [26:27<22:56, 10.50s/it] 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 160/290 [26:38<23:10, 10.70s/it]{'loss': '1.208', 'grad_norm': '0.4874', 'learning_rate': '4.686e-05', 'epoch': '0.03652'}
JLOG {"event": "step", "step": 160, "elapsed": 1598.6, "sps": 0.1001, "mem_gb": 26.17, "loss": 1.0011799335479736, "grad_norm": 0.45698073506355286, "learning_rate": 4.6290619752077395e-05, "epoch": 0.0367541491988744, "t": 1784994839.832}
55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 160/290 [26:38<23:10, 10.70s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 161/290 [26:47<21:57, 10.21s/it]{'loss': '1.001', 'grad_norm': '0.457', 'learning_rate': '4.629e-05', 'epoch': '0.03675'}
JLOG {"event": "step", "step": 161, "elapsed": 1607.7, "sps": 0.1001, "mem_gb": 26.17, "loss": 0.8260566592216492, "grad_norm": 0.5553998947143555, "learning_rate": 4.5721249576058027e-05, "epoch": 0.03698386263136737, "t": 1784994848.91}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 161/290 [26:47<21:57, 10.21s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 162/290 [26:55<20:16, 9.50s/it]{'loss': '0.8261', 'grad_norm': '0.5554', 'learning_rate': '4.572e-05', 'epoch': '0.03698'}
JLOG {"event": "step", "step": 162, "elapsed": 1615.6, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.23900306224823, "grad_norm": 0.4703269898891449, "learning_rate": 4.515243780155593e-05, "epoch": 0.03721357606386033, "t": 1784994856.758}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 162/290 [26:55<20:16, 9.50s/it] 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 163/290 [27:03<19:23, 9.16s/it]{'loss': '1.239', 'grad_norm': '0.4703', 'learning_rate': '4.515e-05', 'epoch': '0.03721'}
JLOG {"event": "step", "step": 163, "elapsed": 1623.9, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.3527334928512573, "grad_norm": 0.6355881690979004, "learning_rate": 4.4584258661776275e-05, "epoch": 0.037443289496353296, "t": 1784994865.133}
56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 163/290 [27:03<19:23, 9.16s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 164/290 [27:14<20:17, 9.66s/it]{'loss': '1.353', 'grad_norm': '0.6356', 'learning_rate': '4.458e-05', 'epoch': '0.03744'}
JLOG {"event": "step", "step": 164, "elapsed": 1634.8, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9812292456626892, "grad_norm": 0.6364296674728394, "learning_rate": 4.401678630736172e-05, "epoch": 0.03767300292884626, "t": 1784994875.955}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 164/290 [27:14<20:17, 9.66s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 165/290 [27:25<20:45, 9.97s/it]{'loss': '0.9812', 'grad_norm': '0.6364', 'learning_rate': '4.402e-05', 'epoch': '0.03767'}
JLOG {"event": "step", "step": 165, "elapsed": 1645.4, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.003961205482483, "grad_norm": 0.4628686308860779, "learning_rate": 4.345009479671536e-05, "epoch": 0.03790271636133923, "t": 1784994886.63}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 165/290 [27:25<20:45, 9.97s/it] 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 166/290 [27:35<20:40, 10.00s/it]{'loss': '1.004', 'grad_norm': '0.4629', 'learning_rate': '4.345e-05', 'epoch': '0.0379'}
JLOG {"event": "step", "step": 166, "elapsed": 1655.5, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0581750869750977, "grad_norm": 0.5079083442687988, "learning_rate": 4.288425808633575e-05, "epoch": 0.0381324297938322, "t": 1784994896.725}
57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 166/290 [27:35<20:40, 10.00s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 167/290 [27:44<20:13, 9.87s/it]{'loss': '1.058', 'grad_norm': '0.5079', 'learning_rate': '4.288e-05', 'epoch': '0.03813'}
JLOG {"event": "step", "step": 167, "elapsed": 1665.1, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.8559304475784302, "grad_norm": 0.4427659809589386, "learning_rate": 4.231935002116504e-05, "epoch": 0.03836214322632516, "t": 1784994906.278}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 167/290 [27:44<20:13, 9.87s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 168/290 [27:55<20:23, 10.03s/it]{'loss': '0.8559', 'grad_norm': '0.4428', 'learning_rate': '4.232e-05', 'epoch': '0.03836'}
JLOG {"event": "step", "step": 168, "elapsed": 1675.5, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9794153571128845, "grad_norm": 0.3735242486000061, "learning_rate": 4.175544432495184e-05, "epoch": 0.038591856658818126, "t": 1784994916.686}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 168/290 [27:55<20:23, 10.03s/it] 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 169/290 [28:03<19:11, 9.51s/it]{'loss': '0.9794', 'grad_norm': '0.3735', 'learning_rate': '4.176e-05', 'epoch': '0.03859'}
JLOG {"event": "step", "step": 169, "elapsed": 1683.8, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.337433934211731, "grad_norm": 0.4345966577529907, "learning_rate": 4.1192614590629915e-05, "epoch": 0.03882157009131109, "t": 1784994924.993}
58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 169/290 [28:03<19:11, 9.51s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 170/290 [28:13<19:16, 9.64s/it]{'loss': '1.337', 'grad_norm': '0.4346', 'learning_rate': '4.119e-05', 'epoch': '0.03882'}
JLOG {"event": "step", "step": 170, "elapsed": 1693.7, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.3513025045394897, "grad_norm": 0.4592370390892029, "learning_rate": 4.063093427071376e-05, "epoch": 0.039051283523804055, "t": 1784994934.924}
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 170/290 [28:13<19:16, 9.64s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 171/290 [28:22<18:38, 9.40s/it]{'loss': '1.351', 'grad_norm': '0.4592', 'learning_rate': '4.063e-05', 'epoch': '0.03905'}
JLOG {"event": "step", "step": 171, "elapsed": 1702.6, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.0722851753234863, "grad_norm": 0.36886540055274963, "learning_rate": 4.007047666771274e-05, "epoch": 0.03928099695629702, "t": 1784994943.764}
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 171/290 [28:22<18:38, 9.40s/it] 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 172/290 [28:32<18:48, 9.56s/it]{'loss': '1.072', 'grad_norm': '0.3689', 'learning_rate': '4.007e-05', 'epoch': '0.03928'}
JLOG {"event": "step", "step": 172, "elapsed": 1712.5, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.2050808668136597, "grad_norm": 0.3466119170188904, "learning_rate": 3.951131492456454e-05, "epoch": 0.039510710388789984, "t": 1784994953.711}
59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 172/290 [28:32<18:48, 9.56s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 173/290 [28:45<20:44, 10.63s/it]{'loss': '1.205', 'grad_norm': '0.3466', 'learning_rate': '3.951e-05', 'epoch': '0.03951'}
JLOG {"event": "step", "step": 173, "elapsed": 1725.6, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.1663082838058472, "grad_norm": 0.8693311810493469, "learning_rate": 3.89535220150898e-05, "epoch": 0.03974042382128295, "t": 1784994966.845}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 173/290 [28:45<20:44, 10.63s/it] 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 174/290 [28:54<19:45, 10.22s/it]{'loss': '1.166', 'grad_norm': '0.8693', 'learning_rate': '3.895e-05', 'epoch': '0.03974'}
JLOG {"event": "step", "step": 174, "elapsed": 1734.9, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.163559913635254, "grad_norm": 0.38193315267562866, "learning_rate": 3.8397170734468425e-05, "epoch": 0.03997013725377591, "t": 1784994976.085}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 174/290 [28:54<19:45, 10.22s/it]{'loss': '1.164', 'grad_norm': '0.3819', 'learning_rate': '3.84e-05', 'epoch': '0.03997'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000175", "t": 1784994984.75}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 175/290 [29:03<18:41, 9.75s/it]JLOG {"event": "step", "step": 175, "elapsed": 1743.5, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.9504402875900269, "grad_norm": 0.47296595573425293, "learning_rate": 3.7842333689739524e-05, "epoch": 0.04019985068626888, "t": 1784994984.752}
60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 175/290 [29:03<18:41, 9.75s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 176/290 [29:14<19:25, 10.22s/it]{'loss': '0.9504', 'grad_norm': '0.473', 'learning_rate': '3.784e-05', 'epoch': '0.0402'}
JLOG {"event": "step", "step": 176, "elapsed": 1754.9, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0445835590362549, "grad_norm": 0.3545779585838318, "learning_rate": 3.728908329032567e-05, "epoch": 0.04042956411876184, "t": 1784994996.07}
61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 176/290 [29:14<19:25, 10.22s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 177/290 [29:25<19:39, 10.43s/it]{'loss': '1.045', 'grad_norm': '0.3546', 'learning_rate': '3.729e-05', 'epoch': '0.04043'}
JLOG {"event": "step", "step": 177, "elapsed": 1765.8, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.0302048921585083, "grad_norm": 0.5631554126739502, "learning_rate": 3.673749173858312e-05, "epoch": 0.040659277551254806, "t": 1784995007.001}
61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 177/290 [29:25<19:39, 10.43s/it] 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 178/290 [29:33<17:53, 9.59s/it]{'loss': '1.03', 'grad_norm': '0.5632', 'learning_rate': '3.674e-05', 'epoch': '0.04066'}
JLOG {"event": "step", "step": 178, "elapsed": 1773.4, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.0882076025009155, "grad_norm": 0.3192915916442871, "learning_rate": 3.6187631020378986e-05, "epoch": 0.04088899098374778, "t": 1784995014.612}
61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 178/290 [29:33<17:53, 9.59s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 179/290 [29:42<17:26, 9.43s/it]{'loss': '1.088', 'grad_norm': '0.3193', 'learning_rate': '3.619e-05', 'epoch': '0.04089'}
JLOG {"event": "step", "step": 179, "elapsed": 1782.5, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.9429888725280762, "grad_norm": 0.5405993461608887, "learning_rate": 3.563957289569669e-05, "epoch": 0.04111870441624074, "t": 1784995023.683}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 179/290 [29:42<17:26, 9.43s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 180/290 [29:49<16:24, 8.95s/it]{'loss': '0.943', 'grad_norm': '0.5406', 'learning_rate': '3.564e-05', 'epoch': '0.04112'}
JLOG {"event": "step", "step": 180, "elapsed": 1790.3, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.2515050172805786, "grad_norm": 0.48727282881736755, "learning_rate": 3.5093388889270786e-05, "epoch": 0.04134841784873371, "t": 1784995031.498}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 180/290 [29:49<16:24, 8.95s/it] 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 181/290 [30:00<16:56, 9.33s/it]{'loss': '1.252', 'grad_norm': '0.4873', 'learning_rate': '3.509e-05', 'epoch': '0.04135'}
JLOG {"event": "step", "step": 181, "elapsed": 1800.5, "sps": 0.1005, "mem_gb": 26.17, "loss": 0.6636870503425598, "grad_norm": 0.3517967164516449, "learning_rate": 3.4549150281252636e-05, "epoch": 0.04157813128122667, "t": 1784995041.706}
62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 181/290 [30:00<16:56, 9.33s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 182/290 [30:09<16:58, 9.43s/it]{'loss': '0.6637', 'grad_norm': '0.3518', 'learning_rate': '3.455e-05', 'epoch': '0.04158'}
JLOG {"event": "step", "step": 182, "elapsed": 1810.2, "sps": 0.1005, "mem_gb": 26.17, "loss": 0.3942037522792816, "grad_norm": 2.4803099632263184, "learning_rate": 3.400692809790796e-05, "epoch": 0.041807844713719636, "t": 1784995051.374}
63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 182/290 [30:09<16:58, 9.43s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 183/290 [30:19<16:52, 9.47s/it]{'loss': '0.3942', 'grad_norm': '2.48', 'learning_rate': '3.401e-05', 'epoch': '0.04181'}
JLOG {"event": "step", "step": 183, "elapsed": 1819.7, "sps": 0.1006, "mem_gb": 26.17, "loss": 0.6333301663398743, "grad_norm": 0.5371298789978027, "learning_rate": 3.3466793102347435e-05, "epoch": 0.0420375581462126, "t": 1784995060.929}
63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 183/290 [30:19<16:52, 9.47s/it] 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 184/290 [30:31<18:11, 10.30s/it]{'loss': '0.6333', 'grad_norm': '0.5371', 'learning_rate': '3.347e-05', 'epoch': '0.04204'}
JLOG {"event": "step", "step": 184, "elapsed": 1832.0, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.8305069208145142, "grad_norm": 0.3354390859603882, "learning_rate": 3.292881578529179e-05, "epoch": 0.042267271578705565, "t": 1784995073.176}
63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 184/290 [30:31<18:11, 10.30s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 185/290 [30:41<17:41, 10.11s/it]{'loss': '0.8305', 'grad_norm': '0.3354', 'learning_rate': '3.293e-05', 'epoch': '0.04227'}
JLOG {"event": "step", "step": 185, "elapsed": 1841.6, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.0527807474136353, "grad_norm": 0.6422765851020813, "learning_rate": 3.239306635587227e-05, "epoch": 0.04249698501119853, "t": 1784995082.835}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 185/290 [30:41<17:41, 10.11s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 186/290 [30:51<17:22, 10.03s/it]{'loss': '1.053', 'grad_norm': '0.6423', 'learning_rate': '3.239e-05', 'epoch': '0.0425'}
JLOG {"event": "step", "step": 186, "elapsed": 1851.5, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.1027737855911255, "grad_norm": 0.36502066254615784, "learning_rate": 3.1859614732467954e-05, "epoch": 0.042726698443691494, "t": 1784995092.678}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 186/290 [30:51<17:22, 10.03s/it] 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 187/290 [31:00<16:49, 9.80s/it]{'loss': '1.103', 'grad_norm': '0.365', 'learning_rate': '3.186e-05', 'epoch': '0.04273'}
JLOG {"event": "step", "step": 187, "elapsed": 1860.8, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.039709448814392, "grad_norm": 0.34212446212768555, "learning_rate": 3.13285305335811e-05, "epoch": 0.04295641187618446, "t": 1784995101.953}
64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 187/290 [31:00<16:49, 9.80s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 188/290 [31:11<17:08, 10.08s/it]{'loss': '1.04', 'grad_norm': '0.3421', 'learning_rate': '3.133e-05', 'epoch': '0.04296'}
JLOG {"event": "step", "step": 188, "elapsed": 1871.5, "sps": 0.1005, "mem_gb": 26.17, "loss": 0.8301854729652405, "grad_norm": 0.5514313578605652, "learning_rate": 3.079988306875143e-05, "epoch": 0.04318612530867742, "t": 1784995112.695}
65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 188/290 [31:11<17:08, 10.08s/it] 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 189/290 [31:18<15:30, 9.22s/it]{'loss': '0.8302', 'grad_norm': '0.5514', 'learning_rate': '3.08e-05', 'epoch': '0.04319'}
JLOG {"event": "step", "step": 189, "elapsed": 1878.7, "sps": 0.1006, "mem_gb": 26.17, "loss": 0.8591382503509521, "grad_norm": 0.4159432351589203, "learning_rate": 3.0273741329510853e-05, "epoch": 0.04341583874117039, "t": 1784995119.888}
65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 189/290 [31:18<15:30, 9.22s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 190/290 [31:31<17:14, 10.35s/it]{'loss': '0.8591', 'grad_norm': '0.4159', 'learning_rate': '3.027e-05', 'epoch': '0.04342'}
JLOG {"event": "step", "step": 190, "elapsed": 1891.7, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.5583387613296509, "grad_norm": 0.4571380615234375, "learning_rate": 2.9750173980379736e-05, "epoch": 0.04364555217366335, "t": 1784995132.873}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 190/290 [31:31<17:14, 10.35s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 191/290 [31:41<16:47, 10.17s/it]{'loss': '0.5583', 'grad_norm': '0.4571', 'learning_rate': '2.975e-05', 'epoch': '0.04365'}
JLOG {"event": "step", "step": 191, "elapsed": 1901.4, "sps": 0.1005, "mem_gb": 26.17, "loss": 0.9041093587875366, "grad_norm": 0.48922351002693176, "learning_rate": 2.9229249349905684e-05, "epoch": 0.04387526560615632, "t": 1784995142.642}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 191/290 [31:41<16:47, 10.17s/it] 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 192/290 [31:53<17:33, 10.74s/it]{'loss': '0.9041', 'grad_norm': '0.4892', 'learning_rate': '2.923e-05', 'epoch': '0.04388'}
JLOG {"event": "step", "step": 192, "elapsed": 1913.5, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.7454911470413208, "grad_norm": 0.36315855383872986, "learning_rate": 2.8711035421746367e-05, "epoch": 0.04410497903864929, "t": 1784995154.719}
66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 192/290 [31:53<17:33, 10.74s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 193/290 [32:00<15:31, 9.60s/it]{'loss': '0.7455', 'grad_norm': '0.3632', 'learning_rate': '2.871e-05', 'epoch': '0.0441'}
JLOG {"event": "step", "step": 193, "elapsed": 1920.5, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.2126561403274536, "grad_norm": 0.38086646795272827, "learning_rate": 2.819559982579723e-05, "epoch": 0.04433469247114225, "t": 1784995161.661}
67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 193/290 [32:00<15:31, 9.60s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 194/290 [32:09<15:25, 9.64s/it]{'loss': '1.213', 'grad_norm': '0.3809', 'learning_rate': '2.82e-05', 'epoch': '0.04433'}
JLOG {"event": "step", "step": 194, "elapsed": 1930.2, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.0694125890731812, "grad_norm": 0.3953205645084381, "learning_rate": 2.7683009829365412e-05, "epoch": 0.04456440590363522, "t": 1784995171.399}
67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 194/290 [32:09<15:25, 9.64s/it] 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 195/290 [32:19<15:24, 9.73s/it]{'loss': '1.069', 'grad_norm': '0.3953', 'learning_rate': '2.768e-05', 'epoch': '0.04456'}
JLOG {"event": "step", "step": 195, "elapsed": 1940.1, "sps": 0.1005, "mem_gb": 26.17, "loss": 0.884109616279602, "grad_norm": 0.4223475456237793, "learning_rate": 2.7173332328390876e-05, "epoch": 0.04479411933612818, "t": 1784995181.319}
67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 195/290 [32:19<15:24, 9.73s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 196/290 [32:31<16:02, 10.24s/it]{'loss': '0.8841', 'grad_norm': '0.4223', 'learning_rate': '2.717e-05', 'epoch': '0.04479'}
JLOG {"event": "step", "step": 196, "elapsed": 1951.6, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.9834740161895752, "grad_norm": 0.491249144077301, "learning_rate": 2.6666633838716314e-05, "epoch": 0.045023832768621146, "t": 1784995192.766}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 196/290 [32:31<16:02, 10.24s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 197/290 [32:41<16:01, 10.34s/it]{'loss': '0.9835', 'grad_norm': '0.4912', 'learning_rate': '2.667e-05', 'epoch': '0.04502'}
JLOG {"event": "step", "step": 197, "elapsed": 1962.1, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.5026577115058899, "grad_norm": 0.3652594983577728, "learning_rate": 2.6162980487406257e-05, "epoch": 0.04525354620111411, "t": 1784995203.322}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 197/290 [32:41<16:01, 10.34s/it] 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 198/290 [32:52<16:10, 10.55s/it]{'loss': '0.5027', 'grad_norm': '0.3653', 'learning_rate': '2.616e-05', 'epoch': '0.04525'}
JLOG {"event": "step", "step": 198, "elapsed": 1973.2, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.3246065378189087, "grad_norm": 0.3865174651145935, "learning_rate": 2.566243800411719e-05, "epoch": 0.045483259633607075, "t": 1784995214.362}
68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 198/290 [32:52<16:10, 10.55s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 199/290 [33:02<15:34, 10.26s/it]{'loss': '1.325', 'grad_norm': '0.3865', 'learning_rate': '2.566e-05', 'epoch': '0.04548'}
JLOG {"event": "step", "step": 199, "elapsed": 1982.8, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.0560667514801025, "grad_norm": 0.6061482429504395, "learning_rate": 2.5165071712519444e-05, "epoch": 0.04571297306610004, "t": 1784995223.966}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 199/290 [33:02<15:34, 10.26s/it]{'loss': '1.056', 'grad_norm': '0.6061', 'learning_rate': '2.517e-05', 'epoch': '0.04571'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000200", "t": 1784995234.246}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 200/290 [33:12<15:24, 10.27s/it]JLOG {"event": "step", "step": 200, "elapsed": 1993.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9928292036056519, "grad_norm": 3.4149961471557617, "learning_rate": 2.4670946521772093e-05, "epoch": 0.045942686498593004, "t": 1784995234.247}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 200/290 [33:12<15:24, 10.27s/it] 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 201/290 [33:25<16:10, 10.90s/it]{'loss': '0.9928', 'grad_norm': '3.415', 'learning_rate': '2.467e-05', 'epoch': '0.04594'}
JLOG {"event": "step", "step": 201, "elapsed": 2005.4, "sps": 0.1002, "mem_gb": 26.17, "loss": 0.9524517059326172, "grad_norm": 0.4809345304965973, "learning_rate": 2.418012691805191e-05, "epoch": 0.04617239993108597, "t": 1784995246.633}
69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 201/290 [33:25<16:10, 10.90s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 202/290 [33:33<15:01, 10.25s/it]{'loss': '0.9525', 'grad_norm': '0.4809', 'learning_rate': '2.418e-05', 'epoch': '0.04617'}
JLOG {"event": "step", "step": 202, "elapsed": 2014.1, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0676500797271729, "grad_norm": 0.46976760029792786, "learning_rate": 2.3692676956137583e-05, "epoch": 0.04640211336357893, "t": 1784995255.345}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 202/290 [33:33<15:01, 10.25s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 203/290 [33:44<15:11, 10.48s/it]{'loss': '1.068', 'grad_norm': '0.4698', 'learning_rate': '2.369e-05', 'epoch': '0.0464'}
JLOG {"event": "step", "step": 203, "elapsed": 2025.2, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.2749090194702148, "grad_norm": 0.4437876343727112, "learning_rate": 2.3208660251050158e-05, "epoch": 0.0466318267960719, "t": 1784995266.361}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 203/290 [33:44<15:11, 10.48s/it] 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 204/290 [33:54<14:52, 10.37s/it]{'loss': '1.275', 'grad_norm': '0.4438', 'learning_rate': '2.321e-05', 'epoch': '0.04663'}
JLOG {"event": "step", "step": 204, "elapsed": 2035.3, "sps": 0.1002, "mem_gb": 26.17, "loss": 0.9705283641815186, "grad_norm": 0.44651681184768677, "learning_rate": 2.2728139969751006e-05, "epoch": 0.04686154022856487, "t": 1784995276.488}
70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 204/290 [33:54<14:52, 10.37s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 205/290 [34:05<14:40, 10.36s/it]{'loss': '0.9705', 'grad_norm': '0.4465', 'learning_rate': '2.273e-05', 'epoch': '0.04686'}
JLOG {"event": "step", "step": 205, "elapsed": 2045.6, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.334708571434021, "grad_norm": 0.3829931318759918, "learning_rate": 2.2251178822897988e-05, "epoch": 0.04709125366105783, "t": 1784995286.81}
71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 205/290 [34:05<14:40, 10.36s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 206/290 [34:14<13:54, 9.93s/it]{'loss': '1.335', 'grad_norm': '0.383', 'learning_rate': '2.225e-05', 'epoch': '0.04709'}
JLOG {"event": "step", "step": 206, "elapsed": 2054.6, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9761781692504883, "grad_norm": 0.4318469166755676, "learning_rate": 2.1777839056661554e-05, "epoch": 0.0473209670935508, "t": 1784995295.753}
71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 206/290 [34:14<13:54, 9.93s/it] 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 207/290 [34:25<14:09, 10.24s/it]{'loss': '0.9762', 'grad_norm': '0.4318', 'learning_rate': '2.178e-05', 'epoch': '0.04732'}
JLOG {"event": "step", "step": 207, "elapsed": 2065.5, "sps": 0.1002, "mem_gb": 26.17, "loss": 0.9165526032447815, "grad_norm": 0.4049586057662964, "learning_rate": 2.1308182444601127e-05, "epoch": 0.04755068052604376, "t": 1784995306.7}
71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 207/290 [34:25<14:09, 10.24s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 208/290 [34:34<13:27, 9.85s/it]{'loss': '0.9166', 'grad_norm': '0.405', 'learning_rate': '2.131e-05', 'epoch': '0.04755'}
JLOG {"event": "step", "step": 208, "elapsed": 2074.4, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0068080425262451, "grad_norm": 0.43081653118133545, "learning_rate": 2.0842270279603404e-05, "epoch": 0.04778039395853673, "t": 1784995315.631}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 208/290 [34:34<13:27, 9.85s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 209/290 [34:44<13:42, 10.15s/it]{'loss': '1.007', 'grad_norm': '0.4308', 'learning_rate': '2.084e-05', 'epoch': '0.04778'}
JLOG {"event": "step", "step": 209, "elapsed": 2085.3, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.1478123664855957, "grad_norm": 0.40161922574043274, "learning_rate": 2.0380163365883187e-05, "epoch": 0.04801010739102969, "t": 1784995326.488}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 209/290 [34:44<13:42, 10.15s/it] 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 210/290 [34:53<12:57, 9.72s/it]{'loss': '1.148', 'grad_norm': '0.4016', 'learning_rate': '2.038e-05', 'epoch': '0.04801'}
JLOG {"event": "step", "step": 210, "elapsed": 2094.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.057541847229004, "grad_norm": 1.2700574398040771, "learning_rate": 1.9921922011048068e-05, "epoch": 0.048239820823522656, "t": 1784995335.196}
72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 210/290 [34:53<12:57, 9.72s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 211/290 [35:03<12:56, 9.83s/it]{'loss': '1.058', 'grad_norm': '1.27', 'learning_rate': '1.992e-05', 'epoch': '0.04824'}
JLOG {"event": "step", "step": 211, "elapsed": 2104.1, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.1890546083450317, "grad_norm": 0.4977864921092987, "learning_rate": 1.946760601822809e-05, "epoch": 0.04846953425601562, "t": 1784995345.279}
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 211/290 [35:03<12:56, 9.83s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 212/290 [35:11<12:02, 9.27s/it]{'loss': '1.189', 'grad_norm': '0.4978', 'learning_rate': '1.947e-05', 'epoch': '0.04847'}
JLOG {"event": "step", "step": 212, "elapsed": 2112.0, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.003334403038025, "grad_norm": 0.5720475316047668, "learning_rate": 1.9017274678270947e-05, "epoch": 0.048699247688508585, "t": 1784995353.243}
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 212/290 [35:11<12:02, 9.27s/it] 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 213/290 [35:20<11:35, 9.03s/it]{'loss': '1.003', 'grad_norm': '0.572', 'learning_rate': '1.902e-05', 'epoch': '0.0487'}
JLOG {"event": "step", "step": 213, "elapsed": 2120.5, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.8830097913742065, "grad_norm": 0.3894023597240448, "learning_rate": 1.8570986762004243e-05, "epoch": 0.04892896112100155, "t": 1784995361.714}
73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 213/290 [35:20<11:35, 9.03s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 214/290 [35:28<11:05, 8.76s/it]{'loss': '0.883', 'grad_norm': '0.3894', 'learning_rate': '1.857e-05', 'epoch': '0.04893'}
JLOG {"event": "step", "step": 214, "elapsed": 2128.7, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.1752692461013794, "grad_norm": 0.6193303465843201, "learning_rate": 1.8128800512565513e-05, "epoch": 0.049158674553494514, "t": 1784995369.854}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 214/290 [35:28<11:05, 8.76s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 215/290 [35:39<11:53, 9.51s/it]{'loss': '1.175', 'grad_norm': '0.6193', 'learning_rate': '1.813e-05', 'epoch': '0.04916'}
JLOG {"event": "step", "step": 215, "elapsed": 2139.9, "sps": 0.1005, "mem_gb": 26.17, "loss": 0.7471806406974792, "grad_norm": 0.4554375410079956, "learning_rate": 1.7690773637801294e-05, "epoch": 0.04938838798598748, "t": 1784995381.113}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 215/290 [35:39<11:53, 9.51s/it] 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 216/290 [35:47<11:05, 8.99s/it]{'loss': '0.7472', 'grad_norm': '0.4554', 'learning_rate': '1.769e-05', 'epoch': '0.04939'}
JLOG {"event": "step", "step": 216, "elapsed": 2147.7, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.0265140533447266, "grad_norm": 0.521947979927063, "learning_rate": 1.725696330273575e-05, "epoch": 0.04961810141848044, "t": 1784995388.897}
74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 216/290 [35:47<11:05, 8.99s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 217/290 [35:57<11:11, 9.20s/it]{'loss': '1.027', 'grad_norm': '0.5219', 'learning_rate': '1.726e-05', 'epoch': '0.04962'}
JLOG {"event": "step", "step": 217, "elapsed": 2157.4, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.0466783046722412, "grad_norm": 0.3114124536514282, "learning_rate": 1.6827426122110413e-05, "epoch": 0.049847814850973414, "t": 1784995398.573}
75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 217/290 [35:57<11:11, 9.20s/it] 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 218/290 [36:07<11:18, 9.42s/it]{'loss': '1.047', 'grad_norm': '0.3114', 'learning_rate': '1.683e-05', 'epoch': '0.04985'}
JLOG {"event": "step", "step": 218, "elapsed": 2167.3, "sps": 0.1006, "mem_gb": 26.17, "loss": 0.5880823731422424, "grad_norm": 0.5129798650741577, "learning_rate": 1.6402218152995607e-05, "epoch": 0.05007752828346638, "t": 1784995408.52}
75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 218/290 [36:07<11:18, 9.42s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 219/290 [36:14<10:23, 8.78s/it]{'loss': '0.5881', 'grad_norm': '0.513', 'learning_rate': '1.64e-05', 'epoch': '0.05008'}
JLOG {"event": "step", "step": 219, "elapsed": 2174.6, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.8568986058235168, "grad_norm": 0.36495378613471985, "learning_rate": 1.598139488747467e-05, "epoch": 0.05030724171595934, "t": 1784995415.798}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 219/290 [36:14<10:23, 8.78s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 220/290 [36:26<11:19, 9.70s/it]{'loss': '0.8569', 'grad_norm': '0.365', 'learning_rate': '1.598e-05', 'epoch': '0.05031'}
JLOG {"event": "step", "step": 220, "elapsed": 2186.5, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.2239227294921875, "grad_norm": 0.3244815766811371, "learning_rate": 1.556501124540193e-05, "epoch": 0.05053695514845231, "t": 1784995427.655}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 220/290 [36:26<11:19, 9.70s/it] 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 221/290 [36:36<11:14, 9.77s/it]{'loss': '1.224', 'grad_norm': '0.3245', 'learning_rate': '1.557e-05', 'epoch': '0.05054'}
JLOG {"event": "step", "step": 221, "elapsed": 2196.4, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.238423228263855, "grad_norm": 0.376667857170105, "learning_rate": 1.5153121567235335e-05, "epoch": 0.05076666858094527, "t": 1784995437.593}
76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 221/290 [36:36<11:14, 9.77s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 222/290 [36:47<11:39, 10.29s/it]{'loss': '1.238', 'grad_norm': '0.3767', 'learning_rate': '1.515e-05', 'epoch': '0.05077'}
JLOG {"event": "step", "step": 222, "elapsed": 2207.9, "sps": 0.1005, "mem_gb": 26.17, "loss": 1.3745856285095215, "grad_norm": 0.4580274820327759, "learning_rate": 1.4745779606944716e-05, "epoch": 0.050996382013438236, "t": 1784995449.102}
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 222/290 [36:47<11:39, 10.29s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 223/290 [36:56<11:11, 10.02s/it]{'loss': '1.375', 'grad_norm': '0.458', 'learning_rate': '1.475e-05', 'epoch': '0.051'}
JLOG {"event": "step", "step": 223, "elapsed": 2217.3, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.4674558639526367, "grad_norm": 0.4837997555732727, "learning_rate": 1.4343038524996644e-05, "epoch": 0.0512260954459312, "t": 1784995458.492}
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 223/290 [36:56<11:11, 10.02s/it] 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 224/290 [37:05<10:23, 9.45s/it]{'loss': '1.467', 'grad_norm': '0.4838', 'learning_rate': '1.434e-05', 'epoch': '0.05123'}
JLOG {"event": "step", "step": 224, "elapsed": 2225.4, "sps": 0.1007, "mem_gb": 26.17, "loss": 1.2091748714447021, "grad_norm": 0.6074104309082031, "learning_rate": 1.3944950881416541e-05, "epoch": 0.051455808878424165, "t": 1784995466.596}
77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 224/290 [37:05<10:23, 9.45s/it]{'loss': '1.209', 'grad_norm': '0.6074', 'learning_rate': '1.394e-05', 'epoch': '0.05146'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000225", "t": 1784995474.776}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 225/290 [37:13<09:49, 9.07s/it]JLOG {"event": "step", "step": 225, "elapsed": 2233.6, "sps": 0.1007, "mem_gb": 26.17, "loss": 1.114803433418274, "grad_norm": 0.39872562885284424, "learning_rate": 1.3551568628929434e-05, "epoch": 0.05168552231091713, "t": 1784995474.777}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 225/290 [37:13<09:49, 9.07s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 226/290 [37:24<10:27, 9.80s/it]{'loss': '1.115', 'grad_norm': '0.3987', 'learning_rate': '1.355e-05', 'epoch': '0.05169'}
JLOG {"event": "step", "step": 226, "elapsed": 2245.1, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.7899085283279419, "grad_norm": 0.4407997131347656, "learning_rate": 1.3162943106179749e-05, "epoch": 0.051915235743410094, "t": 1784995486.298}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 226/290 [37:24<10:27, 9.80s/it] 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 227/290 [37:32<09:35, 9.13s/it]{'loss': '0.7899', 'grad_norm': '0.4408', 'learning_rate': '1.316e-05', 'epoch': '0.05192'}
JLOG {"event": "step", "step": 227, "elapsed": 2252.7, "sps": 0.1008, "mem_gb": 26.17, "loss": 1.042850136756897, "grad_norm": 0.3662990629673004, "learning_rate": 1.2779125031031414e-05, "epoch": 0.05214494917590306, "t": 1784995493.866}
78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 227/290 [37:32<09:35, 9.13s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 228/290 [37:42<09:38, 9.33s/it]{'loss': '1.043', 'grad_norm': '0.3663', 'learning_rate': '1.278e-05', 'epoch': '0.05214'}
JLOG {"event": "step", "step": 228, "elapsed": 2262.5, "sps": 0.1008, "mem_gb": 26.17, "loss": 0.8692542910575867, "grad_norm": 0.40171852707862854, "learning_rate": 1.2400164493948713e-05, "epoch": 0.05237466260839602, "t": 1784995503.657}
79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 228/290 [37:42<09:38, 9.33s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 229/290 [37:52<09:50, 9.67s/it]{'loss': '0.8693', 'grad_norm': '0.4017', 'learning_rate': '1.24e-05', 'epoch': '0.05237'}
JLOG {"event": "step", "step": 229, "elapsed": 2272.9, "sps": 0.1008, "mem_gb": 26.17, "loss": 1.025320053100586, "grad_norm": 0.5924814343452454, "learning_rate": 1.2026110951459362e-05, "epoch": 0.05260437604088899, "t": 1784995514.135}
79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 229/290 [37:52<09:50, 9.67s/it] 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 230/290 [38:02<09:46, 9.77s/it]{'loss': '1.025', 'grad_norm': '0.5925', 'learning_rate': '1.203e-05', 'epoch': '0.0526'}
JLOG {"event": "step", "step": 230, "elapsed": 2282.9, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.9111807942390442, "grad_norm": 0.46345260739326477, "learning_rate": 1.1657013219700108e-05, "epoch": 0.05283408947338196, "t": 1784995524.139}
79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 230/290 [38:02<09:46, 9.77s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 231/290 [38:12<09:46, 9.94s/it]{'loss': '0.9112', 'grad_norm': '0.4635', 'learning_rate': '1.166e-05', 'epoch': '0.05283'}
JLOG {"event": "step", "step": 231, "elapsed": 2293.3, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.9606931805610657, "grad_norm": 0.3804723620414734, "learning_rate": 1.1292919468045877e-05, "epoch": 0.053063802905874924, "t": 1784995534.457}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 231/290 [38:12<09:46, 9.94s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 232/290 [38:23<09:38, 9.98s/it]{'loss': '0.9607', 'grad_norm': '0.3805', 'learning_rate': '1.129e-05', 'epoch': '0.05306'}
JLOG {"event": "step", "step": 232, "elapsed": 2303.3, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.7348148226737976, "grad_norm": 0.5007413029670715, "learning_rate": 1.0933877212823463e-05, "epoch": 0.05329351633836789, "t": 1784995544.546}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 232/290 [38:23<09:38, 9.98s/it] 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 233/290 [38:32<09:25, 9.93s/it]{'loss': '0.7348', 'grad_norm': '0.5007', 'learning_rate': '1.093e-05', 'epoch': '0.05329'}
JLOG {"event": "step", "step": 233, "elapsed": 2313.1, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.8692693710327148, "grad_norm": 0.46604347229003906, "learning_rate": 1.057993331111029e-05, "epoch": 0.05352322977086085, "t": 1784995554.349}
80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 233/290 [38:32<09:25, 9.93s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 234/290 [38:40<08:46, 9.39s/it]{'loss': '0.8693', 'grad_norm': '0.466', 'learning_rate': '1.058e-05', 'epoch': '0.05352'}
JLOG {"event": "step", "step": 234, "elapsed": 2321.3, "sps": 0.1008, "mem_gb": 26.17, "loss": 1.4048855304718018, "grad_norm": 0.423218309879303, "learning_rate": 1.0231133954619448e-05, "epoch": 0.05375294320335382, "t": 1784995562.492}
81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 234/290 [38:40<08:46, 9.39s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 235/290 [38:51<08:47, 9.59s/it]{'loss': '1.405', 'grad_norm': '0.4232', 'learning_rate': '1.023e-05', 'epoch': '0.05375'}
JLOG {"event": "step", "step": 235, "elapsed": 2331.3, "sps": 0.1008, "mem_gb": 26.17, "loss": 1.0622655153274536, "grad_norm": 0.47460174560546875, "learning_rate": 9.887524663671243e-06, "epoch": 0.05398265663584678, "t": 1784995572.539}
81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 235/290 [38:51<08:47, 9.59s/it] 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 236/290 [39:02<09:11, 10.22s/it]{'loss': '1.062', 'grad_norm': '0.4746', 'learning_rate': '9.888e-06', 'epoch': '0.05398'}
JLOG {"event": "step", "step": 236, "elapsed": 2343.0, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.8568949103355408, "grad_norm": 0.4363693594932556, "learning_rate": 9.549150281252633e-06, "epoch": 0.054212370068339746, "t": 1784995584.231}
81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 236/290 [39:02<09:11, 10.22s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 237/290 [39:13<09:05, 10.28s/it]{'loss': '0.8569', 'grad_norm': '0.4364', 'learning_rate': '9.549e-06', 'epoch': '0.05421'}
JLOG {"event": "step", "step": 237, "elapsed": 2353.5, "sps": 0.1007, "mem_gb": 26.17, "loss": 1.1836336851119995, "grad_norm": 0.5043432712554932, "learning_rate": 9.216054967164917e-06, "epoch": 0.05444208350083271, "t": 1784995594.666}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 237/290 [39:13<09:05, 10.28s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 238/290 [39:21<08:24, 9.69s/it]{'loss': '1.184', 'grad_norm': '0.5043', 'learning_rate': '9.216e-06', 'epoch': '0.05444'}
JLOG {"event": "step", "step": 238, "elapsed": 2361.8, "sps": 0.1008, "mem_gb": 26.17, "loss": 0.8469375967979431, "grad_norm": 0.3950647711753845, "learning_rate": 8.888282192260645e-06, "epoch": 0.054671796933325675, "t": 1784995602.981}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 238/290 [39:21<08:24, 9.69s/it] 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 239/290 [39:33<08:47, 10.34s/it]{'loss': '0.8469', 'grad_norm': '0.3951', 'learning_rate': '8.888e-06', 'epoch': '0.05467'}
JLOG {"event": "step", "step": 239, "elapsed": 2373.6, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.8860755562782288, "grad_norm": 0.3970368504524231, "learning_rate": 8.56587473277043e-06, "epoch": 0.05490151036581864, "t": 1784995614.824}
82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 239/290 [39:33<08:47, 10.34s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 240/290 [39:43<08:38, 10.37s/it]{'loss': '0.8861', 'grad_norm': '0.397', 'learning_rate': '8.566e-06', 'epoch': '0.0549'}
JLOG {"event": "step", "step": 240, "elapsed": 2384.1, "sps": 0.1007, "mem_gb": 26.17, "loss": 1.1376510858535767, "grad_norm": 0.4215221107006073, "learning_rate": 8.248874664720375e-06, "epoch": 0.055131223798311604, "t": 1784995625.256}
83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 240/290 [39:43<08:38, 10.37s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 241/290 [39:52<08:05, 9.90s/it]{'loss': '1.138', 'grad_norm': '0.4215', 'learning_rate': '8.249e-06', 'epoch': '0.05513'}
JLOG {"event": "step", "step": 241, "elapsed": 2392.9, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.7866100072860718, "grad_norm": 0.5986670255661011, "learning_rate": 7.937323358440935e-06, "epoch": 0.05536093723080457, "t": 1784995634.077}
83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 241/290 [39:52<08:05, 9.90s/it] 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 242/290 [40:02<07:57, 9.95s/it]{'loss': '0.7866', 'grad_norm': '0.5987', 'learning_rate': '7.937e-06', 'epoch': '0.05536'}
JLOG {"event": "step", "step": 242, "elapsed": 2403.0, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.7847855091094971, "grad_norm": 0.735242486000061, "learning_rate": 7.631261473167877e-06, "epoch": 0.05559065066329753, "t": 1784995644.152}
83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 242/290 [40:02<07:57, 9.95s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 243/290 [40:14<08:09, 10.42s/it]{'loss': '0.7848', 'grad_norm': '0.7352', 'learning_rate': '7.631e-06', 'epoch': '0.05559'}
JLOG {"event": "step", "step": 243, "elapsed": 2414.5, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.1859419345855713, "grad_norm": 0.5820416808128357, "learning_rate": 7.330728951735915e-06, "epoch": 0.055820364095790505, "t": 1784995655.662}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 243/290 [40:14<08:09, 10.42s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 244/290 [40:26<08:21, 10.91s/it]{'loss': '1.186', 'grad_norm': '0.582', 'learning_rate': '7.331e-06', 'epoch': '0.05582'}
JLOG {"event": "step", "step": 244, "elapsed": 2426.5, "sps": 0.1006, "mem_gb": 26.17, "loss": 0.9427791833877563, "grad_norm": 0.7382686734199524, "learning_rate": 7.035765015366047e-06, "epoch": 0.05605007752828347, "t": 1784995667.72}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 244/290 [40:26<08:21, 10.91s/it] 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 245/290 [40:35<07:44, 10.32s/it]{'loss': '0.9428', 'grad_norm': '0.7383', 'learning_rate': '7.036e-06', 'epoch': '0.05605'}
JLOG {"event": "step", "step": 245, "elapsed": 2435.5, "sps": 0.1006, "mem_gb": 26.17, "loss": 1.115507960319519, "grad_norm": 0.6112185120582581, "learning_rate": 6.746408158546947e-06, "epoch": 0.056279790960776434, "t": 1784995676.665}
84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 245/290 [40:35<07:44, 10.32s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 246/290 [40:44<07:15, 9.89s/it]{'loss': '1.116', 'grad_norm': '0.6112', 'learning_rate': '6.746e-06', 'epoch': '0.05628'}
JLOG {"event": "step", "step": 246, "elapsed": 2444.3, "sps": 0.1006, "mem_gb": 26.17, "loss": 0.9172548055648804, "grad_norm": 0.4631510078907013, "learning_rate": 6.462696144011149e-06, "epoch": 0.0565095043932694, "t": 1784995685.539}
85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 246/290 [40:44<07:15, 9.89s/it] 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 247/290 [40:53<06:53, 9.61s/it]{'loss': '0.9173', 'grad_norm': '0.4632', 'learning_rate': '6.463e-06', 'epoch': '0.05651'}
JLOG {"event": "step", "step": 247, "elapsed": 2453.3, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.9810536503791809, "grad_norm": 0.4337417483329773, "learning_rate": 6.184665997806832e-06, "epoch": 0.05673921782576236, "t": 1784995694.507}
85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 247/290 [40:53<06:53, 9.61s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 248/290 [41:02<06:36, 9.43s/it]{'loss': '0.9811', 'grad_norm': '0.4337', 'learning_rate': '6.185e-06', 'epoch': '0.05674'}
JLOG {"event": "step", "step": 248, "elapsed": 2462.3, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.9260852932929993, "grad_norm": 0.4616958200931549, "learning_rate": 5.912354004465709e-06, "epoch": 0.05696893125825533, "t": 1784995703.515}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 248/290 [41:02<06:36, 9.43s/it] 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 249/290 [41:12<06:40, 9.76s/it]{'loss': '0.9261', 'grad_norm': '0.4617', 'learning_rate': '5.912e-06', 'epoch': '0.05697'}
JLOG {"event": "step", "step": 249, "elapsed": 2472.8, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.8671744465827942, "grad_norm": 0.4522026479244232, "learning_rate": 5.645795702267731e-06, "epoch": 0.05719864469074829, "t": 1784995714.034}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 249/290 [41:12<06:40, 9.76s/it]{'loss': '0.8672', 'grad_norm': '0.4522', 'learning_rate': '5.646e-06', 'epoch': '0.0572'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000250", "t": 1784995724.371}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 250/290 [41:22<06:37, 9.93s/it]JLOG {"event": "step", "step": 250, "elapsed": 2483.2, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.85639488697052, "grad_norm": 0.4320604205131531, "learning_rate": 5.385025878603039e-06, "epoch": 0.057428358123241256, "t": 1784995724.373}
86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 250/290 [41:22<06:37, 9.93s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 251/290 [41:33<06:33, 10.08s/it]{'loss': '0.8564', 'grad_norm': '0.4321', 'learning_rate': '5.385e-06', 'epoch': '0.05743'}
JLOG {"event": "step", "step": 251, "elapsed": 2493.6, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.5363849997520447, "grad_norm": 0.4966599941253662, "learning_rate": 5.13007856543209e-06, "epoch": 0.05765807155573422, "t": 1784995734.792}
87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 251/290 [41:33<06:33, 10.08s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 252/290 [41:43<06:19, 9.97s/it]{'loss': '0.5364', 'grad_norm': '0.4967', 'learning_rate': '5.13e-06', 'epoch': '0.05766'}
JLOG {"event": "step", "step": 252, "elapsed": 2503.3, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.784080445766449, "grad_norm": 0.38488292694091797, "learning_rate": 4.880987034844231e-06, "epoch": 0.057887784988227185, "t": 1784995744.526}
87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 252/290 [41:43<06:19, 9.97s/it] 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 253/290 [41:51<05:50, 9.46s/it]{'loss': '0.7841', 'grad_norm': '0.3849', 'learning_rate': '4.881e-06', 'epoch': '0.05789'}
JLOG {"event": "step", "step": 253, "elapsed": 2511.6, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.9763104915618896, "grad_norm": 0.30688515305519104, "learning_rate": 4.637783794715589e-06, "epoch": 0.05811749842072015, "t": 1784995752.791}
87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 253/290 [41:51<05:50, 9.46s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 254/290 [42:01<05:53, 9.83s/it]{'loss': '0.9763', 'grad_norm': '0.3069', 'learning_rate': '4.638e-06', 'epoch': '0.05812'}
JLOG {"event": "step", "step": 254, "elapsed": 2522.3, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.5534109473228455, "grad_norm": 0.5016852617263794, "learning_rate": 4.400500584466505e-06, "epoch": 0.058347211853213114, "t": 1784995763.469}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 254/290 [42:01<05:53, 9.83s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 255/290 [42:11<05:43, 9.82s/it]{'loss': '0.5534', 'grad_norm': '0.5017', 'learning_rate': '4.401e-06', 'epoch': '0.05835'}
JLOG {"event": "step", "step": 255, "elapsed": 2532.1, "sps": 0.1007, "mem_gb": 26.17, "loss": 1.0432038307189941, "grad_norm": 0.45460987091064453, "learning_rate": 4.169168370919419e-06, "epoch": 0.05857692528570608, "t": 1784995773.278}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 255/290 [42:11<05:43, 9.82s/it] 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 256/290 [42:22<05:45, 10.16s/it]{'loss': '1.043', 'grad_norm': '0.4546', 'learning_rate': '4.169e-06', 'epoch': '0.05858'}
JLOG {"event": "step", "step": 256, "elapsed": 2543.0, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.7019085884094238, "grad_norm": 0.4499092996120453, "learning_rate": 3.9438173442575e-06, "epoch": 0.05880663871819904, "t": 1784995784.214}
88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 256/290 [42:22<05:45, 10.16s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 257/290 [42:31<05:17, 9.62s/it]{'loss': '0.7019', 'grad_norm': '0.4499', 'learning_rate': '3.944e-06', 'epoch': '0.05881'}
JLOG {"event": "step", "step": 257, "elapsed": 2551.4, "sps": 0.1007, "mem_gb": 26.17, "loss": 0.894534170627594, "grad_norm": 0.36569350957870483, "learning_rate": 3.724476914084657e-06, "epoch": 0.059036352150692015, "t": 1784995792.592}
89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 257/290 [42:31<05:17, 9.62s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 258/290 [42:40<05:04, 9.52s/it]{'loss': '0.8945', 'grad_norm': '0.3657', 'learning_rate': '3.724e-06', 'epoch': '0.05904'}
JLOG {"event": "step", "step": 258, "elapsed": 2560.7, "sps": 0.1008, "mem_gb": 26.17, "loss": 1.179345726966858, "grad_norm": 0.6009256839752197, "learning_rate": 3.511175705587433e-06, "epoch": 0.05926606558318498, "t": 1784995801.858}
89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 258/290 [42:40<05:04, 9.52s/it] 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 259/290 [42:49<04:55, 9.54s/it]{'loss': '1.179', 'grad_norm': '0.6009', 'learning_rate': '3.511e-06', 'epoch': '0.05927'}
JLOG {"event": "step", "step": 259, "elapsed": 2570.2, "sps": 0.1008, "mem_gb": 26.17, "loss": 0.8715092539787292, "grad_norm": 0.38063642382621765, "learning_rate": 3.3039415557992225e-06, "epoch": 0.059495779015677944, "t": 1784995811.448}
89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 259/290 [42:49<04:55, 9.54s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 260/290 [42:59<04:49, 9.66s/it]{'loss': '0.8715', 'grad_norm': '0.3806', 'learning_rate': '3.304e-06', 'epoch': '0.0595'}
JLOG {"event": "step", "step": 260, "elapsed": 2580.2, "sps": 0.1008, "mem_gb": 26.17, "loss": 0.8992326855659485, "grad_norm": 0.4235899746417999, "learning_rate": 3.1028015099673955e-06, "epoch": 0.05972549244817091, "t": 1784995821.398}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 260/290 [42:59<04:49, 9.66s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 261/290 [43:09<04:35, 9.51s/it]{'loss': '0.8992', 'grad_norm': '0.4236', 'learning_rate': '3.103e-06', 'epoch': '0.05973'}
JLOG {"event": "step", "step": 261, "elapsed": 2589.4, "sps": 0.1008, "mem_gb": 26.17, "loss": 0.712963879108429, "grad_norm": 0.39785468578338623, "learning_rate": 2.9077818180237693e-06, "epoch": 0.05995520588066387, "t": 1784995830.565}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 261/290 [43:09<04:35, 9.51s/it] 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 262/290 [43:17<04:20, 9.30s/it]{'loss': '0.713', 'grad_norm': '0.3979', 'learning_rate': '2.908e-06', 'epoch': '0.05996'}
JLOG {"event": "step", "step": 262, "elapsed": 2598.2, "sps": 0.1008, "mem_gb": 26.17, "loss": 1.3513892889022827, "grad_norm": 0.48847496509552, "learning_rate": 2.7189079311587594e-06, "epoch": 0.06018491931315684, "t": 1784995839.374}
90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 262/290 [43:17<04:20, 9.30s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 263/290 [43:25<03:55, 8.72s/it]{'loss': '1.351', 'grad_norm': '0.4885', 'learning_rate': '2.719e-06', 'epoch': '0.06018'}
JLOG {"event": "step", "step": 263, "elapsed": 2605.5, "sps": 0.1009, "mem_gb": 26.17, "loss": 1.1129690408706665, "grad_norm": 0.6329951882362366, "learning_rate": 2.536204498499922e-06, "epoch": 0.0604146327456498, "t": 1784995846.743}
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 263/290 [43:25<03:55, 8.72s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 264/290 [43:34<03:49, 8.84s/it]{'loss': '1.113', 'grad_norm': '0.633', 'learning_rate': '2.536e-06', 'epoch': '0.06041'}
JLOG {"event": "step", "step": 264, "elapsed": 2614.6, "sps": 0.101, "mem_gb": 26.17, "loss": 1.2161818742752075, "grad_norm": 0.45582401752471924, "learning_rate": 2.359695363895109e-06, "epoch": 0.060644346178142766, "t": 1784995855.847}
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 264/290 [43:34<03:49, 8.84s/it] 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 265/290 [43:42<03:32, 8.51s/it]{'loss': '1.216', 'grad_norm': '0.4558', 'learning_rate': '2.36e-06', 'epoch': '0.06064'}
JLOG {"event": "step", "step": 265, "elapsed": 2622.4, "sps": 0.1011, "mem_gb": 26.17, "loss": 1.1733707189559937, "grad_norm": 0.5605895519256592, "learning_rate": 2.1894035628006517e-06, "epoch": 0.06087405961063573, "t": 1784995863.589}
91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 265/290 [43:42<03:32, 8.51s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 266/290 [43:51<03:27, 8.66s/it]{'loss': '1.173', 'grad_norm': '0.5606', 'learning_rate': '2.189e-06', 'epoch': '0.06087'}
JLOG {"event": "step", "step": 266, "elapsed": 2631.4, "sps": 0.1011, "mem_gb": 26.17, "loss": 1.1739319562911987, "grad_norm": 0.9685074687004089, "learning_rate": 2.0253513192751373e-06, "epoch": 0.061103773043128695, "t": 1784995872.599}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 266/290 [43:51<03:27, 8.66s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 267/290 [44:01<03:27, 9.04s/it]{'loss': '1.174', 'grad_norm': '0.9685', 'learning_rate': '2.025e-06', 'epoch': '0.0611'}
JLOG {"event": "step", "step": 267, "elapsed": 2641.3, "sps": 0.1011, "mem_gb": 26.17, "loss": 0.9966856837272644, "grad_norm": 0.39078766107559204, "learning_rate": 1.8675600430790308e-06, "epoch": 0.06133348647562166, "t": 1784995882.52}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 267/290 [44:01<03:27, 9.04s/it] 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 268/290 [44:10<03:19, 9.07s/it]{'loss': '0.9967', 'grad_norm': '0.3908', 'learning_rate': '1.868e-06', 'epoch': '0.06133'}
JLOG {"event": "step", "step": 268, "elapsed": 2650.5, "sps": 0.1011, "mem_gb": 26.17, "loss": 0.9958986639976501, "grad_norm": 0.558258593082428, "learning_rate": 1.7160503268806083e-06, "epoch": 0.061563199908114624, "t": 1784995891.653}
92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 268/290 [44:10<03:19, 9.07s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 269/290 [44:22<03:31, 10.06s/it]{'loss': '0.9959', 'grad_norm': '0.5583', 'learning_rate': '1.716e-06', 'epoch': '0.06156'}
JLOG {"event": "step", "step": 269, "elapsed": 2662.8, "sps": 0.101, "mem_gb": 26.17, "loss": 0.8480861186981201, "grad_norm": 0.45669516921043396, "learning_rate": 1.5708419435684462e-06, "epoch": 0.06179291334060759, "t": 1784995904.039}
93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 269/290 [44:22<03:31, 10.06s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 270/290 [44:32<03:18, 9.93s/it]{'loss': '0.8481', 'grad_norm': '0.4567', 'learning_rate': '1.571e-06', 'epoch': '0.06179'}
JLOG {"event": "step", "step": 270, "elapsed": 2672.5, "sps": 0.101, "mem_gb": 26.17, "loss": 0.7758588194847107, "grad_norm": 0.2341517210006714, "learning_rate": 1.4319538436709746e-06, "epoch": 0.06202262677310056, "t": 1784995913.673}
93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 270/290 [44:32<03:18, 9.93s/it] 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 271/290 [44:43<03:14, 10.26s/it]{'loss': '0.7759', 'grad_norm': '0.2342', 'learning_rate': '1.432e-06', 'epoch': '0.06202'}
JLOG {"event": "step", "step": 271, "elapsed": 2683.5, "sps": 0.101, "mem_gb": 26.17, "loss": 0.6006261706352234, "grad_norm": 0.4799966514110565, "learning_rate": 1.2994041528833266e-06, "epoch": 0.062252340205593525, "t": 1784995924.697}
93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 271/290 [44:43<03:14, 10.26s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 272/290 [44:51<02:56, 9.79s/it]{'loss': '0.6006', 'grad_norm': '0.48', 'learning_rate': '1.299e-06', 'epoch': '0.06225'}
JLOG {"event": "step", "step": 272, "elapsed": 2692.2, "sps": 0.101, "mem_gb": 26.17, "loss": 0.8342770338058472, "grad_norm": 0.430403470993042, "learning_rate": 1.1732101697018161e-06, "epoch": 0.06248205363808649, "t": 1784995933.377}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 272/290 [44:51<02:56, 9.79s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 273/290 [45:20<04:23, 15.52s/it]{'loss': '0.8343', 'grad_norm': '0.4304', 'learning_rate': '1.173e-06', 'epoch': '0.06248'}
JLOG {"event": "step", "step": 273, "elapsed": 2721.1, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.1603645086288452, "grad_norm": 0.3649888038635254, "learning_rate": 1.0533883631663966e-06, "epoch": 0.06271176707057945, "t": 1784995962.266}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 273/290 [45:20<04:23, 15.52s/it] 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 274/290 [45:29<03:37, 13.58s/it]{'loss': '1.16', 'grad_norm': '0.365', 'learning_rate': '1.053e-06', 'epoch': '0.06271'}
JLOG {"event": "step", "step": 274, "elapsed": 2730.1, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.9568006992340088, "grad_norm": 0.4201377034187317, "learning_rate": 9.3995437071136e-07, "epoch": 0.06294148050307241, "t": 1784995971.333}
94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 274/290 [45:29<03:37, 13.58s/it]{'loss': '0.9568', 'grad_norm': '0.4201', 'learning_rate': '9.4e-07', 'epoch': '0.06294'}
JLOG {"event": "hub_push_queued", "path": "checkpoints/step_000275", "t": 1784995981.426}
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 275/290 [45:39<03:08, 12.54s/it]JLOG {"event": "step", "step": 275, "elapsed": 2740.2, "sps": 0.1004, "mem_gb": 26.17, "loss": 1.005335807800293, "grad_norm": 0.41010183095932007, "learning_rate": 8.329229961245355e-07, "epoch": 0.06317119393556538, "t": 1784995981.428}
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 275/290 [45:39<03:08, 12.54s/it] 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 276/290 [45:49<02:41, 11.55s/it]{'loss': '1.005', 'grad_norm': '0.4101', 'learning_rate': '8.329e-07', 'epoch': '0.06317'}
JLOG {"event": "step", "step": 276, "elapsed": 2749.5, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.4597717821598053, "grad_norm": 0.3909689486026764, "learning_rate": 7.323082076153509e-07, "epoch": 0.06340090736805835, "t": 1784995990.691}
95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 276/290 [45:49<02:41, 11.55s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 277/290 [46:01<02:33, 11.78s/it]{'loss': '0.4598', 'grad_norm': '0.391', 'learning_rate': '7.323e-07', 'epoch': '0.0634'}
JLOG {"event": "step", "step": 277, "elapsed": 2761.8, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.6272485256195068, "grad_norm": 0.6699784994125366, "learning_rate": 6.381231359918638e-07, "epoch": 0.06363062080055132, "t": 1784996003.008}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 277/290 [46:01<02:33, 11.78s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 278/290 [46:11<02:15, 11.30s/it]{'loss': '0.6272', 'grad_norm': '0.67', 'learning_rate': '6.381e-07', 'epoch': '0.06363'}
JLOG {"event": "step", "step": 278, "elapsed": 2772.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9912877678871155, "grad_norm": 0.4068925678730011, "learning_rate": 5.503800729471376e-07, "epoch": 0.06386033423304428, "t": 1784996013.179}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 278/290 [46:11<02:15, 11.30s/it] 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 279/290 [46:21<01:59, 10.83s/it]{'loss': '0.9913', 'grad_norm': '0.4069', 'learning_rate': '5.504e-07', 'epoch': '0.06386'}
JLOG {"event": "step", "step": 279, "elapsed": 2781.7, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9467837810516357, "grad_norm": 0.719234824180603, "learning_rate": 4.6909046945509125e-07, "epoch": 0.06409004766553725, "t": 1784996022.914}
96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 279/290 [46:21<01:59, 10.83s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 280/290 [46:30<01:42, 10.29s/it]{'loss': '0.9468', 'grad_norm': '0.7192', 'learning_rate': '4.691e-07', 'epoch': '0.06409'}
JLOG {"event": "step", "step": 280, "elapsed": 2790.7, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.14493989944458, "grad_norm": 0.6443649530410767, "learning_rate": 3.9426493427611177e-07, "epoch": 0.06431976109803021, "t": 1784996031.945}
97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 280/290 [46:30<01:42, 10.29s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 281/290 [46:40<01:31, 10.13s/it]{'loss': '1.145', 'grad_norm': '0.6444', 'learning_rate': '3.943e-07', 'epoch': '0.06432'}
JLOG {"event": "step", "step": 281, "elapsed": 2800.5, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.1531542539596558, "grad_norm": 0.42555496096611023, "learning_rate": 3.2591323257248893e-07, "epoch": 0.06454947453052318, "t": 1784996041.715}
97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 281/290 [46:40<01:31, 10.13s/it] 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 282/290 [46:50<01:21, 10.16s/it]{'loss': '1.153', 'grad_norm': '0.4256', 'learning_rate': '3.259e-07', 'epoch': '0.06455'}
JLOG {"event": "step", "step": 282, "elapsed": 2810.7, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.9997274875640869, "grad_norm": 0.5444992184638977, "learning_rate": 2.640442846340796e-07, "epoch": 0.06477918796301614, "t": 1784996051.938}
97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 282/290 [46:50<01:21, 10.16s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 283/290 [47:00<01:11, 10.20s/it]{'loss': '0.9997', 'grad_norm': '0.5445', 'learning_rate': '2.64e-07', 'epoch': '0.06478'}
JLOG {"event": "step", "step": 283, "elapsed": 2821.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.7051418423652649, "grad_norm": 0.5544769167900085, "learning_rate": 2.086661647140997e-07, "epoch": 0.0650089013955091, "t": 1784996062.22}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 283/290 [47:00<01:11, 10.20s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 284/290 [47:10<01:00, 10.10s/it]{'loss': '0.7051', 'grad_norm': '0.5545', 'learning_rate': '2.087e-07', 'epoch': '0.06501'}
JLOG {"event": "step", "step": 284, "elapsed": 2830.9, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0231595039367676, "grad_norm": 0.4749950170516968, "learning_rate": 1.5978609997542304e-07, "epoch": 0.06523861482800207, "t": 1784996072.095}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 284/290 [47:10<01:00, 10.10s/it] 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 285/290 [47:18<00:47, 9.58s/it]{'loss': '1.023', 'grad_norm': '0.475', 'learning_rate': '1.598e-07', 'epoch': '0.06524'}
JLOG {"event": "step", "step": 285, "elapsed": 2839.3, "sps": 0.1004, "mem_gb": 26.17, "loss": 0.8631291389465332, "grad_norm": 0.6004589200019836, "learning_rate": 1.1741046954736878e-07, "epoch": 0.06546832826049503, "t": 1784996080.472}
98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 285/290 [47:18<00:47, 9.58s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 286/290 [47:31<00:42, 10.55s/it]{'loss': '0.8631', 'grad_norm': '0.6005', 'learning_rate': '1.174e-07', 'epoch': '0.06547'}
JLOG {"event": "step", "step": 286, "elapsed": 2852.1, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.7734222412109375, "grad_norm": 0.39963412284851074, "learning_rate": 8.15448036932176e-08, "epoch": 0.065698041692988, "t": 1784996093.291}
99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 286/290 [47:31<00:42, 10.55s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 287/290 [47:40<00:30, 10.05s/it]{'loss': '0.7734', 'grad_norm': '0.3996', 'learning_rate': '8.154e-08', 'epoch': '0.0657'}
JLOG {"event": "step", "step": 287, "elapsed": 2861.0, "sps": 0.1003, "mem_gb": 26.17, "loss": 1.0377631187438965, "grad_norm": 0.44385361671447754, "learning_rate": 5.2193783088455576e-08, "epoch": 0.06592775512548096, "t": 1784996102.162}
99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 287/290 [47:40<00:30, 10.05s/it] 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 288/290 [47:52<00:21, 10.59s/it]{'loss': '1.038', 'grad_norm': '0.4439', 'learning_rate': '5.219e-08', 'epoch': '0.06593'}
JLOG {"event": "step", "step": 288, "elapsed": 2872.8, "sps": 0.1003, "mem_gb": 26.17, "loss": 0.8836758136749268, "grad_norm": 0.4671189486980438, "learning_rate": 2.936123820993508e-08, "epoch": 0.06615746855797393, "t": 1784996114.004}
99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 288/290 [47:52<00:21, 10.59s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 289/290 [48:03<00:10, 10.56s/it]{'loss': '0.8837', 'grad_norm': '0.4671', 'learning_rate': '2.936e-08', 'epoch': '0.06616'}
JLOG {"event": "step", "step": 289, "elapsed": 2883.3, "sps": 0.1002, "mem_gb": 26.17, "loss": 0.7882477045059204, "grad_norm": 0.5389400720596313, "learning_rate": 1.305014883595801e-08, "epoch": 0.06638718199046689, "t": 1784996124.506}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 289/290 [48:03<00:10, 10.56s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 290/290 [48:12<00:00, 10.33s/it]{'loss': '0.7882', 'grad_norm': '0.5389', 'learning_rate': '1.305e-08', 'epoch': '0.06639'}
JLOG {"event": "step", "step": 290, "elapsed": 2893.1, "sps": 0.1002, "mem_gb": 26.17, "loss": 1.081870675086975, "grad_norm": 0.37443339824676514, "learning_rate": 3.262643657425679e-09, "epoch": 0.06661689542295986, "t": 1784996134.306}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 290/290 [48:12<00:00, 10.33s/it]{'loss': '1.082', 'grad_norm': '0.3744', 'learning_rate': '3.263e-09', 'epoch': '0.06662'}
JLOG {"event": "step", "step": 290, "elapsed": 2893.4, "sps": 0.1002, "mem_gb": 26.17, "train_runtime": 2893.0894, "train_samples_per_second": 3.208, "train_steps_per_second": 0.1, "total_flos": 1.3307880663755597e+17, "train_loss": 1.6558819168600543, "epoch": 0.06661689542295986, "t": 1784996134.584}
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 290/290 [48:13<00:00, 10.33s/it] 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 290/290 [48:13<00:00, 9.98s/it]
{'train_runtime': '2893', 'train_samples_per_second': '3.208', 'train_steps_per_second': '0.1', 'train_loss': '1.656', 'epoch': '0.06662'}
JLOG {"event": "final_saved", "path": "/home/shadeform/c2l/out/final_adapter", "t": 1784996135.045}
JLOG {"event": "hub_push_queued", "path": "final_adapter", "t": 1784996135.045}
JLOG {"event": "hub_push_queued", "path": "logs", "t": 1784996135.045}