train.log

train.log

@@ -346,3 +346,14 @@
 [13:51:18] step 4975/8000 | loss=1.7636 | lr=2.00e-03,3.00e-05 | clip=0/25 | mix s/d/b=2626800/0/0 q=0 p=0 | 505 pos/s | vram=35.72GB
 [13:51:40] step 5000/8000 | loss=1.7778 | lr=2.00e-03,3.00e-05 | clip=3/25 | mix s/d/b=2640000/0/0 q=0 p=0 | 505 pos/s | vram=35.72GB
 [13:51:49] val/lichess_opening hard_ce=1.4362 soft_ce=1.4362 soft_temp_ce=1.4362 teacher_entropy=0.0000 teacher_kl=1.4362 wdl_ce=1.0361 value_rows=8192.0000
+[13:52:11] step 5025/8000 | loss=1.7575 | lr=2.00e-03,3.00e-05 | clip=2/25 | mix s/d/b=2653200/0/0 q=0 p=0 | 505 pos/s | vram=35.72GB
+[13:52:33] step 5050/8000 | loss=1.7691 | lr=2.00e-03,3.00e-05 | clip=0/25 | mix s/d/b=2666400/0/0 q=0 p=0 | 505 pos/s | vram=35.72GB
+[13:52:55] step 5075/8000 | loss=1.7413 | lr=2.00e-03,3.00e-05 | clip=0/25 | mix s/d/b=2679600/0/0 q=0 p=0 | 506 pos/s | vram=35.72GB
+[13:53:16] step 5100/8000 | loss=1.7701 | lr=2.00e-03,3.00e-05 | clip=0/25 | mix s/d/b=2692800/0/0 q=0 p=0 | 506 pos/s | vram=35.72GB
+[13:53:17] ckpt step_005100.pt + latest.pt (live) steps=5100 status=mid kind=full
+[13:53:26] val/lichess_opening hard_ce=1.4361 soft_ce=1.4361 soft_temp_ce=1.4361 teacher_entropy=0.0000 teacher_kl=1.4361 wdl_ce=1.0370 value_rows=8192.0000
+[13:53:48] step 5125/8000 | loss=1.7740 | lr=2.00e-03,3.00e-05 | clip=1/25 | mix s/d/b=2706000/0/0 q=0 p=0 | 506 pos/s | vram=35.72GB
+[13:54:10] step 5150/8000 | loss=1.7771 | lr=2.00e-03,3.00e-05 | clip=1/25 | mix s/d/b=2719200/0/0 q=0 p=0 | 506 pos/s | vram=35.72GB
+[13:54:32] step 5175/8000 | loss=1.7650 | lr=2.00e-03,3.00e-05 | clip=0/25 | mix s/d/b=2732400/0/0 q=0 p=0 | 506 pos/s | vram=35.72GB
+[13:54:54] step 5200/8000 | loss=1.7655 | lr=2.00e-03,3.00e-05 | clip=1/25 | mix s/d/b=2745600/0/0 q=0 p=0 | 507 pos/s | vram=35.72GB
+[13:55:03] val/lichess_opening hard_ce=1.4293 soft_ce=1.4293 soft_temp_ce=1.4293 teacher_entropy=0.0000 teacher_kl=1.4293 wdl_ce=1.0344 value_rows=8192.0000