Upload train log after epoch 2
Browse files
checkpoints/h200_phase2_lora_encoder/train.log
CHANGED
|
@@ -363,3 +363,100 @@ Frozen params: 1,279,887,360
|
|
| 363 |
2026-06-22 18:21:50,337 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/epoch_001.pt -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/epochs/epoch_001_step_437.pt
|
| 364 |
2026-06-22 18:22:13,383 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/config.yaml -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/config.yaml
|
| 365 |
2026-06-22 18:22:13,705 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/train.log -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/train.log
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 363 |
2026-06-22 18:21:50,337 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/epoch_001.pt -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/epochs/epoch_001_step_437.pt
|
| 364 |
2026-06-22 18:22:13,383 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/config.yaml -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/config.yaml
|
| 365 |
2026-06-22 18:22:13,705 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/train.log -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/train.log
|
| 366 |
+
2026-06-22 18:22:14,071 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/checkpoint_manifest.json -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/checkpoint_manifest.json
|
| 367 |
+
2026-06-22 18:22:14,144 [WARNING] No files have been modified since last commit. Skipping to prevent empty commit.
|
| 368 |
+
2026-06-22 18:22:14,772 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/best.pt -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/best.pt
|
| 369 |
+
2026-06-22 18:22:25,324 [INFO] Saved trainable-only checkpoint to runs/h200_llm2seq_phase2_lora_encoder/checkpoint_437.pt (519 model tensors, stores_base_encoder_weights=False)
|
| 370 |
+
2026-06-22 18:23:06,031 [INFO] Step 440/874 | Loss: 0.7526 | CE: 0.7526 | LR: 2.59e-05 | Epoch: 2/2
|
| 371 |
+
2026-06-22 18:24:11,928 [INFO] Step 445/874 | Loss: 0.6760 | CE: 0.6760 | LR: 2.55e-05 | Epoch: 2/2
|
| 372 |
+
2026-06-22 18:25:18,237 [INFO] Step 450/874 | Loss: 0.6585 | CE: 0.6585 | LR: 2.50e-05 | Epoch: 2/2
|
| 373 |
+
2026-06-22 18:26:23,672 [INFO] Step 455/874 | Loss: 0.6663 | CE: 0.6663 | LR: 2.45e-05 | Epoch: 2/2
|
| 374 |
+
2026-06-22 18:27:27,604 [INFO] Step 460/874 | Loss: 0.6314 | CE: 0.6314 | LR: 2.41e-05 | Epoch: 2/2
|
| 375 |
+
2026-06-22 18:28:30,667 [INFO] Step 465/874 | Loss: 0.6577 | CE: 0.6577 | LR: 2.36e-05 | Epoch: 2/2
|
| 376 |
+
2026-06-22 18:29:37,585 [INFO] Step 470/874 | Loss: 0.6223 | CE: 0.6223 | LR: 2.31e-05 | Epoch: 2/2
|
| 377 |
+
2026-06-22 18:30:45,121 [INFO] Step 475/874 | Loss: 0.6784 | CE: 0.6784 | LR: 2.27e-05 | Epoch: 2/2
|
| 378 |
+
2026-06-22 18:31:51,490 [INFO] Step 480/874 | Loss: 0.6582 | CE: 0.6582 | LR: 2.22e-05 | Epoch: 2/2
|
| 379 |
+
2026-06-22 18:32:51,515 [INFO] Step 485/874 | Loss: 0.6192 | CE: 0.6192 | LR: 2.18e-05 | Epoch: 2/2
|
| 380 |
+
2026-06-22 18:33:58,174 [INFO] Step 490/874 | Loss: 0.6675 | CE: 0.6675 | LR: 2.13e-05 | Epoch: 2/2
|
| 381 |
+
2026-06-22 18:35:03,199 [INFO] Step 495/874 | Loss: 0.6733 | CE: 0.6733 | LR: 2.09e-05 | Epoch: 2/2
|
| 382 |
+
2026-06-22 18:36:10,421 [INFO] Step 500/874 | Loss: 0.6779 | CE: 0.6779 | LR: 2.04e-05 | Epoch: 2/2
|
| 383 |
+
2026-06-22 18:37:17,323 [INFO] Step 505/874 | Loss: 0.6684 | CE: 0.6684 | LR: 1.99e-05 | Epoch: 2/2
|
| 384 |
+
2026-06-22 18:38:24,713 [INFO] Step 510/874 | Loss: 0.6440 | CE: 0.6440 | LR: 1.95e-05 | Epoch: 2/2
|
| 385 |
+
2026-06-22 18:39:31,511 [INFO] Step 515/874 | Loss: 0.6573 | CE: 0.6573 | LR: 1.90e-05 | Epoch: 2/2
|
| 386 |
+
2026-06-22 18:40:35,820 [INFO] Step 520/874 | Loss: 0.7002 | CE: 0.7002 | LR: 1.86e-05 | Epoch: 2/2
|
| 387 |
+
2026-06-22 18:41:42,196 [INFO] Step 525/874 | Loss: 0.6571 | CE: 0.6571 | LR: 1.81e-05 | Epoch: 2/2
|
| 388 |
+
2026-06-22 18:42:49,510 [INFO] Step 530/874 | Loss: 0.6473 | CE: 0.6473 | LR: 1.77e-05 | Epoch: 2/2
|
| 389 |
+
2026-06-22 18:43:53,557 [INFO] Step 535/874 | Loss: 0.6248 | CE: 0.6248 | LR: 1.73e-05 | Epoch: 2/2
|
| 390 |
+
2026-06-22 18:45:00,697 [INFO] Step 540/874 | Loss: 0.6269 | CE: 0.6269 | LR: 1.68e-05 | Epoch: 2/2
|
| 391 |
+
2026-06-22 18:46:06,469 [INFO] Step 545/874 | Loss: 0.6463 | CE: 0.6463 | LR: 1.64e-05 | Epoch: 2/2
|
| 392 |
+
2026-06-22 18:47:12,936 [INFO] Step 550/874 | Loss: 0.6561 | CE: 0.6561 | LR: 1.59e-05 | Epoch: 2/2
|
| 393 |
+
2026-06-22 18:48:15,872 [INFO] Step 555/874 | Loss: 0.6494 | CE: 0.6494 | LR: 1.55e-05 | Epoch: 2/2
|
| 394 |
+
2026-06-22 18:49:21,795 [INFO] Step 560/874 | Loss: 0.6783 | CE: 0.6783 | LR: 1.51e-05 | Epoch: 2/2
|
| 395 |
+
2026-06-22 18:50:26,199 [INFO] Step 565/874 | Loss: 0.6812 | CE: 0.6812 | LR: 1.47e-05 | Epoch: 2/2
|
| 396 |
+
2026-06-22 18:51:33,721 [INFO] Step 570/874 | Loss: 0.6749 | CE: 0.6749 | LR: 1.42e-05 | Epoch: 2/2
|
| 397 |
+
2026-06-22 18:52:38,482 [INFO] Step 575/874 | Loss: 0.6687 | CE: 0.6687 | LR: 1.38e-05 | Epoch: 2/2
|
| 398 |
+
2026-06-22 18:53:42,361 [INFO] Step 580/874 | Loss: 0.6773 | CE: 0.6773 | LR: 1.34e-05 | Epoch: 2/2
|
| 399 |
+
2026-06-22 18:54:47,657 [INFO] Step 585/874 | Loss: 0.6899 | CE: 0.6899 | LR: 1.30e-05 | Epoch: 2/2
|
| 400 |
+
2026-06-22 18:55:52,042 [INFO] Step 590/874 | Loss: 0.6634 | CE: 0.6634 | LR: 1.26e-05 | Epoch: 2/2
|
| 401 |
+
2026-06-22 18:56:59,644 [INFO] Step 595/874 | Loss: 0.6923 | CE: 0.6923 | LR: 1.22e-05 | Epoch: 2/2
|
| 402 |
+
2026-06-22 18:58:07,066 [INFO] Step 600/874 | Loss: 0.6613 | CE: 0.6613 | LR: 1.18e-05 | Epoch: 2/2
|
| 403 |
+
2026-06-22 18:59:13,375 [INFO] Step 605/874 | Loss: 0.6895 | CE: 0.6895 | LR: 1.14e-05 | Epoch: 2/2
|
| 404 |
+
2026-06-22 19:00:20,714 [INFO] Step 610/874 | Loss: 0.6508 | CE: 0.6508 | LR: 1.10e-05 | Epoch: 2/2
|
| 405 |
+
2026-06-22 19:01:25,988 [INFO] Step 615/874 | Loss: 0.6793 | CE: 0.6793 | LR: 1.07e-05 | Epoch: 2/2
|
| 406 |
+
2026-06-22 19:02:29,223 [INFO] Step 620/874 | Loss: 0.6470 | CE: 0.6470 | LR: 1.03e-05 | Epoch: 2/2
|
| 407 |
+
2026-06-22 19:03:34,145 [INFO] Step 625/874 | Loss: 0.7125 | CE: 0.7125 | LR: 9.90e-06 | Epoch: 2/2
|
| 408 |
+
2026-06-22 19:04:40,433 [INFO] Step 630/874 | Loss: 0.6656 | CE: 0.6656 | LR: 9.54e-06 | Epoch: 2/2
|
| 409 |
+
2026-06-22 19:05:47,144 [INFO] Step 635/874 | Loss: 0.6328 | CE: 0.6328 | LR: 9.18e-06 | Epoch: 2/2
|
| 410 |
+
2026-06-22 19:06:54,351 [INFO] Step 640/874 | Loss: 0.6952 | CE: 0.6952 | LR: 8.82e-06 | Epoch: 2/2
|
| 411 |
+
2026-06-22 19:08:01,812 [INFO] Step 645/874 | Loss: 0.6720 | CE: 0.6720 | LR: 8.47e-06 | Epoch: 2/2
|
| 412 |
+
2026-06-22 19:09:05,437 [INFO] Step 650/874 | Loss: 0.6587 | CE: 0.6587 | LR: 8.13e-06 | Epoch: 2/2
|
| 413 |
+
2026-06-22 19:10:10,727 [INFO] Step 655/874 | Loss: 0.6706 | CE: 0.6706 | LR: 7.79e-06 | Epoch: 2/2
|
| 414 |
+
2026-06-22 19:11:17,984 [INFO] Step 660/874 | Loss: 0.7082 | CE: 0.7082 | LR: 7.45e-06 | Epoch: 2/2
|
| 415 |
+
2026-06-22 19:12:21,738 [INFO] Step 665/874 | Loss: 0.6731 | CE: 0.6731 | LR: 7.13e-06 | Epoch: 2/2
|
| 416 |
+
2026-06-22 19:13:28,847 [INFO] Step 670/874 | Loss: 0.6692 | CE: 0.6692 | LR: 6.81e-06 | Epoch: 2/2
|
| 417 |
+
2026-06-22 19:14:32,901 [INFO] Step 675/874 | Loss: 0.6216 | CE: 0.6216 | LR: 6.49e-06 | Epoch: 2/2
|
| 418 |
+
2026-06-22 19:15:40,203 [INFO] Step 680/874 | Loss: 0.6764 | CE: 0.6764 | LR: 6.18e-06 | Epoch: 2/2
|
| 419 |
+
2026-06-22 19:16:43,589 [INFO] Step 685/874 | Loss: 0.6857 | CE: 0.6857 | LR: 5.88e-06 | Epoch: 2/2
|
| 420 |
+
2026-06-22 19:17:47,913 [INFO] Step 690/874 | Loss: 0.6641 | CE: 0.6641 | LR: 5.59e-06 | Epoch: 2/2
|
| 421 |
+
2026-06-22 19:18:54,829 [INFO] Step 695/874 | Loss: 0.6673 | CE: 0.6673 | LR: 5.30e-06 | Epoch: 2/2
|
| 422 |
+
2026-06-22 19:19:59,148 [INFO] Step 700/874 | Loss: 0.6734 | CE: 0.6734 | LR: 5.02e-06 | Epoch: 2/2
|
| 423 |
+
2026-06-22 19:21:03,180 [INFO] Step 705/874 | Loss: 0.6858 | CE: 0.6858 | LR: 5.00e-06 | Epoch: 2/2
|
| 424 |
+
2026-06-22 19:22:07,855 [INFO] Step 710/874 | Loss: 0.6633 | CE: 0.6633 | LR: 5.00e-06 | Epoch: 2/2
|
| 425 |
+
2026-06-22 19:23:11,988 [INFO] Step 715/874 | Loss: 0.6516 | CE: 0.6516 | LR: 5.00e-06 | Epoch: 2/2
|
| 426 |
+
2026-06-22 19:24:18,106 [INFO] Step 720/874 | Loss: 0.6375 | CE: 0.6375 | LR: 5.00e-06 | Epoch: 2/2
|
| 427 |
+
2026-06-22 19:25:23,269 [INFO] Step 725/874 | Loss: 0.6936 | CE: 0.6936 | LR: 5.00e-06 | Epoch: 2/2
|
| 428 |
+
2026-06-22 19:26:28,035 [INFO] Step 730/874 | Loss: 0.6723 | CE: 0.6723 | LR: 5.00e-06 | Epoch: 2/2
|
| 429 |
+
2026-06-22 19:27:32,438 [INFO] Step 735/874 | Loss: 0.6811 | CE: 0.6811 | LR: 5.00e-06 | Epoch: 2/2
|
| 430 |
+
2026-06-22 19:28:37,581 [INFO] Step 740/874 | Loss: 0.7179 | CE: 0.7179 | LR: 5.00e-06 | Epoch: 2/2
|
| 431 |
+
2026-06-22 19:29:41,822 [INFO] Step 745/874 | Loss: 0.6541 | CE: 0.6541 | LR: 5.00e-06 | Epoch: 2/2
|
| 432 |
+
2026-06-22 19:30:47,379 [INFO] Step 750/874 | Loss: 0.6483 | CE: 0.6483 | LR: 5.00e-06 | Epoch: 2/2
|
| 433 |
+
2026-06-22 19:31:50,610 [INFO] Step 755/874 | Loss: 0.6943 | CE: 0.6943 | LR: 5.00e-06 | Epoch: 2/2
|
| 434 |
+
2026-06-22 19:32:55,945 [INFO] Step 760/874 | Loss: 0.6906 | CE: 0.6906 | LR: 5.00e-06 | Epoch: 2/2
|
| 435 |
+
2026-06-22 19:34:01,473 [INFO] Step 765/874 | Loss: 0.6776 | CE: 0.6776 | LR: 5.00e-06 | Epoch: 2/2
|
| 436 |
+
2026-06-22 19:35:08,560 [INFO] Step 770/874 | Loss: 0.7123 | CE: 0.7123 | LR: 5.00e-06 | Epoch: 2/2
|
| 437 |
+
2026-06-22 19:36:16,040 [INFO] Step 775/874 | Loss: 0.6830 | CE: 0.6830 | LR: 5.00e-06 | Epoch: 2/2
|
| 438 |
+
2026-06-22 19:37:21,682 [INFO] Step 780/874 | Loss: 0.6902 | CE: 0.6902 | LR: 5.00e-06 | Epoch: 2/2
|
| 439 |
+
2026-06-22 19:38:24,254 [INFO] Step 785/874 | Loss: 0.6839 | CE: 0.6839 | LR: 5.00e-06 | Epoch: 2/2
|
| 440 |
+
2026-06-22 19:39:30,320 [INFO] Step 790/874 | Loss: 0.6676 | CE: 0.6676 | LR: 5.00e-06 | Epoch: 2/2
|
| 441 |
+
2026-06-22 19:40:37,677 [INFO] Step 795/874 | Loss: 0.6743 | CE: 0.6743 | LR: 5.00e-06 | Epoch: 2/2
|
| 442 |
+
2026-06-22 19:41:39,133 [INFO] Step 800/874 | Loss: 0.7150 | CE: 0.7150 | LR: 5.00e-06 | Epoch: 2/2
|
| 443 |
+
2026-06-22 19:42:44,981 [INFO] Step 805/874 | Loss: 0.7008 | CE: 0.7008 | LR: 5.00e-06 | Epoch: 2/2
|
| 444 |
+
2026-06-22 19:43:51,776 [INFO] Step 810/874 | Loss: 0.6678 | CE: 0.6678 | LR: 5.00e-06 | Epoch: 2/2
|
| 445 |
+
2026-06-22 19:44:56,521 [INFO] Step 815/874 | Loss: 0.6620 | CE: 0.6620 | LR: 5.00e-06 | Epoch: 2/2
|
| 446 |
+
2026-06-22 19:46:02,087 [INFO] Step 820/874 | Loss: 0.7109 | CE: 0.7109 | LR: 5.00e-06 | Epoch: 2/2
|
| 447 |
+
2026-06-22 19:47:09,600 [INFO] Step 825/874 | Loss: 0.6774 | CE: 0.6774 | LR: 5.00e-06 | Epoch: 2/2
|
| 448 |
+
2026-06-22 19:48:10,324 [INFO] Step 830/874 | Loss: 0.7153 | CE: 0.7153 | LR: 5.00e-06 | Epoch: 2/2
|
| 449 |
+
2026-06-22 19:49:16,199 [INFO] Step 835/874 | Loss: 0.6919 | CE: 0.6919 | LR: 5.00e-06 | Epoch: 2/2
|
| 450 |
+
2026-06-22 19:50:21,486 [INFO] Step 840/874 | Loss: 0.6811 | CE: 0.6811 | LR: 5.00e-06 | Epoch: 2/2
|
| 451 |
+
2026-06-22 19:51:24,706 [INFO] Step 845/874 | Loss: 0.6961 | CE: 0.6961 | LR: 5.00e-06 | Epoch: 2/2
|
| 452 |
+
2026-06-22 19:52:29,023 [INFO] Step 850/874 | Loss: 0.6782 | CE: 0.6782 | LR: 5.00e-06 | Epoch: 2/2
|
| 453 |
+
2026-06-22 19:53:35,015 [INFO] Step 855/874 | Loss: 0.7270 | CE: 0.7270 | LR: 5.00e-06 | Epoch: 2/2
|
| 454 |
+
2026-06-22 19:54:41,082 [INFO] Step 860/874 | Loss: 0.7041 | CE: 0.7041 | LR: 5.00e-06 | Epoch: 2/2
|
| 455 |
+
2026-06-22 19:55:46,639 [INFO] Step 865/874 | Loss: 0.7503 | CE: 0.7503 | LR: 5.00e-06 | Epoch: 2/2
|
| 456 |
+
2026-06-22 19:56:51,604 [INFO] Step 870/874 | Loss: 0.7782 | CE: 0.7782 | LR: 5.00e-06 | Epoch: 2/2
|
| 457 |
+
2026-06-22 20:00:50,496 [INFO] Step 874 | Eval Loss: 1.5088
|
| 458 |
+
2026-06-22 20:00:51,631 [INFO] Saved trainable-only checkpoint to runs/h200_llm2seq_phase2_lora_encoder/epoch_002.pt (519 model tensors, stores_base_encoder_weights=False)
|
| 459 |
+
2026-06-22 20:00:52,641 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/epoch_002.pt -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/epochs/epoch_002_step_874.pt
|
| 460 |
+
2026-06-22 20:01:18,459 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/config.yaml -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/config.yaml
|
| 461 |
+
2026-06-22 20:01:18,541 [WARNING] No files have been modified since last commit. Skipping to prevent empty commit.
|
| 462 |
+
2026-06-22 20:01:18,595 [INFO] Uploading to HF: runs/h200_llm2seq_phase2_lora_encoder/train.log -> BienKieu/llm2seq-wikilingua/checkpoints/h200_phase2_lora_encoder/train.log
|