| === preinstall helpers === |
| WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. |
|
|
| [notice] A new release of pip is available: 24.2 -> 26.2.1 |
| [notice] To update, run: python -m pip install --upgrade pip |
| === pip deps === |
| WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. |
|
|
| [notice] A new release of pip is available: 24.2 -> 26.2.1 |
| [notice] To update, run: python -m pip install --upgrade pip |
| === training === |
| WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. |
|
|
| [notice] A new release of pip is available: 24.2 -> 26.2.1 |
| [notice] To update, run: python -m pip install --upgrade pip |
| === load SmallAICreator/aurora700m-sft-hf |
| trainable params: 11,501,568 || all params: 718,981,632 || trainable%: 1.5997 |
| === examples 560 |
|
0%| | 0/105 [00:00<?, ?it/s]
1%| | 1/105 [00:01<02:54, 1.67s/it]
2%|▏ | 2/105 [00:02<01:31, 1.12it/s]
3%|▎ | 3/105 [00:02<01:05, 1.57it/s]
4%|▍ | 4/105 [00:02<00:52, 1.92it/s]
5%|▍ | 5/105 [00:03<00:45, 2.21it/s]
{'loss': 2.602, 'grad_norm': 0.823043942451477, 'learning_rate': 0.00019995162822919883, 'epoch': 0.14} |
|
5%|▍ | 5/105 [00:03<00:45, 2.21it/s]
6%|▌ | 6/105 [00:03<00:40, 2.42it/s]
7%|▋ | 7/105 [00:03<00:38, 2.57it/s]
8%|▊ | 8/105 [00:04<00:35, 2.70it/s]
9%|▊ | 9/105 [00:04<00:34, 2.78it/s]
10%|▉ | 10/105 [00:04<00:33, 2.82it/s]
{'loss': 2.1297, 'grad_norm': 0.8792126178741455, 'learning_rate': 0.00019826352482222638, 'epoch': 0.29} |
|
10%|▉ | 10/105 [00:04<00:33, 2.82it/s]
10%|█ | 11/105 [00:05<00:32, 2.87it/s]
11%|█▏ | 12/105 [00:05<00:32, 2.90it/s]
12%|█▏ | 13/105 [00:05<00:31, 2.92it/s]
13%|█▎ | 14/105 [00:06<00:30, 2.96it/s]
14%|█▍ | 15/105 [00:06<00:30, 2.99it/s]
{'loss': 1.6048, 'grad_norm': 0.7620522975921631, 'learning_rate': 0.0001942034263469989, 'epoch': 0.43} |
|
14%|█▍ | 15/105 [00:06<00:30, 2.99it/s]
15%|█▌ | 16/105 [00:06<00:29, 3.03it/s]
16%|█▌ | 17/105 [00:07<00:29, 3.03it/s]
17%|█▋ | 18/105 [00:07<00:28, 3.02it/s]
18%|█▊ | 19/105 [00:07<00:28, 3.02it/s]
19%|█▉ | 20/105 [00:08<00:28, 3.03it/s]
{'loss': 1.4066, 'grad_norm': 1.0061097145080566, 'learning_rate': 0.00018786934000992688, 'epoch': 0.57} |
|
19%|█▉ | 20/105 [00:08<00:28, 3.03it/s]
20%|██ | 21/105 [00:08<00:27, 3.03it/s]
21%|██ | 22/105 [00:08<00:27, 3.05it/s]
22%|██▏ | 23/105 [00:09<00:27, 3.02it/s]
23%|██▎ | 24/105 [00:09<00:26, 3.03it/s]
24%|██▍ | 25/105 [00:09<00:26, 3.04it/s]
{'loss': 1.0735, 'grad_norm': 0.7485285997390747, 'learning_rate': 0.00017941416508447536, 'epoch': 0.71} |
|
24%|██▍ | 25/105 [00:09<00:26, 3.04it/s]
25%|██▍ | 26/105 [00:09<00:25, 3.05it/s]
26%|██▌ | 27/105 [00:10<00:25, 3.06it/s]
27%|██▋ | 28/105 [00:10<00:25, 3.07it/s]
28%|██▊ | 29/105 [00:10<00:24, 3.07it/s]
29%|██▊ | 30/105 [00:11<00:24, 3.07it/s]
{'loss': 0.8117, 'grad_norm': 0.8129481077194214, 'learning_rate': 0.0001690420020571747, 'epoch': 0.86} |
|
29%|██▊ | 30/105 [00:11<00:24, 3.07it/s]
30%|██▉ | 31/105 [00:11<00:24, 3.08it/s]
30%|███ | 32/105 [00:11<00:23, 3.07it/s]
31%|███▏ | 33/105 [00:12<00:23, 3.06it/s]
32%|███▏ | 34/105 [00:12<00:23, 3.06it/s]
33%|███▎ | 35/105 [00:12<00:22, 3.07it/s]
{'loss': 0.6801, 'grad_norm': 0.8515280485153198, 'learning_rate': 0.00015700322582137827, 'epoch': 1.0} |
|
33%|███▎ | 35/105 [00:12<00:22, 3.07it/s]
34%|███▍ | 36/105 [00:13<00:22, 3.07it/s]
35%|███▌ | 37/105 [00:13<00:22, 3.06it/s]
36%|███▌ | 38/105 [00:13<00:21, 3.07it/s]
37%|███▋ | 39/105 [00:14<00:21, 3.09it/s]
38%|███▊ | 40/105 [00:14<00:21, 3.09it/s]
{'loss': 0.4874, 'grad_norm': 0.9037691950798035, 'learning_rate': 0.00014358844184753712, 'epoch': 1.14} |
|
38%|███▊ | 40/105 [00:14<00:21, 3.09it/s]
39%|███▉ | 41/105 [00:14<00:20, 3.09it/s]
40%|████ | 42/105 [00:15<00:20, 3.08it/s]
41%|████ | 43/105 [00:15<00:20, 3.07it/s]
42%|████▏ | 44/105 [00:15<00:19, 3.08it/s]
43%|████▎ | 45/105 [00:16<00:19, 3.08it/s]
{'loss': 0.3424, 'grad_norm': 0.8173766732215881, 'learning_rate': 0.00012912147122272523, 'epoch': 1.29} |
|
43%|████▎ | 45/105 [00:16<00:19, 3.08it/s]
44%|████▍ | 46/105 [00:16<00:19, 3.08it/s]
45%|████▍ | 47/105 [00:16<00:18, 3.05it/s]
46%|████▌ | 48/105 [00:17<00:18, 3.08it/s]
47%|████▋ | 49/105 [00:17<00:18, 3.09it/s]
48%|████▊ | 50/105 [00:17<00:18, 3.05it/s]
{'loss': 0.2959, 'grad_norm': 0.7996039986610413, 'learning_rate': 0.00011395153389439233, 'epoch': 1.43} |
|
48%|████▊ | 50/105 [00:17<00:18, 3.05it/s]
49%|████▊ | 51/105 [00:18<00:17, 3.06it/s]
50%|████▉ | 52/105 [00:18<00:17, 3.07it/s]
50%|█████ | 53/105 [00:18<00:16, 3.07it/s]
51%|█████▏ | 54/105 [00:19<00:16, 3.05it/s]
52%|█████▏ | 55/105 [00:19<00:16, 3.05it/s]
{'loss': 0.173, 'grad_norm': 0.3497333228588104, 'learning_rate': 9.844481880796491e-05, 'epoch': 1.57} |
|
52%|█████▏ | 55/105 [00:19<00:16, 3.05it/s]
53%|█████▎ | 56/105 [00:19<00:15, 3.07it/s]
54%|█████▍ | 57/105 [00:20<00:15, 3.05it/s]
55%|█████▌ | 58/105 [00:20<00:15, 3.06it/s]
56%|█████▌ | 59/105 [00:20<00:14, 3.07it/s]
57%|█████▋ | 60/105 [00:21<00:14, 3.06it/s]
{'loss': 0.143, 'grad_norm': 0.5418777465820312, 'learning_rate': 8.297564442776014e-05, 'epoch': 1.71} |
|
57%|█████▋ | 60/105 [00:21<00:14, 3.06it/s]
58%|█████▊ | 61/105 [00:21<00:14, 3.07it/s]
59%|█████▉ | 62/105 [00:21<00:14, 3.06it/s]
60%|██████ | 63/105 [00:22<00:13, 3.06it/s]
61%|██████ | 64/105 [00:22<00:13, 3.02it/s]
62%|██████▏ | 65/105 [00:22<00:13, 3.03it/s]
{'loss': 0.098, 'grad_norm': 0.4032457172870636, 'learning_rate': 6.791742301846326e-05, 'epoch': 1.86} |
|
62%|██████▏ | 65/105 [00:22<00:13, 3.03it/s]
63%|██████▎ | 66/105 [00:23<00:12, 3.01it/s]
64%|██████▍ | 67/105 [00:23<00:12, 3.03it/s]
65%|██████▍ | 68/105 [00:23<00:12, 3.04it/s]
66%|██████▌ | 69/105 [00:24<00:11, 3.06it/s]
67%|██████▋ | 70/105 [00:24<00:11, 3.07it/s]
{'loss': 0.0745, 'grad_norm': 0.280824214220047, 'learning_rate': 5.363364680146725e-05, 'epoch': 2.0} |
|
67%|██████▋ | 70/105 [00:24<00:11, 3.07it/s]
68%|██████▊ | 71/105 [00:24<00:11, 3.07it/s]
69%|██████▊ | 72/105 [00:25<00:10, 3.05it/s]
70%|██████▉ | 73/105 [00:25<00:10, 2.99it/s]
70%|███████ | 74/105 [00:25<00:10, 3.03it/s]
71%|███████▏ | 75/105 [00:26<00:09, 3.01it/s]
{'loss': 0.0619, 'grad_norm': 0.2352001816034317, 'learning_rate': 4.046911357233343e-05, 'epoch': 2.14} |
|
71%|███████▏ | 75/105 [00:26<00:09, 3.01it/s]
72%|███████▏ | 76/105 [00:26<00:09, 3.00it/s]
73%|███████▎ | 77/105 [00:26<00:09, 2.99it/s]
74%|███████▍ | 78/105 [00:27<00:09, 2.97it/s]
75%|███████▌ | 79/105 [00:27<00:08, 2.98it/s]
76%|███████▌ | 80/105 [00:27<00:08, 2.97it/s]
{'loss': 0.0505, 'grad_norm': 0.21805675327777863, 'learning_rate': 2.874160358524931e-05, 'epoch': 2.29} |
|
76%|███████▌ | 80/105 [00:27<00:08, 2.97it/s]
77%|███████▋ | 81/105 [00:28<00:08, 2.96it/s]
78%|███████▊ | 82/105 [00:28<00:07, 2.97it/s]
79%|███████▉ | 83/105 [00:28<00:07, 2.96it/s]
80%|████████ | 84/105 [00:29<00:07, 2.98it/s]
81%|████████ | 85/105 [00:29<00:06, 2.99it/s]
{'loss': 0.0554, 'grad_norm': 0.14976684749126434, 'learning_rate': 1.8734208617174988e-05, 'epoch': 2.43} |
|
81%|████████ | 85/105 [00:29<00:06, 2.99it/s]
82%|████████▏ | 86/105 [00:29<00:06, 2.98it/s]
83%|████████▎ | 87/105 [00:30<00:06, 3.00it/s]
84%|████████▍ | 88/105 [00:30<00:05, 2.98it/s]
85%|████████▍ | 89/105 [00:30<00:05, 2.97it/s]
86%|████████▌ | 90/105 [00:31<00:05, 2.99it/s]
{'loss': 0.06, 'grad_norm': 0.22281073033809662, 'learning_rate': 1.0688498381320855e-05, 'epoch': 2.57} |
|
86%|████████▌ | 90/105 [00:31<00:05, 2.99it/s]
87%|████████▋ | 91/105 [00:31<00:04, 2.97it/s]
88%|████████▊ | 92/105 [00:31<00:04, 2.97it/s]
89%|████████▊ | 93/105 [00:32<00:04, 2.99it/s]
90%|████████▉ | 94/105 [00:32<00:03, 2.98it/s]
90%|█████████ | 95/105 [00:32<00:03, 2.97it/s]
{'loss': 0.0501, 'grad_norm': 0.3793380558490753, 'learning_rate': 4.798689246727006e-06, 'epoch': 2.71} |
|
90%|█████████ | 95/105 [00:32<00:03, 2.97it/s]
91%|█████████▏| 96/105 [00:33<00:03, 2.93it/s]
92%|█████████▏| 97/105 [00:33<00:02, 2.94it/s]
93%|█████████▎| 98/105 [00:33<00:02, 2.95it/s]
94%|█████████▍| 99/105 [00:34<00:02, 2.95it/s]
95%|█████████▌| 100/105 [00:34<00:01, 2.95it/s]
{'loss': 0.055, 'grad_norm': 0.2545742988586426, 'learning_rate': 1.2069560259243328e-06, 'epoch': 2.86} |
|
95%|█████████▌| 100/105 [00:34<00:01, 2.95it/s]
96%|█████████▌| 101/105 [00:34<00:01, 2.96it/s]
97%|█████████▋| 102/105 [00:35<00:01, 2.97it/s]
98%|█████████▊| 103/105 [00:35<00:00, 2.98it/s]
99%|█████████▉| 104/105 [00:35<00:00, 2.97it/s]
100%|██████████| 105/105 [00:36<00:00, 2.96it/s]
{'loss': 0.0502, 'grad_norm': 0.5177201628684998, 'learning_rate': 0.0, 'epoch': 3.0} |
|
100%|██████████| 105/105 [00:36<00:00, 2.96it/s]
{'train_runtime': 36.1239, 'train_samples_per_second': 46.507, 'train_steps_per_second': 2.907, 'train_loss': 0.5859903886204674, 'epoch': 3.0} |
|
100%|██████████| 105/105 [00:36<00:00, 2.96it/s]
100%|██████████| 105/105 [00:36<00:00, 2.91it/s] |
| === merge |
| === convert to Q8 gguf |
| Cloning into 'llama.cpp'... |
| fatal: unable to access 'https://github.com/ggerganov/llama.cpp/': server certificate verification failed. CAfile: none CRLfile: none |
|
|
| CONVERR python: can't open file '/workspace/llama.cpp/convert_hf_to_gguf.py': [Errno 2] No such file or directory |
|
|
| !!! gguf missing, pushing MERGED model as fallback |
|
Processing Files (0 / 0) : | | 0.00B / 0.00B |
|
New Data Upload : | | 0.00B / 0.00B [A |
|
|
|
.../merged/model.safetensors: 3%|▎ | 47.9MB / 1.41GB [A[A |
|
|
|
.../merged/model.safetensors: 3%|▎ | 47.9MB / 1.41GB [A[A
Processing Files (0 / 1) : 3%|▎ | 47.9MB / 1.41GB, ???B/s |
|
|
|
.../merged/model.safetensors: 7%|▋ | 98.2MB / 1.41GB [A[A
Processing Files (0 / 1) : 7%|▋ | 98.2MB / 1.41GB, 9.52MB/s |
|
|
|
.../merged/model.safetensors: 7%|▋ | 98.8MB / 1.41GB [A[A
Processing Files (0 / 1) : 7%|▋ | 98.8MB / 1.41GB, 9.34MB/s |
|
New Data Upload : 0%| | 524kB / 134MB, 50.9kB/s [A |
|
|
|
.../merged/model.safetensors: 7%|▋ | 103MB / 1.41GB [A[A
Processing Files (0 / 1) : 7%|▋ | 103MB / 1.41GB, 9.52MB/s |
|
New Data Upload : 2%|▏ | 4.72MB / 201MB, 454kB/s [A |
|
|
|
.../merged/model.safetensors: 8%|▊ | 119MB / 1.41GB [A[A
Processing Files (0 / 1) : 8%|▊ | 119MB / 1.41GB, 10.8MB/s |
|
New Data Upload : 10%|█ | 21.0MB / 201MB, 2.00MB/s [A |
|
|
|
.../merged/model.safetensors: 10%|▉ | 141MB / 1.41GB [A[A
Processing Files (0 / 1) : 10%|▉ | 141MB / 1.41GB, 12.7MB/s |
|
New Data Upload : 21%|██▏ | 43.0MB / 201MB, 4.04MB/s [A |
|
|
|
.../merged/model.safetensors: 12%|█▏ | 163MB / 1.41GB [A[A
Processing Files (0 / 1) : 12%|█▏ | 163MB / 1.41GB, 14.5MB/s |
|
New Data Upload : 32%|███▏ | 65.0MB / 201MB, 6.03MB/s [A |
|
|
|
.../merged/model.safetensors: 13%|█▎ | 189MB / 1.41GB [A[A
Processing Files (0 / 1) : 13%|█▎ | 189MB / 1.41GB, 16.6MB/s |
|
New Data Upload : 45%|████▌ | 91.2MB / 201MB, 8.35MB/s [A |
|
|
|
.../merged/model.safetensors: 15%|█▍ | 210MB / 1.41GB [A[A
Processing Files (0 / 1) : 15%|█▍ | 210MB / 1.41GB, 18.2MB/s |
|
New Data Upload : 56%|█████▌ | 112MB / 201MB, 10.1MB/s [A |
|
|
|
.../merged/model.safetensors: 16%|█▋ | 231MB / 1.41GB [A[A
Processing Files (0 / 1) : 16%|█▋ | 231MB / 1.41GB, 19.7MB/s |
|
New Data Upload : 66%|██████▌ | 133MB / 201MB, 11.8MB/s [A |
|
|
|
.../merged/model.safetensors: 16%|█▋ | 232MB / 1.41GB [A[A
Processing Files (0 / 1) : 16%|█▋ | 232MB / 1.41GB, 19.3MB/s |
|
New Data Upload : 67%|██████▋ | 134MB / 201MB, 11.6MB/s [A |
|
|
|
.../merged/model.safetensors: 17%|█▋ | 236MB / 1.41GB [A[A
Processing Files (0 / 1) : 17%|█▋ | 236MB / 1.41GB, 17.9MB/s |
|
New Data Upload : 51%|█████▏ | 138MB / 268MB, 10.9MB/s [A |
|
|
|
.../merged/model.safetensors: 18%|█▊ | 249MB / 1.41GB [A[A
Processing Files (0 / 1) : 18%|█▊ | 249MB / 1.41GB, 18.7MB/s |
|
New Data Upload : 45%|████▍ | 150MB / 335MB, 11.8MB/s [A |
|
|
|
.../merged/model.safetensors: 19%|█▉ | 271MB / 1.41GB [A[A
Processing Files (0 / 1) : 19%|█▉ | 271MB / 1.41GB, 20.2MB/s |
|
New Data Upload : 51%|█████▏ | 172MB / 335MB, 13.5MB/s [A |
|
|
|
.../merged/model.safetensors: 21%|██ | 299MB / 1.41GB [A[A
Processing Files (0 / 1) : 21%|██ | 299MB / 1.41GB, 22.3MB/s |
|
New Data Upload : 43%|████▎ | 201MB / 469MB, 15.8MB/s [A |
|
|
|
.../merged/model.safetensors: 23%|██▎ | 330MB / 1.41GB [A[A
Processing Files (0 / 1) : 23%|██▎ | 330MB / 1.41GB, 24.6MB/s |
|
New Data Upload : 49%|████▉ | 232MB / 469MB, 18.2MB/s [A |
|
|
|
.../merged/model.safetensors: 25%|██▌ | 360MB / 1.41GB [A[A
Processing Files (0 / 1) : 25%|██▌ | 360MB / 1.41GB, 26.6MB/s |
|
New Data Upload : 56%|█████▌ | 262MB / 469MB, 20.4MB/s [A |
|
|
|
.../merged/model.safetensors: 27%|██▋ | 382MB / 1.41GB [A[A
Processing Files (0 / 1) : 27%|██▋ | 382MB / 1.41GB, 27.9MB/s |
|
New Data Upload : 53%|█████▎ | 283MB / 537MB, 21.8MB/s [A |
|
|
|
.../merged/model.safetensors: 29%|██▉ | 408MB / 1.41GB [A[A
Processing Files (0 / 1) : 29%|██▉ | 408MB / 1.41GB, 29.7MB/s |
|
New Data Upload : 58%|█████▊ | 310MB / 537MB, 23.7MB/s [A |
|
|
|
.../merged/model.safetensors: 31%|███ | 439MB / 1.41GB [A[A
Processing Files (0 / 1) : 31%|███ | 439MB / 1.41GB, 31.6MB/s |
|
New Data Upload : 56%|█████▋ | 341MB / 604MB, 25.8MB/s [A |
|
|
|
.../merged/model.safetensors: 33%|███▎ | 471MB / 1.41GB [A[A
Processing Files (0 / 1) : 33%|███▎ | 471MB / 1.41GB, 33.7MB/s |
|
New Data Upload : 56%|█████▌ | 373MB / 671MB, 28.0MB/s [A |
|
|
|
.../merged/model.safetensors: 35%|███▌ | 498MB / 1.41GB [A[A
Processing Files (0 / 1) : 35%|███▌ | 498MB / 1.41GB, 35.3MB/s |
|
New Data Upload : 60%|█████▉ | 399MB / 671MB, 29.7MB/s [A |
|
|
|
.../merged/model.safetensors: 37%|███▋ | 522MB / 1.41GB [A[A
Processing Files (0 / 1) : 37%|███▋ | 522MB / 1.41GB, 36.6MB/s |
|
New Data Upload : 57%|█████▋ | 424MB / 738MB, 31.2MB/s [A |
|
|
|
.../merged/model.safetensors: 39%|███▉ | 552MB / 1.41GB [A[A
Processing Files (0 / 1) : 39%|███▉ | 552MB / 1.41GB, 38.4MB/s |
|
New Data Upload : 61%|██████▏ | 453MB / 738MB, 33.0MB/s [A |
|
|
|
.../merged/model.safetensors: 41%|████ | 579MB / 1.41GB [A[A
Processing Files (0 / 1) : 41%|████ | 579MB / 1.41GB, 39.9MB/s |
|
New Data Upload : 60%|█████▉ | 481MB / 805MB, 34.6MB/s [A |
|
|
|
.../merged/model.safetensors: 43%|████▎ | 612MB / 1.41GB [A[A
Processing Files (0 / 1) : 43%|████▎ | 612MB / 1.41GB, 41.9MB/s |
|
New Data Upload : 64%|██████▍ | 514MB / 805MB, 36.7MB/s [A |
|
|
|
.../merged/model.safetensors: 45%|████▍ | 636MB / 1.41GB [A[A
Processing Files (0 / 1) : 45%|████▍ | 636MB / 1.41GB, 43.0MB/s |
|
New Data Upload : 62%|██████▏ | 538MB / 872MB, 37.9MB/s [A |
|
|
|
.../merged/model.safetensors: 48%|████▊ | 673MB / 1.41GB [A[A
Processing Files (0 / 1) : 48%|████▊ | 673MB / 1.41GB, 45.2MB/s |
|
New Data Upload : 61%|██████ | 575MB / 939MB, 40.2MB/s [A |
|
|
|
.../merged/model.safetensors: 49%|████▉ | 698MB / 1.41GB [A[A
Processing Files (0 / 1) : 49%|████▉ | 698MB / 1.41GB, 46.3MB/s |
|
New Data Upload : 64%|██████▍ | 600MB / 939MB, 41.5MB/s [A |
|
|
|
.../merged/model.safetensors: 51%|█████ | 724MB / 1.41GB [A[A
Processing Files (0 / 1) : 51%|█████ | 724MB / 1.41GB, 47.5MB/s |
|
New Data Upload : 62%|██████▏ | 626MB / 1.01GB, 42.8MB/s [A |
|
|
|
.../merged/model.safetensors: 54%|█████▎ | 759MB / 1.41GB [A[A
Processing Files (0 / 1) : 54%|█████▎ | 759MB / 1.41GB, 49.4MB/s |
|
New Data Upload : 62%|██████▏ | 660MB / 1.07GB, 44.7MB/s [A |
|
|
|
.../merged/model.safetensors: 56%|█████▌ | 786MB / 1.41GB [A[A
Processing Files (0 / 1) : 56%|█████▌ | 786MB / 1.41GB, 50.6MB/s |
|
New Data Upload : 60%|██████ | 687MB / 1.14GB, 46.1MB/s [A |
|
|
|
.../merged/model.safetensors: 57%|█████▋ | 811MB / 1.41GB [A[A
Processing Files (0 / 1) : 57%|█████▋ | 811MB / 1.41GB, 51.6MB/s |
|
New Data Upload : 59%|█████▉ | 713MB / 1.21GB, 47.2MB/s [A |
|
|
|
.../merged/model.safetensors: 60%|█████▉ | 845MB / 1.41GB [A[A
Processing Files (0 / 1) : 60%|█████▉ | 845MB / 1.41GB, 53.4MB/s |
|
New Data Upload : 59%|█████▊ | 747MB / 1.27GB, 49.0MB/s [A |
|
|
|
.../merged/model.safetensors: 62%|██████▏ | 876MB / 1.41GB [A[A
Processing Files (0 / 1) : 62%|██████▏ | 876MB / 1.41GB, 54.8MB/s |
|
New Data Upload : 59%|█████▉ | 778MB / 1.32GB, 50.5MB/s [A |
|
|
|
.../merged/model.safetensors: 64%|██████▍ | 905MB / 1.41GB [A[A
Processing Files (0 / 1) : 64%|██████▍ | 905MB / 1.41GB, 56.1MB/s |
|
New Data Upload : 61%|██████▏ | 807MB / 1.32GB, 51.9MB/s [A |
|
|
|
.../merged/model.safetensors: 66%|██████▌ | 933MB / 1.41GB [A[A
Processing Files (0 / 1) : 66%|██████▌ | 933MB / 1.41GB, 57.2MB/s |
|
New Data Upload : 63%|██████▎ | 835MB / 1.32GB, 53.1MB/s [A |
|
|
|
.../merged/model.safetensors: 68%|██████▊ | 968MB / 1.41GB [A[A
Processing Files (0 / 1) : 68%|██████▊ | 968MB / 1.41GB, 58.9MB/s |
|
New Data Upload : 66%|██████▌ | 870MB / 1.32GB, 54.9MB/s [A |
|
|
|
.../merged/model.safetensors: 70%|███████ | 996MB / 1.41GB [A[A
Processing Files (0 / 1) : 70%|███████ | 996MB / 1.41GB, 59.9MB/s |
|
New Data Upload : 68%|██████▊ | 898MB / 1.32GB, 56.0MB/s [A |
|
|
|
.../merged/model.safetensors: 73%|███████▎ | 1.03GB / 1.41GB [A[A
Processing Files (0 / 1) : 73%|███████▎ | 1.03GB / 1.41GB, 61.3MB/s |
|
New Data Upload : 71%|███████ | 929MB / 1.32GB, 57.4MB/s [A |
|
|
|
.../merged/model.safetensors: 74%|███████▍ | 1.05GB / 1.41GB [A[A
Processing Files (0 / 1) : 74%|███████▍ | 1.05GB / 1.41GB, 62.2MB/s |
|
New Data Upload : 73%|███████▎ | 956MB / 1.32GB, 58.4MB/s [A |
|
|
|
.../merged/model.safetensors: 77%|███████▋ | 1.09GB / 1.41GB [A[A
Processing Files (0 / 1) : 77%|███████▋ | 1.09GB / 1.41GB, 63.6MB/s |
|
New Data Upload : 75%|███████▌ | 989MB / 1.32GB, 59.9MB/s [A |
|
|
|
.../merged/model.safetensors: 79%|███████▉ | 1.12GB / 1.41GB [A[A
Processing Files (0 / 1) : 79%|███████▉ | 1.12GB / 1.41GB, 64.6MB/s |
|
New Data Upload : 77%|███████▋ | 1.02GB / 1.32GB, 61.0MB/s [A |
|
|
|
.../merged/model.safetensors: 81%|████████ | 1.14GB / 1.41GB [A[A
Processing Files (0 / 1) : 81%|████████ | 1.14GB / 1.41GB, 65.5MB/s |
|
New Data Upload : 79%|███████▉ | 1.04GB / 1.32GB, 61.9MB/s [A |
|
|
|
.../merged/model.safetensors: 83%|████████▎ | 1.17GB / 1.41GB [A[A
Processing Files (0 / 1) : 83%|████████▎ | 1.17GB / 1.41GB, 66.5MB/s |
|
New Data Upload : 82%|████████▏ | 1.07GB / 1.32GB, 63.0MB/s [A |
|
|
|
.../merged/model.safetensors: 85%|████████▍ | 1.20GB / 1.41GB [A[A
Processing Files (0 / 1) : 85%|████████▍ | 1.20GB / 1.41GB, 67.2MB/s |
|
New Data Upload : 84%|████████▎ | 1.10GB / 1.32GB, 63.8MB/s [A |
|
|
|
.../merged/model.safetensors: 87%|████████▋ | 1.23GB / 1.41GB [A[A
Processing Files (0 / 1) : 87%|████████▋ | 1.23GB / 1.41GB, 68.2MB/s |
|
New Data Upload : 86%|████████▌ | 1.13GB / 1.32GB, 64.9MB/s [A |
|
|
|
.../merged/model.safetensors: 88%|████████▊ | 1.24GB / 1.41GB [A[A
Processing Files (0 / 1) : 88%|████████▊ | 1.24GB / 1.41GB, 68.2MB/s |
|
New Data Upload : 87%|████████▋ | 1.15GB / 1.32GB, 64.9MB/s [A |
|
|
|
.../merged/model.safetensors: 89%|████████▉ | 1.26GB / 1.41GB [A[A
Processing Files (0 / 1) : 89%|████████▉ | 1.26GB / 1.41GB, 68.3MB/s |
|
New Data Upload : 88%|████████▊ | 1.16GB / 1.32GB, 65.0MB/s [A |
|
|
|
.../merged/model.safetensors: 90%|█████████ | 1.28GB / 1.41GB [A[A
Processing Files (0 / 1) : 90%|█████████ | 1.28GB / 1.41GB, 68.3MB/s |
|
New Data Upload : 90%|████████▉ | 1.18GB / 1.32GB, 65.2MB/s [A |
|
|
|
.../merged/model.safetensors: 91%|█████████▏| 1.29GB / 1.41GB [A[A
Processing Files (0 / 1) : 91%|█████████▏| 1.29GB / 1.41GB, 68.1MB/s |
|
New Data Upload : 91%|█████████ | 1.20GB / 1.32GB, 65.0MB/s [A |
|
|
|
.../merged/model.safetensors: 92%|█████████▏| 1.31GB / 1.41GB [A[A
Processing Files (0 / 1) : 92%|█████████▏| 1.31GB / 1.41GB, 67.7MB/s |
|
New Data Upload : 92%|█████████▏| 1.21GB / 1.32GB, 64.6MB/s [A |
|
|
|
.../merged/model.safetensors: 93%|█████████▎| 1.31GB / 1.41GB [A[A
Processing Files (0 / 1) : 93%|█████████▎| 1.31GB / 1.41GB, 67.0MB/s |
|
New Data Upload : 92%|█████████▏| 1.22GB / 1.32GB, 64.0MB/s [A |
|
|
|
.../merged/model.safetensors: 93%|█████████▎| 1.32GB / 1.41GB [A[A
Processing Files (0 / 1) : 93%|█████████▎| 1.32GB / 1.41GB, 66.4MB/s |
|
New Data Upload : 93%|█████████▎| 1.22GB / 1.32GB, 63.5MB/s [A |
|
|
|
.../merged/model.safetensors: 94%|█████████▍| 1.33GB / 1.41GB [A[A
Processing Files (0 / 1) : 94%|█████████▍| 1.33GB / 1.41GB, 65.8MB/s |
|
New Data Upload : 94%|█████████▎| 1.23GB / 1.32GB, 63.0MB/s [A |
|
|
|
.../merged/model.safetensors: 95%|█████████▍| 1.34GB / 1.41GB [A[A
Processing Files (0 / 1) : 95%|█████████▍| 1.34GB / 1.41GB, 65.0MB/s |
|
New Data Upload : 94%|█████████▍| 1.24GB / 1.32GB, 62.2MB/s [A |
|
|
|
.../merged/model.safetensors: 95%|█████████▌| 1.35GB / 1.41GB [A[A
Processing Files (0 / 1) : 95%|█████████▌| 1.35GB / 1.41GB, 64.4MB/s |
|
New Data Upload : 95%|█████████▍| 1.25GB / 1.32GB, 61.7MB/s [A |
|
|
|
.../merged/model.safetensors: 96%|█████████▌| 1.35GB / 1.41GB [A[A
Processing Files (0 / 1) : 96%|█████████▌| 1.35GB / 1.41GB, 63.6MB/s |
|
New Data Upload : 95%|█████████▌| 1.25GB / 1.32GB, 61.0MB/s [A |
|
|
|
.../merged/model.safetensors: 96%|█████████▌| 1.36GB / 1.41GB [A[A
Processing Files (0 / 1) : 96%|█████████▌| 1.36GB / 1.41GB, 62.8MB/s |
|
New Data Upload : 96%|█████████▌| 1.26GB / 1.32GB, 60.2MB/s [A |
|
|
|
.../merged/model.safetensors: 96%|█████████▋| 1.36GB / 1.41GB [A[A
Processing Files (0 / 1) : 96%|█████████▋| 1.36GB / 1.41GB, 61.9MB/s |
|
New Data Upload : 96%|█████████▌| 1.26GB / 1.32GB, 59.3MB/s [A |
|
|
|
.../merged/model.safetensors: 96%|█████████▋| 1.36GB / 1.41GB [A[A
Processing Files (0 / 1) : 96%|█████████▋| 1.36GB / 1.41GB, 60.9MB/s |
|
New Data Upload : 96%|█████████▌| 1.27GB / 1.32GB, 58.3MB/s [A |
|
|
|
.../merged/model.safetensors: 97%|█████████▋| 1.37GB / 1.41GB [A[A
Processing Files (0 / 1) : 97%|█████████▋| 1.37GB / 1.41GB, 59.9MB/s |
|
New Data Upload : 96%|█████████▋| 1.27GB / 1.32GB, 57.4MB/s [A |
|
|
|
.../merged/model.safetensors: 97%|█████████▋| 1.37GB / 1.41GB [A[A
Processing Files (0 / 1) : 97%|█████████▋| 1.37GB / 1.41GB, 59.0MB/s |
|
New Data Upload : 96%|█████████▋| 1.27GB / 1.32GB, 56.5MB/s [A |
|
|
|
.../merged/model.safetensors: 97%|█████████▋| 1.37GB / 1.41GB [A[A
Processing Files (0 / 1) : 97%|█████████▋| 1.37GB / 1.41GB, 58.2MB/s |
|
New Data Upload : 97%|█████████▋| 1.27GB / 1.32GB, 55.8MB/s [A |
|
|
|
.../merged/model.safetensors: 97%|█████████▋| 1.38GB / 1.41GB [A[A
Processing Files (0 / 1) : 97%|█████████▋| 1.38GB / 1.41GB, 57.3MB/s |
|
New Data Upload : 97%|█████████▋| 1.28GB / 1.32GB, 54.9MB/s [A |
|
|
|
.../merged/model.safetensors: 97%|█████████▋| 1.38GB / 1.41GB [A[A
Processing Files (0 / 1) : 97%|█████████▋| 1.38GB / 1.41GB, 56.4MB/s |
|
New Data Upload : 97%|█████████▋| 1.28GB / 1.32GB, 54.1MB/s [A |
|
|
|
.../merged/model.safetensors: 98%|█████████▊| 1.38GB / 1.41GB [A[A
Processing Files (0 / 1) : 98%|█████████▊| 1.38GB / 1.41GB, 55.5MB/s |
|
New Data Upload : 97%|█████████▋| 1.28GB / 1.32GB, 53.2MB/s [A |
|
|
|
.../merged/model.safetensors: 98%|█████████▊| 1.38GB / 1.41GB [A[A
Processing Files (0 / 1) : 98%|█████████▊| 1.38GB / 1.41GB, 54.7MB/s |
|
New Data Upload : 98%|█████████▊| 1.29GB / 1.32GB, 52.5MB/s [A |
|
|
|
.../merged/model.safetensors: 98%|█████████▊| 1.39GB / 1.41GB [A[A
Processing Files (0 / 1) : 98%|█████████▊| 1.39GB / 1.41GB, 53.9MB/s |
|
New Data Upload : 98%|█████████▊| 1.29GB / 1.32GB, 51.8MB/s [A |
|
|
|
.../merged/model.safetensors: 98%|█████████▊| 1.39GB / 1.41GB [A[A
Processing Files (0 / 1) : 98%|█████████▊| 1.39GB / 1.41GB, 53.1MB/s |
|
New Data Upload : 98%|█████████▊| 1.29GB / 1.32GB, 50.9MB/s [A |
|
|
|
.../merged/model.safetensors: 98%|█████████▊| 1.39GB / 1.41GB [A[A
Processing Files (0 / 1) : 98%|█████████▊| 1.39GB / 1.41GB, 52.3MB/s |
|
New Data Upload : 98%|█████████▊| 1.29GB / 1.32GB, 50.2MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▊| 1.39GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▊| 1.39GB / 1.41GB, 51.5MB/s |
|
New Data Upload : 98%|█████████▊| 1.30GB / 1.32GB, 49.4MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▊| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▊| 1.40GB / 1.41GB, 50.6MB/s |
|
New Data Upload : 99%|█████████▊| 1.30GB / 1.32GB, 48.6MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▊| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▊| 1.40GB / 1.41GB, 49.8MB/s |
|
New Data Upload : 99%|█████████▊| 1.30GB / 1.32GB, 47.8MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.40GB / 1.41GB, 48.9MB/s |
|
New Data Upload : 99%|█████████▉| 1.30GB / 1.32GB, 47.0MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.40GB / 1.41GB, 48.1MB/s |
|
New Data Upload : 99%|█████████▉| 1.30GB / 1.32GB, 46.2MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.40GB / 1.41GB, 47.3MB/s |
|
New Data Upload : 99%|█████████▉| 1.30GB / 1.32GB, 45.5MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.40GB / 1.41GB, 46.6MB/s |
|
New Data Upload : 99%|█████████▉| 1.30GB / 1.32GB, 44.7MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.40GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.40GB / 1.41GB, 45.8MB/s |
|
New Data Upload : 99%|█████████▉| 1.31GB / 1.32GB, 44.0MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.41GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.41GB / 1.41GB, 45.0MB/s |
|
New Data Upload : 99%|█████████▉| 1.31GB / 1.32GB, 43.3MB/s [A |
|
|
|
.../merged/model.safetensors: 99%|█████████▉| 1.41GB / 1.41GB [A[A
Processing Files (0 / 1) : 99%|█████████▉| 1.41GB / 1.41GB, 44.3MB/s |
|
New Data Upload : 99%|█████████▉| 1.31GB / 1.32GB, 42.6MB/s [A |
|
|
|
.../merged/model.safetensors: 100%|█████████▉| 1.41GB / 1.41GB [A[A
Processing Files (0 / 1) : 100%|█████████▉| 1.41GB / 1.41GB, 43.7MB/s |
|
New Data Upload : 100%|█████████▉| 1.31GB / 1.32GB, 42.0MB/s [A |
|
|
|
.../merged/model.safetensors: 100%|█████████▉| 1.41GB / 1.41GB [A[A
Processing Files (0 / 1) : 100%|█████████▉| 1.41GB / 1.41GB, 43.0MB/s |
|
New Data Upload : 100%|█████████▉| 1.31GB / 1.32GB, 41.3MB/s [A |
|
|
|
.../merged/model.safetensors: 100%|█████████▉| 1.41GB / 1.41GB [A[A
Processing Files (0 / 1) : 100%|█████████▉| 1.41GB / 1.41GB, 42.3MB/s |
|
New Data Upload : 100%|█████████▉| 1.31GB / 1.32GB, 40.7MB/s [A |
|
|
|
.../merged/model.safetensors: 100%|█████████▉| 1.41GB / 1.41GB [A[A
Processing Files (0 / 1) : 100%|█████████▉| 1.41GB / 1.41GB, 41.7MB/s |
|
New Data Upload : 100%|█████████▉| 1.32GB / 1.32GB, 40.1MB/s [A |
|
|
|
.../merged/model.safetensors: 100%|██████████| 1.41GB / 1.41GB [A[A
Processing Files (1 / 1) : 100%|██████████| 1.41GB / 1.41GB, 38.0MB/s |
|
New Data Upload : 100%|██████████| 1.32GB / 1.32GB, 36.5MB/s [A
Processing Files (1 / 1) : 100%|██████████| 1.41GB / 1.41GB, 38.0MB/s |
|
New Data Upload : 100%|██████████| 1.32GB / 1.32GB, 36.5MB/s |
|
.../merged/model.safetensors: 100%|██████████| 1.41GB / 1.41GB |
| === PUSHED merged -> SmallAICreator/aurora-think-merged |
| === TRAINER DONE |
| === trainer exit 0 === |
| !!! [finish] gguf NOT on HF -- leaving pod for the watchdog |
| === preinstall helpers === |
| WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. |
|
|
| [notice] A new release of pip is available: 24.2 -> 26.2.1 |
| [notice] To update, run: python -m pip install --upgrade pip |
| === pip deps === |
|
|
