Buckets:
| {"examples": 3169, "tokens": 1711105, "readout_from_votes": 3162, "readout_gold_fallback": 7} | |
| Loading weights: 0%| | 0/426 [00:00<?, ?it/s] Loading weights: 88%|████████▊ | 374/426 [00:00<00:00, 3736.46it/s] Loading weights: 100%|██████████| 426/426 [00:00<00:00, 3690.31it/s] | |
| trainable params: 60,948,480 || all params: 4,266,699,776 || trainable%: 1.4285 | |
| [transformers] `causal_conv1d_fn` is falling back to its reference PyTorch implementation because `causal_conv1d` is not installed. This is correct but much slower; install `causal_conv1d` for the optimized kernel. | |
| /workspace/decision-reasoner/train.py:145: UserWarning: Converting a tensor with requires_grad=True to a scalar may lead to unexpected behavior. | |
| Consider using tensor.detach() first. (Triggered internally at /__w/pytorch/pytorch/torch/csrc/autograd/generated/python_variable_methods.cpp:822.) | |
| stats["readout_loss"] += float(loss) | |
| {"probe_tok_per_s": 3838.0248403195706, "fit_tokens": 5899450.747378086, "have_tokens": 1711105} | |
| {"step": 1, "of": 37, "lr": 0.0001, "grad_norm": 16.499691009521484, "examples": 50, "readout_examples": 50, "reasoner_examples": 0, "step_tokens": 47327, "chain_tokens": 0, "micro_batches": 3, "tok_per_s": 3962.3054761679205, "elapsed_min": 0.1990718126296997, "eta_min": 7.166585254669189, "chain_loss": null, "readout_loss": 1.439049574509263, "readout_argmax_matches_target": 0.44, "readout_mean_top_prob": 0.5607822763919831, "readout_target_entropy": 0.11168528795242309, "mem_gb": 17.69098752} | |
| {"step": 2, "of": 37, "lr": 9.980973490458728e-05, "grad_norm": 20.690614700317383, "examples": 61, "readout_examples": 61, "reasoner_examples": 0, "step_tokens": 47314, "chain_tokens": 0, "micro_batches": 3, "tok_per_s": 4012.912072142604, "elapsed_min": 0.3930686672528585, "eta_min": 6.878701676925023, "chain_loss": null, "readout_loss": 1.4830484572401057, "readout_argmax_matches_target": 0.32786885245901637, "readout_mean_top_prob": 0.579077528881245, "readout_target_entropy": 0.0866156288834869, "mem_gb": 17.69098752} | |
| {"step": 3, "of": 37, "lr": 9.924038765061042e-05, "grad_norm": 5.102482795715332, "examples": 123, "readout_examples": 123, "reasoner_examples": 0, "step_tokens": 44319, "chain_tokens": 0, "micro_batches": 3, "tok_per_s": 3912.300240803209, "elapsed_min": 0.5919791062672933, "eta_min": 6.70909653769599, "chain_loss": null, "readout_loss": 0.720007419059, "readout_argmax_matches_target": 0.7073170731707317, "readout_mean_top_prob": 0.7052061976940651, "readout_target_entropy": 0.12027148987219585, "mem_gb": 17.69098752} | |
| {"step": 10, "of": 37, "lr": 8.535533905932738e-05, "grad_norm": 8.605474472045898, "examples": 56, "readout_examples": 56, "reasoner_examples": 0, "step_tokens": 47335, "chain_tokens": 0, "micro_batches": 3, "tok_per_s": 3920.875668113465, "elapsed_min": 1.9859339237213134, "eta_min": 5.362021594047547, "chain_loss": null, "readout_loss": 0.9844543824458795, "readout_argmax_matches_target": 0.6071428571428571, "readout_mean_top_prob": 0.6930059604346752, "readout_target_entropy": 0.08096023542540413, "mem_gb": 17.69098752} | |
| {"step": 20, "of": 37, "lr": 4.564221286261709e-05, "grad_norm": 6.041411399841309, "examples": 97, "readout_examples": 97, "reasoner_examples": 0, "step_tokens": 46614, "chain_tokens": 0, "micro_batches": 3, "tok_per_s": 3916.0817292546385, "elapsed_min": 3.98547180891037, "eta_min": 3.387651037573814, "chain_loss": null, "readout_loss": 0.930043653974468, "readout_argmax_matches_target": 0.6494845360824743, "readout_mean_top_prob": 0.7174164949311423, "readout_target_entropy": 0.1419014734091218, "mem_gb": 17.69098752} | |
| {"step": 30, "of": 37, "lr": 9.042397785550405e-06, "grad_norm": 4.9224772453308105, "examples": 68, "readout_examples": 68, "reasoner_examples": 0, "step_tokens": 47388, "chain_tokens": 0, "micro_batches": 3, "tok_per_s": 3910.8449548034732, "elapsed_min": 5.970849506060282, "eta_min": 1.3931982180807325, "chain_loss": null, "readout_loss": 0.43335475402829404, "readout_argmax_matches_target": 0.8529411764705882, "readout_mean_top_prob": 0.7824242110638058, "readout_target_entropy": 0.043113489361370314, "mem_gb": 17.69098752} | |
| {"mode": "readout_only", "alpha": 0.0, "lr": 0.0001, "rank": 32, "lora_alpha": 64, "seed": 17, "examples": 3169, "steps_done": 37, "steps_planned": 37, "stopped_at_deadline": false, "train_tokens": 1711105, "train_seconds": 438.92514300346375, "tok_per_s": 3898.3982286621867, "counts": {"readout_from_votes": 3162, "readout_gold_fallback": 7}, "reasoner_examples": 0, "readout_examples": 3169} | |
Xet Storage Details
- Size:
- 4.59 kB
- Xet hash:
- 214a6f0a129b1cc5a39d9db969e7e9a67d8aa0b70597e37cca4fbf11a99f70d9
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.