train.log

06:26:30 rows 1573008 train 1266165 val 154346 test 152497 (novel test 145441); epoch cuts (565, 593); vocab 56; train base rate 0.248
06:26:56 baseline: has alloc+copy+fork: test auroc 0.5260
06:26:56 baseline: logistic on 15 hand features: test auroc 0.6091
06:27:41 screen epoch 1/8 loss 1.0093 val_auroc 0.6292 (32s)
06:28:13 screen epoch 2/8 loss 0.9852 val_auroc 0.6459 (31s)
06:28:44 screen epoch 3/8 loss 0.9709 val_auroc 0.6557 (31s)
06:29:14 screen epoch 4/8 loss 0.9630 val_auroc 0.6573 (30s)
06:29:44 screen epoch 5/8 loss 0.9575 val_auroc 0.6627 (30s)
06:30:16 screen epoch 6/8 loss 0.9534 val_auroc 0.6626 (31s)
06:30:46 screen epoch 7/8 loss 0.9494 val_auroc 0.6642 (31s)
06:31:17 screen epoch 8/8 loss 0.9460 val_auroc 0.6666 (31s)
06:31:19 screen: test auroc 0.6667 (novel 0.6590)
06:31:32 generator epoch 1/12 nll 1.4800 val_logprob/token -0.8854 (12s)
06:31:44 generator epoch 2/12 nll 0.8963 val_logprob/token -0.7759 (12s)
06:31:56 generator epoch 3/12 nll 0.8297 val_logprob/token -0.7381 (12s)
06:32:08 generator epoch 4/12 nll 0.7913 val_logprob/token -0.7091 (12s)
06:32:20 generator epoch 5/12 nll 0.7655 val_logprob/token -0.6833 (12s)
06:32:33 generator epoch 6/12 nll 0.7458 val_logprob/token -0.6740 (13s)
06:32:45 generator epoch 7/12 nll 0.7329 val_logprob/token -0.6664 (12s)
06:32:57 generator epoch 8/12 nll 0.7240 val_logprob/token -0.6586 (12s)
06:33:09 generator epoch 9/12 nll 0.7147 val_logprob/token -0.6504 (12s)
06:33:21 generator epoch 10/12 nll 0.7092 val_logprob/token -0.6461 (12s)
06:33:34 generator epoch 11/12 nll 0.7024 val_logprob/token -0.6477 (13s)
06:33:45 generator epoch 12/12 nll 0.6972 val_logprob/token -0.6433 (12s)
06:33:48 generator ranking: test auroc 0.5822
06:34:16 done: {"n": 1000, "valid_length": 1.0, "has_alloc_copy_fork": 0.832, "identical_to_parent": 0.023, "screen_mean_p_generated": 0.5254685282707214, "screen_mean_p_real_test_children": 0.4690079689025879, "note": "screen scores on generated children are one model judging another; only a live colony is ground truth"}