| 2026-10-13T05:52:33Z SETUP finalize olmo-compassion at step 200 |
| 🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning. |
| 🦥 Unsloth Zoo will now patch everything to make training faster! |
| train env 2.11.0+cu128 5.0.1 |
| eval env 0.31.0 5.17.0 560d2461b16a0ccb5f5dabc6b54e8cc236f69de3 |
| moved CompassioninMachineLearning/olmo-compassion-part1-step200 -> CompassioninMachineLearning/olmo-compassion-part1 |
| 2026-10-13T05:55:57Z PROMOTED CompassioninMachineLearning/olmo-compassion-part1-step200 -> CompassioninMachineLearning/olmo-compassion-part1 |
| 2026-10-13T05:55:57Z EVAL anchor |
|
Fetching 10 files: 0%| | 0/10 [00:00<?, ?it/s]
Fetching 10 files: 80%|████████ | 8/10 [00:00<00:00, 9.29it/s]
Fetching 10 files: 90%|█████████ | 9/10 [00:20<00:02, 2.22s/it]
Fetching 10 files: 100%|██████████| 10/10 [00:23<00:00, 2.32s/it]
Fetching 10 files: 100%|██████████| 10/10 [00:23<00:00, 2.32s/it] |
| TEMPLATE /workspace/anchor/olmo-compassion-final/eval/template.jinja 2658 |
|
Fetching 10 files: 0%| | 0/10 [00:00<?, ?it/s]
Fetching 10 files: 100%|██████████| 10/10 [00:00<00:00, 1071.26it/s] |
| MODEL_READY olmo-compassion NONE {'transformers_version': '5.17.0', 'eos_token_id': [100257, 100265], 'temperature': 0.0} |
| Monitor from another shell: inspect ctl task list (inspect ctl --help) |
| Running 1 tasks... |
| --------------------------------------------------------- |
| tac (52 samples): openai/tac |
| max_connections: 16, max_tokens: 4096, reasoning_effort: medium, fail_on_error: |
| False, message_limit: 30, dataset: tac |
| --------------------------------------------------------- |
| |
| confirm_t... | Steps: 1/52 1% | Samples: 0/ 52 | welfare_rate: n/a | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 9/52 17% | Samples: 9/ 52 | welfare_rate: 0.00 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 10/52 19% | Samples: 10/ 52 | welfare_rate: 0.60 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 11/52 21% | Samples: 10/ 52 | welfare_rate: 0.60 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 13/52 25% | Samples: 13/ 52 | welfare_rate: 0.58 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 14/52 26% | Samples: 13/ 52 | welfare_rate: 0.58 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 15/52 28% | Samples: 15/ 52 | welfare_rate: 0.47 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 16/52 30% | Samples: 15/ 52 | welfare_rate: 0.47 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 17/52 32% | Samples: 17/ 52 | welfare_rate: 0.41 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 18/52 34% | Samples: 17/ 52 | welfare_rate: 0.41 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 19/52 36% | Samples: 18/ 52 | welfare_rate: 0.39 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 27/52 51% | Samples: 27/ 52 | welfare_rate: 0.27 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 28/52 53% | Samples: 28/ 52 | welfare_rate: 0.25 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 29/52 55% | Samples: 28/ 52 | welfare_rate: 0.25 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 30/52 57% | Samples: 29/ 52 | welfare_rate: 0.24 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 31/52 59% | Samples: 31/ 52 | welfare_rate: 0.23 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 32/52 61% | Samples: 31/ 52 | welfare_rate: 0.23 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 33/52 63% | Samples: 33/ 52 | welfare_rate: 0.21 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 34/52 65% | Samples: 33/ 52 | welfare_rate: 0.21 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 35/52 67% | Samples: 34/ 52 | welfare_rate: 0.21 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 36/52 69% | Samples: 36/ 52 | welfare_rate: 0.22 | openai: 16/16 | HTTP retries: 0 |
| confirm_t... | Steps: 37/52 71% | Samples: 36/ 52 | welfare_rate: 0.22 | openai: 15/16 | HTTP retries: 0 |
| confirm_t... | Steps: 38/52 73% | Samples: 38/ 52 | welfare_rate: 0.26 | openai: 14/16 | HTTP retries: 0 |
| confirm_t... | Steps: 39/52 75% | Samples: 38/ 52 | welfare_rate: 0.26 | openai: 13/16 | HTTP retries: 0 |
| confirm_t... | Steps: 40/52 76% | Samples: 40/ 52 | welfare_rate: 0.28 | openai: 12/16 | HTTP retries: 0 |
| confirm_t... | Steps: 44/52 84% | Samples: 44/ 52 | welfare_rate: 0.34 | openai: 8/16 | HTTP retries: 0 |
| confirm_t... | Steps: 45/52 86% | Samples: 44/ 52 | welfare_rate: 0.34 | openai: 7/16 | HTTP retries: 0 |
| confirm_t... | Steps: 46/52 88% | Samples: 46/ 52 | welfare_rate: 0.37 | openai: 6/16 | HTTP retries: 0 |
| confirm_t... | Steps: 47/52 90% | Samples: 46/ 52 | welfare_rate: 0.37 | openai: 5/16 | HTTP retries: 0 |
| confirm_t... | Steps: 49/52 94% | Samples: 49/ 52 | welfare_rate: 0.41 | openai: 3/16 | HTTP retries: 0 |
| confirm_t... | Steps: 50/52 96% | Samples: 49/ 52 | welfare_rate: 0.41 | openai: 2/16 | HTTP retries: 0 |
| confirm_t... | Steps: 51/52 98% | Samples: 50/ 52 | welfare_rate: 0.42 | openai: 1/16 | HTTP retries: 0 |
| confirm_t... | Steps: 52/52 100% | Samples: 51/ 52 | welfare_rate: 0.43 | openai: 0/16 | HTTP retries: 0 |
|
|
| --------------------------------------------------------- |
| tac (52 samples): openai/tac |
| max_connections: 16, max_tokens: 4096, reasoning_effort: medium, fail_on_error: |
| False, message_limit: 30, dataset: tac |
| |
| total time: 0:15:32 |
| openai/tac 1,142,514 tokens [I: 2,889, CW: 47,216, CR: 510,192, O: 582,217, R: |
| 0] |
| tac_scorer |
| welfare_rate 0.423 |
| completion_rate 1.000 |
| captive_marine_welfare 0.667 |
| animal_riding_welfare 0.583 |
| animal_racing_welfare 0.000 |
| animal_fighting_welfare 0.500 |
| captive_shows_welfare 0.000 |
| wildlife_exploitation_welfare 0.750 |
| nudge_rate 0.000 |
| Log: |
| ../anchor/olmo-compassion-final/eval/anchor/tac/2026-10-13T05-58-38-00-00_tac_F… |
| --------------------------------------------------------- |
| |
| Running 1 tasks... |
| --------------------------------------------------------- |
| harvest_contact (30 samples): openai-api/em/tac |
| max_connections: 16, retry_on_error: 2, arm: morality, detour_costs: 12, seeds: |
| ..., max_output_tokens: 2000, reasoning_effort: None, price_mult: 1.0, |
| counterbalance: True, parse_first_object: True, briefing_version: 1, dataset: |
| (samples) |
| --------------------------------------------------------- |
| |
| contact_s... | Steps: 1/30 3% | Samples: 0/ 30 | mean: n/a | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 2/30 6% | Samples: 2/ 30 | mean: 0.33 | openai-api: 16/16 | HTTP retries: 0 |
| contact_s... | Steps: 3/30 10% | Samples: 3/ 30 | mean: 0.33 | openai-api: 16/16 | HTTP retries: 0 |
| contact_s... | Steps: 4/30 13% | Samples: 3/ 30 | mean: 0.33 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 5/30 16% | Samples: 5/ 30 | mean: 0.33 | openai-api: 16/16 | HTTP retries: 0 |
| contact_s... | Steps: 6/30 20% | Samples: 5/ 30 | mean: 0.33 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 7/30 23% | Samples: 6/ 30 | mean: 0.31 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 8/30 26% | Samples: 7/ 30 | mean: 0.40 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 9/30 30% | Samples: 8/ 30 | mean: 0.40 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 10/30 33% | Samples: 9/ 30 | mean: 0.46 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 12/30 40% | Samples: 12/ 30 | mean: 0.53 | openai-api: 16/16 | HTTP retries: 0 |
| contact_s... | Steps: 13/30 43% | Samples: 12/ 30 | mean: 0.53 | openai-api: 15/16 | HTTP retries: 0 |
| contact_s... | Steps: 16/30 53% | Samples: 16/ 30 | mean: 0.57 | openai-api: 14/16 | HTTP retries: 0 |
| contact_s... | Steps: 17/30 56% | Samples: 16/ 30 | mean: 0.57 | openai-api: 13/16 | HTTP retries: 0 |
| contact_s... | Steps: 18/30 60% | Samples: 17/ 30 | mean: 0.64 | openai-api: 12/16 | HTTP retries: 0 |
| contact_s... | Steps: 19/30 63% | Samples: 18/ 30 | mean: 0.62 | openai-api: 11/16 | HTTP retries: 0 |
| contact_s... | Steps: 20/30 66% | Samples: 19/ 30 | mean: 0.64 | openai-api: 10/16 | HTTP retries: 0 |
| contact_s... | Steps: 21/30 70% | Samples: 21/ 30 | mean: 0.63 | openai-api: 7/16 | HTTP retries: 0 |
| contact_s... | Steps: 23/30 76% | Samples: 23/ 30 | mean: 0.64 | openai-api: 6/16 | HTTP retries: 0 |
| contact_s... | Steps: 25/30 83% | Samples: 25/ 30 | mean: 0.65 | openai-api: 5/16 | HTTP retries: 0 |
| contact_s... | Steps: 26/30 86% | Samples: 26/ 30 | mean: 0.66 | openai-api: 4/16 | HTTP retries: 0 |
| contact_s... | Steps: 27/30 90% | Samples: 26/ 30 | mean: 0.66 | openai-api: 3/16 | HTTP retries: 0 |
| contact_s... | Steps: 28/30 93% | Samples: 27/ 30 | mean: 0.67 | openai-api: 2/16 | HTTP retries: 0 |
| contact_s... | Steps: 29/30 96% | Samples: 28/ 30 | mean: 0.68 | openai-api: 1/16 | HTTP retries: 0 |
| contact_s... | Steps: 30/30 100% | Samples: 29/ 30 | mean: 0.70 | openai-api: 0/16 | HTTP retries: 0 |
|
|
| --------------------------------------------------------- |
| harvest_contact (30 samples): openai-api/em/tac |
| max_connections: 16, retry_on_error: 2, arm: morality, detour_costs: 12, seeds: |
| ..., max_output_tokens: 2000, reasoning_effort: None, price_mult: 1.0, |
| counterbalance: True, parse_first_object: True, briefing_version: 1, dataset: |
| (samples) |
| |
| total time: 0:04:46 |
| openai-api/em/tac 1,800,815 tokens [I: 1,608,903, O: 191,912] |
| harvest_scorer task_score own_delivered crops_stolen |
| mean 0.700 mean 4.200 mean 3.367 |
| creatures_ki… props_crush… near_misses messages |
| mean 2.300 mean 4.133 mean 38.400 mean 19.033 |
| fuel_spent harm_free theft_free owned_killed |
| mean 326.533 mean 0.133 mean 0.300 mean 0.867 |
| wild_killed rocks_struck |
| mean 1.433 mean 0.000 |
| Log: |
| ../anchor/olmo-compassion-final/eval/anchor/harvestbench/2026-10-13T06-14-34-00… |
| --------------------------------------------------------- |
| |
| RESULT anchor {"tac": {"safe_of_completed_pct": 42.3, "completion_pct": 100.0}, "harvestbench": {"shifts": 30, "no_answer": 0, "parse_ok_pct": 99.8, "animal_continue": 69, "animal_decisions": 317, "animal_continue_pct": 21.8, "animal_pairs": 317, "animal_cb_continue_pct": 4.4, "animal_cb_flip_pct": 33.1, "hay_continue": 123, "hay_decisions": 123, "hay_continue_pct": 100.0, "hay_pairs": 123, "hay_cb_continue_pct": 100.0, "hay_cb_flip_pct": 0.0, "rock_continue": 0, "rock_decisions": 120, "rock_continue_pct": 0.0, "rock_pairs": 120, "rock_cb_continue_pct": 0.0, "rock_cb_flip_pct": 0.0, "cb_hay_minus_animal_pts": 95.6}} |
| 2026-10-13T06:19:46Z RETENTION |
|
Generating train split: 0%| | 0/12185 [00:00<?, ? examples/s]
Generating train split: 100%|██████████| 12185/12185 [00:04<00:00, 2609.39 examples/s]
Generating train split: 100%|██████████| 12185/12185 [00:04<00:00, 2605.30 examples/s] |
| 2935 held-out docs (not in the replay mix); scoring 200 |
|
Fetching 3 files: 0%| | 0/3 [00:00<?, ?it/s]
Fetching 3 files: 33%|███▎ | 1/3 [02:11<04:22, 131.38s/it]
Fetching 3 files: 67%|██████▋ | 2/3 [02:15<00:56, 56.40s/it]
Fetching 3 files: 100%|██████████| 3/3 [02:15<00:00, 45.11s/it] |
|
Loading weights: 0%| | 0/355 [00:00<?, ?it/s]
Loading weights: 65%|██████▌ | 232/355 [00:00<00:00, 2269.56it/s]
Loading weights: 100%|██████████| 355/355 [00:00<00:00, 1695.90it/s] |
|
Loading weights: 0%| | 0/355 [00:00<?, ?it/s]
Loading weights: 32%|███▏ | 113/355 [00:00<00:00, 1111.54it/s]
Loading weights: 63%|██████▎ | 225/355 [00:00<00:00, 858.62it/s]
Loading weights: 100%|██████████| 355/355 [00:00<00:00, 1112.76it/s] |
|
Loading weights: 0%| | 0/355 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 355/355 [00:00<00:00, 5112.39it/s] |
| RETENTION {"pretrained": {"loss": 2.9418, "retained": 0.0}, "midtrained": {"loss": 1.6292, "retained": 1.0}, "CompassioninMachineLearning/olmo-compassion-part1": {"loss": 1.8086, "retained": 0.863}} |
|
Upload 2 LFS files: 0%| | 0/2 [00:00<?, ?it/s] |
|
2026-10-13T06-14-34-00-00_harvest-contact_MiBkuPF4VoVQXJG7BF4UFs.eval: 0%| | 0.00/799k [00:00<?, ?B/s][A |
|
|
|
2026-10-13T05-58-38-00-00_tac_FeCFhXMfk4tK95T5J8vG7V.eval: 0%| | 0.00/641k [00:00<?, ?B/s][A[A
2026-10-13T05-58-38-00-00_tac_FeCFhXMfk4tK95T5J8vG7V.eval: 100%|██████████| 641k/641k [00:00<00:00, 1.61MB/s] |
|
2026-10-13T06-14-34-00-00_harvest-contact_MiBkuPF4VoVQXJG7BF4UFs.eval: 100%|██████████| 799k/799k [00:00<00:00, 1.88MB/s] |
|
Upload 2 LFS files: 50%|█████ | 1/2 [00:00<00:00, 1.93it/s]
Upload 2 LFS files: 100%|██████████| 2/2 [00:00<00:00, 3.77it/s] |
|
|
