|
|
| ┐ ╖ |
| ╓╖╬│╡ ││╬╖╖ |
| ╓╖╬│││││┘ ╬│││││╬╖ |
| ╖╬│││││╬╜ ╙╬│││││╖╖ ╗╗╗ |
| ╬╬╬╬╖││╦╖ ╖╬││╗╣╣╣╬ ╟╣╣╬ ╟╣╣╣ ╜╜╜ ╟╣╣ |
| ╬╬╬╬╬╬╬╬╖│╬╖╖╓╬╪│╓╣╣╣╣╣╣╣╬ ╟╣╣╬ ╟╣╣╣ ╒╣╣╖╗╣╣╣╗ ╣╣╣ ╣╣╣╣╣╣ ╟╣╣╖ ╣╣╣ |
| ╬╬╬╬┐ ╙╬╬╬╬│╓╣╣╣╝╜ ╫╣╣╣╬ ╟╣╣╬ ╟╣╣╣ ╟╣╣╣╙ ╙╣╣╣ ╣╣╣ ╙╟╣╣╜╙ ╫╣╣ ╟╣╣ |
| ╬╬╬╬┐ ╙╬╬╣╣ ╫╣╣╣╬ ╟╣╣╬ ╟╣╣╣ ╟╣╣╬ ╣╣╣ ╣╣╣ ╟╣╣ ╣╣╣┌╣╣╜ |
| ╬╬╬╜ ╬╬╣╣ ╙╝╣╣╬ ╙╣╣╣╗╖╓╗╣╣╣╜ ╟╣╣╬ ╣╣╣ ╣╣╣ ╟╣╣╦╓ ╣╣╣╣╣ |
| ╙ ╓╦╖ ╬╬╣╣ ╓╗╗╖ ╙╝╣╣╣╣╝╜ ╘╝╝╜ ╝╝╝ ╝╝╝ ╙╣╣╣ ╟╣╣╣ |
| ╩╬╬╬╬╬╬╦╦╬╬╣╣╗╣╣╣╣╣╣╣╝ ╫╣╣╣╣ |
| ╙╬╬╬╬╬╬╬╣╣╣╣╣╣╝╜ |
| ╙╬╬╬╣╣╣╜ |
| ╙ |
| |
| Version information: |
| ml-agents: 1.2.0.dev0, |
| ml-agents-envs: 1.2.0.dev0, |
| Communicator API: 1.5.0, |
| PyTorch: 2.2.2+cu121 |
| [INFO] Connected to Unity environment with package version 2.1.0-exp.1 and communication version 1.5.0 |
| [INFO] Connected new brain: SnowballTarget?team=0 |
| [INFO] Hyperparameters for behavior name SnowballTarget: |
| trainer_type: ppo |
| hyperparameters: |
| batch_size: 128 |
| buffer_size: 2048 |
| learning_rate: 0.0003 |
| beta: 0.005 |
| epsilon: 0.2 |
| lambd: 0.95 |
| num_epoch: 3 |
| shared_critic: False |
| learning_rate_schedule: linear |
| beta_schedule: linear |
| epsilon_schedule: linear |
| checkpoint_interval: 50000 |
| network_settings: |
| normalize: False |
| hidden_units: 256 |
| num_layers: 2 |
| vis_encode_type: simple |
| memory: None |
| goal_conditioning_type: hyper |
| deterministic: False |
| reward_signals: |
| extrinsic: |
| gamma: 0.99 |
| strength: 1.0 |
| network_settings: |
| normalize: False |
| hidden_units: 128 |
| num_layers: 2 |
| vis_encode_type: simple |
| memory: None |
| goal_conditioning_type: hyper |
| deterministic: False |
| init_path: None |
| keep_checkpoints: 5 |
| even_checkpoints: False |
| max_steps: 200000 |
| time_horizon: 64 |
| summary_freq: 10000 |
| threaded: False |
| self_play: None |
| behavioral_cloning: None |
| [INFO] SnowballTarget. Step: 10000. Time Elapsed: 65.297 s. Mean Reward: 4.500. Std of Reward: 1.725. Training. |
| [INFO] SnowballTarget. Step: 20000. Time Elapsed: 126.340 s. Mean Reward: 6.945. Std of Reward: 2.203. Training. |
| [INFO] SnowballTarget. Step: 30000. Time Elapsed: 204.251 s. Mean Reward: 10.136. Std of Reward: 3.035. Training. |
| [INFO] SnowballTarget. Step: 40000. Time Elapsed: 290.814 s. Mean Reward: 10.618. Std of Reward: 2.693. Training. |
| [INFO] SnowballTarget. Step: 50000. Time Elapsed: 376.351 s. Mean Reward: 13.227. Std of Reward: 2.214. Training. |
| [INFO] Exported results/SnowballTarget-course-20260925-v2/SnowballTarget/SnowballTarget-49936.onnx |
| [INFO] SnowballTarget. Step: 60000. Time Elapsed: 460.009 s. Mean Reward: 14.655. Std of Reward: 2.718. Training. |
| [INFO] SnowballTarget. Step: 70000. Time Elapsed: 550.002 s. Mean Reward: 15.886. Std of Reward: 3.135. Training. |
| [INFO] SnowballTarget. Step: 80000. Time Elapsed: 677.162 s. Mean Reward: 18.109. Std of Reward: 2.755. Training. |
| [INFO] SnowballTarget. Step: 90000. Time Elapsed: 782.237 s. Mean Reward: 19.977. Std of Reward: 2.580. Training. |
| [INFO] Learning was interrupted. Please wait while the graph is generated. |
| [INFO] Exported results/SnowballTarget-course-20260925-v2/SnowballTarget/SnowballTarget-91608.onnx |
| [INFO] Copied results/SnowballTarget-course-20260925-v2/SnowballTarget/SnowballTarget-91608.onnx to results/SnowballTarget-course-20260925-v2/SnowballTarget.onnx. |
|
|
