Hugging Face's logo

rondahahda
/
ppo-SnowballTarget

Reinforcement Learning
ml-agents
ONNX
deep-reinforcement-learning
SnowballTarget
ML-Agents-SnowballTarget
Eval Results (legacy)
Model card Files
xet
 Community
ppo-SnowballTarget
File size: 4,212 Bytes
9e1b6c4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81

            ┐  ╖
        ╓╖╬│╡  ││╬╖╖
    ╓╖╬│││││┘  ╬│││││╬╖
 ╖╬│││││╬╜        ╙╬│││││╖╖                               ╗╗╗
 ╬╬╬╬╖││╦╖        ╖╬││╗╣╣╣╬      ╟╣╣╬    ╟╣╣╣             ╜╜╜  ╟╣╣
 ╬╬╬╬╬╬╬╬╖│╬╖╖╓╬╪│╓╣╣╣╣╣╣╣╬      ╟╣╣╬    ╟╣╣╣ ╒╣╣╖╗╣╣╣╗   ╣╣╣ ╣╣╣╣╣╣ ╟╣╣╖   ╣╣╣
 ╬╬╬╬┐  ╙╬╬╬╬│╓╣╣╣╝╜  ╫╣╣╣╬      ╟╣╣╬    ╟╣╣╣ ╟╣╣╣╙ ╙╣╣╣  ╣╣╣ ╙╟╣╣╜╙  ╫╣╣  ╟╣╣
 ╬╬╬╬┐     ╙╬╬╣╣      ╫╣╣╣╬      ╟╣╣╬    ╟╣╣╣ ╟╣╣╬   ╣╣╣  ╣╣╣  ╟╣╣     ╣╣╣┌╣╣╜
 ╬╬╬╜       ╬╬╣╣      ╙╝╣╣╬      ╙╣╣╣╗╖╓╗╣╣╣╜ ╟╣╣╬   ╣╣╣  ╣╣╣  ╟╣╣╦╓    ╣╣╣╣╣
 ╙   ╓╦╖    ╬╬╣╣   ╓╗╗╖            ╙╝╣╣╣╣╝╜   ╘╝╝╜   ╝╝╝  ╝╝╝   ╙╣╣╣    ╟╣╣╣
   ╩╬╬╬╬╬╬╦╦╬╬╣╣╗╣╣╣╣╣╣╣╝                                             ╫╣╣╣╣
      ╙╬╬╬╬╬╬╬╣╣╣╣╣╣╝╜
          ╙╬╬╬╣╣╣╜
             ╙
        
 Version information:
  ml-agents: 1.2.0.dev0,
  ml-agents-envs: 1.2.0.dev0,
  Communicator API: 1.5.0,
  PyTorch: 2.2.2+cu121
[INFO] Connected to Unity environment with package version 2.1.0-exp.1 and communication version 1.5.0
[INFO] Connected new brain: SnowballTarget?team=0
[INFO] Hyperparameters for behavior name SnowballTarget: 
	trainer_type:	ppo
	hyperparameters:	
	  batch_size:	128
	  buffer_size:	2048
	  learning_rate:	0.0003
	  beta:	0.005
	  epsilon:	0.2
	  lambd:	0.95
	  num_epoch:	3
	  shared_critic:	False
	  learning_rate_schedule:	linear
	  beta_schedule:	linear
	  epsilon_schedule:	linear
	checkpoint_interval:	50000
	network_settings:	
	  normalize:	False
	  hidden_units:	256
	  num_layers:	2
	  vis_encode_type:	simple
	  memory:	None
	  goal_conditioning_type:	hyper
	  deterministic:	False
	reward_signals:	
	  extrinsic:	
	    gamma:	0.99
	    strength:	1.0
	    network_settings:	
	      normalize:	False
	      hidden_units:	128
	      num_layers:	2
	      vis_encode_type:	simple
	      memory:	None
	      goal_conditioning_type:	hyper
	      deterministic:	False
	init_path:	None
	keep_checkpoints:	5
	even_checkpoints:	False
	max_steps:	200000
	time_horizon:	64
	summary_freq:	10000
	threaded:	False
	self_play:	None
	behavioral_cloning:	None
[INFO] SnowballTarget. Step: 10000. Time Elapsed: 65.297 s. Mean Reward: 4.500. Std of Reward: 1.725. Training.
[INFO] SnowballTarget. Step: 20000. Time Elapsed: 126.340 s. Mean Reward: 6.945. Std of Reward: 2.203. Training.
[INFO] SnowballTarget. Step: 30000. Time Elapsed: 204.251 s. Mean Reward: 10.136. Std of Reward: 3.035. Training.
[INFO] SnowballTarget. Step: 40000. Time Elapsed: 290.814 s. Mean Reward: 10.618. Std of Reward: 2.693. Training.
[INFO] SnowballTarget. Step: 50000. Time Elapsed: 376.351 s. Mean Reward: 13.227. Std of Reward: 2.214. Training.
[INFO] Exported results/SnowballTarget-course-20260925-v2/SnowballTarget/SnowballTarget-49936.onnx
[INFO] SnowballTarget. Step: 60000. Time Elapsed: 460.009 s. Mean Reward: 14.655. Std of Reward: 2.718. Training.
[INFO] SnowballTarget. Step: 70000. Time Elapsed: 550.002 s. Mean Reward: 15.886. Std of Reward: 3.135. Training.
[INFO] SnowballTarget. Step: 80000. Time Elapsed: 677.162 s. Mean Reward: 18.109. Std of Reward: 2.755. Training.
[INFO] SnowballTarget. Step: 90000. Time Elapsed: 782.237 s. Mean Reward: 19.977. Std of Reward: 2.580. Training.
[INFO] Learning was interrupted. Please wait while the graph is generated.
[INFO] Exported results/SnowballTarget-course-20260925-v2/SnowballTarget/SnowballTarget-91608.onnx
[INFO] Copied results/SnowballTarget-course-20260925-v2/SnowballTarget/SnowballTarget-91608.onnx to results/SnowballTarget-course-20260925-v2/SnowballTarget.onnx.