Hugging Face's logo

pre63
/
entropy-trpo-weights

Reinforcement Learning
entropy-trpo
trpo
policy-optimization
mujoco
cartpole
Model card Files
xet
 Community
pre63 commited on
Commit
6b902a0
·
verified ·
1 Parent(s): b742d0d

Update model card and training summary

Browse files
Files changed (2) hide show
  1. README.md +2 -2
  2. results/summary.md +2 -2
README.md CHANGED
@@ -128,7 +128,7 @@ make eval-checkpoints
128
 
129
  ## Training progress
130
 
131
- _Last updated: 2026-07-05 06:57:59 UTC_
132
 
133
  - **Xu window** — mean eval return over the last **W** epochs (Xu Table 6 protocol).
134
  - **Full run** — mean eval return over all epochs.
@@ -222,7 +222,7 @@ _Last updated: 2026-07-05 06:57:59 UTC_
222
  | ERO-TRPO (s2) | done | **976/976** | 999,424 | 54828.2 ± 5440.4 | 57270.1 | 53365.4 | 45660.3 | 163 | 0.0006 |
223
  | ERC-TRPO (s0) | done | **976/976** | 999,424 | 44648.7 ± 1975.6 | 47619.2 | 43774.6 | 40086.5 | 163 | -0.0007 |
224
  | ERC-TRPO (s1) | done | **976/976** | 999,424 | 53205.4 ± 4787.5 | 56941.8 | 52720.3 | 46702.6 | 163 | -0.0042 |
225
- | ERC-TRPO (s2) | running | 870/976 | 890,880 | 52045.6 ± 2169.6 | 55790.2 | 49708.2 | 43798.7 | 163 | 0.0003 |
226
  | EnTRPO-Buffer (s0) | done | **488/488** | 999,424 | 36194.0 ± 1992.8 | 40890.8 | 36737.9 | 37064.1 | 81 | 0.0096 |
227
  | EnTRPO-Buffer (s1) | done | **488/488** | 999,424 | 42289.7 ± 2855.5 | 46657.7 | 40983.5 | 41893.8 | 81 | 0.0078 |
228
  | EnTRPO-Buffer (s2) | done | **488/488** | 999,424 | 37238.8 ± 1760.8 | 40826.2 | 37388.7 | 37541.4 | 81 | 0.0058 |
 
128
 
129
  ## Training progress
130
 
131
+ _Last updated: 2026-07-05 06:59:04 UTC_
132
 
133
  - **Xu window** — mean eval return over the last **W** epochs (Xu Table 6 protocol).
134
  - **Full run** — mean eval return over all epochs.
 
222
  | ERO-TRPO (s2) | done | **976/976** | 999,424 | 54828.2 ± 5440.4 | 57270.1 | 53365.4 | 45660.3 | 163 | 0.0006 |
223
  | ERC-TRPO (s0) | done | **976/976** | 999,424 | 44648.7 ± 1975.6 | 47619.2 | 43774.6 | 40086.5 | 163 | -0.0007 |
224
  | ERC-TRPO (s1) | done | **976/976** | 999,424 | 53205.4 ± 4787.5 | 56941.8 | 52720.3 | 46702.6 | 163 | -0.0042 |
225
+ | ERC-TRPO (s2) | running | 880/976 | 901,120 | 52135.8 ± 4853.2 | 55790.2 | 49790.0 | 43876.3 | 163 | 0.0006 |
226
  | EnTRPO-Buffer (s0) | done | **488/488** | 999,424 | 36194.0 ± 1992.8 | 40890.8 | 36737.9 | 37064.1 | 81 | 0.0096 |
227
  | EnTRPO-Buffer (s1) | done | **488/488** | 999,424 | 42289.7 ± 2855.5 | 46657.7 | 40983.5 | 41893.8 | 81 | 0.0078 |
228
  | EnTRPO-Buffer (s2) | done | **488/488** | 999,424 | 37238.8 ± 1760.8 | 40826.2 | 37388.7 | 37541.4 | 81 | 0.0058 |
results/summary.md CHANGED
@@ -1,6 +1,6 @@
1
  # Training progress
2
 
3
- _Last updated: 2026-07-05 06:57:59 UTC_
4
 
5
  - **Xu window** — mean eval return over the last **W** epochs (Xu Table 6 protocol).
6
  - **Full run** — mean eval return over all epochs.
@@ -94,7 +94,7 @@ _Last updated: 2026-07-05 06:57:59 UTC_
94
  | ERO-TRPO (s2) | done | **976/976** | 999,424 | 54828.2 ± 5440.4 | 57270.1 | 53365.4 | 45660.3 | 163 | 0.0006 |
95
  | ERC-TRPO (s0) | done | **976/976** | 999,424 | 44648.7 ± 1975.6 | 47619.2 | 43774.6 | 40086.5 | 163 | -0.0007 |
96
  | ERC-TRPO (s1) | done | **976/976** | 999,424 | 53205.4 ± 4787.5 | 56941.8 | 52720.3 | 46702.6 | 163 | -0.0042 |
97
- | ERC-TRPO (s2) | running | 870/976 | 890,880 | 52045.6 ± 2169.6 | 55790.2 | 49708.2 | 43798.7 | 163 | 0.0003 |
98
  | EnTRPO-Buffer (s0) | done | **488/488** | 999,424 | 36194.0 ± 1992.8 | 40890.8 | 36737.9 | 37064.1 | 81 | 0.0096 |
99
  | EnTRPO-Buffer (s1) | done | **488/488** | 999,424 | 42289.7 ± 2855.5 | 46657.7 | 40983.5 | 41893.8 | 81 | 0.0078 |
100
  | EnTRPO-Buffer (s2) | done | **488/488** | 999,424 | 37238.8 ± 1760.8 | 40826.2 | 37388.7 | 37541.4 | 81 | 0.0058 |
 
1
  # Training progress
2
 
3
+ _Last updated: 2026-07-05 06:59:04 UTC_
4
 
5
  - **Xu window** — mean eval return over the last **W** epochs (Xu Table 6 protocol).
6
  - **Full run** — mean eval return over all epochs.
 
94
  | ERO-TRPO (s2) | done | **976/976** | 999,424 | 54828.2 ± 5440.4 | 57270.1 | 53365.4 | 45660.3 | 163 | 0.0006 |
95
  | ERC-TRPO (s0) | done | **976/976** | 999,424 | 44648.7 ± 1975.6 | 47619.2 | 43774.6 | 40086.5 | 163 | -0.0007 |
96
  | ERC-TRPO (s1) | done | **976/976** | 999,424 | 53205.4 ± 4787.5 | 56941.8 | 52720.3 | 46702.6 | 163 | -0.0042 |
97
+ | ERC-TRPO (s2) | running | 880/976 | 901,120 | 52135.8 ± 4853.2 | 55790.2 | 49790.0 | 43876.3 | 163 | 0.0006 |
98
  | EnTRPO-Buffer (s0) | done | **488/488** | 999,424 | 36194.0 ± 1992.8 | 40890.8 | 36737.9 | 37064.1 | 81 | 0.0096 |
99
  | EnTRPO-Buffer (s1) | done | **488/488** | 999,424 | 42289.7 ± 2855.5 | 46657.7 | 40983.5 | 41893.8 | 81 | 0.0078 |
100
  | EnTRPO-Buffer (s2) | done | **488/488** | 999,424 | 37238.8 ± 1760.8 | 40826.2 | 37388.7 | 37541.4 | 81 | 0.0058 |