docs: show the environment transition in the rollout picture
Browse filesThe environment read as a pure source, so the generated a_t+1 looked like the cause of the incoming s_t+1. Every action in a token now goes up into the environment, labelled with the glyphs the circles use. An action is *for* the state it sits beside, not *from* it. Alt text updated to match.
- README.md +1 -1
- assets/action-generation-in-a-rollout.svg +79 -66
README.md
CHANGED
|
@@ -21,7 +21,7 @@ token → next token (LLM generation)
|
|
| 21 |
(state, action) → (next state from env, next action) (RL rollout)
|
| 22 |
```
|
| 23 |
|
| 24 |
-

|
| 25 |
|
| 26 |
Causal GPT-RL policies act stably under their own rollouts — long-horizon control without the drift that has historically kept transformers from being usable as RL agents.
|
| 27 |
|
assets/action-generation-in-a-rollout.svg
CHANGED
|
|
|
|