docs: say what the two lines are showing
Browse filesThe block sat between two paragraphs with no lead-in, so the claim it makes -- that RL interaction has the same shape as token generation -- was left for the reader to infer and appeared nowhere on the card. It now says so, in the wording the repository README already uses. The RL line also pairs state with action and marks the next state as coming from the environment, which the old one-per-arrow reading blurred.
README.md
CHANGED
|
@@ -15,9 +15,11 @@ hybrid action spaces**, including cooperative and competitive multi-agent scenes
|
|
| 15 |
without a separate model per action-space type. Autoregressive generation carries
|
| 16 |
long-horizon control without auxiliary networks.
|
| 17 |
|
|
|
|
|
|
|
| 18 |
```text
|
| 19 |
-
|
| 20 |
-
|
| 21 |
```
|
| 22 |
|
| 23 |
Stable under self-generated rollouts — long-horizon control without the drift that
|
|
|
|
| 15 |
without a separate model per action-space type. Autoregressive generation carries
|
| 16 |
long-horizon control without auxiliary networks.
|
| 17 |
|
| 18 |
+
Both LLM generation and RL interaction are autoregressive:
|
| 19 |
+
|
| 20 |
```text
|
| 21 |
+
token → next token (LLM generation)
|
| 22 |
+
(state, action) → (next state from env, next action) (RL rollout)
|
| 23 |
```
|
| 24 |
|
| 25 |
Stable under self-generated rollouts — long-horizon control without the drift that
|