Intro / framework-inventory / why-comparison:
- Merge Abstract and Introduction into a single section with shorter,
less-repetitive prose; expand env→environment everywhere.
- Drop framework-name list from the intro paragraph; link the word
'frameworks' to the inventory chapter instead.
- Move the 'why have environment frameworks at all?' explanation into
a markdown blockquote callout at the top of the inventory chapter.
- Bold 'RL environments' on the opening line.
- Mention the companion repo (RL_Envs_101) in the intro.
- TL;DR shortened back to abstract framing.
Anatomy hero (d3-anatomy-hero.html):
- Rewrite as pure SVG (no D3) with the env on the left and the
Training Loop box on the right.
- Env contains all 9 components (Tasks, Prompt template, Initial state,
Tools / Harness, State, Execution backend, Observation, Reward, Done)
with Lucide-style icons matching the rest of the article.
- Training Loop box contains LLM Agent, Rollout, Trainer, Weight update
with vert…
Add framework specification cards and global comparison matrix
- Introduced a new HTML component for displaying framework specification cards, including styling and dynamic content generation via JavaScript.
- Added a global comparison matrix to facilitate side-by-side evaluation of multiple frameworks, complete with filter functionality and copy-to-clipboard feature for row data.
Adds five new D3/HTML embeds that replace ASCII or static blocks across
rl-environment.mdx and framework-inventory.mdx:
- d3-classical-rl.html: live CartPole simulation framed as Agent ↔ Environment,
with action / state·reward bus animation and slow-speed support down to 0.05x.
- d3-llm-rl-coding.html: multi-rollout coding env with synced animations,
agent (LLM policy) on top, environment (sandboxed shell) below, and the
"+ N more rollouts" placeholder pulsing only while the visible rollouts run.
- d3-rl-pipeline.html: five-stage pipeline (Tasks → Harness → Reward → Rollout
→ Trainer) with per-framework brackets above and an "RL environment"
underbrace below the first three pills.
- taxonomy-of-environment.html: components-of-an-environment view with a
grid/table toggle, default to table, header row, and per-row accent cards.
- framework-cards.html: 3x2 minimal cards for the implemented frameworks
with creator chip, transport pill, package badge, copy-to-clipboard,
rep…
