AdrianLlopart commited on
Commit
3af10a9
·
verified ·
1 Parent(s): 0413a39

Convert label–definition em-dashes to colons/periods (impeccable: em-dash overuse)

Browse files
Files changed (1) hide show
  1. index.html +21 -21
index.html CHANGED
@@ -3,7 +3,7 @@
3
  <head>
4
  <meta charset="UTF-8" />
5
  <meta name="viewport" content="width=device-width, initial-scale=1.0" />
6
- <title>OpenRAL — Runtime for VLA Robot Agents</title>
7
  <style>
8
  *, *::before, *::after { box-sizing: border-box; margin: 0; padding: 0; }
9
 
@@ -227,10 +227,10 @@
227
  <p>A VLA model alone can't run on your robot. It needs a camera pipeline, an observation normaliser, an action de-normaliser, a safety wrapper, a replanning layer when it fails, and a way to log everything for later fine-tuning. <strong>OpenRAL is that infrastructure.</strong></p>
228
  <br/>
229
  <ul>
230
- <li><strong>Typed runtime</strong> — eight well-defined layers connected by Pydantic v2 contracts. No magic globals, no hidden retries.</li>
231
- <li><strong>rSkill format</strong> — Hub repos containing weights, a <code>rskill.yaml</code> manifest, quantisation hints, latency budgets, and reproducible <code>eval/</code>. Install like a model.</li>
232
- <li><strong>Dual-system planning</strong> — a fast visuomotor policy (S1, 30–200 Hz) and a slow LLM planner (S2) emitting typed tool-calls. Replanning is bounded and explicit.</li>
233
- <li><strong>Safety kernel</strong> — deny-by-default, Python proposes, C++ disposes. <code>ROSSafetyViolation</code> is never silently caught.</li>
234
  </ul>
235
  </div>
236
 
@@ -256,7 +256,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
256
  <div class="arch-row">
257
  <span class="arch-num">0</span>
258
  <span class="arch-name">HAL</span>
259
- <span class="arch-desc">Per-robot adapters — uniform connect / read_state / write_command Protocol</span>
260
  <span class="arch-tag tag-green">shipped</span>
261
  </div>
262
  <div class="arch-row">
@@ -274,7 +274,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
274
  <div class="arch-row">
275
  <span class="arch-num">3</span>
276
  <span class="arch-name">rSkill (S1)</span>
277
- <span class="arch-desc">Fast visuomotor policy — VLA, 30–200 Hz, async action chunks</span>
278
  <span class="arch-tag tag-green">shipped</span>
279
  </div>
280
  <div class="arch-row">
@@ -286,7 +286,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
286
  <div class="arch-row">
287
  <span class="arch-num">5</span>
288
  <span class="arch-name">WAM</span>
289
- <span class="arch-desc">World Action Model — mental simulation, failure anticipation</span>
290
  <span class="arch-tag tag-gray">planned</span>
291
  </div>
292
  <div class="arch-row">
@@ -309,11 +309,11 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
309
  <table>
310
  <thead><tr><th>Type</th><th>What</th><th>Count</th></tr></thead>
311
  <tbody>
312
- <tr><td><code>rskill-*</code> models</td><td>VLA policy rSkills — VLA weights + ROS-wrapped action skill + manifest + eval</td><td>20</td></tr>
313
- <tr><td><code>rskill-*</code> models</td><td>ROS-action rSkills (<code>kind: ros_action</code>) — classical motion planners (MoveIt MoveGroup, Nav2) the reasoner dispatches like any other skill</td><td>4</td></tr>
314
- <tr><td><code>rskill-*</code> models</td><td>Perception detector rSkills (<code>kind: detector</code>) — RT-DETR + OmDet-Turbo + LocateAnything → <code>ObjectsMetadata</code></td><td>5</td></tr>
315
- <tr><td><code>rskill-*</code> models</td><td>Scene-understanding VLM rSkill (<code>kind: vlm</code>) — drives the reasoner's read-only <code>query_scene</code> tool</td><td>1</td></tr>
316
- <tr><td><code>rskill-*</code> models</td><td>Reward / progress-monitor rSkill (<code>kind: reward</code>) — robotic reward model run parallel to a VLA; drives the reasoner's read-only <code>query_task_progress</code> tool</td><td>1</td></tr>
317
  <tr><td><code>dataset-*</code></td><td>LeRobotDataset v3 demonstration datasets</td><td>growing</td></tr>
318
  </tbody>
319
  </table>
@@ -417,7 +417,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
417
  </div>
418
 
419
  <h2>ROS-action rSkills</h2>
420
- <p><code>kind: ros_action</code> — classical motion planners packaged as rSkills, so the S2 reasoner dispatches a MoveIt or Nav2 motion exactly like a learned policy (this is the "VLA <em>and</em> classical controllers" thesis). No weights; they wrap a ROS 2 action server.</p>
421
  <div class="table-wrap">
422
  <table>
423
  <thead><tr><th>rSkill</th><th>Planner</th><th>What it does</th><th>License</th></tr></thead>
@@ -447,7 +447,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
447
  </div>
448
 
449
  <h2>Perception detector rSkills</h2>
450
- <p><code>kind: detector</code> — emit <code>ObjectsMetadata</code> (2D detections lifted to 3D via depth) rather than an <code>Action</code>. Plug directly into the <code>openral deploy</code> graph and fold into World State.</p>
451
  <div class="table-wrap">
452
  <table>
453
  <thead><tr><th>rSkill</th><th>Backbone</th><th>Notes</th><th>License</th></tr></thead>
@@ -469,7 +469,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
469
  </tr>
470
  <tr>
471
  <td><code>rskill-omdet-turbo-locator</code></td>
472
- <td>OmDet-Turbo (Swin-tiny)</td><td>On-demand <code>locate_in_view</code> — lightweight in-process "find X"</td>
473
  <td><span class="lic lic-green"></span>Apache-2.0</td>
474
  </tr>
475
  <tr>
@@ -482,7 +482,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
482
  </div>
483
 
484
  <h2>Scene-understanding VLM rSkill</h2>
485
- <p><code>kind: vlm</code> — a scene VLM that answers open-ended questions about the current view. It powers the S2 reasoner's <strong>read-only</strong> <code>query_scene</code> tool for task-progress / success verification ("did the grasp succeed?"); it holds no actuation authority (ADR-0047). Runs out-of-process in an NF4 sidecar served by <code>scene_vlm_node</code>.</p>
486
  <div class="table-wrap">
487
  <table>
488
  <thead><tr><th>rSkill</th><th>Backbone</th><th>Notes</th><th>License</th></tr></thead>
@@ -497,7 +497,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
497
  </div>
498
 
499
  <h2>Reward-monitor rSkill</h2>
500
- <p><code>kind: reward</code> — a robotic <strong>reward / progress-monitor</strong> model that runs <strong>in parallel with a VLA</strong> and scores the live rollout, emitting per-frame normalised progress (0–1) and success probability. It powers the S2 reasoner's <strong>read-only</strong> <code>query_task_progress</code> tool ("is the task succeeding right now?"); advisory, never on the control path (ADR-0057). Runs out-of-process in an NF4 sidecar served by <code>reward_monitor_node</code>; the pre-quantized checkpoint is meta-loaded directly as 4-bit.</p>
501
  <div class="table-wrap">
502
  <table>
503
  <thead><tr><th>rSkill</th><th>Backbone</th><th>Notes</th><th>License</th></tr></thead>
@@ -515,7 +515,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
515
  <p style="font-size:12.5px; color: var(--mid);">
516
  <span class="lic lic-green"></span> Free for any use &nbsp;
517
  <span class="lic lic-yellow"></span> Research-permissive weights (check upstream terms) &nbsp;
518
- <span class="lic lic-red"></span> Non-commercial — requires <code>OPENRAL_ACCEPT_NONCOMMERCIAL=1</code>
519
  </p>
520
 
521
  <!-- rSkill manifest format -->
@@ -545,7 +545,7 @@ quantization: null</code></pre>
545
  </div>
546
 
547
  <div class="robot-group">
548
- <h3>Sim — HW bring-up in progress</h3>
549
  <div class="robot-chips">
550
  <span class="chip chip-blue">Franka Panda</span>
551
  <span class="chip chip-blue">UR5e</span>
@@ -580,7 +580,7 @@ openral benchmark report</code></pre>
580
 
581
  <!-- Observability -->
582
  <h2>Observability &amp; data flywheel</h2>
583
- <p>Every skill execution is an OpenTelemetry span — weights revision pinned, camera frames captured, LLM prompts logged. Traces replay as LeRobotDataset v3 rows, closing the loop from deployment back to training data.</p>
584
  <pre><code>openral dashboard # OTLP receiver at :4318, live trace viewer</code></pre>
585
 
586
  <!-- License -->
 
3
  <head>
4
  <meta charset="UTF-8" />
5
  <meta name="viewport" content="width=device-width, initial-scale=1.0" />
6
+ <title>OpenRAL: Runtime for VLA Robot Agents</title>
7
  <style>
8
  *, *::before, *::after { box-sizing: border-box; margin: 0; padding: 0; }
9
 
 
227
  <p>A VLA model alone can't run on your robot. It needs a camera pipeline, an observation normaliser, an action de-normaliser, a safety wrapper, a replanning layer when it fails, and a way to log everything for later fine-tuning. <strong>OpenRAL is that infrastructure.</strong></p>
228
  <br/>
229
  <ul>
230
+ <li><strong>Typed runtime</strong>: eight well-defined layers connected by Pydantic v2 contracts. No magic globals, no hidden retries.</li>
231
+ <li><strong>rSkill format</strong>: Hub repos containing weights, a <code>rskill.yaml</code> manifest, quantisation hints, latency budgets, and reproducible <code>eval/</code>. Install like a model.</li>
232
+ <li><strong>Dual-system planning</strong>: a fast visuomotor policy (S1, 30–200 Hz) and a slow LLM planner (S2) emitting typed tool-calls. Replanning is bounded and explicit.</li>
233
+ <li><strong>Safety kernel</strong>: deny-by-default, Python proposes, C++ disposes. <code>ROSSafetyViolation</code> is never silently caught.</li>
234
  </ul>
235
  </div>
236
 
 
256
  <div class="arch-row">
257
  <span class="arch-num">0</span>
258
  <span class="arch-name">HAL</span>
259
+ <span class="arch-desc">Per-robot adapters: uniform connect / read_state / write_command Protocol</span>
260
  <span class="arch-tag tag-green">shipped</span>
261
  </div>
262
  <div class="arch-row">
 
274
  <div class="arch-row">
275
  <span class="arch-num">3</span>
276
  <span class="arch-name">rSkill (S1)</span>
277
+ <span class="arch-desc">Fast visuomotor policy: VLA, 30–200 Hz, async action chunks</span>
278
  <span class="arch-tag tag-green">shipped</span>
279
  </div>
280
  <div class="arch-row">
 
286
  <div class="arch-row">
287
  <span class="arch-num">5</span>
288
  <span class="arch-name">WAM</span>
289
+ <span class="arch-desc">World Action Model: mental simulation, failure anticipation</span>
290
  <span class="arch-tag tag-gray">planned</span>
291
  </div>
292
  <div class="arch-row">
 
309
  <table>
310
  <thead><tr><th>Type</th><th>What</th><th>Count</th></tr></thead>
311
  <tbody>
312
+ <tr><td><code>rskill-*</code> models</td><td>VLA policy rSkills: VLA weights + ROS-wrapped action skill + manifest + eval</td><td>20</td></tr>
313
+ <tr><td><code>rskill-*</code> models</td><td>ROS-action rSkills (<code>kind: ros_action</code>): classical motion planners (MoveIt MoveGroup, Nav2) the reasoner dispatches like any other skill</td><td>4</td></tr>
314
+ <tr><td><code>rskill-*</code> models</td><td>Perception detector rSkills (<code>kind: detector</code>): RT-DETR + OmDet-Turbo + LocateAnything → <code>ObjectsMetadata</code></td><td>5</td></tr>
315
+ <tr><td><code>rskill-*</code> models</td><td>Scene-understanding VLM rSkill (<code>kind: vlm</code>): drives the reasoner's read-only <code>query_scene</code> tool</td><td>1</td></tr>
316
+ <tr><td><code>rskill-*</code> models</td><td>Reward / progress-monitor rSkill (<code>kind: reward</code>): robotic reward model run parallel to a VLA; drives the reasoner's read-only <code>query_task_progress</code> tool</td><td>1</td></tr>
317
  <tr><td><code>dataset-*</code></td><td>LeRobotDataset v3 demonstration datasets</td><td>growing</td></tr>
318
  </tbody>
319
  </table>
 
417
  </div>
418
 
419
  <h2>ROS-action rSkills</h2>
420
+ <p><code>kind: ros_action</code>. Classical motion planners packaged as rSkills, so the S2 reasoner dispatches a MoveIt or Nav2 motion exactly like a learned policy (this is the "VLA <em>and</em> classical controllers" thesis). No weights; they wrap a ROS 2 action server.</p>
421
  <div class="table-wrap">
422
  <table>
423
  <thead><tr><th>rSkill</th><th>Planner</th><th>What it does</th><th>License</th></tr></thead>
 
447
  </div>
448
 
449
  <h2>Perception detector rSkills</h2>
450
+ <p><code>kind: detector</code>. Emit <code>ObjectsMetadata</code> (2D detections lifted to 3D via depth) rather than an <code>Action</code>. Plug directly into the <code>openral deploy</code> graph and fold into World State.</p>
451
  <div class="table-wrap">
452
  <table>
453
  <thead><tr><th>rSkill</th><th>Backbone</th><th>Notes</th><th>License</th></tr></thead>
 
469
  </tr>
470
  <tr>
471
  <td><code>rskill-omdet-turbo-locator</code></td>
472
+ <td>OmDet-Turbo (Swin-tiny)</td><td>On-demand <code>locate_in_view</code>: lightweight in-process "find X"</td>
473
  <td><span class="lic lic-green"></span>Apache-2.0</td>
474
  </tr>
475
  <tr>
 
482
  </div>
483
 
484
  <h2>Scene-understanding VLM rSkill</h2>
485
+ <p><code>kind: vlm</code>. A scene VLM that answers open-ended questions about the current view. It powers the S2 reasoner's <strong>read-only</strong> <code>query_scene</code> tool for task-progress / success verification ("did the grasp succeed?"); it holds no actuation authority (ADR-0047). Runs out-of-process in an NF4 sidecar served by <code>scene_vlm_node</code>.</p>
486
  <div class="table-wrap">
487
  <table>
488
  <thead><tr><th>rSkill</th><th>Backbone</th><th>Notes</th><th>License</th></tr></thead>
 
497
  </div>
498
 
499
  <h2>Reward-monitor rSkill</h2>
500
+ <p><code>kind: reward</code>. A robotic <strong>reward / progress-monitor</strong> model that runs <strong>in parallel with a VLA</strong> and scores the live rollout, emitting per-frame normalised progress (0–1) and success probability. It powers the S2 reasoner's <strong>read-only</strong> <code>query_task_progress</code> tool ("is the task succeeding right now?"); advisory, never on the control path (ADR-0057). Runs out-of-process in an NF4 sidecar served by <code>reward_monitor_node</code>; the pre-quantized checkpoint is meta-loaded directly as 4-bit.</p>
501
  <div class="table-wrap">
502
  <table>
503
  <thead><tr><th>rSkill</th><th>Backbone</th><th>Notes</th><th>License</th></tr></thead>
 
515
  <p style="font-size:12.5px; color: var(--mid);">
516
  <span class="lic lic-green"></span> Free for any use &nbsp;
517
  <span class="lic lic-yellow"></span> Research-permissive weights (check upstream terms) &nbsp;
518
+ <span class="lic lic-red"></span> Non-commercial: requires <code>OPENRAL_ACCEPT_NONCOMMERCIAL=1</code>
519
  </p>
520
 
521
  <!-- rSkill manifest format -->
 
545
  </div>
546
 
547
  <div class="robot-group">
548
+ <h3>Sim: HW bring-up in progress</h3>
549
  <div class="robot-chips">
550
  <span class="chip chip-blue">Franka Panda</span>
551
  <span class="chip chip-blue">UR5e</span>
 
580
 
581
  <!-- Observability -->
582
  <h2>Observability &amp; data flywheel</h2>
583
+ <p>Every skill execution is an OpenTelemetry span: weights revision pinned, camera frames captured, LLM prompts logged. Traces replay as LeRobotDataset v3 rows, closing the loop from deployment back to training data.</p>
584
  <pre><code>openral dashboard # OTLP receiver at :4318, live trace viewer</code></pre>
585
 
586
  <!-- License -->