Download command.md from LinJinwei/XY-VLA: direct link, hf CLI and curl.
- Browser
- Download file 11.9 kB
-
https://huggingface.co/LinJinwei/XY-VLA/resolve/main/command.md
- Command line
-
hf download hf://LinJinwei/XY-VLA/command.md
-
curl -L -o command.md https://huggingface.co/LinJinwei/XY-VLA/resolve/main/command.md
1.1 Core Example (billboard_id=3, default config is upper yellow frame — use ID as reference)
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through only the rectangular portal marked billboard_id=18" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
1.2 Other IDs (change the number in --cmd only)
Lower ring example (default config billboard_id=12 ≈ orange frame; still use ID as reference):
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Pass through portal billboard number 12 only; stay parallel to the long edge of billboard_id=12." `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
Short phrase (suitable for batch scripts changing the last digit):
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Navigate through rectangular frame billboard_id=16; long-opening alignment; no other portals." `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
1.3 Alternative: Color Commands (legacy compatibility, lower precision)
Easy to confuse when 2 portals share the same color on upper/lower layers; use only when ambiguity is acceptable or for temporary comparison.
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through the yellow rectangular frame safely, align with the long opening" `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
2. Capability Test B — Obstacle Avoidance & Safety Semantics (still targeting portal traversal)
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through only billboard_id=3 safely; keep clearance from all other frames and obstacles" `
--sim-steps 280 `
--infer-every 5 `
--xvla-steps 4 `
--log-every 12 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.5
Control: Disable near-field repulsion (comparison experiment only):
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through billboard_id=3 only" `
--no-local-avoidance `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
3. Capability Test C — Traverse Specified ID Only Under Multi-Frame Interference
Test objective: Whether only billboard_id=N / ignore other billboard markers in the instruction suppresses neighboring distractor frames.
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through ONLY billboard_id=7; numbered markers 6 and 8 are distractors — do not enter them." `
--sim-steps 260 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Pass through portal billboard 16 only; all other billboard_id values must be skipped." `
--sim-steps 280 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
4. Capability Test D — Visual Alignment + Traversal (Two-Stage Semantics)
Test objective: Align/center first, then traverse — evaluate whether temporal language is interpreted by the model as pose/position first, then crossing.
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Center billboard_id=5 opening in view, then fly through it along the long opening only." `
--sim-steps 300 `
--infer-every 5 `
--xvla-steps 4 `
--log-every 12 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.5
Near-range gate pose estimation relies on fpv_slot_align, gate_pose_estimator (opencv / xvla); see config.json.
5. Capability Test E — Tilt / Narrow Slot Geometry Hints
Mid-layer frames in the scene have random tilt/yaw; explicitly requiring tilted / narrow slot in the instruction tests the model's response to geometric language (still combined with real simulation poses).
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through the tilted rectangular portal billboard_id=1; stay parallel to the long edge to avoid hitting the rails." `
--sim-steps 280 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.5
6. Capability Test F — Motion Scale Trio (Smoke / Robust / Aggressive)
Same --cmd, only change dynamics-related parameters; for video comparison, best use --gui or increase recording_scene_margin.
Smoke (small steps, easy to stabilize)
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through billboard_id=3 only" `
--sim-steps 240 `
--infer-every 8 `
--xvla-steps 2 `
--log-every 12 `
--speed 4 `
--cmd-motion-amplify 2.0 `
--cmd-min-step 0.04 `
--infer-displacement-scale 1.2
Robust (default) — same as §1.1.
Aggressive (faster approach, prone to going off-screen or overshoot)
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through billboard_id=3 only" `
--sim-steps 200 `
--infer-every 4 `
--xvla-steps 4 `
--log-every 8 `
--speed 6 `
--cmd-motion-amplify 3.0 `
--cmd-min-step 0.05 `
--infer-displacement-scale 2.2
7. Capability Test G — Full Scene Language Catalog Ablation
Catalog off: Test pure vision + short instruction; compare the effect of having vs. not having a numeric object list on frame selection / path.
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through billboard_id=3 only" `
--no-xvla-scene-catalog `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
8. Full 20-Frame Sequential Traversal vs --cmd
Code convention: when --cmd is present, non-empty task_sequence in JSON is ignored; language instruction only. For 20-frame sequential endurance, do not pass --cmd, e.g.:
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--config e:/X-VLA/config.json `
--scheme widowx_ee6d `
--instruction "Sequential portal flight demo"
9. Top-Down Coarse Planning Phase1+2+3 (cmd_coarse_plan_once)
9.1 Copy-Paste Command — Single Frame Traversal (default Phase3 action)
Same --cmd as §1.1; with cmd_coarse_plan_once: true runs Phase3 instead of main simulation:
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly through only the rectangular portal marked billboard_id=3" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
Expected log: [Phase 3][Refine] object '…' base_action=pass_through.
9.2 Copy-Paste Commands — Explicit Five Actions (single-frame debug)
Fly by (does not emphasize center through):
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Fly by portal billboard number 3 without entering the opening center" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
Orbit 2 laps:
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Orbit billboard_id=3 twice for inspection, then pass through billboard_id=3" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
Hover:
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Hover over portal billboard number 5" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
Collision (geometry debug, not safe flight):
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Collide with rectangular portal billboard_id=7; ram the frame directly" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
9.3 Copy-Paste Command — Multi-Frame Chain + Phase3 Refinement
Same as cmd_multi_1.md §5.1; Phase3 turns each feedback sphere contacted along the global trajectory red sequentially and refines:
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--cmd "Pass through portal billboard number 2 then pass through portal billboard number 3, then pass through portal billboard number 5" `
--sim-steps 200 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6
9.4 Disable Coarse Planning to Restore Closed-Loop Portal Traversal
Set "cmd_coarse_plan_once": false in config.json → schemes.widowx_ee6d, then run §2–§7 commands to enter the X‑VLA main simulation loop.
10. Appendix: Full Command Template with config / scheme / QS
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--config e:/X-VLA/config.json `
--scheme widowx_ee6d `
--cmd "Fly through only billboard_id=3; align with the long opening; ignore other portals." `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6 `
--qs-path e:/X-VLA/QS.json
If v‑vla is also needed: add ` at the end of the **--qs-path** line above, and **start a new line** for --vvla-url (no continuation on the last line); full example:
& C:/Users/ydook/anaconda3/envs/xy-vla/python.exe d:/XY-VLA/run_xyVLA.py `
--config e:/X-VLA/config.json `
--scheme widowx_ee6d `
--cmd "Fly through only billboard_id=3; align with the long opening; ignore other portals." `
--sim-steps 220 `
--infer-every 6 `
--xvla-steps 4 `
--log-every 10 `
--speed 5 `
--cmd-motion-amplify 2.5 `
--cmd-min-step 0.045 `
--infer-displacement-scale 1.6 `
--qs-path e:/X-VLA/QS.json `
--vvla-url http://127.0.0.1:9000/vvla
(--vvla-url should match your actual service address.) Seeing [===> TransCMD]: ... when multiple Q entries match is normal.