Yangyihui commited on
Commit
bfffc52
·
verified ·
1 Parent(s): 111607e

Use the paired original instruction in the inference example

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -46,14 +46,15 @@ Download the Wan VAE, text encoder and tokenizer using the
46
 
47
  ## Inference
48
 
49
- After installing the ScaleNav code and preparing an observation:
 
50
 
51
  ```bash
52
  awm check --checkpoint checkpoints/scalenav --sha256
53
  awm infer --checkpoint checkpoints/scalenav \
54
  --base-model checkpoints/Wan2.2-TI2V-5B \
55
  --image data/example/observation.png \
56
- --prompt 'Approach the chair beside the table.' --output outputs/example
57
  ```
58
 
59
  This produces a nine-step action trajectory and a generated video. Actions are
 
46
 
47
  ## Inference
48
 
49
+ Prepare the paired observation and its original instruction using the
50
+ [data instructions](https://github.com/yangyihui0502/ScaleNav#data), then run:
51
 
52
  ```bash
53
  awm check --checkpoint checkpoints/scalenav --sha256
54
  awm infer --checkpoint checkpoints/scalenav \
55
  --base-model checkpoints/Wan2.2-TI2V-5B \
56
  --image data/example/observation.png \
57
+ --prompt "$(cat data/example/instruction.txt)" --output outputs/example
58
  ```
59
 
60
  This produces a nine-step action trajectory and a generated video. Actions are