Archive original hopper pi05 profile bundle
Browse files- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/README.md +31 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/checkpoints/model.pt +3 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/config.full.yaml +246 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/config.yaml +123 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/dataset_statistics.json +123 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/latency_prompt_map.json +12 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/manifest.json +143 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/provenance.json +34 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/source/README.md +5 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/source/provenance.json +512 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/task_contract.json +62 -0
- archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/validation.json +10 -0
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/README.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# hopper / qwenpi_v3
|
| 2 |
+
|
| 3 |
+
Training condition: `latency-aware`. Run: `hopper_pi05_profile_gt2500_h1_5fps_g128_20260922`.
|
| 4 |
+
|
| 5 |
+
Copied from [Standard-Pipeline](https://huggingface.co/latency-sensitive-bench/Standard-Pipeline/tree/2208875f92b21e3f8ec2363a30a6705dfe56cc04/hopper/profile_latency/Pi05) at `2208875f92b21e3f8ec2363a30a6705dfe56cc04`.
|
| 6 |
+
|
| 7 |
+
- Checkpoint: `checkpoints/model.pt`
|
| 8 |
+
- Selection: only published VLA checkpoint
|
| 9 |
+
- Checkpoint SHA256: `93f66960f8eae69b52350e2d15271ef037dc8826332268fac69ce7c018d654c8`
|
| 10 |
+
- Configuration, FPS, actions, normalization and latency semantics retain their source values.
|
| 11 |
+
- This import does not run evaluations or change training/evaluation/acceptance status.
|
| 12 |
+
|
| 13 |
+
Action horizon is 1. Use `config.yaml` and `dataset_statistics.json` with the matching
|
| 14 |
+
prepared backbone. `task_contract.json` is extracted from the original training configuration.
|
| 15 |
+
Original machine paths in historical configurations are provenance: bind checkpoint,
|
| 16 |
+
backbone, manifest and profile paths to downloaded local files when running inference.
|
| 17 |
+
|
| 18 |
+
See [the original model notes](source/README.md) for experiment results and limitations.
|
| 19 |
+
|
| 20 |
+
[Original provenance](source/provenance.json) retains dataset references and recorded experiment evidence.
|
| 21 |
+
|
| 22 |
+
## Download
|
| 23 |
+
|
| 24 |
+
```python
|
| 25 |
+
from huggingface_hub import snapshot_download
|
| 26 |
+
prefix = "latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922"
|
| 27 |
+
snapshot_download("latency-sensitive-bench/benchmark-models", revision="<commit>",
|
| 28 |
+
allow_patterns=[prefix + "/**"])
|
| 29 |
+
```
|
| 30 |
+
|
| 31 |
+
Use the verified import commit listed in the repository's import report.
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/checkpoints/model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:93f66960f8eae69b52350e2d15271ef037dc8826332268fac69ce7c018d654c8
|
| 3 |
+
size 10922629277
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/config.full.yaml
ADDED
|
@@ -0,0 +1,246 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
framework:
|
| 2 |
+
name: QwenPI_v3
|
| 3 |
+
qwenvl:
|
| 4 |
+
base_vlm: ${oc.env:PI05_BACKBONE_DIR}
|
| 5 |
+
attn_implementation: flash_attention_2
|
| 6 |
+
vl_hidden_dim: 2560
|
| 7 |
+
num_vl_layers: 36
|
| 8 |
+
enable_gradient_checkpointing: false
|
| 9 |
+
action_model:
|
| 10 |
+
action_model_type: LayerwiseFM
|
| 11 |
+
action_dim: 3
|
| 12 |
+
state_dim: 11
|
| 13 |
+
state_encoding: continuous_projector
|
| 14 |
+
task_objective: null
|
| 15 |
+
action_horizon: 1
|
| 16 |
+
repeated_diffusion_steps: 2
|
| 17 |
+
num_inference_timesteps: 4
|
| 18 |
+
add_pos_embed: true
|
| 19 |
+
max_seq_len: 1024
|
| 20 |
+
num_target_vision_tokens: 32
|
| 21 |
+
noise_beta_alpha: 1.5
|
| 22 |
+
noise_beta_beta: 1.0
|
| 23 |
+
noise_s: 0.999
|
| 24 |
+
num_timestep_buckets: 1000
|
| 25 |
+
diffusion_model_cfg:
|
| 26 |
+
action_dit_hidden_dim: 1024
|
| 27 |
+
dropout: 0.2
|
| 28 |
+
final_dropout: true
|
| 29 |
+
interleave_self_attention: true
|
| 30 |
+
norm_type: ada_norm
|
| 31 |
+
positional_embeddings: null
|
| 32 |
+
attention_head_dim: 64
|
| 33 |
+
num_layers: 36
|
| 34 |
+
input_embedding_dim: 1024
|
| 35 |
+
cross_attention_dim: 1024
|
| 36 |
+
output_dim: 1024
|
| 37 |
+
num_attention_heads: 16
|
| 38 |
+
action_env_dim: 3
|
| 39 |
+
future_action_window_size: 0
|
| 40 |
+
past_action_window_size: 0
|
| 41 |
+
datasets:
|
| 42 |
+
vla_data:
|
| 43 |
+
dataset_py: lerobot_datasets
|
| 44 |
+
include_state: true
|
| 45 |
+
data_root_dir: /
|
| 46 |
+
data_mix: train
|
| 47 |
+
eval_data_mix: validation
|
| 48 |
+
custom_mixtures_path: ${PI05_RUN_DIR}/profile_latency/vla_gt2500_20260922/mixture.json
|
| 49 |
+
action_type: continuous
|
| 50 |
+
sequential_step_sampling: true
|
| 51 |
+
eval_sequential_step_sampling: null
|
| 52 |
+
num_workers: 4
|
| 53 |
+
eval_num_workers: 0
|
| 54 |
+
prefetch_factor: 2
|
| 55 |
+
persistent_workers: true
|
| 56 |
+
pin_memory: true
|
| 57 |
+
shuffle: true
|
| 58 |
+
action_balance:
|
| 59 |
+
enabled: false
|
| 60 |
+
strategy: balanced_epoch
|
| 61 |
+
action_key: action_id
|
| 62 |
+
target_flap_fraction: 0.3
|
| 63 |
+
noop_id: 0
|
| 64 |
+
flap_id: 1
|
| 65 |
+
latency_curriculum:
|
| 66 |
+
enabled: false
|
| 67 |
+
strategy: exclusive
|
| 68 |
+
latencies: null
|
| 69 |
+
phase_steps: null
|
| 70 |
+
phase_distributions: null
|
| 71 |
+
new_latency_passes: 1.0
|
| 72 |
+
replay_passes: 0.25
|
| 73 |
+
target_total_passes: 2.0
|
| 74 |
+
final_equalization: true
|
| 75 |
+
step_budget_mode: auto
|
| 76 |
+
eval_at_phase_end: false
|
| 77 |
+
save_at_phase_end: false
|
| 78 |
+
computed_plan: null
|
| 79 |
+
per_device_batch_size: 64
|
| 80 |
+
load_all_data_for_training: true
|
| 81 |
+
num_obs_frames: 1
|
| 82 |
+
image_mode: single
|
| 83 |
+
prompt_mode: raw
|
| 84 |
+
stitch_grid:
|
| 85 |
+
- 2
|
| 86 |
+
- 2
|
| 87 |
+
obs_image_size:
|
| 88 |
+
- 224
|
| 89 |
+
- 224
|
| 90 |
+
video_backend: pyav
|
| 91 |
+
lerobot_version: v2.0
|
| 92 |
+
gymnasium_task_contract:
|
| 93 |
+
action_space:
|
| 94 |
+
dtype: float32
|
| 95 |
+
high:
|
| 96 |
+
- 1.0
|
| 97 |
+
- 1.0
|
| 98 |
+
- 1.0
|
| 99 |
+
labels:
|
| 100 |
+
- thigh_torque
|
| 101 |
+
- leg_torque
|
| 102 |
+
- foot_torque
|
| 103 |
+
low:
|
| 104 |
+
- -1.0
|
| 105 |
+
- -1.0
|
| 106 |
+
- -1.0
|
| 107 |
+
type: box
|
| 108 |
+
base_prompt: Move the Hopper robot forward while keeping its torso upright.
|
| 109 |
+
Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot.
|
| 110 |
+
env_fps: 5.0
|
| 111 |
+
env_id: LatencyBench/Hopper-v0
|
| 112 |
+
frame_stack: 1
|
| 113 |
+
make_kwargs:
|
| 114 |
+
base_env_id: Hopper-v4
|
| 115 |
+
base_make_kwargs:
|
| 116 |
+
ctrl_cost_weight: 0.001
|
| 117 |
+
exclude_current_positions_from_observation: true
|
| 118 |
+
forward_reward_weight: 1.0
|
| 119 |
+
healthy_reward: 1.0
|
| 120 |
+
reset_noise_scale: 0.005
|
| 121 |
+
terminate_when_unhealthy: true
|
| 122 |
+
render_mode: rgb_array
|
| 123 |
+
noop_action:
|
| 124 |
+
- 0.0
|
| 125 |
+
- 0.0
|
| 126 |
+
- 0.0
|
| 127 |
+
obs_fps: 5.0
|
| 128 |
+
registration_imports:
|
| 129 |
+
- latency_bench.envs.gymnasium_hopper
|
| 130 |
+
state_space:
|
| 131 |
+
labels:
|
| 132 |
+
- torso_height
|
| 133 |
+
- torso_angle
|
| 134 |
+
- thigh_angle
|
| 135 |
+
- leg_angle
|
| 136 |
+
- foot_angle
|
| 137 |
+
- torso_x_velocity
|
| 138 |
+
- torso_z_velocity
|
| 139 |
+
- torso_angular_velocity
|
| 140 |
+
- thigh_angular_velocity
|
| 141 |
+
- leg_angular_velocity
|
| 142 |
+
- foot_angular_velocity
|
| 143 |
+
task_name: hopper
|
| 144 |
+
active_action_dim: 3
|
| 145 |
+
dataset:
|
| 146 |
+
source_hf: ''
|
| 147 |
+
config_name: null
|
| 148 |
+
source_subdir: null
|
| 149 |
+
converted_name: flappy_train
|
| 150 |
+
single_source_hf: ''
|
| 151 |
+
mixed_source_hf: ''
|
| 152 |
+
single_converted_name: flappy_train
|
| 153 |
+
mixed_converted_name: flappy_mixed_latency_train
|
| 154 |
+
single_latency_filter: null
|
| 155 |
+
mixed_latency_filter: null
|
| 156 |
+
force_download: false
|
| 157 |
+
setup_force: false
|
| 158 |
+
skip_verification: false
|
| 159 |
+
target_latency_unit: observation_steps
|
| 160 |
+
verify_rows: 200
|
| 161 |
+
max_episodes: null
|
| 162 |
+
episodes_per_latency: null
|
| 163 |
+
latency_filter: null
|
| 164 |
+
debug_subset:
|
| 165 |
+
enabled: false
|
| 166 |
+
max_episodes: 5
|
| 167 |
+
suffix: debug
|
| 168 |
+
base_model:
|
| 169 |
+
repo_id: Qwen/Qwen3-VL-4B-Instruct
|
| 170 |
+
initialization:
|
| 171 |
+
checkpoint_local_dir: null
|
| 172 |
+
checkpoint_hf_repo_id: null
|
| 173 |
+
checkpoint_filename: null
|
| 174 |
+
trainer:
|
| 175 |
+
max_train_steps: 5000
|
| 176 |
+
num_warmup_steps: 100
|
| 177 |
+
save_interval: 500
|
| 178 |
+
eval_interval: 500
|
| 179 |
+
eval_num_batches: 200
|
| 180 |
+
per_latency_eval_num_batches: null
|
| 181 |
+
eval_action_classification: false
|
| 182 |
+
eval_action_classification_interval: null
|
| 183 |
+
cc_f1_tolerance: 1
|
| 184 |
+
learning_rate:
|
| 185 |
+
base: 2.0e-05
|
| 186 |
+
qwen_vl_interface: 1.0e-05
|
| 187 |
+
action_model: 0.0001
|
| 188 |
+
lr_scheduler_type: cosine_with_min_lr
|
| 189 |
+
scheduler_specific_kwargs:
|
| 190 |
+
min_lr: 1.0e-06
|
| 191 |
+
freeze_modules: ''
|
| 192 |
+
freeze_vit: false
|
| 193 |
+
freeze_tied_embedding: false
|
| 194 |
+
freeze_llm_layers: []
|
| 195 |
+
loss_scale:
|
| 196 |
+
vla: 1.0
|
| 197 |
+
vlm: 0.1
|
| 198 |
+
max_grad_norm: 1.0
|
| 199 |
+
weight_decay: 0.0
|
| 200 |
+
logging_frequency: 1
|
| 201 |
+
profile_timing:
|
| 202 |
+
enabled: false
|
| 203 |
+
log_interval: 10
|
| 204 |
+
gradient_clipping: 1.0
|
| 205 |
+
gradient_accumulation_steps: 1
|
| 206 |
+
distributed_backend: deepspeed
|
| 207 |
+
is_resume: false
|
| 208 |
+
pretrained_checkpoint: null
|
| 209 |
+
resume_step: 0
|
| 210 |
+
reload_modules: null
|
| 211 |
+
optimizer:
|
| 212 |
+
name: AdamW
|
| 213 |
+
betas:
|
| 214 |
+
- 0.9
|
| 215 |
+
- 0.95
|
| 216 |
+
eps: 1.0e-08
|
| 217 |
+
weight_decay: 1.0e-08
|
| 218 |
+
fused: true
|
| 219 |
+
save_format: pt
|
| 220 |
+
run_id: hopper_pi05_profile_gt2500_h1_5fps_g128_20260922
|
| 221 |
+
run_root_dir: ${PI05_RUN_DIR}/profile_latency/vla_gt2500_20260922/training
|
| 222 |
+
seed: 42
|
| 223 |
+
is_debug: false
|
| 224 |
+
version_id: '0.21'
|
| 225 |
+
wandb_project: latency-sensitive-bench
|
| 226 |
+
wandb_entity: dongqianyu99-zhejiang-university
|
| 227 |
+
wandb_name: hopper_pi05_profile_gt2500_h1_5fps_g128_20260922
|
| 228 |
+
wandb_group: pi05-seven-env
|
| 229 |
+
wandb_tags:
|
| 230 |
+
- hopper
|
| 231 |
+
- profile_latency
|
| 232 |
+
- Pi05
|
| 233 |
+
- h1
|
| 234 |
+
training_latency_condition: profile_latency
|
| 235 |
+
backbone:
|
| 236 |
+
repo_id: Qwen/Qwen3-VL-4B-Instruct
|
| 237 |
+
revision: ebb281ec70b05090aa6165b016eac8ec08e71b17
|
| 238 |
+
checkpoint:
|
| 239 |
+
save_best_model: false
|
| 240 |
+
save_final_model: true
|
| 241 |
+
save_pt_file: true
|
| 242 |
+
save_training_state: true
|
| 243 |
+
local:
|
| 244 |
+
keep_last_n: 1
|
| 245 |
+
config_yaml: ${PI05_RUN_DIR}/profile_latency/vla_gt2500_20260922/train.yaml
|
| 246 |
+
output_dir: ${PI05_RUN_DIR}/profile_latency/vla_gt2500_20260922/training/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/config.yaml
ADDED
|
@@ -0,0 +1,123 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
framework:
|
| 2 |
+
name: QwenPI_v3
|
| 3 |
+
qwenvl:
|
| 4 |
+
base_vlm: ${oc.env:PI05_BACKBONE_DIR}
|
| 5 |
+
attn_implementation: flash_attention_2
|
| 6 |
+
vl_hidden_dim: 2560
|
| 7 |
+
num_vl_layers: 36
|
| 8 |
+
enable_gradient_checkpointing: false
|
| 9 |
+
action_model:
|
| 10 |
+
action_model_type: LayerwiseFM
|
| 11 |
+
action_dim: 3
|
| 12 |
+
state_dim: 11
|
| 13 |
+
state_encoding: continuous_projector
|
| 14 |
+
task_objective: null
|
| 15 |
+
action_horizon: 1
|
| 16 |
+
repeated_diffusion_steps: 2
|
| 17 |
+
num_inference_timesteps: 4
|
| 18 |
+
add_pos_embed: true
|
| 19 |
+
max_seq_len: 1024
|
| 20 |
+
num_target_vision_tokens: 32
|
| 21 |
+
noise_beta_alpha: 1.5
|
| 22 |
+
noise_beta_beta: 1.0
|
| 23 |
+
noise_s: 0.999
|
| 24 |
+
num_timestep_buckets: 1000
|
| 25 |
+
diffusion_model_cfg:
|
| 26 |
+
action_dit_hidden_dim: 1024
|
| 27 |
+
dropout: 0.2
|
| 28 |
+
final_dropout: true
|
| 29 |
+
interleave_self_attention: true
|
| 30 |
+
norm_type: ada_norm
|
| 31 |
+
positional_embeddings: null
|
| 32 |
+
attention_head_dim: 64
|
| 33 |
+
num_layers: 36
|
| 34 |
+
input_embedding_dim: 1024
|
| 35 |
+
cross_attention_dim: 1024
|
| 36 |
+
output_dim: 1024
|
| 37 |
+
num_attention_heads: 16
|
| 38 |
+
action_env_dim: 3
|
| 39 |
+
future_action_window_size: 0
|
| 40 |
+
past_action_window_size: 0
|
| 41 |
+
version_id: '0.21'
|
| 42 |
+
datasets:
|
| 43 |
+
vla_data:
|
| 44 |
+
include_state: true
|
| 45 |
+
obs_image_size:
|
| 46 |
+
- 224
|
| 47 |
+
- 224
|
| 48 |
+
image_mode: single
|
| 49 |
+
stitch_grid:
|
| 50 |
+
- 2
|
| 51 |
+
- 2
|
| 52 |
+
num_obs_frames: 1
|
| 53 |
+
gymnasium_task_contract: &id001
|
| 54 |
+
action_space:
|
| 55 |
+
dtype: float32
|
| 56 |
+
high:
|
| 57 |
+
- 1.0
|
| 58 |
+
- 1.0
|
| 59 |
+
- 1.0
|
| 60 |
+
labels:
|
| 61 |
+
- thigh_torque
|
| 62 |
+
- leg_torque
|
| 63 |
+
- foot_torque
|
| 64 |
+
low:
|
| 65 |
+
- -1.0
|
| 66 |
+
- -1.0
|
| 67 |
+
- -1.0
|
| 68 |
+
type: box
|
| 69 |
+
base_prompt: Move the Hopper robot forward while keeping its torso upright.
|
| 70 |
+
Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot.
|
| 71 |
+
env_fps: 5.0
|
| 72 |
+
env_id: LatencyBench/Hopper-v0
|
| 73 |
+
frame_stack: 1
|
| 74 |
+
make_kwargs:
|
| 75 |
+
base_env_id: Hopper-v4
|
| 76 |
+
base_make_kwargs:
|
| 77 |
+
ctrl_cost_weight: 0.001
|
| 78 |
+
exclude_current_positions_from_observation: true
|
| 79 |
+
forward_reward_weight: 1.0
|
| 80 |
+
healthy_reward: 1.0
|
| 81 |
+
reset_noise_scale: 0.005
|
| 82 |
+
terminate_when_unhealthy: true
|
| 83 |
+
render_mode: rgb_array
|
| 84 |
+
noop_action:
|
| 85 |
+
- 0.0
|
| 86 |
+
- 0.0
|
| 87 |
+
- 0.0
|
| 88 |
+
obs_fps: 5.0
|
| 89 |
+
registration_imports:
|
| 90 |
+
- latency_bench.envs.gymnasium_hopper
|
| 91 |
+
state_space:
|
| 92 |
+
labels:
|
| 93 |
+
- torso_height
|
| 94 |
+
- torso_angle
|
| 95 |
+
- thigh_angle
|
| 96 |
+
- leg_angle
|
| 97 |
+
- foot_angle
|
| 98 |
+
- torso_x_velocity
|
| 99 |
+
- torso_z_velocity
|
| 100 |
+
- torso_angular_velocity
|
| 101 |
+
- thigh_angular_velocity
|
| 102 |
+
- leg_angular_velocity
|
| 103 |
+
- foot_angular_velocity
|
| 104 |
+
task_name: hopper
|
| 105 |
+
trainer:
|
| 106 |
+
pretrained_checkpoint: null
|
| 107 |
+
profile_timing:
|
| 108 |
+
enabled: false
|
| 109 |
+
log_interval: 10
|
| 110 |
+
backbone:
|
| 111 |
+
repo_id: Qwen/Qwen3-VL-4B-Instruct
|
| 112 |
+
revision: ebb281ec70b05090aa6165b016eac8ec08e71b17
|
| 113 |
+
rl_games:
|
| 114 |
+
model_alias: pi05
|
| 115 |
+
task: gymnasium
|
| 116 |
+
action_carrier: native
|
| 117 |
+
gymnasium:
|
| 118 |
+
task_contract: *id001
|
| 119 |
+
env_eval:
|
| 120 |
+
image_size: 224
|
| 121 |
+
frameskip: 1
|
| 122 |
+
image_transform: raw_rgb
|
| 123 |
+
prompt_mode: raw
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/dataset_statistics.json
ADDED
|
@@ -0,0 +1,123 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"new_embodiment": {
|
| 3 |
+
"action": {
|
| 4 |
+
"mean": [
|
| 5 |
+
0.004830775782465935,
|
| 6 |
+
0.6506988406181335,
|
| 7 |
+
-0.16816289722919464
|
| 8 |
+
],
|
| 9 |
+
"std": [
|
| 10 |
+
0.2572890818119049,
|
| 11 |
+
0.6471112370491028,
|
| 12 |
+
0.8130112886428833
|
| 13 |
+
],
|
| 14 |
+
"max": [
|
| 15 |
+
0.92793208360672,
|
| 16 |
+
1.0,
|
| 17 |
+
1.0
|
| 18 |
+
],
|
| 19 |
+
"min": [
|
| 20 |
+
-0.6471852660179138,
|
| 21 |
+
-1.0,
|
| 22 |
+
-1.0
|
| 23 |
+
],
|
| 24 |
+
"q01": [
|
| 25 |
+
-0.535171184539795,
|
| 26 |
+
-1.0,
|
| 27 |
+
-1.0
|
| 28 |
+
],
|
| 29 |
+
"q99": [
|
| 30 |
+
0.6878180891275406,
|
| 31 |
+
1.0,
|
| 32 |
+
1.0
|
| 33 |
+
],
|
| 34 |
+
"mask": [
|
| 35 |
+
true,
|
| 36 |
+
true,
|
| 37 |
+
true
|
| 38 |
+
]
|
| 39 |
+
},
|
| 40 |
+
"state": {
|
| 41 |
+
"mean": [
|
| 42 |
+
0.256259024143219,
|
| 43 |
+
-0.2865329384803772,
|
| 44 |
+
0.40575700998306274,
|
| 45 |
+
0.7239107489585876,
|
| 46 |
+
-0.09208492189645767,
|
| 47 |
+
-0.27265146374702454,
|
| 48 |
+
0.23160217702388763,
|
| 49 |
+
-0.001304655452258885,
|
| 50 |
+
0.15476475656032562,
|
| 51 |
+
-0.0018315694760531187,
|
| 52 |
+
-0.0054734814912080765
|
| 53 |
+
],
|
| 54 |
+
"std": [
|
| 55 |
+
0.32620856165885925,
|
| 56 |
+
0.27870386838912964,
|
| 57 |
+
0.22778616845607758,
|
| 58 |
+
0.2515462040901184,
|
| 59 |
+
0.6812174916267395,
|
| 60 |
+
0.2129003256559372,
|
| 61 |
+
0.389985591173172,
|
| 62 |
+
0.1715511977672577,
|
| 63 |
+
0.2775718867778778,
|
| 64 |
+
0.40339428186416626,
|
| 65 |
+
0.58819580078125
|
| 66 |
+
],
|
| 67 |
+
"max": [
|
| 68 |
+
1.0,
|
| 69 |
+
1.0,
|
| 70 |
+
1.0,
|
| 71 |
+
1.0,
|
| 72 |
+
1.0,
|
| 73 |
+
1.0,
|
| 74 |
+
1.0,
|
| 75 |
+
1.0,
|
| 76 |
+
1.0,
|
| 77 |
+
1.0,
|
| 78 |
+
1.0
|
| 79 |
+
],
|
| 80 |
+
"min": [
|
| 81 |
+
-1.0,
|
| 82 |
+
-1.0,
|
| 83 |
+
-1.0,
|
| 84 |
+
-1.0,
|
| 85 |
+
-1.0,
|
| 86 |
+
-1.0,
|
| 87 |
+
-1.0,
|
| 88 |
+
-1.0,
|
| 89 |
+
-1.0,
|
| 90 |
+
-1.0,
|
| 91 |
+
-1.0
|
| 92 |
+
],
|
| 93 |
+
"q01": [
|
| 94 |
+
-0.4246590751409531,
|
| 95 |
+
-0.8132983136177063,
|
| 96 |
+
-0.05858398914337158,
|
| 97 |
+
0.08747239470481873,
|
| 98 |
+
-0.9689728409051895,
|
| 99 |
+
-0.8721107774972916,
|
| 100 |
+
-0.4223246592283249,
|
| 101 |
+
-0.42529766380786893,
|
| 102 |
+
-0.36811228275299074,
|
| 103 |
+
-0.9744406068325042,
|
| 104 |
+
-1.0
|
| 105 |
+
],
|
| 106 |
+
"q99": [
|
| 107 |
+
0.8820206296443941,
|
| 108 |
+
0.38169503450393677,
|
| 109 |
+
0.9299243867397309,
|
| 110 |
+
0.9230736374855042,
|
| 111 |
+
0.935717363357544,
|
| 112 |
+
0.10131574153900186,
|
| 113 |
+
0.9169844460487366,
|
| 114 |
+
0.36585895061492923,
|
| 115 |
+
0.8261520147323609,
|
| 116 |
+
0.9779282450675965,
|
| 117 |
+
1.0
|
| 118 |
+
]
|
| 119 |
+
},
|
| 120 |
+
"num_transitions": 87404,
|
| 121 |
+
"num_trajectories": 90
|
| 122 |
+
}
|
| 123 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/latency_prompt_map.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"1": {
|
| 3 |
+
"prompt": "Move the Hopper robot forward while keeping its torso upright. Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot. Current action latency is 1 raw frames (200.00 ms). The environment runs at 5 FPS and observations are emitted at 5 FPS. Choose the best next action.",
|
| 4 |
+
"latency_raw_frames": 1,
|
| 5 |
+
"latency_ms": 200.0
|
| 6 |
+
},
|
| 7 |
+
"2": {
|
| 8 |
+
"prompt": "Move the Hopper robot forward while keeping its torso upright. Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot. Current action latency is 2 raw frames (400.00 ms). The environment runs at 5 FPS and observations are emitted at 5 FPS. Choose the best next action.",
|
| 9 |
+
"latency_raw_frames": 2,
|
| 10 |
+
"latency_ms": 400.0
|
| 11 |
+
}
|
| 12 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/manifest.json
ADDED
|
@@ -0,0 +1,143 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"dataset_name": "hopper_h1_5fps_profile_gt2500",
|
| 3 |
+
"env_name": "hopper",
|
| 4 |
+
"episodes": 90,
|
| 5 |
+
"frames": 87404,
|
| 6 |
+
"task_prompts": [
|
| 7 |
+
"Move the Hopper robot forward while keeping its torso upright. Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot. Current action latency is 1 raw frames (200.00 ms). The environment runs at 5 FPS and observations are emitted at 5 FPS. Choose the best next action.",
|
| 8 |
+
"Move the Hopper robot forward while keeping its torso upright. Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot. Current action latency is 2 raw frames (400.00 ms). The environment runs at 5 FPS and observations are emitted at 5 FPS. Choose the best next action."
|
| 9 |
+
],
|
| 10 |
+
"format": "lerobot_v2_image_parquet",
|
| 11 |
+
"source": "${PI05_RUN_DIR}/profile_latency/data/raw_profile_gt2500",
|
| 12 |
+
"integration_name": "gymnasium",
|
| 13 |
+
"task_name": "hopper",
|
| 14 |
+
"action_layout": "gymnasium_continuous_v1",
|
| 15 |
+
"action_labels": [
|
| 16 |
+
"thigh_torque",
|
| 17 |
+
"leg_torque",
|
| 18 |
+
"foot_torque"
|
| 19 |
+
],
|
| 20 |
+
"carrier_action_labels": [
|
| 21 |
+
"thigh_torque",
|
| 22 |
+
"leg_torque",
|
| 23 |
+
"foot_torque"
|
| 24 |
+
],
|
| 25 |
+
"action_dim": 3,
|
| 26 |
+
"active_action_dim": 3,
|
| 27 |
+
"action_carrier": "native",
|
| 28 |
+
"rows_unit": "decision_step",
|
| 29 |
+
"obs_fps": 5.0,
|
| 30 |
+
"obs_stride_raw_frames": 1,
|
| 31 |
+
"uses_state": true,
|
| 32 |
+
"state_dim": 11,
|
| 33 |
+
"state_labels": [
|
| 34 |
+
"torso_height",
|
| 35 |
+
"torso_angle",
|
| 36 |
+
"thigh_angle",
|
| 37 |
+
"leg_angle",
|
| 38 |
+
"foot_angle",
|
| 39 |
+
"torso_x_velocity",
|
| 40 |
+
"torso_z_velocity",
|
| 41 |
+
"torso_angular_velocity",
|
| 42 |
+
"thigh_angular_velocity",
|
| 43 |
+
"leg_angular_velocity",
|
| 44 |
+
"foot_angular_velocity"
|
| 45 |
+
],
|
| 46 |
+
"state_normalization": {
|
| 47 |
+
"type": "min_max",
|
| 48 |
+
"min": [
|
| 49 |
+
0.7025294303894043,
|
| 50 |
+
-0.18769855797290802,
|
| 51 |
+
-1.4441453218460083,
|
| 52 |
+
-1.9619364738464355,
|
| 53 |
+
-0.9252399802207947,
|
| 54 |
+
-0.014216306619346142,
|
| 55 |
+
-5.1731038093566895,
|
| 56 |
+
-6.168967247009277,
|
| 57 |
+
-10.0,
|
| 58 |
+
-10.0,
|
| 59 |
+
-10.0
|
| 60 |
+
],
|
| 61 |
+
"max": [
|
| 62 |
+
1.819760799407959,
|
| 63 |
+
0.19951485097408295,
|
| 64 |
+
0.0425863191485405,
|
| 65 |
+
0.15077050030231476,
|
| 66 |
+
0.9662268757820129,
|
| 67 |
+
7.153366565704346,
|
| 68 |
+
3.250192880630493,
|
| 69 |
+
6.1806535720825195,
|
| 70 |
+
7.204126834869385,
|
| 71 |
+
10.0,
|
| 72 |
+
10.0
|
| 73 |
+
]
|
| 74 |
+
},
|
| 75 |
+
"robot_type": "rl_games_gymnasium",
|
| 76 |
+
"latency_prompt_map_path": "${PI05_RUN_DIR}/profile_latency/data/lerobot/hopper_h1_5fps_profile_gt2500/latency_prompt_map.json",
|
| 77 |
+
"custom_mixtures_path": "${PI05_RUN_DIR}/profile_latency/data/lerobot/_generated_mixtures/hopper_h1_5fps_profile_gt2500.json",
|
| 78 |
+
"gymnasium_task": {
|
| 79 |
+
"action_space": {
|
| 80 |
+
"dtype": "float32",
|
| 81 |
+
"high": [
|
| 82 |
+
1.0,
|
| 83 |
+
1.0,
|
| 84 |
+
1.0
|
| 85 |
+
],
|
| 86 |
+
"labels": [
|
| 87 |
+
"thigh_torque",
|
| 88 |
+
"leg_torque",
|
| 89 |
+
"foot_torque"
|
| 90 |
+
],
|
| 91 |
+
"low": [
|
| 92 |
+
-1.0,
|
| 93 |
+
-1.0,
|
| 94 |
+
-1.0
|
| 95 |
+
],
|
| 96 |
+
"type": "box"
|
| 97 |
+
},
|
| 98 |
+
"base_prompt": "Move the Hopper robot forward while keeping its torso upright. Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot.",
|
| 99 |
+
"env_fps": 5.0,
|
| 100 |
+
"env_id": "LatencyBench/Hopper-v0",
|
| 101 |
+
"frame_stack": 1,
|
| 102 |
+
"make_kwargs": {
|
| 103 |
+
"base_env_id": "Hopper-v4",
|
| 104 |
+
"base_make_kwargs": {
|
| 105 |
+
"ctrl_cost_weight": 0.001,
|
| 106 |
+
"exclude_current_positions_from_observation": true,
|
| 107 |
+
"forward_reward_weight": 1.0,
|
| 108 |
+
"healthy_reward": 1.0,
|
| 109 |
+
"reset_noise_scale": 0.005,
|
| 110 |
+
"terminate_when_unhealthy": true
|
| 111 |
+
},
|
| 112 |
+
"render_mode": "rgb_array"
|
| 113 |
+
},
|
| 114 |
+
"noop_action": [
|
| 115 |
+
0.0,
|
| 116 |
+
0.0,
|
| 117 |
+
0.0
|
| 118 |
+
],
|
| 119 |
+
"obs_fps": 5.0,
|
| 120 |
+
"registration_imports": [
|
| 121 |
+
"latency_bench.envs.gymnasium_hopper"
|
| 122 |
+
],
|
| 123 |
+
"state_space": {
|
| 124 |
+
"labels": [
|
| 125 |
+
"torso_height",
|
| 126 |
+
"torso_angle",
|
| 127 |
+
"thigh_angle",
|
| 128 |
+
"leg_angle",
|
| 129 |
+
"foot_angle",
|
| 130 |
+
"torso_x_velocity",
|
| 131 |
+
"torso_z_velocity",
|
| 132 |
+
"torso_angular_velocity",
|
| 133 |
+
"thigh_angular_velocity",
|
| 134 |
+
"leg_angular_velocity",
|
| 135 |
+
"foot_angular_velocity"
|
| 136 |
+
]
|
| 137 |
+
},
|
| 138 |
+
"task_name": "hopper"
|
| 139 |
+
},
|
| 140 |
+
"validation_dataset_name": "hopper_h1_5fps_profile_gt2500__val",
|
| 141 |
+
"validation_episodes": 10,
|
| 142 |
+
"validation_frames": 9776
|
| 143 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/provenance.json
ADDED
|
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"task": "hopper",
|
| 3 |
+
"model": "qwenpi_v3",
|
| 4 |
+
"training_condition": "latency-aware",
|
| 5 |
+
"training_run_id": "hopper_pi05_profile_gt2500_h1_5fps_g128_20260922",
|
| 6 |
+
"source": {
|
| 7 |
+
"repo_id": "latency-sensitive-bench/Standard-Pipeline",
|
| 8 |
+
"revision": "2208875f92b21e3f8ec2363a30a6705dfe56cc04",
|
| 9 |
+
"path": "hopper/profile_latency/Pi05",
|
| 10 |
+
"url": "https://huggingface.co/latency-sensitive-bench/Standard-Pipeline/tree/2208875f92b21e3f8ec2363a30a6705dfe56cc04/hopper/profile_latency/Pi05"
|
| 11 |
+
},
|
| 12 |
+
"hf_repo_id": "latency-sensitive-bench/benchmark-models",
|
| 13 |
+
"hf_path": "latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922",
|
| 14 |
+
"checkpoint": {
|
| 15 |
+
"source_file": "hopper/profile_latency/Pi05/checkpoints/model.pt",
|
| 16 |
+
"source_sha256": "93f66960f8eae69b52350e2d15271ef037dc8826332268fac69ce7c018d654c8",
|
| 17 |
+
"source_bytes": 10922629277,
|
| 18 |
+
"file": "checkpoints/model.pt",
|
| 19 |
+
"selection_rule": "only published VLA checkpoint",
|
| 20 |
+
"method": "copy",
|
| 21 |
+
"sha256": "93f66960f8eae69b52350e2d15271ef037dc8826332268fac69ce7c018d654c8",
|
| 22 |
+
"bytes": 10922629277
|
| 23 |
+
},
|
| 24 |
+
"config_source": "hopper/profile_latency/Pi05/config.yaml",
|
| 25 |
+
"task_contract_file": "task_contract.json",
|
| 26 |
+
"missing_source_files": [],
|
| 27 |
+
"migration": {
|
| 28 |
+
"operation": "copy_selected_inference_bundle",
|
| 29 |
+
"source_modified": false,
|
| 30 |
+
"evaluation_performed": false,
|
| 31 |
+
"experiment_status": "preserved_in_source_evidence"
|
| 32 |
+
},
|
| 33 |
+
"action_horizon": 1
|
| 34 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/source/README.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# hopper Pi0.5 profile-latency VLA
|
| 2 |
+
|
| 3 |
+
Fresh QwenPI_v3,5000 updates,seed42,global128 (micro64 × accumulation1 ×2 GPUs),GC off,ZeRO2,H1,RGB224,5/5FPS,native state/action and train-only state min-max once. Dataset used the explicitly approved >2500 gate without an attempt ceiling: 218 total attempts, 53 earlier >3000 accepted records retained plus 47 new >2500 records.
|
| 4 |
+
|
| 5 |
+
Set PI05_BACKBONE_DIR to Qwen3-VL-4B-Instruct revision ebb281ec70b05090aa6165b016eac8ec08e71b17. Use config.yaml/checkpoints/model.pt and latency_prompt_map.json. Weights are byte-identical to final training export. CPU tensor-finiteness/hash validation passed; actual realtime F evaluation is a separate stage. No optimizer, training state, W&B cache or credentials are included.
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/source/provenance.json
ADDED
|
@@ -0,0 +1,512 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"task": "hopper",
|
| 3 |
+
"backbone": {
|
| 4 |
+
"repo_id": "Qwen/Qwen3-VL-4B-Instruct",
|
| 5 |
+
"revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17"
|
| 6 |
+
},
|
| 7 |
+
"checkpoint": "steps_5000_pytorch_model.pt",
|
| 8 |
+
"training_steps": 5000,
|
| 9 |
+
"seed": 42,
|
| 10 |
+
"global_batch": 128,
|
| 11 |
+
"training_run_id": "hopper_pi05_profile_gt2500_h1_5fps_g128_20260922",
|
| 12 |
+
"condition": "profile_latency",
|
| 13 |
+
"source": {
|
| 14 |
+
"task": "hopper",
|
| 15 |
+
"condition": "profile_latency",
|
| 16 |
+
"teacher_checkpoint_path": "${PI05_RUN_DIR}/profile_latency/teacher/checkpoints/pi05_hopper_profile_appo_h1_5fps_g128_20260921/checkpoint_p0/checkpoint_000019536_10002432.pth",
|
| 17 |
+
"teacher_checkpoint_sha256": "9b78ae32c795cf0eecbd2b66e04f2775091a9756a40e5f5635791ac2b2ca4b86",
|
| 18 |
+
"teacher": {
|
| 19 |
+
"state": "TEACHER_FULL_TRACE_AUDIT_PASSED",
|
| 20 |
+
"verified_at": "2026-09-21T14:09:31.112834+00:00",
|
| 21 |
+
"task": "hopper",
|
| 22 |
+
"model_revision": "408930d8a85f0cb316dc3bdebfb8142526570355",
|
| 23 |
+
"P_profile_sha256": "1289653bf6e8591cdd5cf805ad539ddd1cb041cdad08a9f2833597fe72271e1e",
|
| 24 |
+
"P_warnings": [
|
| 25 |
+
{
|
| 26 |
+
"session": 1,
|
| 27 |
+
"warmup_status": "unstable",
|
| 28 |
+
"warmup_stability_reason": "drifting",
|
| 29 |
+
"samples_excluded": 100
|
| 30 |
+
}
|
| 31 |
+
],
|
| 32 |
+
"actual_final_env_steps": 10002432,
|
| 33 |
+
"actual_final_train_step": 19536,
|
| 34 |
+
"selection": {
|
| 35 |
+
"selected": "final",
|
| 36 |
+
"candidates": {
|
| 37 |
+
"final": {
|
| 38 |
+
"checkpoint": "${PI05_RUN_DIR}/profile_latency/teacher/checkpoints/pi05_hopper_profile_appo_h1_5fps_g128_20260921/checkpoint_p0/checkpoint_000019536_10002432.pth",
|
| 39 |
+
"sha256": "9b78ae32c795cf0eecbd2b66e04f2775091a9756a40e5f5635791ac2b2ca4b86",
|
| 40 |
+
"episodes": 20,
|
| 41 |
+
"seeds": [
|
| 42 |
+
104771,
|
| 43 |
+
104772,
|
| 44 |
+
104773,
|
| 45 |
+
104774,
|
| 46 |
+
104775,
|
| 47 |
+
104776,
|
| 48 |
+
104777,
|
| 49 |
+
104778,
|
| 50 |
+
104779,
|
| 51 |
+
104780,
|
| 52 |
+
104781,
|
| 53 |
+
104782,
|
| 54 |
+
104783,
|
| 55 |
+
104784,
|
| 56 |
+
104785,
|
| 57 |
+
104786,
|
| 58 |
+
104787,
|
| 59 |
+
104788,
|
| 60 |
+
104789,
|
| 61 |
+
104790
|
| 62 |
+
],
|
| 63 |
+
"returns": [
|
| 64 |
+
2224.1403163381674,
|
| 65 |
+
2819.128114077857,
|
| 66 |
+
3489.646074260514,
|
| 67 |
+
2009.7554991069278,
|
| 68 |
+
2113.0389978032463,
|
| 69 |
+
2530.889359173486,
|
| 70 |
+
3528.0257119878297,
|
| 71 |
+
3480.216905777773,
|
| 72 |
+
1947.2163728885328,
|
| 73 |
+
2019.6803983866998,
|
| 74 |
+
271.37905453360946,
|
| 75 |
+
2083.796228363727,
|
| 76 |
+
3447.6906733909796,
|
| 77 |
+
2591.8151761056497,
|
| 78 |
+
265.78937272271213,
|
| 79 |
+
1892.4932081793627,
|
| 80 |
+
1981.7056002712736,
|
| 81 |
+
3621.6136520722443,
|
| 82 |
+
3614.0425221471028,
|
| 83 |
+
3542.033646827985
|
| 84 |
+
],
|
| 85 |
+
"mean": 2473.704844220784,
|
| 86 |
+
"population_std": 983.5990191484575,
|
| 87 |
+
"strict_gt3000": 7
|
| 88 |
+
},
|
| 89 |
+
"training_best": {
|
| 90 |
+
"checkpoint": "${PI05_RUN_DIR}/profile_latency/teacher/checkpoints/pi05_hopper_profile_appo_h1_5fps_g128_20260921/checkpoint_p0/best_000019536_10002432_reward_2535.456.pth",
|
| 91 |
+
"sha256": "f0d71c11d6f468510a6b1e98d528060bfe213e094ae81a13a7c9129af2f5b2ec",
|
| 92 |
+
"episodes": 20,
|
| 93 |
+
"seeds": [
|
| 94 |
+
104771,
|
| 95 |
+
104772,
|
| 96 |
+
104773,
|
| 97 |
+
104774,
|
| 98 |
+
104775,
|
| 99 |
+
104776,
|
| 100 |
+
104777,
|
| 101 |
+
104778,
|
| 102 |
+
104779,
|
| 103 |
+
104780,
|
| 104 |
+
104781,
|
| 105 |
+
104782,
|
| 106 |
+
104783,
|
| 107 |
+
104784,
|
| 108 |
+
104785,
|
| 109 |
+
104786,
|
| 110 |
+
104787,
|
| 111 |
+
104788,
|
| 112 |
+
104789,
|
| 113 |
+
104790
|
| 114 |
+
],
|
| 115 |
+
"returns": [
|
| 116 |
+
2224.1403163381674,
|
| 117 |
+
2819.128114077857,
|
| 118 |
+
3489.646074260514,
|
| 119 |
+
2009.7554991069278,
|
| 120 |
+
2113.0389978032463,
|
| 121 |
+
2530.889359173486,
|
| 122 |
+
3528.0257119878297,
|
| 123 |
+
3480.216905777773,
|
| 124 |
+
1947.2163728885328,
|
| 125 |
+
2019.6803983866998,
|
| 126 |
+
271.37905453360946,
|
| 127 |
+
2083.796228363727,
|
| 128 |
+
3447.6906733909796,
|
| 129 |
+
2591.8151761056497,
|
| 130 |
+
265.78937272271213,
|
| 131 |
+
1892.4932081793627,
|
| 132 |
+
1981.7056002712736,
|
| 133 |
+
3621.6136520722443,
|
| 134 |
+
3614.0425221471028,
|
| 135 |
+
3542.033646827985
|
| 136 |
+
],
|
| 137 |
+
"mean": 2473.704844220784,
|
| 138 |
+
"population_std": 983.5990191484575,
|
| 139 |
+
"strict_gt3000": 7
|
| 140 |
+
}
|
| 141 |
+
},
|
| 142 |
+
"completed_at": "2026-09-21T14:06:00.799410+00:00",
|
| 143 |
+
"final_checkpoint_env_steps": 10002432,
|
| 144 |
+
"final_checkpoint_train_step": 19536
|
| 145 |
+
},
|
| 146 |
+
"evaluations": {
|
| 147 |
+
"final": {
|
| 148 |
+
"episodes": 20,
|
| 149 |
+
"seeds": [
|
| 150 |
+
104771,
|
| 151 |
+
104772,
|
| 152 |
+
104773,
|
| 153 |
+
104774,
|
| 154 |
+
104775,
|
| 155 |
+
104776,
|
| 156 |
+
104777,
|
| 157 |
+
104778,
|
| 158 |
+
104779,
|
| 159 |
+
104780,
|
| 160 |
+
104781,
|
| 161 |
+
104782,
|
| 162 |
+
104783,
|
| 163 |
+
104784,
|
| 164 |
+
104785,
|
| 165 |
+
104786,
|
| 166 |
+
104787,
|
| 167 |
+
104788,
|
| 168 |
+
104789,
|
| 169 |
+
104790
|
| 170 |
+
],
|
| 171 |
+
"returns": [
|
| 172 |
+
2224.1403163381674,
|
| 173 |
+
2819.128114077857,
|
| 174 |
+
3489.646074260514,
|
| 175 |
+
2009.7554991069278,
|
| 176 |
+
2113.0389978032463,
|
| 177 |
+
2530.889359173486,
|
| 178 |
+
3528.0257119878297,
|
| 179 |
+
3480.216905777773,
|
| 180 |
+
1947.2163728885328,
|
| 181 |
+
2019.6803983866998,
|
| 182 |
+
271.37905453360946,
|
| 183 |
+
2083.796228363727,
|
| 184 |
+
3447.6906733909796,
|
| 185 |
+
2591.8151761056497,
|
| 186 |
+
265.78937272271213,
|
| 187 |
+
1892.4932081793627,
|
| 188 |
+
1981.7056002712736,
|
| 189 |
+
3621.6136520722443,
|
| 190 |
+
3614.0425221471028,
|
| 191 |
+
3542.033646827985
|
| 192 |
+
],
|
| 193 |
+
"lengths": [
|
| 194 |
+
594,
|
| 195 |
+
757,
|
| 196 |
+
1000,
|
| 197 |
+
544,
|
| 198 |
+
593,
|
| 199 |
+
682,
|
| 200 |
+
1000,
|
| 201 |
+
1000,
|
| 202 |
+
528,
|
| 203 |
+
539,
|
| 204 |
+
134,
|
| 205 |
+
566,
|
| 206 |
+
919,
|
| 207 |
+
698,
|
| 208 |
+
132,
|
| 209 |
+
508,
|
| 210 |
+
539,
|
| 211 |
+
1000,
|
| 212 |
+
983,
|
| 213 |
+
1000
|
| 214 |
+
],
|
| 215 |
+
"mean_return": 2473.704844220784,
|
| 216 |
+
"population_std_return": 983.5990191484575,
|
| 217 |
+
"mean_length": 685.8,
|
| 218 |
+
"raw_steps": 13716,
|
| 219 |
+
"strict_gt3000": 7,
|
| 220 |
+
"actions": 10606,
|
| 221 |
+
"action_latency_mean_ms": 199.08640804375509,
|
| 222 |
+
"action_latency_p95_ms": 256.6691669408085,
|
| 223 |
+
"commands_requiring_native_clip": 0,
|
| 224 |
+
"invalid_actions": 0,
|
| 225 |
+
"dropped_actions": 0,
|
| 226 |
+
"submitted_observations": 10606,
|
| 227 |
+
"dropped_observations": 3110,
|
| 228 |
+
"observation_drop_fraction": 0.2267424905220181,
|
| 229 |
+
"config_sha256": "39166d114a7d4b46e64da14382bd644f4095e7eb36fc6eae52479c2545093f81",
|
| 230 |
+
"state_contract": "Native state11 is bound to manifest/loader QA/saved reload; no per-step state vector is recorded."
|
| 231 |
+
},
|
| 232 |
+
"training_best": {
|
| 233 |
+
"episodes": 20,
|
| 234 |
+
"seeds": [
|
| 235 |
+
104771,
|
| 236 |
+
104772,
|
| 237 |
+
104773,
|
| 238 |
+
104774,
|
| 239 |
+
104775,
|
| 240 |
+
104776,
|
| 241 |
+
104777,
|
| 242 |
+
104778,
|
| 243 |
+
104779,
|
| 244 |
+
104780,
|
| 245 |
+
104781,
|
| 246 |
+
104782,
|
| 247 |
+
104783,
|
| 248 |
+
104784,
|
| 249 |
+
104785,
|
| 250 |
+
104786,
|
| 251 |
+
104787,
|
| 252 |
+
104788,
|
| 253 |
+
104789,
|
| 254 |
+
104790
|
| 255 |
+
],
|
| 256 |
+
"returns": [
|
| 257 |
+
2224.1403163381674,
|
| 258 |
+
2819.128114077857,
|
| 259 |
+
3489.646074260514,
|
| 260 |
+
2009.7554991069278,
|
| 261 |
+
2113.0389978032463,
|
| 262 |
+
2530.889359173486,
|
| 263 |
+
3528.0257119878297,
|
| 264 |
+
3480.216905777773,
|
| 265 |
+
1947.2163728885328,
|
| 266 |
+
2019.6803983866998,
|
| 267 |
+
271.37905453360946,
|
| 268 |
+
2083.796228363727,
|
| 269 |
+
3447.6906733909796,
|
| 270 |
+
2591.8151761056497,
|
| 271 |
+
265.78937272271213,
|
| 272 |
+
1892.4932081793627,
|
| 273 |
+
1981.7056002712736,
|
| 274 |
+
3621.6136520722443,
|
| 275 |
+
3614.0425221471028,
|
| 276 |
+
3542.033646827985
|
| 277 |
+
],
|
| 278 |
+
"lengths": [
|
| 279 |
+
594,
|
| 280 |
+
757,
|
| 281 |
+
1000,
|
| 282 |
+
544,
|
| 283 |
+
593,
|
| 284 |
+
682,
|
| 285 |
+
1000,
|
| 286 |
+
1000,
|
| 287 |
+
528,
|
| 288 |
+
539,
|
| 289 |
+
134,
|
| 290 |
+
566,
|
| 291 |
+
919,
|
| 292 |
+
698,
|
| 293 |
+
132,
|
| 294 |
+
508,
|
| 295 |
+
539,
|
| 296 |
+
1000,
|
| 297 |
+
983,
|
| 298 |
+
1000
|
| 299 |
+
],
|
| 300 |
+
"mean_return": 2473.704844220784,
|
| 301 |
+
"population_std_return": 983.5990191484575,
|
| 302 |
+
"mean_length": 685.8,
|
| 303 |
+
"raw_steps": 13716,
|
| 304 |
+
"strict_gt3000": 7,
|
| 305 |
+
"actions": 10606,
|
| 306 |
+
"action_latency_mean_ms": 199.08640804375509,
|
| 307 |
+
"action_latency_p95_ms": 256.6691669408085,
|
| 308 |
+
"commands_requiring_native_clip": 0,
|
| 309 |
+
"invalid_actions": 0,
|
| 310 |
+
"dropped_actions": 0,
|
| 311 |
+
"submitted_observations": 10606,
|
| 312 |
+
"dropped_observations": 3110,
|
| 313 |
+
"observation_drop_fraction": 0.2267424905220181,
|
| 314 |
+
"config_sha256": "8447bbc671595a369933dff026480db4f94846a7970e4e8ac6731abdf21d0138",
|
| 315 |
+
"state_contract": "Native state11 is bound to manifest/loader QA/saved reload; no per-step state vector is recorded."
|
| 316 |
+
}
|
| 317 |
+
},
|
| 318 |
+
"E10": {
|
| 319 |
+
"episodes": 10,
|
| 320 |
+
"seeds": [
|
| 321 |
+
104771,
|
| 322 |
+
104772,
|
| 323 |
+
104773,
|
| 324 |
+
104774,
|
| 325 |
+
104775,
|
| 326 |
+
104776,
|
| 327 |
+
104777,
|
| 328 |
+
104778,
|
| 329 |
+
104779,
|
| 330 |
+
104780
|
| 331 |
+
],
|
| 332 |
+
"returns": [
|
| 333 |
+
2224.1403163381674,
|
| 334 |
+
2819.128114077857,
|
| 335 |
+
3489.646074260514,
|
| 336 |
+
2009.7554991069278,
|
| 337 |
+
2113.0389978032463,
|
| 338 |
+
2530.889359173486,
|
| 339 |
+
3528.0257119878297,
|
| 340 |
+
3480.216905777773,
|
| 341 |
+
1947.2163728885328,
|
| 342 |
+
2019.6803983866998
|
| 343 |
+
],
|
| 344 |
+
"lengths": [
|
| 345 |
+
594,
|
| 346 |
+
757,
|
| 347 |
+
1000,
|
| 348 |
+
544,
|
| 349 |
+
593,
|
| 350 |
+
682,
|
| 351 |
+
1000,
|
| 352 |
+
1000,
|
| 353 |
+
528,
|
| 354 |
+
539
|
| 355 |
+
],
|
| 356 |
+
"mean_return": 2616.173774980103,
|
| 357 |
+
"population_std_return": 629.868919379035,
|
| 358 |
+
"mean_length": 723.7,
|
| 359 |
+
"raw_steps": 7237,
|
| 360 |
+
"strict_gt3000": 3,
|
| 361 |
+
"actions": 5577,
|
| 362 |
+
"action_latency_mean_ms": 199.29742636488007,
|
| 363 |
+
"action_latency_p95_ms": 257.7097693485515,
|
| 364 |
+
"commands_requiring_native_clip": 0,
|
| 365 |
+
"invalid_actions": 0,
|
| 366 |
+
"dropped_actions": 0,
|
| 367 |
+
"submitted_observations": 5577,
|
| 368 |
+
"dropped_observations": 1660,
|
| 369 |
+
"observation_drop_fraction": 0.22937681359679427,
|
| 370 |
+
"config_sha256": "8a5246d083413a735ed88e2e3b9a5c4f7b49896abfd3153488d9fcd1edd62176",
|
| 371 |
+
"state_contract": "Native state11 is bound to manifest/loader QA/saved reload; no per-step state vector is recorded."
|
| 372 |
+
},
|
| 373 |
+
"probe": {
|
| 374 |
+
"attempts": 12,
|
| 375 |
+
"accepted": 2,
|
| 376 |
+
"rejected": 10,
|
| 377 |
+
"source_state_sha256": "fad846336f923f7f0bf755c2d5cdbbcc2a8c4f955556c2299ef088cbd20d1f72",
|
| 378 |
+
"accepted_specs": [
|
| 379 |
+
{
|
| 380 |
+
"attempt_idx": 4,
|
| 381 |
+
"episode_idx": 0,
|
| 382 |
+
"episode_length": 1000,
|
| 383 |
+
"episode_raw_frames": 1000,
|
| 384 |
+
"episode_raw_return": 3573.1784443855286,
|
| 385 |
+
"seed": 3337,
|
| 386 |
+
"split": "train"
|
| 387 |
+
},
|
| 388 |
+
{
|
| 389 |
+
"attempt_idx": 9,
|
| 390 |
+
"episode_idx": 1,
|
| 391 |
+
"episode_length": 1000,
|
| 392 |
+
"episode_raw_frames": 1000,
|
| 393 |
+
"episode_raw_return": 3552.9572883844376,
|
| 394 |
+
"seed": 3342,
|
| 395 |
+
"split": "val"
|
| 396 |
+
}
|
| 397 |
+
]
|
| 398 |
+
},
|
| 399 |
+
"strict_gate": "episode_raw_return > 3000",
|
| 400 |
+
"E10_caveat": "Repeats the first ten selection seeds; not an independent gate.",
|
| 401 |
+
"training_unit_exit_claim": false,
|
| 402 |
+
"gate": "PASSED"
|
| 403 |
+
},
|
| 404 |
+
"profile_source": {
|
| 405 |
+
"model_revision": "408930d8a85f0cb316dc3bdebfb8142526570355",
|
| 406 |
+
"checkpoint_sha256": "c35ddc57fef8fd096adca3df9ecf94662824c26b311c3884508f07646231f05b",
|
| 407 |
+
"profile_sha256": "1289653bf6e8591cdd5cf805ad539ddd1cb041cdad08a9f2833597fe72271e1e",
|
| 408 |
+
"source_run_id": "20260921T094220318783Z",
|
| 409 |
+
"P_publication_revision": "e1a9bdd566b96d5da4703f769d40eab656af491e",
|
| 410 |
+
"warnings": [
|
| 411 |
+
{
|
| 412 |
+
"session": 1,
|
| 413 |
+
"warmup_status": "unstable",
|
| 414 |
+
"warmup_stability_reason": "drifting",
|
| 415 |
+
"samples_excluded": 100
|
| 416 |
+
}
|
| 417 |
+
]
|
| 418 |
+
},
|
| 419 |
+
"dataset": {
|
| 420 |
+
"attempts": 218,
|
| 421 |
+
"accepted": 100,
|
| 422 |
+
"old_history": {
|
| 423 |
+
"attempts": 120,
|
| 424 |
+
"gate": "episode_raw_return > 3000",
|
| 425 |
+
"accepted_reused": 53,
|
| 426 |
+
"rejected": 67,
|
| 427 |
+
"rejections_reclassified": false
|
| 428 |
+
},
|
| 429 |
+
"continuation": {
|
| 430 |
+
"start_attempt_idx": 120,
|
| 431 |
+
"attempts": 98,
|
| 432 |
+
"accepted": 47,
|
| 433 |
+
"rejected": 51,
|
| 434 |
+
"gate": "episode_raw_return > 2500",
|
| 435 |
+
"attempt_limit": null
|
| 436 |
+
},
|
| 437 |
+
"max_total_attempts": null,
|
| 438 |
+
"splits": {
|
| 439 |
+
"train": {
|
| 440 |
+
"rows": 87404,
|
| 441 |
+
"episodes": 90,
|
| 442 |
+
"return_min": 2501.0231088399887,
|
| 443 |
+
"action_min": -1.0,
|
| 444 |
+
"action_max": 1.0
|
| 445 |
+
},
|
| 446 |
+
"val": {
|
| 447 |
+
"rows": 9776,
|
| 448 |
+
"episodes": 10,
|
| 449 |
+
"return_min": 2859.5413383841515,
|
| 450 |
+
"action_min": -1.0,
|
| 451 |
+
"action_max": 1.0
|
| 452 |
+
}
|
| 453 |
+
},
|
| 454 |
+
"sha256": {
|
| 455 |
+
"metadata.json": "6a0e1ef5b903e923c37f5091eeece485d4a00dfc7a8c63a95c523cf59399531a",
|
| 456 |
+
"train.parquet": "47b4bd70080aa670c285f207aca9cc2f3c803d1f07c58fa0faa3a585e325939a",
|
| 457 |
+
"val.parquet": "af5561f9912e9a580bc8112875cf11a55e7014e418677293428e32fb911962e0"
|
| 458 |
+
}
|
| 459 |
+
},
|
| 460 |
+
"probe_state": {
|
| 461 |
+
"path": "${PI05_RUN_DIR}/profile_latency/data/probe_state_gt2500.json",
|
| 462 |
+
"sha256": "eae3de415d0cced764c95c9ed12ae9b70a2a02ae30f7bbbc4bb461cd7f3da675",
|
| 463 |
+
"attempted": 218,
|
| 464 |
+
"accepted": 100,
|
| 465 |
+
"rejected": 118,
|
| 466 |
+
"original_12_sha256": "fad846336f923f7f0bf755c2d5cdbbcc2a8c4f955556c2299ef088cbd20d1f72",
|
| 467 |
+
"original_120_sha256": "8427adc4e968df0ea8467a8848462e51a481a9d31a2dbbc7f5458e3700da3a9b"
|
| 468 |
+
},
|
| 469 |
+
"evaluation_prompt_keys": [
|
| 470 |
+
"1",
|
| 471 |
+
"2"
|
| 472 |
+
],
|
| 473 |
+
"state_dim": 11,
|
| 474 |
+
"action_dim": 3,
|
| 475 |
+
"action_units": "native continuous; environment Box clips pre-clip values outside [-1,1]",
|
| 476 |
+
"preclip_action_range": [
|
| 477 |
+
-1.0,
|
| 478 |
+
1.0
|
| 479 |
+
],
|
| 480 |
+
"commands_requiring_native_clip": 0,
|
| 481 |
+
"teacher_seed": 3333,
|
| 482 |
+
"actual_final_env_steps": 10002432,
|
| 483 |
+
"selected_teacher": "final",
|
| 484 |
+
"selection_mean": 2473.704844220784,
|
| 485 |
+
"selection_strict_gt3000": 7,
|
| 486 |
+
"E10_repeats_first10_selection_seeds": true,
|
| 487 |
+
"loader_checks": {
|
| 488 |
+
"train": {
|
| 489 |
+
"rows": 87404,
|
| 490 |
+
"indices": [
|
| 491 |
+
0,
|
| 492 |
+
43702,
|
| 493 |
+
87403
|
| 494 |
+
],
|
| 495 |
+
"state_train_minmax_exact_once": true,
|
| 496 |
+
"action_image_prompt_exact": true
|
| 497 |
+
},
|
| 498 |
+
"val": {
|
| 499 |
+
"rows": 9776,
|
| 500 |
+
"indices": [
|
| 501 |
+
0,
|
| 502 |
+
4888,
|
| 503 |
+
9775
|
| 504 |
+
],
|
| 505 |
+
"state_train_minmax_exact_once": true,
|
| 506 |
+
"action_image_prompt_exact": true
|
| 507 |
+
}
|
| 508 |
+
}
|
| 509 |
+
},
|
| 510 |
+
"training_config_sha256": "1f30ce61cfd0ee83b15c2b34ca7f37ce2de836d7693aa7b4f37d4e921befb17c",
|
| 511 |
+
"dataset_manifest_sha256": "32324928c5d8f933ae59f76c0c9ac4121d631568a552348449fe7555d1f30e5e"
|
| 512 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/task_contract.json
ADDED
|
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"action_space": {
|
| 3 |
+
"dtype": "float32",
|
| 4 |
+
"high": [
|
| 5 |
+
1.0,
|
| 6 |
+
1.0,
|
| 7 |
+
1.0
|
| 8 |
+
],
|
| 9 |
+
"labels": [
|
| 10 |
+
"thigh_torque",
|
| 11 |
+
"leg_torque",
|
| 12 |
+
"foot_torque"
|
| 13 |
+
],
|
| 14 |
+
"low": [
|
| 15 |
+
-1.0,
|
| 16 |
+
-1.0,
|
| 17 |
+
-1.0
|
| 18 |
+
],
|
| 19 |
+
"type": "box"
|
| 20 |
+
},
|
| 21 |
+
"base_prompt": "Move the Hopper robot forward while keeping its torso upright. Predict three continuous torques in [-1, 1] ordered as thigh, leg, and foot.",
|
| 22 |
+
"env_fps": 5.0,
|
| 23 |
+
"env_id": "LatencyBench/Hopper-v0",
|
| 24 |
+
"frame_stack": 1,
|
| 25 |
+
"make_kwargs": {
|
| 26 |
+
"base_env_id": "Hopper-v4",
|
| 27 |
+
"base_make_kwargs": {
|
| 28 |
+
"ctrl_cost_weight": 0.001,
|
| 29 |
+
"exclude_current_positions_from_observation": true,
|
| 30 |
+
"forward_reward_weight": 1.0,
|
| 31 |
+
"healthy_reward": 1.0,
|
| 32 |
+
"reset_noise_scale": 0.005,
|
| 33 |
+
"terminate_when_unhealthy": true
|
| 34 |
+
},
|
| 35 |
+
"render_mode": "rgb_array"
|
| 36 |
+
},
|
| 37 |
+
"noop_action": [
|
| 38 |
+
0.0,
|
| 39 |
+
0.0,
|
| 40 |
+
0.0
|
| 41 |
+
],
|
| 42 |
+
"obs_fps": 5.0,
|
| 43 |
+
"registration_imports": [
|
| 44 |
+
"latency_bench.envs.gymnasium_hopper"
|
| 45 |
+
],
|
| 46 |
+
"state_space": {
|
| 47 |
+
"labels": [
|
| 48 |
+
"torso_height",
|
| 49 |
+
"torso_angle",
|
| 50 |
+
"thigh_angle",
|
| 51 |
+
"leg_angle",
|
| 52 |
+
"foot_angle",
|
| 53 |
+
"torso_x_velocity",
|
| 54 |
+
"torso_z_velocity",
|
| 55 |
+
"torso_angular_velocity",
|
| 56 |
+
"thigh_angular_velocity",
|
| 57 |
+
"leg_angular_velocity",
|
| 58 |
+
"foot_angular_velocity"
|
| 59 |
+
]
|
| 60 |
+
},
|
| 61 |
+
"task_name": "hopper"
|
| 62 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/hopper/vla/starvla-qwenpi_v3-h1/hopper_pi05_profile_gt2500_h1_5fps_g128_20260922/validation.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"state": "CPU_STATE_DICT_AND_BUNDLE_HASH_VERIFIED",
|
| 3 |
+
"checkpoint_sha256": "93f66960f8eae69b52350e2d15271ef037dc8826332268fac69ce7c018d654c8",
|
| 4 |
+
"tensor_count": 1386,
|
| 5 |
+
"all_floating_tensors_finite": true,
|
| 6 |
+
"training_steps": 5000,
|
| 7 |
+
"global_batch": 128,
|
| 8 |
+
"gpu_forward": "NOT_RUN_AT_PUBLICATION",
|
| 9 |
+
"verified_at": "2026-09-22T01:31:19.235344+00:00"
|
| 10 |
+
}
|