Archive original ant pi05 profile bundle
Browse files- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/README.md +31 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/checkpoints/model.pt +3 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/config.full.yaml +280 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/config.yaml +157 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/dataset_statistics.json +254 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/evaluation/comparison.json +419 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/evaluation/status.json +47 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/latency_prompt_map.json +7 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/manifest.json +232 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/provenance.json +34 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/source/README.md +5 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/source/provenance.json +562 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/task_contract.json +94 -0
- archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/validation.json +11 -0
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/README.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# ant / qwenpi_v3
|
| 2 |
+
|
| 3 |
+
Training condition: `latency-aware`. Run: `ant_pi05_profile_h1_5fps_g128_20260920`.
|
| 4 |
+
|
| 5 |
+
Copied from [Standard-Pipeline](https://huggingface.co/latency-sensitive-bench/Standard-Pipeline/tree/2208875f92b21e3f8ec2363a30a6705dfe56cc04/ant/profile_latency/Pi05) at `2208875f92b21e3f8ec2363a30a6705dfe56cc04`.
|
| 6 |
+
|
| 7 |
+
- Checkpoint: `checkpoints/model.pt`
|
| 8 |
+
- Selection: only published VLA checkpoint
|
| 9 |
+
- Checkpoint SHA256: `01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f`
|
| 10 |
+
- Configuration, FPS, actions, normalization and latency semantics retain their source values.
|
| 11 |
+
- This import does not run evaluations or change training/evaluation/acceptance status.
|
| 12 |
+
|
| 13 |
+
Action horizon is 1. Use `config.yaml` and `dataset_statistics.json` with the matching
|
| 14 |
+
prepared backbone. `task_contract.json` is extracted from the original training configuration.
|
| 15 |
+
Original machine paths in historical configurations are provenance: bind checkpoint,
|
| 16 |
+
backbone, manifest and profile paths to downloaded local files when running inference.
|
| 17 |
+
|
| 18 |
+
See [the original model notes](source/README.md) for experiment results and limitations.
|
| 19 |
+
|
| 20 |
+
[Original provenance](source/provenance.json) retains dataset references and recorded experiment evidence.
|
| 21 |
+
|
| 22 |
+
## Download
|
| 23 |
+
|
| 24 |
+
```python
|
| 25 |
+
from huggingface_hub import snapshot_download
|
| 26 |
+
prefix = "latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920"
|
| 27 |
+
snapshot_download("latency-sensitive-bench/benchmark-models", revision="<commit>",
|
| 28 |
+
allow_patterns=[prefix + "/**"])
|
| 29 |
+
```
|
| 30 |
+
|
| 31 |
+
Use the verified import commit listed in the repository's import report.
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/checkpoints/model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f
|
| 3 |
+
size 10922682525
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/config.full.yaml
ADDED
|
@@ -0,0 +1,280 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
framework:
|
| 2 |
+
name: QwenPI_v3
|
| 3 |
+
qwenvl:
|
| 4 |
+
base_vlm: ${oc.env:PI05_BACKBONE_DIR}
|
| 5 |
+
attn_implementation: flash_attention_2
|
| 6 |
+
vl_hidden_dim: 2560
|
| 7 |
+
num_vl_layers: 36
|
| 8 |
+
enable_gradient_checkpointing: false
|
| 9 |
+
action_model:
|
| 10 |
+
action_model_type: LayerwiseFM
|
| 11 |
+
action_dim: 8
|
| 12 |
+
state_dim: 27
|
| 13 |
+
state_encoding: continuous_projector
|
| 14 |
+
task_objective: null
|
| 15 |
+
action_horizon: 1
|
| 16 |
+
repeated_diffusion_steps: 2
|
| 17 |
+
num_inference_timesteps: 4
|
| 18 |
+
add_pos_embed: true
|
| 19 |
+
max_seq_len: 1024
|
| 20 |
+
num_target_vision_tokens: 32
|
| 21 |
+
noise_beta_alpha: 1.5
|
| 22 |
+
noise_beta_beta: 1.0
|
| 23 |
+
noise_s: 0.999
|
| 24 |
+
num_timestep_buckets: 1000
|
| 25 |
+
diffusion_model_cfg:
|
| 26 |
+
action_dit_hidden_dim: 1024
|
| 27 |
+
dropout: 0.2
|
| 28 |
+
final_dropout: true
|
| 29 |
+
interleave_self_attention: true
|
| 30 |
+
norm_type: ada_norm
|
| 31 |
+
positional_embeddings: null
|
| 32 |
+
attention_head_dim: 64
|
| 33 |
+
num_layers: 36
|
| 34 |
+
input_embedding_dim: 1024
|
| 35 |
+
cross_attention_dim: 1024
|
| 36 |
+
output_dim: 1024
|
| 37 |
+
num_attention_heads: 16
|
| 38 |
+
action_env_dim: 8
|
| 39 |
+
future_action_window_size: 0
|
| 40 |
+
past_action_window_size: 0
|
| 41 |
+
datasets:
|
| 42 |
+
vla_data:
|
| 43 |
+
dataset_py: lerobot_datasets
|
| 44 |
+
include_state: true
|
| 45 |
+
data_root_dir: /
|
| 46 |
+
data_mix: train
|
| 47 |
+
eval_data_mix: validation
|
| 48 |
+
custom_mixtures_path: ${PI05_RUN_DIR}/profile_latency/vla/mixture.json
|
| 49 |
+
action_type: continuous
|
| 50 |
+
sequential_step_sampling: true
|
| 51 |
+
eval_sequential_step_sampling: null
|
| 52 |
+
num_workers: 4
|
| 53 |
+
eval_num_workers: 0
|
| 54 |
+
prefetch_factor: 2
|
| 55 |
+
persistent_workers: true
|
| 56 |
+
pin_memory: true
|
| 57 |
+
shuffle: true
|
| 58 |
+
action_balance:
|
| 59 |
+
enabled: false
|
| 60 |
+
strategy: balanced_epoch
|
| 61 |
+
action_key: action_id
|
| 62 |
+
target_flap_fraction: 0.3
|
| 63 |
+
noop_id: 0
|
| 64 |
+
flap_id: 1
|
| 65 |
+
latency_curriculum:
|
| 66 |
+
enabled: false
|
| 67 |
+
strategy: exclusive
|
| 68 |
+
latencies: null
|
| 69 |
+
phase_steps: null
|
| 70 |
+
phase_distributions: null
|
| 71 |
+
new_latency_passes: 1.0
|
| 72 |
+
replay_passes: 0.25
|
| 73 |
+
target_total_passes: 2.0
|
| 74 |
+
final_equalization: true
|
| 75 |
+
step_budget_mode: auto
|
| 76 |
+
eval_at_phase_end: false
|
| 77 |
+
save_at_phase_end: false
|
| 78 |
+
computed_plan: null
|
| 79 |
+
per_device_batch_size: 32
|
| 80 |
+
load_all_data_for_training: true
|
| 81 |
+
num_obs_frames: 1
|
| 82 |
+
image_mode: single
|
| 83 |
+
prompt_mode: raw
|
| 84 |
+
stitch_grid:
|
| 85 |
+
- 2
|
| 86 |
+
- 2
|
| 87 |
+
obs_image_size:
|
| 88 |
+
- 224
|
| 89 |
+
- 224
|
| 90 |
+
video_backend: pyav
|
| 91 |
+
lerobot_version: v2.0
|
| 92 |
+
gymnasium_task_contract:
|
| 93 |
+
action_space:
|
| 94 |
+
dtype: float32
|
| 95 |
+
high:
|
| 96 |
+
- 1.0
|
| 97 |
+
- 1.0
|
| 98 |
+
- 1.0
|
| 99 |
+
- 1.0
|
| 100 |
+
- 1.0
|
| 101 |
+
- 1.0
|
| 102 |
+
- 1.0
|
| 103 |
+
- 1.0
|
| 104 |
+
labels:
|
| 105 |
+
- back_right_hip_torque
|
| 106 |
+
- back_right_ankle_torque
|
| 107 |
+
- front_left_hip_torque
|
| 108 |
+
- front_left_ankle_torque
|
| 109 |
+
- front_right_hip_torque
|
| 110 |
+
- front_right_ankle_torque
|
| 111 |
+
- back_left_hip_torque
|
| 112 |
+
- back_left_ankle_torque
|
| 113 |
+
low:
|
| 114 |
+
- -1.0
|
| 115 |
+
- -1.0
|
| 116 |
+
- -1.0
|
| 117 |
+
- -1.0
|
| 118 |
+
- -1.0
|
| 119 |
+
- -1.0
|
| 120 |
+
- -1.0
|
| 121 |
+
- -1.0
|
| 122 |
+
type: box
|
| 123 |
+
base_prompt: Make the Ant move forward as fast as possible without falling.
|
| 124 |
+
Predict eight continuous torques in [-1, 1] ordered as back right hip, back
|
| 125 |
+
right ankle, front left hip, front left ankle, front right hip, front right
|
| 126 |
+
ankle, back left hip, and back left ankle.
|
| 127 |
+
env_fps: 5.0
|
| 128 |
+
env_id: LatencyBench/AntContinuous-v0
|
| 129 |
+
frame_stack: 1
|
| 130 |
+
make_kwargs:
|
| 131 |
+
base_env_id: Ant-v4
|
| 132 |
+
base_make_kwargs:
|
| 133 |
+
exclude_current_positions_from_observation: true
|
| 134 |
+
use_contact_forces: false
|
| 135 |
+
render_mode: rgb_array
|
| 136 |
+
noop_action:
|
| 137 |
+
- 0.0
|
| 138 |
+
- 0.0
|
| 139 |
+
- 0.0
|
| 140 |
+
- 0.0
|
| 141 |
+
- 0.0
|
| 142 |
+
- 0.0
|
| 143 |
+
- 0.0
|
| 144 |
+
- 0.0
|
| 145 |
+
obs_fps: 5.0
|
| 146 |
+
registration_imports:
|
| 147 |
+
- latency_bench.envs.gymnasium_ant
|
| 148 |
+
state_space:
|
| 149 |
+
labels:
|
| 150 |
+
- torso_z
|
| 151 |
+
- torso_quaternion_w
|
| 152 |
+
- torso_quaternion_x
|
| 153 |
+
- torso_quaternion_y
|
| 154 |
+
- torso_quaternion_z
|
| 155 |
+
- front_left_hip_angle
|
| 156 |
+
- front_left_ankle_angle
|
| 157 |
+
- front_right_hip_angle
|
| 158 |
+
- front_right_ankle_angle
|
| 159 |
+
- back_left_hip_angle
|
| 160 |
+
- back_left_ankle_angle
|
| 161 |
+
- back_right_hip_angle
|
| 162 |
+
- back_right_ankle_angle
|
| 163 |
+
- torso_x_velocity
|
| 164 |
+
- torso_y_velocity
|
| 165 |
+
- torso_z_velocity
|
| 166 |
+
- torso_angular_velocity_x
|
| 167 |
+
- torso_angular_velocity_y
|
| 168 |
+
- torso_angular_velocity_z
|
| 169 |
+
- front_left_hip_angular_velocity
|
| 170 |
+
- front_left_ankle_angular_velocity
|
| 171 |
+
- front_right_hip_angular_velocity
|
| 172 |
+
- front_right_ankle_angular_velocity
|
| 173 |
+
- back_left_hip_angular_velocity
|
| 174 |
+
- back_left_ankle_angular_velocity
|
| 175 |
+
- back_right_hip_angular_velocity
|
| 176 |
+
- back_right_ankle_angular_velocity
|
| 177 |
+
task_name: ant
|
| 178 |
+
active_action_dim: 8
|
| 179 |
+
dataset:
|
| 180 |
+
source_hf: ''
|
| 181 |
+
config_name: null
|
| 182 |
+
source_subdir: null
|
| 183 |
+
converted_name: flappy_train
|
| 184 |
+
single_source_hf: ''
|
| 185 |
+
mixed_source_hf: ''
|
| 186 |
+
single_converted_name: flappy_train
|
| 187 |
+
mixed_converted_name: flappy_mixed_latency_train
|
| 188 |
+
single_latency_filter: null
|
| 189 |
+
mixed_latency_filter: null
|
| 190 |
+
force_download: false
|
| 191 |
+
setup_force: false
|
| 192 |
+
skip_verification: false
|
| 193 |
+
target_latency_unit: observation_steps
|
| 194 |
+
verify_rows: 200
|
| 195 |
+
max_episodes: null
|
| 196 |
+
episodes_per_latency: null
|
| 197 |
+
latency_filter: null
|
| 198 |
+
debug_subset:
|
| 199 |
+
enabled: false
|
| 200 |
+
max_episodes: 5
|
| 201 |
+
suffix: debug
|
| 202 |
+
base_model:
|
| 203 |
+
repo_id: Qwen/Qwen3-VL-4B-Instruct
|
| 204 |
+
initialization:
|
| 205 |
+
checkpoint_local_dir: null
|
| 206 |
+
checkpoint_hf_repo_id: null
|
| 207 |
+
checkpoint_filename: null
|
| 208 |
+
trainer:
|
| 209 |
+
max_train_steps: 5000
|
| 210 |
+
num_warmup_steps: 100
|
| 211 |
+
save_interval: 500
|
| 212 |
+
eval_interval: 500
|
| 213 |
+
eval_num_batches: 200
|
| 214 |
+
per_latency_eval_num_batches: null
|
| 215 |
+
eval_action_classification: false
|
| 216 |
+
eval_action_classification_interval: null
|
| 217 |
+
cc_f1_tolerance: 1
|
| 218 |
+
learning_rate:
|
| 219 |
+
base: 2.0e-05
|
| 220 |
+
qwen_vl_interface: 1.0e-05
|
| 221 |
+
action_model: 0.0001
|
| 222 |
+
lr_scheduler_type: cosine_with_min_lr
|
| 223 |
+
scheduler_specific_kwargs:
|
| 224 |
+
min_lr: 1.0e-06
|
| 225 |
+
freeze_modules: ''
|
| 226 |
+
freeze_vit: false
|
| 227 |
+
freeze_tied_embedding: false
|
| 228 |
+
freeze_llm_layers: []
|
| 229 |
+
loss_scale:
|
| 230 |
+
vla: 1.0
|
| 231 |
+
vlm: 0.1
|
| 232 |
+
max_grad_norm: 1.0
|
| 233 |
+
weight_decay: 0.0
|
| 234 |
+
logging_frequency: 1
|
| 235 |
+
profile_timing:
|
| 236 |
+
enabled: false
|
| 237 |
+
log_interval: 10
|
| 238 |
+
gradient_clipping: 1.0
|
| 239 |
+
gradient_accumulation_steps: 2
|
| 240 |
+
distributed_backend: deepspeed
|
| 241 |
+
is_resume: false
|
| 242 |
+
pretrained_checkpoint: null
|
| 243 |
+
resume_step: 0
|
| 244 |
+
reload_modules: null
|
| 245 |
+
optimizer:
|
| 246 |
+
name: AdamW
|
| 247 |
+
betas:
|
| 248 |
+
- 0.9
|
| 249 |
+
- 0.95
|
| 250 |
+
eps: 1.0e-08
|
| 251 |
+
weight_decay: 1.0e-08
|
| 252 |
+
fused: true
|
| 253 |
+
save_format: pt
|
| 254 |
+
run_id: ant_pi05_profile_h1_5fps_g128_20260920
|
| 255 |
+
run_root_dir: ${PI05_RUN_DIR}/profile_latency/vla/training
|
| 256 |
+
seed: 42
|
| 257 |
+
is_debug: false
|
| 258 |
+
version_id: '0.21'
|
| 259 |
+
wandb_project: latency-sensitive-bench
|
| 260 |
+
wandb_entity: dongqianyu99-zhejiang-university
|
| 261 |
+
wandb_name: ant_pi05_profile_h1_5fps_g128_20260920
|
| 262 |
+
wandb_group: pi05-seven-env
|
| 263 |
+
wandb_tags:
|
| 264 |
+
- ant
|
| 265 |
+
- profile_latency
|
| 266 |
+
- Pi05
|
| 267 |
+
- h1
|
| 268 |
+
training_latency_condition: profile_latency
|
| 269 |
+
backbone:
|
| 270 |
+
repo_id: Qwen/Qwen3-VL-4B-Instruct
|
| 271 |
+
revision: ebb281ec70b05090aa6165b016eac8ec08e71b17
|
| 272 |
+
checkpoint:
|
| 273 |
+
save_best_model: false
|
| 274 |
+
save_final_model: true
|
| 275 |
+
save_pt_file: true
|
| 276 |
+
save_training_state: true
|
| 277 |
+
local:
|
| 278 |
+
keep_last_n: 1
|
| 279 |
+
config_yaml: ${PI05_RUN_DIR}/profile_latency/train.yaml
|
| 280 |
+
output_dir: ${PI05_RUN_DIR}/profile_latency/vla/training/ant_pi05_profile_h1_5fps_g128_20260920
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/config.yaml
ADDED
|
@@ -0,0 +1,157 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
framework:
|
| 2 |
+
name: QwenPI_v3
|
| 3 |
+
qwenvl:
|
| 4 |
+
base_vlm: ${oc.env:PI05_BACKBONE_DIR}
|
| 5 |
+
attn_implementation: flash_attention_2
|
| 6 |
+
vl_hidden_dim: 2560
|
| 7 |
+
num_vl_layers: 36
|
| 8 |
+
enable_gradient_checkpointing: false
|
| 9 |
+
action_model:
|
| 10 |
+
action_model_type: LayerwiseFM
|
| 11 |
+
action_dim: 8
|
| 12 |
+
state_dim: 27
|
| 13 |
+
state_encoding: continuous_projector
|
| 14 |
+
task_objective: null
|
| 15 |
+
action_horizon: 1
|
| 16 |
+
repeated_diffusion_steps: 2
|
| 17 |
+
num_inference_timesteps: 4
|
| 18 |
+
add_pos_embed: true
|
| 19 |
+
max_seq_len: 1024
|
| 20 |
+
num_target_vision_tokens: 32
|
| 21 |
+
noise_beta_alpha: 1.5
|
| 22 |
+
noise_beta_beta: 1.0
|
| 23 |
+
noise_s: 0.999
|
| 24 |
+
num_timestep_buckets: 1000
|
| 25 |
+
diffusion_model_cfg:
|
| 26 |
+
action_dit_hidden_dim: 1024
|
| 27 |
+
dropout: 0.2
|
| 28 |
+
final_dropout: true
|
| 29 |
+
interleave_self_attention: true
|
| 30 |
+
norm_type: ada_norm
|
| 31 |
+
positional_embeddings: null
|
| 32 |
+
attention_head_dim: 64
|
| 33 |
+
num_layers: 36
|
| 34 |
+
input_embedding_dim: 1024
|
| 35 |
+
cross_attention_dim: 1024
|
| 36 |
+
output_dim: 1024
|
| 37 |
+
num_attention_heads: 16
|
| 38 |
+
action_env_dim: 8
|
| 39 |
+
future_action_window_size: 0
|
| 40 |
+
past_action_window_size: 0
|
| 41 |
+
version_id: '0.21'
|
| 42 |
+
datasets:
|
| 43 |
+
vla_data:
|
| 44 |
+
include_state: true
|
| 45 |
+
obs_image_size:
|
| 46 |
+
- 224
|
| 47 |
+
- 224
|
| 48 |
+
image_mode: single
|
| 49 |
+
stitch_grid:
|
| 50 |
+
- 2
|
| 51 |
+
- 2
|
| 52 |
+
num_obs_frames: 1
|
| 53 |
+
gymnasium_task_contract: &id001
|
| 54 |
+
action_space:
|
| 55 |
+
dtype: float32
|
| 56 |
+
high:
|
| 57 |
+
- 1.0
|
| 58 |
+
- 1.0
|
| 59 |
+
- 1.0
|
| 60 |
+
- 1.0
|
| 61 |
+
- 1.0
|
| 62 |
+
- 1.0
|
| 63 |
+
- 1.0
|
| 64 |
+
- 1.0
|
| 65 |
+
labels:
|
| 66 |
+
- back_right_hip_torque
|
| 67 |
+
- back_right_ankle_torque
|
| 68 |
+
- front_left_hip_torque
|
| 69 |
+
- front_left_ankle_torque
|
| 70 |
+
- front_right_hip_torque
|
| 71 |
+
- front_right_ankle_torque
|
| 72 |
+
- back_left_hip_torque
|
| 73 |
+
- back_left_ankle_torque
|
| 74 |
+
low:
|
| 75 |
+
- -1.0
|
| 76 |
+
- -1.0
|
| 77 |
+
- -1.0
|
| 78 |
+
- -1.0
|
| 79 |
+
- -1.0
|
| 80 |
+
- -1.0
|
| 81 |
+
- -1.0
|
| 82 |
+
- -1.0
|
| 83 |
+
type: box
|
| 84 |
+
base_prompt: Make the Ant move forward as fast as possible without falling.
|
| 85 |
+
Predict eight continuous torques in [-1, 1] ordered as back right hip, back
|
| 86 |
+
right ankle, front left hip, front left ankle, front right hip, front right
|
| 87 |
+
ankle, back left hip, and back left ankle.
|
| 88 |
+
env_fps: 5.0
|
| 89 |
+
env_id: LatencyBench/AntContinuous-v0
|
| 90 |
+
frame_stack: 1
|
| 91 |
+
make_kwargs:
|
| 92 |
+
base_env_id: Ant-v4
|
| 93 |
+
base_make_kwargs:
|
| 94 |
+
exclude_current_positions_from_observation: true
|
| 95 |
+
use_contact_forces: false
|
| 96 |
+
render_mode: rgb_array
|
| 97 |
+
noop_action:
|
| 98 |
+
- 0.0
|
| 99 |
+
- 0.0
|
| 100 |
+
- 0.0
|
| 101 |
+
- 0.0
|
| 102 |
+
- 0.0
|
| 103 |
+
- 0.0
|
| 104 |
+
- 0.0
|
| 105 |
+
- 0.0
|
| 106 |
+
obs_fps: 5.0
|
| 107 |
+
registration_imports:
|
| 108 |
+
- latency_bench.envs.gymnasium_ant
|
| 109 |
+
state_space:
|
| 110 |
+
labels:
|
| 111 |
+
- torso_z
|
| 112 |
+
- torso_quaternion_w
|
| 113 |
+
- torso_quaternion_x
|
| 114 |
+
- torso_quaternion_y
|
| 115 |
+
- torso_quaternion_z
|
| 116 |
+
- front_left_hip_angle
|
| 117 |
+
- front_left_ankle_angle
|
| 118 |
+
- front_right_hip_angle
|
| 119 |
+
- front_right_ankle_angle
|
| 120 |
+
- back_left_hip_angle
|
| 121 |
+
- back_left_ankle_angle
|
| 122 |
+
- back_right_hip_angle
|
| 123 |
+
- back_right_ankle_angle
|
| 124 |
+
- torso_x_velocity
|
| 125 |
+
- torso_y_velocity
|
| 126 |
+
- torso_z_velocity
|
| 127 |
+
- torso_angular_velocity_x
|
| 128 |
+
- torso_angular_velocity_y
|
| 129 |
+
- torso_angular_velocity_z
|
| 130 |
+
- front_left_hip_angular_velocity
|
| 131 |
+
- front_left_ankle_angular_velocity
|
| 132 |
+
- front_right_hip_angular_velocity
|
| 133 |
+
- front_right_ankle_angular_velocity
|
| 134 |
+
- back_left_hip_angular_velocity
|
| 135 |
+
- back_left_ankle_angular_velocity
|
| 136 |
+
- back_right_hip_angular_velocity
|
| 137 |
+
- back_right_ankle_angular_velocity
|
| 138 |
+
task_name: ant
|
| 139 |
+
trainer:
|
| 140 |
+
pretrained_checkpoint: null
|
| 141 |
+
profile_timing:
|
| 142 |
+
enabled: false
|
| 143 |
+
log_interval: 10
|
| 144 |
+
backbone:
|
| 145 |
+
repo_id: Qwen/Qwen3-VL-4B-Instruct
|
| 146 |
+
revision: ebb281ec70b05090aa6165b016eac8ec08e71b17
|
| 147 |
+
rl_games:
|
| 148 |
+
model_alias: pi05
|
| 149 |
+
task: gymnasium
|
| 150 |
+
action_carrier: native
|
| 151 |
+
gymnasium:
|
| 152 |
+
task_contract: *id001
|
| 153 |
+
env_eval:
|
| 154 |
+
image_size: 224
|
| 155 |
+
frameskip: 1
|
| 156 |
+
image_transform: raw_rgb
|
| 157 |
+
prompt_mode: raw
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/dataset_statistics.json
ADDED
|
@@ -0,0 +1,254 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"new_embodiment": {
|
| 3 |
+
"action": {
|
| 4 |
+
"mean": [
|
| 5 |
+
-0.21258775889873505,
|
| 6 |
+
0.0060735042206943035,
|
| 7 |
+
0.09963339567184448,
|
| 8 |
+
-0.14281702041625977,
|
| 9 |
+
-0.18596597015857697,
|
| 10 |
+
0.16119267046451569,
|
| 11 |
+
-0.1288464218378067,
|
| 12 |
+
-0.007791953627020121
|
| 13 |
+
],
|
| 14 |
+
"std": [
|
| 15 |
+
0.09634324163198471,
|
| 16 |
+
0.31038498878479004,
|
| 17 |
+
0.41215693950653076,
|
| 18 |
+
0.28469160199165344,
|
| 19 |
+
0.09189476817846298,
|
| 20 |
+
0.050707682967185974,
|
| 21 |
+
0.3488219678401947,
|
| 22 |
+
0.3428356945514679
|
| 23 |
+
],
|
| 24 |
+
"max": [
|
| 25 |
+
0.32485297322273254,
|
| 26 |
+
0.8219043016433716,
|
| 27 |
+
0.9785619378089905,
|
| 28 |
+
0.4289686977863312,
|
| 29 |
+
0.3769160807132721,
|
| 30 |
+
0.3570922017097473,
|
| 31 |
+
0.6995806694030762,
|
| 32 |
+
0.9399116635322571
|
| 33 |
+
],
|
| 34 |
+
"min": [
|
| 35 |
+
-0.5221534371376038,
|
| 36 |
+
-0.6670061945915222,
|
| 37 |
+
-0.7619105577468872,
|
| 38 |
+
-0.6787745952606201,
|
| 39 |
+
-0.9190491437911987,
|
| 40 |
+
-0.1269017904996872,
|
| 41 |
+
-0.9429033994674683,
|
| 42 |
+
-0.6738496422767639
|
| 43 |
+
],
|
| 44 |
+
"q01": [
|
| 45 |
+
-0.4226320269703865,
|
| 46 |
+
-0.5816266393661499,
|
| 47 |
+
-0.5641161489486695,
|
| 48 |
+
-0.6360065984725952,
|
| 49 |
+
-0.4370796835422516,
|
| 50 |
+
0.032235059924423694,
|
| 51 |
+
-0.8411082011461258,
|
| 52 |
+
-0.42670102924108505
|
| 53 |
+
],
|
| 54 |
+
"q99": [
|
| 55 |
+
0.018601863235234804,
|
| 56 |
+
0.5683065080642696,
|
| 57 |
+
0.8988946610689162,
|
| 58 |
+
0.31603450089693047,
|
| 59 |
+
0.041702924370765025,
|
| 60 |
+
0.25051053106784804,
|
| 61 |
+
0.5144581693410865,
|
| 62 |
+
0.8364450520277023
|
| 63 |
+
],
|
| 64 |
+
"mask": [
|
| 65 |
+
true,
|
| 66 |
+
true,
|
| 67 |
+
true,
|
| 68 |
+
true,
|
| 69 |
+
true,
|
| 70 |
+
true,
|
| 71 |
+
true,
|
| 72 |
+
true
|
| 73 |
+
]
|
| 74 |
+
},
|
| 75 |
+
"state": {
|
| 76 |
+
"mean": [
|
| 77 |
+
-0.22882035374641418,
|
| 78 |
+
0.47941550612449646,
|
| 79 |
+
-0.1400502622127533,
|
| 80 |
+
-0.03265565261244774,
|
| 81 |
+
0.20965337753295898,
|
| 82 |
+
-0.16846208274364471,
|
| 83 |
+
0.1846654862165451,
|
| 84 |
+
-0.8101072311401367,
|
| 85 |
+
0.09434358030557632,
|
| 86 |
+
0.04786616191267967,
|
| 87 |
+
-0.4570174515247345,
|
| 88 |
+
-0.8917045593261719,
|
| 89 |
+
0.4862286448478699,
|
| 90 |
+
0.35206252336502075,
|
| 91 |
+
0.015424875542521477,
|
| 92 |
+
-0.038056906312704086,
|
| 93 |
+
0.06804008036851883,
|
| 94 |
+
-0.01555140595883131,
|
| 95 |
+
-0.11194365471601486,
|
| 96 |
+
-0.1391102522611618,
|
| 97 |
+
0.00826873816549778,
|
| 98 |
+
0.2900799512863159,
|
| 99 |
+
0.3209729492664337,
|
| 100 |
+
0.09138798713684082,
|
| 101 |
+
0.02823597937822342,
|
| 102 |
+
0.08164655417203903,
|
| 103 |
+
-0.06988196820020676
|
| 104 |
+
],
|
| 105 |
+
"std": [
|
| 106 |
+
0.36191973090171814,
|
| 107 |
+
0.12071270495653152,
|
| 108 |
+
0.21179752051830292,
|
| 109 |
+
0.2269587516784668,
|
| 110 |
+
0.14413319528102875,
|
| 111 |
+
0.6609764099121094,
|
| 112 |
+
0.33706650137901306,
|
| 113 |
+
0.0639922022819519,
|
| 114 |
+
0.07227976620197296,
|
| 115 |
+
0.6279513239860535,
|
| 116 |
+
0.40478047728538513,
|
| 117 |
+
0.07100282609462738,
|
| 118 |
+
0.4061044752597809,
|
| 119 |
+
0.2651371955871582,
|
| 120 |
+
0.19818426668643951,
|
| 121 |
+
0.3602597117424011,
|
| 122 |
+
0.20922724902629852,
|
| 123 |
+
0.272988498210907,
|
| 124 |
+
0.1799745410680771,
|
| 125 |
+
0.42945030331611633,
|
| 126 |
+
0.3028114140033722,
|
| 127 |
+
0.04903984069824219,
|
| 128 |
+
0.0550890788435936,
|
| 129 |
+
0.39300021529197693,
|
| 130 |
+
0.3226502239704132,
|
| 131 |
+
0.042170703411102295,
|
| 132 |
+
0.3688967823982239
|
| 133 |
+
],
|
| 134 |
+
"max": [
|
| 135 |
+
1.0,
|
| 136 |
+
1.0,
|
| 137 |
+
1.0,
|
| 138 |
+
1.0,
|
| 139 |
+
1.0,
|
| 140 |
+
1.0,
|
| 141 |
+
1.0,
|
| 142 |
+
1.0,
|
| 143 |
+
1.0,
|
| 144 |
+
1.0,
|
| 145 |
+
1.0,
|
| 146 |
+
1.0,
|
| 147 |
+
1.0,
|
| 148 |
+
1.0,
|
| 149 |
+
1.0,
|
| 150 |
+
1.0,
|
| 151 |
+
1.0,
|
| 152 |
+
1.0,
|
| 153 |
+
1.0,
|
| 154 |
+
1.0,
|
| 155 |
+
1.0,
|
| 156 |
+
1.0,
|
| 157 |
+
1.0,
|
| 158 |
+
1.0,
|
| 159 |
+
1.0,
|
| 160 |
+
1.0,
|
| 161 |
+
1.0
|
| 162 |
+
],
|
| 163 |
+
"min": [
|
| 164 |
+
-1.0,
|
| 165 |
+
-1.0,
|
| 166 |
+
-1.0,
|
| 167 |
+
-1.0,
|
| 168 |
+
-1.0,
|
| 169 |
+
-1.0,
|
| 170 |
+
-1.0,
|
| 171 |
+
-1.0,
|
| 172 |
+
-1.0,
|
| 173 |
+
-1.0,
|
| 174 |
+
-1.0,
|
| 175 |
+
-1.0,
|
| 176 |
+
-1.0,
|
| 177 |
+
-1.0,
|
| 178 |
+
-1.0,
|
| 179 |
+
-1.0,
|
| 180 |
+
-1.0,
|
| 181 |
+
-1.0,
|
| 182 |
+
-1.0,
|
| 183 |
+
-1.0,
|
| 184 |
+
-1.0,
|
| 185 |
+
-1.0,
|
| 186 |
+
-1.0,
|
| 187 |
+
-1.0,
|
| 188 |
+
-1.0,
|
| 189 |
+
-1.0,
|
| 190 |
+
-1.0
|
| 191 |
+
],
|
| 192 |
+
"q01": [
|
| 193 |
+
-0.8241139680147171,
|
| 194 |
+
0.04648104071617127,
|
| 195 |
+
-0.6652810025215149,
|
| 196 |
+
-0.5314224624633789,
|
| 197 |
+
-0.19820078015327453,
|
| 198 |
+
-0.9496272021532058,
|
| 199 |
+
-0.20859015226364136,
|
| 200 |
+
-0.8253665775060653,
|
| 201 |
+
0.09396191000938416,
|
| 202 |
+
-0.9315658015012741,
|
| 203 |
+
-0.9077210491895675,
|
| 204 |
+
-0.9014575052261352,
|
| 205 |
+
-0.22581478476524353,
|
| 206 |
+
-0.5506806242465973,
|
| 207 |
+
-0.42719365894794464,
|
| 208 |
+
-0.7398031288385392,
|
| 209 |
+
-0.36758168041706085,
|
| 210 |
+
-0.5742466670274734,
|
| 211 |
+
-0.6432376319169998,
|
| 212 |
+
-0.8104029732942581,
|
| 213 |
+
-0.7943315953016281,
|
| 214 |
+
0.2125857985019684,
|
| 215 |
+
0.3195498716831207,
|
| 216 |
+
-0.817195657491684,
|
| 217 |
+
-0.4413272815942764,
|
| 218 |
+
0.05512574553489685,
|
| 219 |
+
-0.8615017014741898
|
| 220 |
+
],
|
| 221 |
+
"q99": [
|
| 222 |
+
0.6039263105392445,
|
| 223 |
+
0.6871944534778593,
|
| 224 |
+
0.3730386269092557,
|
| 225 |
+
0.42124163150787025,
|
| 226 |
+
0.6027398216724373,
|
| 227 |
+
0.9456771314144133,
|
| 228 |
+
0.9311108589172361,
|
| 229 |
+
-0.6299777722358707,
|
| 230 |
+
0.09945510149002075,
|
| 231 |
+
0.9258959579467773,
|
| 232 |
+
0.24740778565406782,
|
| 233 |
+
-0.8100068545341509,
|
| 234 |
+
0.9577416539192198,
|
| 235 |
+
0.7944118678569789,
|
| 236 |
+
0.5177989375591278,
|
| 237 |
+
0.7203878808021538,
|
| 238 |
+
0.6027004325389856,
|
| 239 |
+
0.6471473491191858,
|
| 240 |
+
0.2969542503356919,
|
| 241 |
+
0.8709750354290008,
|
| 242 |
+
0.4969204437732693,
|
| 243 |
+
0.3660900735855095,
|
| 244 |
+
0.32227142453193663,
|
| 245 |
+
0.7621688938140869,
|
| 246 |
+
0.8692629277706144,
|
| 247 |
+
0.12456895589828483,
|
| 248 |
+
0.6941961252689341
|
| 249 |
+
]
|
| 250 |
+
},
|
| 251 |
+
"num_transitions": 89808,
|
| 252 |
+
"num_trajectories": 90
|
| 253 |
+
}
|
| 254 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/evaluation/comparison.json
ADDED
|
@@ -0,0 +1,419 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"state": "MATCHED_B_F20_AUDIT_PASSED",
|
| 3 |
+
"verified_at_utc": "2026-09-22T03:35:27.392265+00:00",
|
| 4 |
+
"B": {
|
| 5 |
+
"state": "B20_SPLIT_SESSION_DERIVED_AUDIT_PASSED",
|
| 6 |
+
"episodes": 20,
|
| 7 |
+
"seeds": [
|
| 8 |
+
42,
|
| 9 |
+
43,
|
| 10 |
+
44,
|
| 11 |
+
45,
|
| 12 |
+
46,
|
| 13 |
+
47,
|
| 14 |
+
48,
|
| 15 |
+
49,
|
| 16 |
+
50,
|
| 17 |
+
51,
|
| 18 |
+
52,
|
| 19 |
+
53,
|
| 20 |
+
54,
|
| 21 |
+
55,
|
| 22 |
+
56,
|
| 23 |
+
57,
|
| 24 |
+
58,
|
| 25 |
+
59,
|
| 26 |
+
60,
|
| 27 |
+
61
|
| 28 |
+
],
|
| 29 |
+
"returns": [
|
| 30 |
+
32.501595490013216,
|
| 31 |
+
56.46892726482151,
|
| 32 |
+
96.83510560036257,
|
| 33 |
+
95.12004972167394,
|
| 34 |
+
68.4796112625599,
|
| 35 |
+
9.427925579208752,
|
| 36 |
+
180.91789918774197,
|
| 37 |
+
126.02311329849451,
|
| 38 |
+
239.58810433012508,
|
| 39 |
+
3.683059784739528,
|
| 40 |
+
291.6266216954973,
|
| 41 |
+
297.4161642880803,
|
| 42 |
+
50.97806575612095,
|
| 43 |
+
48.653726214514066,
|
| 44 |
+
243.76432224961033,
|
| 45 |
+
78.96932272634479,
|
| 46 |
+
252.69957930958387,
|
| 47 |
+
142.4877330153016,
|
| 48 |
+
86.73317256303835,
|
| 49 |
+
229.67420439888363
|
| 50 |
+
],
|
| 51 |
+
"mean_return": 131.6024151868358,
|
| 52 |
+
"population_std_return": 93.71548520884977,
|
| 53 |
+
"raw_steps": 1444,
|
| 54 |
+
"actions": 1424,
|
| 55 |
+
"invalid_actions": 0,
|
| 56 |
+
"dropped_actions": 0,
|
| 57 |
+
"dropped_observations": 0,
|
| 58 |
+
"model_revision": "95dedf8583692024daa890fe3499b5540167eb77",
|
| 59 |
+
"checkpoint_sha256": "ed340a88cfef3522405265e8646b97e26d61106d011f0911d78f8d276a1e8843"
|
| 60 |
+
},
|
| 61 |
+
"F": {
|
| 62 |
+
"state": "F20_FULL_STEP_ACTION_AUDIT_PASSED",
|
| 63 |
+
"task": "ant",
|
| 64 |
+
"verified_at_utc": "2026-09-22T03:35:27.392265+00:00",
|
| 65 |
+
"episodes": 20,
|
| 66 |
+
"seeds": [
|
| 67 |
+
42,
|
| 68 |
+
43,
|
| 69 |
+
44,
|
| 70 |
+
45,
|
| 71 |
+
46,
|
| 72 |
+
47,
|
| 73 |
+
48,
|
| 74 |
+
49,
|
| 75 |
+
50,
|
| 76 |
+
51,
|
| 77 |
+
52,
|
| 78 |
+
53,
|
| 79 |
+
54,
|
| 80 |
+
55,
|
| 81 |
+
56,
|
| 82 |
+
57,
|
| 83 |
+
58,
|
| 84 |
+
59,
|
| 85 |
+
60,
|
| 86 |
+
61
|
| 87 |
+
],
|
| 88 |
+
"returns": [
|
| 89 |
+
2215.21984877659,
|
| 90 |
+
764.2694680291046,
|
| 91 |
+
2290.599554986267,
|
| 92 |
+
1840.29021669272,
|
| 93 |
+
2231.3439323113707,
|
| 94 |
+
2373.9321151344743,
|
| 95 |
+
2372.1426528938036,
|
| 96 |
+
166.30488169019765,
|
| 97 |
+
2302.3785949510366,
|
| 98 |
+
2367.2167682154372,
|
| 99 |
+
2310.4893684982335,
|
| 100 |
+
246.45578812725222,
|
| 101 |
+
677.2055059936616,
|
| 102 |
+
2090.486226750155,
|
| 103 |
+
2344.0109866336898,
|
| 104 |
+
1810.7094305991875,
|
| 105 |
+
2392.8136264328004,
|
| 106 |
+
2337.4267695838707,
|
| 107 |
+
104.35524685972497,
|
| 108 |
+
2256.5825535088743
|
| 109 |
+
],
|
| 110 |
+
"lengths": [
|
| 111 |
+
924,
|
| 112 |
+
382,
|
| 113 |
+
1000,
|
| 114 |
+
774,
|
| 115 |
+
1000,
|
| 116 |
+
1000,
|
| 117 |
+
1000,
|
| 118 |
+
99,
|
| 119 |
+
1000,
|
| 120 |
+
1000,
|
| 121 |
+
1000,
|
| 122 |
+
123,
|
| 123 |
+
332,
|
| 124 |
+
910,
|
| 125 |
+
1000,
|
| 126 |
+
806,
|
| 127 |
+
1000,
|
| 128 |
+
1000,
|
| 129 |
+
63,
|
| 130 |
+
1000
|
| 131 |
+
],
|
| 132 |
+
"mean_return": 1774.7116768334226,
|
| 133 |
+
"population_std_return": 824.6118449109582,
|
| 134 |
+
"mean_length": 770.65,
|
| 135 |
+
"raw_steps": 15413,
|
| 136 |
+
"actions": 15393,
|
| 137 |
+
"invalid_actions": 0,
|
| 138 |
+
"dropped_actions": 0,
|
| 139 |
+
"dropped_observations": 0,
|
| 140 |
+
"submitted_observations": 15413,
|
| 141 |
+
"actual_env_fps_episode_mean": 4.912483565125906,
|
| 142 |
+
"mean_of_episode_latency_ms": 142.64479040267122,
|
| 143 |
+
"action_weighted_mean_latency_ms": 142.5879202059613,
|
| 144 |
+
"action_latency_p95_ms": 148.24638906866312,
|
| 145 |
+
"within_episode_wall_interval_count": 15393,
|
| 146 |
+
"within_episode_wall_interval_mean_ms": 200.00094455385926,
|
| 147 |
+
"within_episode_wall_interval_min_ms": 198.1171239167452,
|
| 148 |
+
"within_episode_wall_interval_max_ms": 201.79568137973547,
|
| 149 |
+
"actual_env_fps_note": "Per-episode actual_env_fps includes startup overhead; within-episode wall intervals are reported separately.",
|
| 150 |
+
"model_revision": "20f7452df3e281b6aea0f5a66a1602eb70297490",
|
| 151 |
+
"checkpoint_sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 152 |
+
"config_sha256": "50304b94913641a189e1481915ff5540773a016b2233d71a7bc45443418eb877",
|
| 153 |
+
"prompt_map_sha256": "310e240a812bcb44139959d28a331ad14fa0f54bb01bd9cfdcd8656b7df99401",
|
| 154 |
+
"matched_B_config": true,
|
| 155 |
+
"native_manifest_binding": {
|
| 156 |
+
"uses_state": true,
|
| 157 |
+
"state_dim": 27,
|
| 158 |
+
"action_dim": 8,
|
| 159 |
+
"action_carrier": "native",
|
| 160 |
+
"state_normalization": {
|
| 161 |
+
"type": "min_max",
|
| 162 |
+
"min": [
|
| 163 |
+
0.45712053775787354,
|
| 164 |
+
0.42918211221694946,
|
| 165 |
+
-0.28085193037986755,
|
| 166 |
+
-0.4074253737926483,
|
| 167 |
+
-0.5388316512107849,
|
| 168 |
+
-0.615333616733551,
|
| 169 |
+
-0.09917011857032776,
|
| 170 |
+
-0.6332460641860962,
|
| 171 |
+
-1.2830065488815308,
|
| 172 |
+
-0.6662936806678772,
|
| 173 |
+
-1.334958553314209,
|
| 174 |
+
-0.5831336379051208,
|
| 175 |
+
-0.09470116347074509,
|
| 176 |
+
-1.3858237266540527,
|
| 177 |
+
-3.0080575942993164,
|
| 178 |
+
-2.8010413646698,
|
| 179 |
+
-5.880337715148926,
|
| 180 |
+
-6.067046165466309,
|
| 181 |
+
-4.152688026428223,
|
| 182 |
+
-11.533856391906738,
|
| 183 |
+
-11.273722648620605,
|
| 184 |
+
-10.24732494354248,
|
| 185 |
+
-11.152595520019531,
|
| 186 |
+
-14.95035457611084,
|
| 187 |
+
-13.3801851272583,
|
| 188 |
+
-7.523056507110596,
|
| 189 |
+
-10.32906723022461
|
| 190 |
+
],
|
| 191 |
+
"max": [
|
| 192 |
+
0.9959571361541748,
|
| 193 |
+
1.098469853401184,
|
| 194 |
+
0.19786669313907623,
|
| 195 |
+
0.22940033674240112,
|
| 196 |
+
0.9005154967308044,
|
| 197 |
+
0.664892852306366,
|
| 198 |
+
1.2915066480636597,
|
| 199 |
+
0.5571166276931763,
|
| 200 |
+
0.09998779743909836,
|
| 201 |
+
0.630243182182312,
|
| 202 |
+
0.09576962888240814,
|
| 203 |
+
0.5611315369606018,
|
| 204 |
+
1.318502426147461,
|
| 205 |
+
6.299008369445801,
|
| 206 |
+
3.3342177867889404,
|
| 207 |
+
3.019660234451294,
|
| 208 |
+
5.154758930206299,
|
| 209 |
+
6.224544525146484,
|
| 210 |
+
5.348186016082764,
|
| 211 |
+
15.20273494720459,
|
| 212 |
+
11.13831615447998,
|
| 213 |
+
5.624480724334717,
|
| 214 |
+
5.72410774230957,
|
| 215 |
+
12.494281768798828,
|
| 216 |
+
12.612875938415527,
|
| 217 |
+
6.370715618133545,
|
| 218 |
+
11.95276927947998
|
| 219 |
+
]
|
| 220 |
+
}
|
| 221 |
+
},
|
| 222 |
+
"post_evaluation_checkpoint_sha256_verified": true,
|
| 223 |
+
"post_evaluation_checkpoint_hash": {
|
| 224 |
+
"state": "COMPLETED_F_CHECKPOINT_STREAM_HASH_VERIFIED",
|
| 225 |
+
"path": "/dev/shm/lsb-ant-profile-f-20f7452d/ant/profile_latency/Pi05/checkpoints/model.pt",
|
| 226 |
+
"bytes": 10922682525,
|
| 227 |
+
"mtime_epoch": 1790005295,
|
| 228 |
+
"sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 229 |
+
"hash_source": "streaming_sha256_of_F_yaml_policy_checkpoint_path",
|
| 230 |
+
"gpu0_protection_check": "empty_before_hash",
|
| 231 |
+
"hash_started_utc": "2026-09-22T03:26:04.687079982Z",
|
| 232 |
+
"hash_finished_utc": "2026-09-22T03:26:10.917816690Z"
|
| 233 |
+
},
|
| 234 |
+
"prompt_key": 1,
|
| 235 |
+
"prompt_sha256": "310e240a812bcb44139959d28a331ad14fa0f54bb01bd9cfdcd8656b7df99401",
|
| 236 |
+
"protocol": {
|
| 237 |
+
"env_fps": 5,
|
| 238 |
+
"obs_fps": 5,
|
| 239 |
+
"raw_step_cap": 1000,
|
| 240 |
+
"mode": "realtime",
|
| 241 |
+
"latency": "measured-only sync_cuda",
|
| 242 |
+
"workers": 1,
|
| 243 |
+
"H": 1,
|
| 244 |
+
"state_dim": 27,
|
| 245 |
+
"action_dim": 8
|
| 246 |
+
},
|
| 247 |
+
"preclip_commands_requiring_native_clip": 5,
|
| 248 |
+
"preclip_range": [
|
| 249 |
+
-0.9922769069671631,
|
| 250 |
+
1.013676643371582
|
| 251 |
+
],
|
| 252 |
+
"state_note": "State is bound to the F manifest/config and prior loader verification; per-step state vectors were not logged.",
|
| 253 |
+
"capacity_drop_note": "Observation and action drop counts are taken from the actual F step/attempt/action joins and episode metadata.",
|
| 254 |
+
"baseline": {
|
| 255 |
+
"source": "B-recovered-audit.json",
|
| 256 |
+
"state": "B20_SPLIT_SESSION_DERIVED_AUDIT_PASSED",
|
| 257 |
+
"split_session": {
|
| 258 |
+
"original_ids": [
|
| 259 |
+
0,
|
| 260 |
+
1,
|
| 261 |
+
2,
|
| 262 |
+
3,
|
| 263 |
+
4,
|
| 264 |
+
5,
|
| 265 |
+
6,
|
| 266 |
+
7,
|
| 267 |
+
8,
|
| 268 |
+
9,
|
| 269 |
+
10,
|
| 270 |
+
11,
|
| 271 |
+
12,
|
| 272 |
+
13,
|
| 273 |
+
14,
|
| 274 |
+
15,
|
| 275 |
+
16,
|
| 276 |
+
17
|
| 277 |
+
],
|
| 278 |
+
"recovery_ids": [
|
| 279 |
+
18,
|
| 280 |
+
19
|
| 281 |
+
],
|
| 282 |
+
"container_restarted": true,
|
| 283 |
+
"diffusion_rng_stream_reset": true,
|
| 284 |
+
"continuous_session_equivalence": false
|
| 285 |
+
},
|
| 286 |
+
"rng_caveat": "The B recovery session reset the diffusion RNG stream; it is retained as recorded."
|
| 287 |
+
}
|
| 288 |
+
},
|
| 289 |
+
"paired": [
|
| 290 |
+
{
|
| 291 |
+
"seed": 42,
|
| 292 |
+
"B": 32.501595490013216,
|
| 293 |
+
"F": 2215.21984877659,
|
| 294 |
+
"delta": 2182.718253286577
|
| 295 |
+
},
|
| 296 |
+
{
|
| 297 |
+
"seed": 43,
|
| 298 |
+
"B": 56.46892726482151,
|
| 299 |
+
"F": 764.2694680291046,
|
| 300 |
+
"delta": 707.800540764283
|
| 301 |
+
},
|
| 302 |
+
{
|
| 303 |
+
"seed": 44,
|
| 304 |
+
"B": 96.83510560036257,
|
| 305 |
+
"F": 2290.599554986267,
|
| 306 |
+
"delta": 2193.7644493859043
|
| 307 |
+
},
|
| 308 |
+
{
|
| 309 |
+
"seed": 45,
|
| 310 |
+
"B": 95.12004972167394,
|
| 311 |
+
"F": 1840.29021669272,
|
| 312 |
+
"delta": 1745.170166971046
|
| 313 |
+
},
|
| 314 |
+
{
|
| 315 |
+
"seed": 46,
|
| 316 |
+
"B": 68.4796112625599,
|
| 317 |
+
"F": 2231.3439323113707,
|
| 318 |
+
"delta": 2162.864321048811
|
| 319 |
+
},
|
| 320 |
+
{
|
| 321 |
+
"seed": 47,
|
| 322 |
+
"B": 9.427925579208752,
|
| 323 |
+
"F": 2373.9321151344743,
|
| 324 |
+
"delta": 2364.5041895552654
|
| 325 |
+
},
|
| 326 |
+
{
|
| 327 |
+
"seed": 48,
|
| 328 |
+
"B": 180.91789918774197,
|
| 329 |
+
"F": 2372.1426528938036,
|
| 330 |
+
"delta": 2191.2247537060616
|
| 331 |
+
},
|
| 332 |
+
{
|
| 333 |
+
"seed": 49,
|
| 334 |
+
"B": 126.02311329849451,
|
| 335 |
+
"F": 166.30488169019765,
|
| 336 |
+
"delta": 40.28176839170314
|
| 337 |
+
},
|
| 338 |
+
{
|
| 339 |
+
"seed": 50,
|
| 340 |
+
"B": 239.58810433012508,
|
| 341 |
+
"F": 2302.3785949510366,
|
| 342 |
+
"delta": 2062.7904906209114
|
| 343 |
+
},
|
| 344 |
+
{
|
| 345 |
+
"seed": 51,
|
| 346 |
+
"B": 3.683059784739528,
|
| 347 |
+
"F": 2367.2167682154372,
|
| 348 |
+
"delta": 2363.5337084306975
|
| 349 |
+
},
|
| 350 |
+
{
|
| 351 |
+
"seed": 52,
|
| 352 |
+
"B": 291.6266216954973,
|
| 353 |
+
"F": 2310.4893684982335,
|
| 354 |
+
"delta": 2018.8627468027362
|
| 355 |
+
},
|
| 356 |
+
{
|
| 357 |
+
"seed": 53,
|
| 358 |
+
"B": 297.4161642880803,
|
| 359 |
+
"F": 246.45578812725222,
|
| 360 |
+
"delta": -50.960376160828105
|
| 361 |
+
},
|
| 362 |
+
{
|
| 363 |
+
"seed": 54,
|
| 364 |
+
"B": 50.97806575612095,
|
| 365 |
+
"F": 677.2055059936616,
|
| 366 |
+
"delta": 626.2274402375407
|
| 367 |
+
},
|
| 368 |
+
{
|
| 369 |
+
"seed": 55,
|
| 370 |
+
"B": 48.653726214514066,
|
| 371 |
+
"F": 2090.486226750155,
|
| 372 |
+
"delta": 2041.8325005356407
|
| 373 |
+
},
|
| 374 |
+
{
|
| 375 |
+
"seed": 56,
|
| 376 |
+
"B": 243.76432224961033,
|
| 377 |
+
"F": 2344.0109866336898,
|
| 378 |
+
"delta": 2100.2466643840794
|
| 379 |
+
},
|
| 380 |
+
{
|
| 381 |
+
"seed": 57,
|
| 382 |
+
"B": 78.96932272634479,
|
| 383 |
+
"F": 1810.7094305991875,
|
| 384 |
+
"delta": 1731.7401078728426
|
| 385 |
+
},
|
| 386 |
+
{
|
| 387 |
+
"seed": 58,
|
| 388 |
+
"B": 252.69957930958387,
|
| 389 |
+
"F": 2392.8136264328004,
|
| 390 |
+
"delta": 2140.1140471232166
|
| 391 |
+
},
|
| 392 |
+
{
|
| 393 |
+
"seed": 59,
|
| 394 |
+
"B": 142.4877330153016,
|
| 395 |
+
"F": 2337.4267695838707,
|
| 396 |
+
"delta": 2194.939036568569
|
| 397 |
+
},
|
| 398 |
+
{
|
| 399 |
+
"seed": 60,
|
| 400 |
+
"B": 86.73317256303835,
|
| 401 |
+
"F": 104.35524685972497,
|
| 402 |
+
"delta": 17.62207429668662
|
| 403 |
+
},
|
| 404 |
+
{
|
| 405 |
+
"seed": 61,
|
| 406 |
+
"B": 229.67420439888363,
|
| 407 |
+
"F": 2256.5825535088743,
|
| 408 |
+
"delta": 2026.9083491099907
|
| 409 |
+
}
|
| 410 |
+
],
|
| 411 |
+
"mean_gain": 1643.1092616465867,
|
| 412 |
+
"population_std_gain": 824.5230676778788,
|
| 413 |
+
"wins": 19,
|
| 414 |
+
"ties": 0,
|
| 415 |
+
"losses": 1,
|
| 416 |
+
"gain_percent": 1248.5403549120786,
|
| 417 |
+
"protocol": "Ant native state27/action8, seeds42-61, cap1000, env/obs5/5FPS, one worker, measured-only CUDA-synchronized latency, B prompt0 and F prompt1, hold/FIFO; no IID delay.",
|
| 418 |
+
"causal_scope": "Descriptive paired comparison under the two measured-latency runs; no equal-delay or architecture-ranking claim."
|
| 419 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/evaluation/status.json
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"state": "PROFILE_MODEL_F20_DEPLOYMENT_AUDIT_VERIFIED",
|
| 3 |
+
"model_revision": "20f7452df3e281b6aea0f5a66a1602eb70297490",
|
| 4 |
+
"checkpoint_sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 5 |
+
"training_steps": 5000,
|
| 6 |
+
"formal_source_state": "COMPLETED",
|
| 7 |
+
"profile_validation_history": {
|
| 8 |
+
"state": "CPU_STATE_DICT_AND_BUNDLE_HASH_VERIFIED",
|
| 9 |
+
"saved_model_gpu_forward": "NOT_RUN",
|
| 10 |
+
"closed_loop_evaluation": "NOT_RUN"
|
| 11 |
+
},
|
| 12 |
+
"F_deployed_inference_audit": "F20_FULL_STEP_ACTION_AUDIT_PASSED",
|
| 13 |
+
"F_independent_heldout_gpu_forward": "NOT_RUN",
|
| 14 |
+
"F": {
|
| 15 |
+
"F_publication_revision": "591db41843567bf4a1946ddfe66d2f51aaf8d7c6",
|
| 16 |
+
"F_model_revision": "20f7452df3e281b6aea0f5a66a1602eb70297490",
|
| 17 |
+
"F_checkpoint_sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 18 |
+
"F_audit_state": "F20_FULL_STEP_ACTION_AUDIT_PASSED",
|
| 19 |
+
"F_verification_published_sha256": "bf9d8c4605b5a4406dea883b8bf498aa13c1d88d7c7cc83293374ccdd36c3777",
|
| 20 |
+
"F_comparison_published_sha256": "bbdce3420304948b37554a7c4f2b37097ee92ac49baa08bc08b4c1d2a9266150",
|
| 21 |
+
"F_config_published_sha256": "387c32ea04ca864934ad10e1b31e41490e526cae71b08cc84e0eb4057ae6313a",
|
| 22 |
+
"F_checkpoint_hash_published_sha256": "acccd0cfcd9c034dda2ba318ea86aa80b55fdca8691bef71e9f66d88f3817c3b",
|
| 23 |
+
"seeds": "42-61",
|
| 24 |
+
"episodes": 20,
|
| 25 |
+
"raw_step_cap": 1000,
|
| 26 |
+
"raw_steps": 15413,
|
| 27 |
+
"actions": 15393,
|
| 28 |
+
"invalid_actions": 0,
|
| 29 |
+
"dropped_actions": 0,
|
| 30 |
+
"mean_length": 770.65,
|
| 31 |
+
"F_mean_return": 1774.7116768334226,
|
| 32 |
+
"F_population_std": 824.6118449109582,
|
| 33 |
+
"action_latency_mean_ms": 142.5879202059613,
|
| 34 |
+
"action_latency_p95_ms": 148.24638906866312,
|
| 35 |
+
"paired_gain": 1643.1092616465867,
|
| 36 |
+
"paired_gain_percent": 1248.5403549120786,
|
| 37 |
+
"wins_ties_losses": [
|
| 38 |
+
19,
|
| 39 |
+
0,
|
| 40 |
+
1
|
| 41 |
+
],
|
| 42 |
+
"baseline_caveat": "The B recovery session reset the diffusion RNG stream; it is retained as recorded.",
|
| 43 |
+
"causal_scope": "Descriptive paired comparison under the two measured-latency runs; no equal-delay or architecture-ranking claim."
|
| 44 |
+
},
|
| 45 |
+
"weights_changed": false,
|
| 46 |
+
"metadata_only_closeout": true
|
| 47 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/latency_prompt_map.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"1": {
|
| 3 |
+
"prompt": "Make the Ant move forward as fast as possible without falling. Predict eight continuous torques in [-1, 1] ordered as back right hip, back right ankle, front left hip, front left ankle, front right hip, front right ankle, back left hip, and back left ankle. Current action latency is 1 raw frames (200.00 ms). The environment runs at 5 FPS and observations are emitted at 5 FPS. Choose the best next action.",
|
| 4 |
+
"latency_raw_frames": 1,
|
| 5 |
+
"latency_ms": 200.0
|
| 6 |
+
}
|
| 7 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/manifest.json
ADDED
|
@@ -0,0 +1,232 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"dataset_name": "ant_h1_5fps_profile",
|
| 3 |
+
"env_name": "ant",
|
| 4 |
+
"episodes": 90,
|
| 5 |
+
"frames": 89808,
|
| 6 |
+
"task_prompts": [
|
| 7 |
+
"Make the Ant move forward as fast as possible without falling. Predict eight continuous torques in [-1, 1] ordered as back right hip, back right ankle, front left hip, front left ankle, front right hip, front right ankle, back left hip, and back left ankle. Current action latency is 1 raw frames (200.00 ms). The environment runs at 5 FPS and observations are emitted at 5 FPS. Choose the best next action."
|
| 8 |
+
],
|
| 9 |
+
"format": "lerobot_v2_image_parquet",
|
| 10 |
+
"source": "${PI05_RUN_DIR}/profile_latency/data/raw_profile",
|
| 11 |
+
"integration_name": "gymnasium",
|
| 12 |
+
"task_name": "ant",
|
| 13 |
+
"action_layout": "gymnasium_continuous_v1",
|
| 14 |
+
"action_labels": [
|
| 15 |
+
"back_right_hip_torque",
|
| 16 |
+
"back_right_ankle_torque",
|
| 17 |
+
"front_left_hip_torque",
|
| 18 |
+
"front_left_ankle_torque",
|
| 19 |
+
"front_right_hip_torque",
|
| 20 |
+
"front_right_ankle_torque",
|
| 21 |
+
"back_left_hip_torque",
|
| 22 |
+
"back_left_ankle_torque"
|
| 23 |
+
],
|
| 24 |
+
"carrier_action_labels": [
|
| 25 |
+
"back_right_hip_torque",
|
| 26 |
+
"back_right_ankle_torque",
|
| 27 |
+
"front_left_hip_torque",
|
| 28 |
+
"front_left_ankle_torque",
|
| 29 |
+
"front_right_hip_torque",
|
| 30 |
+
"front_right_ankle_torque",
|
| 31 |
+
"back_left_hip_torque",
|
| 32 |
+
"back_left_ankle_torque"
|
| 33 |
+
],
|
| 34 |
+
"action_dim": 8,
|
| 35 |
+
"active_action_dim": 8,
|
| 36 |
+
"action_carrier": "native",
|
| 37 |
+
"rows_unit": "decision_step",
|
| 38 |
+
"obs_fps": 5.0,
|
| 39 |
+
"obs_stride_raw_frames": 1,
|
| 40 |
+
"uses_state": true,
|
| 41 |
+
"state_dim": 27,
|
| 42 |
+
"state_labels": [
|
| 43 |
+
"torso_z",
|
| 44 |
+
"torso_quaternion_w",
|
| 45 |
+
"torso_quaternion_x",
|
| 46 |
+
"torso_quaternion_y",
|
| 47 |
+
"torso_quaternion_z",
|
| 48 |
+
"front_left_hip_angle",
|
| 49 |
+
"front_left_ankle_angle",
|
| 50 |
+
"front_right_hip_angle",
|
| 51 |
+
"front_right_ankle_angle",
|
| 52 |
+
"back_left_hip_angle",
|
| 53 |
+
"back_left_ankle_angle",
|
| 54 |
+
"back_right_hip_angle",
|
| 55 |
+
"back_right_ankle_angle",
|
| 56 |
+
"torso_x_velocity",
|
| 57 |
+
"torso_y_velocity",
|
| 58 |
+
"torso_z_velocity",
|
| 59 |
+
"torso_angular_velocity_x",
|
| 60 |
+
"torso_angular_velocity_y",
|
| 61 |
+
"torso_angular_velocity_z",
|
| 62 |
+
"front_left_hip_angular_velocity",
|
| 63 |
+
"front_left_ankle_angular_velocity",
|
| 64 |
+
"front_right_hip_angular_velocity",
|
| 65 |
+
"front_right_ankle_angular_velocity",
|
| 66 |
+
"back_left_hip_angular_velocity",
|
| 67 |
+
"back_left_ankle_angular_velocity",
|
| 68 |
+
"back_right_hip_angular_velocity",
|
| 69 |
+
"back_right_ankle_angular_velocity"
|
| 70 |
+
],
|
| 71 |
+
"state_normalization": {
|
| 72 |
+
"type": "min_max",
|
| 73 |
+
"min": [
|
| 74 |
+
0.45712053775787354,
|
| 75 |
+
0.42918211221694946,
|
| 76 |
+
-0.28085193037986755,
|
| 77 |
+
-0.4074253737926483,
|
| 78 |
+
-0.5388316512107849,
|
| 79 |
+
-0.615333616733551,
|
| 80 |
+
-0.09917011857032776,
|
| 81 |
+
-0.6332460641860962,
|
| 82 |
+
-1.2830065488815308,
|
| 83 |
+
-0.6662936806678772,
|
| 84 |
+
-1.334958553314209,
|
| 85 |
+
-0.5831336379051208,
|
| 86 |
+
-0.09470116347074509,
|
| 87 |
+
-1.3858237266540527,
|
| 88 |
+
-3.0080575942993164,
|
| 89 |
+
-2.8010413646698,
|
| 90 |
+
-5.880337715148926,
|
| 91 |
+
-6.067046165466309,
|
| 92 |
+
-4.152688026428223,
|
| 93 |
+
-11.533856391906738,
|
| 94 |
+
-11.273722648620605,
|
| 95 |
+
-10.24732494354248,
|
| 96 |
+
-11.152595520019531,
|
| 97 |
+
-14.95035457611084,
|
| 98 |
+
-13.3801851272583,
|
| 99 |
+
-7.523056507110596,
|
| 100 |
+
-10.32906723022461
|
| 101 |
+
],
|
| 102 |
+
"max": [
|
| 103 |
+
0.9959571361541748,
|
| 104 |
+
1.098469853401184,
|
| 105 |
+
0.19786669313907623,
|
| 106 |
+
0.22940033674240112,
|
| 107 |
+
0.9005154967308044,
|
| 108 |
+
0.664892852306366,
|
| 109 |
+
1.2915066480636597,
|
| 110 |
+
0.5571166276931763,
|
| 111 |
+
0.09998779743909836,
|
| 112 |
+
0.630243182182312,
|
| 113 |
+
0.09576962888240814,
|
| 114 |
+
0.5611315369606018,
|
| 115 |
+
1.318502426147461,
|
| 116 |
+
6.299008369445801,
|
| 117 |
+
3.3342177867889404,
|
| 118 |
+
3.019660234451294,
|
| 119 |
+
5.154758930206299,
|
| 120 |
+
6.224544525146484,
|
| 121 |
+
5.348186016082764,
|
| 122 |
+
15.20273494720459,
|
| 123 |
+
11.13831615447998,
|
| 124 |
+
5.624480724334717,
|
| 125 |
+
5.72410774230957,
|
| 126 |
+
12.494281768798828,
|
| 127 |
+
12.612875938415527,
|
| 128 |
+
6.370715618133545,
|
| 129 |
+
11.95276927947998
|
| 130 |
+
]
|
| 131 |
+
},
|
| 132 |
+
"robot_type": "rl_games_gymnasium",
|
| 133 |
+
"latency_prompt_map_path": "${PI05_RUN_DIR}/profile_latency/data/lerobot/ant_h1_5fps_profile/latency_prompt_map.json",
|
| 134 |
+
"custom_mixtures_path": "${PI05_RUN_DIR}/profile_latency/data/lerobot/_generated_mixtures/ant_h1_5fps_profile.json",
|
| 135 |
+
"gymnasium_task": {
|
| 136 |
+
"action_space": {
|
| 137 |
+
"dtype": "float32",
|
| 138 |
+
"high": [
|
| 139 |
+
1.0,
|
| 140 |
+
1.0,
|
| 141 |
+
1.0,
|
| 142 |
+
1.0,
|
| 143 |
+
1.0,
|
| 144 |
+
1.0,
|
| 145 |
+
1.0,
|
| 146 |
+
1.0
|
| 147 |
+
],
|
| 148 |
+
"labels": [
|
| 149 |
+
"back_right_hip_torque",
|
| 150 |
+
"back_right_ankle_torque",
|
| 151 |
+
"front_left_hip_torque",
|
| 152 |
+
"front_left_ankle_torque",
|
| 153 |
+
"front_right_hip_torque",
|
| 154 |
+
"front_right_ankle_torque",
|
| 155 |
+
"back_left_hip_torque",
|
| 156 |
+
"back_left_ankle_torque"
|
| 157 |
+
],
|
| 158 |
+
"low": [
|
| 159 |
+
-1.0,
|
| 160 |
+
-1.0,
|
| 161 |
+
-1.0,
|
| 162 |
+
-1.0,
|
| 163 |
+
-1.0,
|
| 164 |
+
-1.0,
|
| 165 |
+
-1.0,
|
| 166 |
+
-1.0
|
| 167 |
+
],
|
| 168 |
+
"type": "box"
|
| 169 |
+
},
|
| 170 |
+
"base_prompt": "Make the Ant move forward as fast as possible without falling. Predict eight continuous torques in [-1, 1] ordered as back right hip, back right ankle, front left hip, front left ankle, front right hip, front right ankle, back left hip, and back left ankle.",
|
| 171 |
+
"env_fps": 5.0,
|
| 172 |
+
"env_id": "LatencyBench/AntContinuous-v0",
|
| 173 |
+
"frame_stack": 1,
|
| 174 |
+
"make_kwargs": {
|
| 175 |
+
"base_env_id": "Ant-v4",
|
| 176 |
+
"base_make_kwargs": {
|
| 177 |
+
"exclude_current_positions_from_observation": true,
|
| 178 |
+
"use_contact_forces": false
|
| 179 |
+
},
|
| 180 |
+
"render_mode": "rgb_array"
|
| 181 |
+
},
|
| 182 |
+
"noop_action": [
|
| 183 |
+
0.0,
|
| 184 |
+
0.0,
|
| 185 |
+
0.0,
|
| 186 |
+
0.0,
|
| 187 |
+
0.0,
|
| 188 |
+
0.0,
|
| 189 |
+
0.0,
|
| 190 |
+
0.0
|
| 191 |
+
],
|
| 192 |
+
"obs_fps": 5.0,
|
| 193 |
+
"registration_imports": [
|
| 194 |
+
"latency_bench.envs.gymnasium_ant"
|
| 195 |
+
],
|
| 196 |
+
"state_space": {
|
| 197 |
+
"labels": [
|
| 198 |
+
"torso_z",
|
| 199 |
+
"torso_quaternion_w",
|
| 200 |
+
"torso_quaternion_x",
|
| 201 |
+
"torso_quaternion_y",
|
| 202 |
+
"torso_quaternion_z",
|
| 203 |
+
"front_left_hip_angle",
|
| 204 |
+
"front_left_ankle_angle",
|
| 205 |
+
"front_right_hip_angle",
|
| 206 |
+
"front_right_ankle_angle",
|
| 207 |
+
"back_left_hip_angle",
|
| 208 |
+
"back_left_ankle_angle",
|
| 209 |
+
"back_right_hip_angle",
|
| 210 |
+
"back_right_ankle_angle",
|
| 211 |
+
"torso_x_velocity",
|
| 212 |
+
"torso_y_velocity",
|
| 213 |
+
"torso_z_velocity",
|
| 214 |
+
"torso_angular_velocity_x",
|
| 215 |
+
"torso_angular_velocity_y",
|
| 216 |
+
"torso_angular_velocity_z",
|
| 217 |
+
"front_left_hip_angular_velocity",
|
| 218 |
+
"front_left_ankle_angular_velocity",
|
| 219 |
+
"front_right_hip_angular_velocity",
|
| 220 |
+
"front_right_ankle_angular_velocity",
|
| 221 |
+
"back_left_hip_angular_velocity",
|
| 222 |
+
"back_left_ankle_angular_velocity",
|
| 223 |
+
"back_right_hip_angular_velocity",
|
| 224 |
+
"back_right_ankle_angular_velocity"
|
| 225 |
+
]
|
| 226 |
+
},
|
| 227 |
+
"task_name": "ant"
|
| 228 |
+
},
|
| 229 |
+
"validation_dataset_name": "ant_h1_5fps_profile__val",
|
| 230 |
+
"validation_episodes": 10,
|
| 231 |
+
"validation_frames": 9757
|
| 232 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/provenance.json
ADDED
|
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"task": "ant",
|
| 3 |
+
"model": "qwenpi_v3",
|
| 4 |
+
"training_condition": "latency-aware",
|
| 5 |
+
"training_run_id": "ant_pi05_profile_h1_5fps_g128_20260920",
|
| 6 |
+
"source": {
|
| 7 |
+
"repo_id": "latency-sensitive-bench/Standard-Pipeline",
|
| 8 |
+
"revision": "2208875f92b21e3f8ec2363a30a6705dfe56cc04",
|
| 9 |
+
"path": "ant/profile_latency/Pi05",
|
| 10 |
+
"url": "https://huggingface.co/latency-sensitive-bench/Standard-Pipeline/tree/2208875f92b21e3f8ec2363a30a6705dfe56cc04/ant/profile_latency/Pi05"
|
| 11 |
+
},
|
| 12 |
+
"hf_repo_id": "latency-sensitive-bench/benchmark-models",
|
| 13 |
+
"hf_path": "latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920",
|
| 14 |
+
"checkpoint": {
|
| 15 |
+
"source_file": "ant/profile_latency/Pi05/checkpoints/model.pt",
|
| 16 |
+
"source_sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 17 |
+
"source_bytes": 10922682525,
|
| 18 |
+
"file": "checkpoints/model.pt",
|
| 19 |
+
"selection_rule": "only published VLA checkpoint",
|
| 20 |
+
"method": "copy",
|
| 21 |
+
"sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 22 |
+
"bytes": 10922682525
|
| 23 |
+
},
|
| 24 |
+
"config_source": "ant/profile_latency/Pi05/config.yaml",
|
| 25 |
+
"task_contract_file": "task_contract.json",
|
| 26 |
+
"missing_source_files": [],
|
| 27 |
+
"migration": {
|
| 28 |
+
"operation": "copy_selected_inference_bundle",
|
| 29 |
+
"source_modified": false,
|
| 30 |
+
"evaluation_performed": false,
|
| 31 |
+
"experiment_status": "preserved_in_source_evidence"
|
| 32 |
+
},
|
| 33 |
+
"action_horizon": 1
|
| 34 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/source/README.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Ant Pi0.5 — profile latency closeout
|
| 2 |
+
|
| 3 |
+
This profile-latency model is the fresh QwenPI_v3 Ant H1/5FPS training result, with native state27/action8 and the published checkpoint SHA `01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f`. The original package validation remains CPU tensor and bundle verification; that historical record continues to state that an independent saved-model GPU forward was not run.
|
| 4 |
+
|
| 5 |
+
A separate F20 deployment audit exercised this fixed published bundle on seeds42–61 at measured 5/5FPS latency, cap1000, native state/action contracts. It audited 20 complete traces and is published at dataset revision `591db41843567bf4a1946ddfe66d2f51aaf8d7c6` with F mean `1774.711677` and B/F paired comparison in `evaluation/comparison.json`. The F audit has no equal-delay or architecture-ranking causal scope.
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/source/provenance.json
ADDED
|
@@ -0,0 +1,562 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"task": "ant",
|
| 3 |
+
"backbone": {
|
| 4 |
+
"repo_id": "Qwen/Qwen3-VL-4B-Instruct",
|
| 5 |
+
"revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17"
|
| 6 |
+
},
|
| 7 |
+
"checkpoint": "steps_5000_pytorch_model.pt",
|
| 8 |
+
"training_steps": 5000,
|
| 9 |
+
"seed": 42,
|
| 10 |
+
"global_batch": 128,
|
| 11 |
+
"training_run_id": "ant_pi05_profile_h1_5fps_g128_20260920",
|
| 12 |
+
"condition": "profile_latency",
|
| 13 |
+
"source": {
|
| 14 |
+
"task": "ant",
|
| 15 |
+
"backbone": {
|
| 16 |
+
"repo_id": "Qwen/Qwen3-VL-4B-Instruct",
|
| 17 |
+
"revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17"
|
| 18 |
+
},
|
| 19 |
+
"teacher": {
|
| 20 |
+
"state": "TEACHER_FULL_TRACE_AUDIT_PASSED",
|
| 21 |
+
"verified_at": "2026-09-21T06:03:32.767075+00:00",
|
| 22 |
+
"run": "h1_5fps_g128_20260920",
|
| 23 |
+
"env_fps": 5,
|
| 24 |
+
"obs_fps": 5,
|
| 25 |
+
"raw_frames_per_training_decision": 1,
|
| 26 |
+
"budget_counted_env_steps": 10000000,
|
| 27 |
+
"actual_env_steps": 10002432,
|
| 28 |
+
"seed": 2222,
|
| 29 |
+
"profile_sha256": "19534f5cce184dd4987b8234b7d712851caef92c2ea7ca0451d8d5aa90cd850c",
|
| 30 |
+
"source_profile_capture_fps": [
|
| 31 |
+
5,
|
| 32 |
+
5
|
| 33 |
+
],
|
| 34 |
+
"profile_ms_rescaled": false,
|
| 35 |
+
"selection": {
|
| 36 |
+
"selected": "final",
|
| 37 |
+
"candidates": {
|
| 38 |
+
"final": {
|
| 39 |
+
"checkpoint": "${PI05_RUN_DIR}/profile_latency/teacher/checkpoints/ant_pi05_profile_appo_h1_5fps_g128_20260920/checkpoint_p0/checkpoint_000019536_10002432.pth",
|
| 40 |
+
"sha256": "bd40c91b4d7cbcd74b60b240638b1587e3269e93ace6fe41166c25c60da4181f",
|
| 41 |
+
"episodes": 20,
|
| 42 |
+
"seeds": [
|
| 43 |
+
104771,
|
| 44 |
+
104772,
|
| 45 |
+
104773,
|
| 46 |
+
104774,
|
| 47 |
+
104775,
|
| 48 |
+
104776,
|
| 49 |
+
104777,
|
| 50 |
+
104778,
|
| 51 |
+
104779,
|
| 52 |
+
104780,
|
| 53 |
+
104781,
|
| 54 |
+
104782,
|
| 55 |
+
104783,
|
| 56 |
+
104784,
|
| 57 |
+
104785,
|
| 58 |
+
104786,
|
| 59 |
+
104787,
|
| 60 |
+
104788,
|
| 61 |
+
104789,
|
| 62 |
+
104790
|
| 63 |
+
],
|
| 64 |
+
"returns": [
|
| 65 |
+
4387.684316148426,
|
| 66 |
+
4506.74232190309,
|
| 67 |
+
4479.172451874021,
|
| 68 |
+
4389.610530796052,
|
| 69 |
+
4527.969076051201,
|
| 70 |
+
4532.91391579832,
|
| 71 |
+
4480.349285462922,
|
| 72 |
+
4648.747994777685,
|
| 73 |
+
4536.536483122084,
|
| 74 |
+
4485.51685443897,
|
| 75 |
+
4460.708050489044,
|
| 76 |
+
4419.17757232338,
|
| 77 |
+
4393.322009171424,
|
| 78 |
+
4492.807308077739,
|
| 79 |
+
4510.353408400214,
|
| 80 |
+
4407.056274506973,
|
| 81 |
+
4576.498658344057,
|
| 82 |
+
4466.795111615093,
|
| 83 |
+
4342.463588897995,
|
| 84 |
+
4449.385739559862
|
| 85 |
+
],
|
| 86 |
+
"mean": 4474.6905475879275,
|
| 87 |
+
"population_std": 71.05590293801662,
|
| 88 |
+
"strict_gt3000": 20
|
| 89 |
+
},
|
| 90 |
+
"training_best": {
|
| 91 |
+
"checkpoint": "${PI05_RUN_DIR}/profile_latency/teacher/checkpoints/ant_pi05_profile_appo_h1_5fps_g128_20260920/checkpoint_p0/best_000019536_10002432_reward_3737.439.pth",
|
| 92 |
+
"sha256": "4ffd8b0969e7c68515561cef98f5364cf0535a4d1edd46d9d15fc4b645d4aa4d",
|
| 93 |
+
"episodes": 20,
|
| 94 |
+
"seeds": [
|
| 95 |
+
104771,
|
| 96 |
+
104772,
|
| 97 |
+
104773,
|
| 98 |
+
104774,
|
| 99 |
+
104775,
|
| 100 |
+
104776,
|
| 101 |
+
104777,
|
| 102 |
+
104778,
|
| 103 |
+
104779,
|
| 104 |
+
104780,
|
| 105 |
+
104781,
|
| 106 |
+
104782,
|
| 107 |
+
104783,
|
| 108 |
+
104784,
|
| 109 |
+
104785,
|
| 110 |
+
104786,
|
| 111 |
+
104787,
|
| 112 |
+
104788,
|
| 113 |
+
104789,
|
| 114 |
+
104790
|
| 115 |
+
],
|
| 116 |
+
"returns": [
|
| 117 |
+
4387.684316148426,
|
| 118 |
+
4506.74232190309,
|
| 119 |
+
4479.172451874021,
|
| 120 |
+
4389.610530796052,
|
| 121 |
+
4527.969076051201,
|
| 122 |
+
4532.91391579832,
|
| 123 |
+
4480.349285462922,
|
| 124 |
+
4648.747994777685,
|
| 125 |
+
4536.536483122084,
|
| 126 |
+
4485.51685443897,
|
| 127 |
+
4460.708050489044,
|
| 128 |
+
4419.17757232338,
|
| 129 |
+
4393.322009171424,
|
| 130 |
+
4492.807308077739,
|
| 131 |
+
4510.353408400214,
|
| 132 |
+
4407.056274506973,
|
| 133 |
+
4576.498658344057,
|
| 134 |
+
4466.795111615093,
|
| 135 |
+
4342.463588897995,
|
| 136 |
+
4449.385739559862
|
| 137 |
+
],
|
| 138 |
+
"mean": 4474.6905475879275,
|
| 139 |
+
"population_std": 71.05590293801662,
|
| 140 |
+
"strict_gt3000": 20
|
| 141 |
+
}
|
| 142 |
+
},
|
| 143 |
+
"completed_at": "2026-09-21T05:54:05.270163+00:00"
|
| 144 |
+
},
|
| 145 |
+
"evaluations": {
|
| 146 |
+
"selection_final": {
|
| 147 |
+
"episodes": 20,
|
| 148 |
+
"seeds": [
|
| 149 |
+
104771,
|
| 150 |
+
104772,
|
| 151 |
+
104773,
|
| 152 |
+
104774,
|
| 153 |
+
104775,
|
| 154 |
+
104776,
|
| 155 |
+
104777,
|
| 156 |
+
104778,
|
| 157 |
+
104779,
|
| 158 |
+
104780,
|
| 159 |
+
104781,
|
| 160 |
+
104782,
|
| 161 |
+
104783,
|
| 162 |
+
104784,
|
| 163 |
+
104785,
|
| 164 |
+
104786,
|
| 165 |
+
104787,
|
| 166 |
+
104788,
|
| 167 |
+
104789,
|
| 168 |
+
104790
|
| 169 |
+
],
|
| 170 |
+
"returns": [
|
| 171 |
+
4387.684316148426,
|
| 172 |
+
4506.74232190309,
|
| 173 |
+
4479.172451874021,
|
| 174 |
+
4389.610530796052,
|
| 175 |
+
4527.969076051201,
|
| 176 |
+
4532.91391579832,
|
| 177 |
+
4480.349285462922,
|
| 178 |
+
4648.747994777685,
|
| 179 |
+
4536.536483122084,
|
| 180 |
+
4485.51685443897,
|
| 181 |
+
4460.708050489044,
|
| 182 |
+
4419.17757232338,
|
| 183 |
+
4393.322009171424,
|
| 184 |
+
4492.807308077739,
|
| 185 |
+
4510.353408400214,
|
| 186 |
+
4407.056274506973,
|
| 187 |
+
4576.498658344057,
|
| 188 |
+
4466.795111615093,
|
| 189 |
+
4342.463588897995,
|
| 190 |
+
4449.385739559862
|
| 191 |
+
],
|
| 192 |
+
"lengths": [
|
| 193 |
+
1000,
|
| 194 |
+
1000,
|
| 195 |
+
1000,
|
| 196 |
+
1000,
|
| 197 |
+
1000,
|
| 198 |
+
1000,
|
| 199 |
+
1000,
|
| 200 |
+
1000,
|
| 201 |
+
1000,
|
| 202 |
+
1000,
|
| 203 |
+
1000,
|
| 204 |
+
1000,
|
| 205 |
+
1000,
|
| 206 |
+
1000,
|
| 207 |
+
1000,
|
| 208 |
+
1000,
|
| 209 |
+
1000,
|
| 210 |
+
1000,
|
| 211 |
+
1000,
|
| 212 |
+
1000
|
| 213 |
+
],
|
| 214 |
+
"mean_return": 4474.6905475879275,
|
| 215 |
+
"population_std_return": 71.05590293801663,
|
| 216 |
+
"mean_length": 1000.0,
|
| 217 |
+
"raw_steps": 20000,
|
| 218 |
+
"cap_episodes": 20,
|
| 219 |
+
"mean_of_episode_latency_ms": 145.46123989918118,
|
| 220 |
+
"action_weighted_mean_latency_ms": 145.46123989918115,
|
| 221 |
+
"action_latency_p95_ms": 151.58370965278118,
|
| 222 |
+
"actions": 20000,
|
| 223 |
+
"invalid_actions": 0,
|
| 224 |
+
"dropped_actions": 0,
|
| 225 |
+
"submitted_observations": 20000,
|
| 226 |
+
"dropped_observations": 0,
|
| 227 |
+
"observation_opportunities": 20000,
|
| 228 |
+
"observation_drop_fraction": 0.0,
|
| 229 |
+
"raw_rewards_lengths_and_admission_counters_match": true,
|
| 230 |
+
"raw_step_indices_and_clock_verified": true,
|
| 231 |
+
"mode": "profile_sample",
|
| 232 |
+
"config_sha256": "33ad9f282ca42be2a0bcacaffeb8d480a24be09caa2dac044e2699f1d48c2b54",
|
| 233 |
+
"strict_gt3000": 20,
|
| 234 |
+
"commands_requiring_native_clip": 0,
|
| 235 |
+
"state_contract": "State27 bound to native config/checkpoint and prior environment preflight; no per-step state vector claim."
|
| 236 |
+
},
|
| 237 |
+
"selection_training_best": {
|
| 238 |
+
"episodes": 20,
|
| 239 |
+
"seeds": [
|
| 240 |
+
104771,
|
| 241 |
+
104772,
|
| 242 |
+
104773,
|
| 243 |
+
104774,
|
| 244 |
+
104775,
|
| 245 |
+
104776,
|
| 246 |
+
104777,
|
| 247 |
+
104778,
|
| 248 |
+
104779,
|
| 249 |
+
104780,
|
| 250 |
+
104781,
|
| 251 |
+
104782,
|
| 252 |
+
104783,
|
| 253 |
+
104784,
|
| 254 |
+
104785,
|
| 255 |
+
104786,
|
| 256 |
+
104787,
|
| 257 |
+
104788,
|
| 258 |
+
104789,
|
| 259 |
+
104790
|
| 260 |
+
],
|
| 261 |
+
"returns": [
|
| 262 |
+
4387.684316148426,
|
| 263 |
+
4506.74232190309,
|
| 264 |
+
4479.172451874021,
|
| 265 |
+
4389.610530796052,
|
| 266 |
+
4527.969076051201,
|
| 267 |
+
4532.91391579832,
|
| 268 |
+
4480.349285462922,
|
| 269 |
+
4648.747994777685,
|
| 270 |
+
4536.536483122084,
|
| 271 |
+
4485.51685443897,
|
| 272 |
+
4460.708050489044,
|
| 273 |
+
4419.17757232338,
|
| 274 |
+
4393.322009171424,
|
| 275 |
+
4492.807308077739,
|
| 276 |
+
4510.353408400214,
|
| 277 |
+
4407.056274506973,
|
| 278 |
+
4576.498658344057,
|
| 279 |
+
4466.795111615093,
|
| 280 |
+
4342.463588897995,
|
| 281 |
+
4449.385739559862
|
| 282 |
+
],
|
| 283 |
+
"lengths": [
|
| 284 |
+
1000,
|
| 285 |
+
1000,
|
| 286 |
+
1000,
|
| 287 |
+
1000,
|
| 288 |
+
1000,
|
| 289 |
+
1000,
|
| 290 |
+
1000,
|
| 291 |
+
1000,
|
| 292 |
+
1000,
|
| 293 |
+
1000,
|
| 294 |
+
1000,
|
| 295 |
+
1000,
|
| 296 |
+
1000,
|
| 297 |
+
1000,
|
| 298 |
+
1000,
|
| 299 |
+
1000,
|
| 300 |
+
1000,
|
| 301 |
+
1000,
|
| 302 |
+
1000,
|
| 303 |
+
1000
|
| 304 |
+
],
|
| 305 |
+
"mean_return": 4474.6905475879275,
|
| 306 |
+
"population_std_return": 71.05590293801663,
|
| 307 |
+
"mean_length": 1000.0,
|
| 308 |
+
"raw_steps": 20000,
|
| 309 |
+
"cap_episodes": 20,
|
| 310 |
+
"mean_of_episode_latency_ms": 145.46123989918118,
|
| 311 |
+
"action_weighted_mean_latency_ms": 145.46123989918115,
|
| 312 |
+
"action_latency_p95_ms": 151.58370965278118,
|
| 313 |
+
"actions": 20000,
|
| 314 |
+
"invalid_actions": 0,
|
| 315 |
+
"dropped_actions": 0,
|
| 316 |
+
"submitted_observations": 20000,
|
| 317 |
+
"dropped_observations": 0,
|
| 318 |
+
"observation_opportunities": 20000,
|
| 319 |
+
"observation_drop_fraction": 0.0,
|
| 320 |
+
"raw_rewards_lengths_and_admission_counters_match": true,
|
| 321 |
+
"raw_step_indices_and_clock_verified": true,
|
| 322 |
+
"mode": "profile_sample",
|
| 323 |
+
"config_sha256": "9b8c6ef91a10ed0a709a3a18a52a863417f8459416f9de2d2674005fc885d42a",
|
| 324 |
+
"strict_gt3000": 20,
|
| 325 |
+
"commands_requiring_native_clip": 0,
|
| 326 |
+
"state_contract": "State27 bound to native config/checkpoint and prior environment preflight; no per-step state vector claim."
|
| 327 |
+
},
|
| 328 |
+
"E10": {
|
| 329 |
+
"episodes": 10,
|
| 330 |
+
"seeds": [
|
| 331 |
+
104771,
|
| 332 |
+
104772,
|
| 333 |
+
104773,
|
| 334 |
+
104774,
|
| 335 |
+
104775,
|
| 336 |
+
104776,
|
| 337 |
+
104777,
|
| 338 |
+
104778,
|
| 339 |
+
104779,
|
| 340 |
+
104780
|
| 341 |
+
],
|
| 342 |
+
"returns": [
|
| 343 |
+
4387.684316148426,
|
| 344 |
+
4506.74232190309,
|
| 345 |
+
4479.172451874021,
|
| 346 |
+
4389.610530796052,
|
| 347 |
+
4527.969076051201,
|
| 348 |
+
4532.91391579832,
|
| 349 |
+
4480.349285462922,
|
| 350 |
+
4648.747994777685,
|
| 351 |
+
4536.536483122084,
|
| 352 |
+
4485.51685443897
|
| 353 |
+
],
|
| 354 |
+
"lengths": [
|
| 355 |
+
1000,
|
| 356 |
+
1000,
|
| 357 |
+
1000,
|
| 358 |
+
1000,
|
| 359 |
+
1000,
|
| 360 |
+
1000,
|
| 361 |
+
1000,
|
| 362 |
+
1000,
|
| 363 |
+
1000,
|
| 364 |
+
1000
|
| 365 |
+
],
|
| 366 |
+
"mean_return": 4497.524323037277,
|
| 367 |
+
"population_std_return": 71.51292984931624,
|
| 368 |
+
"mean_length": 1000.0,
|
| 369 |
+
"raw_steps": 10000,
|
| 370 |
+
"cap_episodes": 10,
|
| 371 |
+
"mean_of_episode_latency_ms": 145.47968413719246,
|
| 372 |
+
"action_weighted_mean_latency_ms": 145.47968413719244,
|
| 373 |
+
"action_latency_p95_ms": 151.63293832470646,
|
| 374 |
+
"actions": 10000,
|
| 375 |
+
"invalid_actions": 0,
|
| 376 |
+
"dropped_actions": 0,
|
| 377 |
+
"submitted_observations": 10000,
|
| 378 |
+
"dropped_observations": 0,
|
| 379 |
+
"observation_opportunities": 10000,
|
| 380 |
+
"observation_drop_fraction": 0.0,
|
| 381 |
+
"raw_rewards_lengths_and_admission_counters_match": true,
|
| 382 |
+
"raw_step_indices_and_clock_verified": true,
|
| 383 |
+
"mode": "profile_sample",
|
| 384 |
+
"config_sha256": "61915ecb228b9ade648570a82164f7007ba7071f138c39b2fcc975bd9442b22d",
|
| 385 |
+
"strict_gt3000": 10,
|
| 386 |
+
"commands_requiring_native_clip": 0,
|
| 387 |
+
"state_contract": "State27 bound to native config/checkpoint and prior environment preflight; no per-step state vector claim."
|
| 388 |
+
}
|
| 389 |
+
},
|
| 390 |
+
"probe": {
|
| 391 |
+
"source_state_sha256": "55b41a8afec1f04cc93fcd0ce889e5862d4ded18a0a9ed0c12b6a79af0f9d589",
|
| 392 |
+
"attempts": 12,
|
| 393 |
+
"accepted": 12,
|
| 394 |
+
"rejected": 0,
|
| 395 |
+
"accepted_specs": [
|
| 396 |
+
{
|
| 397 |
+
"attempt_idx": 0,
|
| 398 |
+
"episode_idx": 0,
|
| 399 |
+
"episode_length": 1000,
|
| 400 |
+
"episode_raw_frames": 1000,
|
| 401 |
+
"episode_raw_return": 4303.197367310524,
|
| 402 |
+
"seed": 2222,
|
| 403 |
+
"split": "train"
|
| 404 |
+
},
|
| 405 |
+
{
|
| 406 |
+
"attempt_idx": 1,
|
| 407 |
+
"episode_idx": 1,
|
| 408 |
+
"episode_length": 1000,
|
| 409 |
+
"episode_raw_frames": 1000,
|
| 410 |
+
"episode_raw_return": 4538.047294437885,
|
| 411 |
+
"seed": 2223,
|
| 412 |
+
"split": "val"
|
| 413 |
+
},
|
| 414 |
+
{
|
| 415 |
+
"attempt_idx": 2,
|
| 416 |
+
"episode_idx": 2,
|
| 417 |
+
"episode_length": 1000,
|
| 418 |
+
"episode_raw_frames": 1000,
|
| 419 |
+
"episode_raw_return": 4552.908017247915,
|
| 420 |
+
"seed": 2224,
|
| 421 |
+
"split": "train"
|
| 422 |
+
},
|
| 423 |
+
{
|
| 424 |
+
"attempt_idx": 3,
|
| 425 |
+
"episode_idx": 3,
|
| 426 |
+
"episode_length": 1000,
|
| 427 |
+
"episode_raw_frames": 1000,
|
| 428 |
+
"episode_raw_return": 4452.552011370659,
|
| 429 |
+
"seed": 2225,
|
| 430 |
+
"split": "val"
|
| 431 |
+
},
|
| 432 |
+
{
|
| 433 |
+
"attempt_idx": 4,
|
| 434 |
+
"episode_idx": 4,
|
| 435 |
+
"episode_length": 1000,
|
| 436 |
+
"episode_raw_frames": 1000,
|
| 437 |
+
"episode_raw_return": 4484.449267148972,
|
| 438 |
+
"seed": 2226,
|
| 439 |
+
"split": "train"
|
| 440 |
+
},
|
| 441 |
+
{
|
| 442 |
+
"attempt_idx": 5,
|
| 443 |
+
"episode_idx": 5,
|
| 444 |
+
"episode_length": 1000,
|
| 445 |
+
"episode_raw_frames": 1000,
|
| 446 |
+
"episode_raw_return": 4352.745992147713,
|
| 447 |
+
"seed": 2227,
|
| 448 |
+
"split": "train"
|
| 449 |
+
},
|
| 450 |
+
{
|
| 451 |
+
"attempt_idx": 6,
|
| 452 |
+
"episode_idx": 6,
|
| 453 |
+
"episode_length": 1000,
|
| 454 |
+
"episode_raw_frames": 1000,
|
| 455 |
+
"episode_raw_return": 4649.359137028456,
|
| 456 |
+
"seed": 2228,
|
| 457 |
+
"split": "train"
|
| 458 |
+
},
|
| 459 |
+
{
|
| 460 |
+
"attempt_idx": 7,
|
| 461 |
+
"episode_idx": 7,
|
| 462 |
+
"episode_length": 1000,
|
| 463 |
+
"episode_raw_frames": 1000,
|
| 464 |
+
"episode_raw_return": 4498.849343210459,
|
| 465 |
+
"seed": 2229,
|
| 466 |
+
"split": "val"
|
| 467 |
+
},
|
| 468 |
+
{
|
| 469 |
+
"attempt_idx": 8,
|
| 470 |
+
"episode_idx": 8,
|
| 471 |
+
"episode_length": 1000,
|
| 472 |
+
"episode_raw_frames": 1000,
|
| 473 |
+
"episode_raw_return": 4381.613434404135,
|
| 474 |
+
"seed": 2230,
|
| 475 |
+
"split": "train"
|
| 476 |
+
},
|
| 477 |
+
{
|
| 478 |
+
"attempt_idx": 9,
|
| 479 |
+
"episode_idx": 9,
|
| 480 |
+
"episode_length": 1000,
|
| 481 |
+
"episode_raw_frames": 1000,
|
| 482 |
+
"episode_raw_return": 4592.18594032526,
|
| 483 |
+
"seed": 2231,
|
| 484 |
+
"split": "train"
|
| 485 |
+
},
|
| 486 |
+
{
|
| 487 |
+
"attempt_idx": 10,
|
| 488 |
+
"episode_idx": 10,
|
| 489 |
+
"episode_length": 1000,
|
| 490 |
+
"episode_raw_frames": 1000,
|
| 491 |
+
"episode_raw_return": 4324.289011418819,
|
| 492 |
+
"seed": 2232,
|
| 493 |
+
"split": "train"
|
| 494 |
+
},
|
| 495 |
+
{
|
| 496 |
+
"attempt_idx": 11,
|
| 497 |
+
"episode_idx": 11,
|
| 498 |
+
"episode_length": 1000,
|
| 499 |
+
"episode_raw_frames": 1000,
|
| 500 |
+
"episode_raw_return": 4577.22168815136,
|
| 501 |
+
"seed": 2233,
|
| 502 |
+
"split": "train"
|
| 503 |
+
}
|
| 504 |
+
]
|
| 505 |
+
},
|
| 506 |
+
"strict_gate": ">3000",
|
| 507 |
+
"E10_seed_caveat": "E10 repeats the first10selection seeds, not independent evaluation",
|
| 508 |
+
"raw_budget_caveat": "Actual counted envsteps are read from Final checkpoint, not W&B telemetry; target10M atstride1.",
|
| 509 |
+
"downstream": "After positive12attemptprobe,100accepted strict>3000 within120TOTALincludingprobe12,actualreplayQA,freshPi05global128/micro32/acc2/GCfalse/ZeRO2/5000updates,andRTX3090F20; otherwise scientificstop",
|
| 510 |
+
"environment_preflight_sha256": "a6aab1ec52c552f83efdac6cf5d24901f5a3e42479aa7a00ee5a37550c3e2b59",
|
| 511 |
+
"source_P_verification_sha256": "008bf81ff19b73e6c6ca81752be4d5cab95be2626536ee20835b23880cd278fa",
|
| 512 |
+
"gate": "PASSED"
|
| 513 |
+
},
|
| 514 |
+
"profile_sha256": "19534f5cce184dd4987b8234b7d712851caef92c2ea7ca0451d8d5aa90cd850c",
|
| 515 |
+
"probe_anchors_sha256": "738da45fe09135d0357c35f9c9e49cf5b8c9bedd8e2ca366d065fb2d46051b1f",
|
| 516 |
+
"dataset": {
|
| 517 |
+
"attempts": 101,
|
| 518 |
+
"accepted": 100,
|
| 519 |
+
"max_total_attempts": 120,
|
| 520 |
+
"splits": {
|
| 521 |
+
"train": {
|
| 522 |
+
"rows": 89808,
|
| 523 |
+
"episodes": 90,
|
| 524 |
+
"return_min": 3643.214549936354,
|
| 525 |
+
"action_min": -0.9429033994674683,
|
| 526 |
+
"action_max": 0.9785619378089905
|
| 527 |
+
},
|
| 528 |
+
"val": {
|
| 529 |
+
"rows": 9757,
|
| 530 |
+
"episodes": 10,
|
| 531 |
+
"return_min": 3314.8423104584217,
|
| 532 |
+
"action_min": -0.9211073517799377,
|
| 533 |
+
"action_max": 0.9520043134689331
|
| 534 |
+
}
|
| 535 |
+
},
|
| 536 |
+
"sha256": {
|
| 537 |
+
"metadata.json": "8d3f1b02ee54ad97283b03392bd5529d72a4b2dfa9f94229db7e9c4e628d88d6",
|
| 538 |
+
"train.parquet": "5bbd64c7d8052722cff5a8efd5369d5ab9078db9e0307105e202fc7b15bfb8f6",
|
| 539 |
+
"val.parquet": "8e6b6c4bdb705d273e1e56ca6e94db22f835d969a391fa6a8f0a7045d0f8ddac"
|
| 540 |
+
}
|
| 541 |
+
},
|
| 542 |
+
"evaluation_prompt_keys": [
|
| 543 |
+
"1"
|
| 544 |
+
],
|
| 545 |
+
"global_batch": 128,
|
| 546 |
+
"micro_batch": 32,
|
| 547 |
+
"accumulation": 2,
|
| 548 |
+
"gradient_checkpointing": false,
|
| 549 |
+
"zero_stage": 2,
|
| 550 |
+
"hardware_allocation": {
|
| 551 |
+
"physical_gpu_indices": [
|
| 552 |
+
4,
|
| 553 |
+
5
|
| 554 |
+
],
|
| 555 |
+
"gpu_type": "H200",
|
| 556 |
+
"gpus": 2,
|
| 557 |
+
"reason": "Coordinator reallocated same2H200 recipe from occupied6/7 to idle4/5; scientifichyperparameters unchanged"
|
| 558 |
+
}
|
| 559 |
+
},
|
| 560 |
+
"training_config_sha256": "8fcc1fdca9a567462f38a896ed3d0bf6c830b1bf4842236a07b2381d943962c2",
|
| 561 |
+
"dataset_manifest_sha256": "e48b48b325cdf8253c1559bd411e23ef7961531c442df69f8a47be0a2cead11b"
|
| 562 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/task_contract.json
ADDED
|
@@ -0,0 +1,94 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"action_space": {
|
| 3 |
+
"dtype": "float32",
|
| 4 |
+
"high": [
|
| 5 |
+
1.0,
|
| 6 |
+
1.0,
|
| 7 |
+
1.0,
|
| 8 |
+
1.0,
|
| 9 |
+
1.0,
|
| 10 |
+
1.0,
|
| 11 |
+
1.0,
|
| 12 |
+
1.0
|
| 13 |
+
],
|
| 14 |
+
"labels": [
|
| 15 |
+
"back_right_hip_torque",
|
| 16 |
+
"back_right_ankle_torque",
|
| 17 |
+
"front_left_hip_torque",
|
| 18 |
+
"front_left_ankle_torque",
|
| 19 |
+
"front_right_hip_torque",
|
| 20 |
+
"front_right_ankle_torque",
|
| 21 |
+
"back_left_hip_torque",
|
| 22 |
+
"back_left_ankle_torque"
|
| 23 |
+
],
|
| 24 |
+
"low": [
|
| 25 |
+
-1.0,
|
| 26 |
+
-1.0,
|
| 27 |
+
-1.0,
|
| 28 |
+
-1.0,
|
| 29 |
+
-1.0,
|
| 30 |
+
-1.0,
|
| 31 |
+
-1.0,
|
| 32 |
+
-1.0
|
| 33 |
+
],
|
| 34 |
+
"type": "box"
|
| 35 |
+
},
|
| 36 |
+
"base_prompt": "Make the Ant move forward as fast as possible without falling. Predict eight continuous torques in [-1, 1] ordered as back right hip, back right ankle, front left hip, front left ankle, front right hip, front right ankle, back left hip, and back left ankle.",
|
| 37 |
+
"env_fps": 5.0,
|
| 38 |
+
"env_id": "LatencyBench/AntContinuous-v0",
|
| 39 |
+
"frame_stack": 1,
|
| 40 |
+
"make_kwargs": {
|
| 41 |
+
"base_env_id": "Ant-v4",
|
| 42 |
+
"base_make_kwargs": {
|
| 43 |
+
"exclude_current_positions_from_observation": true,
|
| 44 |
+
"use_contact_forces": false
|
| 45 |
+
},
|
| 46 |
+
"render_mode": "rgb_array"
|
| 47 |
+
},
|
| 48 |
+
"noop_action": [
|
| 49 |
+
0.0,
|
| 50 |
+
0.0,
|
| 51 |
+
0.0,
|
| 52 |
+
0.0,
|
| 53 |
+
0.0,
|
| 54 |
+
0.0,
|
| 55 |
+
0.0,
|
| 56 |
+
0.0
|
| 57 |
+
],
|
| 58 |
+
"obs_fps": 5.0,
|
| 59 |
+
"registration_imports": [
|
| 60 |
+
"latency_bench.envs.gymnasium_ant"
|
| 61 |
+
],
|
| 62 |
+
"state_space": {
|
| 63 |
+
"labels": [
|
| 64 |
+
"torso_z",
|
| 65 |
+
"torso_quaternion_w",
|
| 66 |
+
"torso_quaternion_x",
|
| 67 |
+
"torso_quaternion_y",
|
| 68 |
+
"torso_quaternion_z",
|
| 69 |
+
"front_left_hip_angle",
|
| 70 |
+
"front_left_ankle_angle",
|
| 71 |
+
"front_right_hip_angle",
|
| 72 |
+
"front_right_ankle_angle",
|
| 73 |
+
"back_left_hip_angle",
|
| 74 |
+
"back_left_ankle_angle",
|
| 75 |
+
"back_right_hip_angle",
|
| 76 |
+
"back_right_ankle_angle",
|
| 77 |
+
"torso_x_velocity",
|
| 78 |
+
"torso_y_velocity",
|
| 79 |
+
"torso_z_velocity",
|
| 80 |
+
"torso_angular_velocity_x",
|
| 81 |
+
"torso_angular_velocity_y",
|
| 82 |
+
"torso_angular_velocity_z",
|
| 83 |
+
"front_left_hip_angular_velocity",
|
| 84 |
+
"front_left_ankle_angular_velocity",
|
| 85 |
+
"front_right_hip_angular_velocity",
|
| 86 |
+
"front_right_ankle_angular_velocity",
|
| 87 |
+
"back_left_hip_angular_velocity",
|
| 88 |
+
"back_left_ankle_angular_velocity",
|
| 89 |
+
"back_right_hip_angular_velocity",
|
| 90 |
+
"back_right_ankle_angular_velocity"
|
| 91 |
+
]
|
| 92 |
+
},
|
| 93 |
+
"task_name": "ant"
|
| 94 |
+
}
|
archive/issued-action-fix-20261010/latency-aware/ant/vla/starvla-qwenpi_v3-h1/ant_pi05_profile_h1_5fps_g128_20260920/validation.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"state": "CPU_STATE_DICT_AND_BUNDLE_HASH_VERIFIED",
|
| 3 |
+
"checkpoint_sha256": "01ce038a96b6479d74680235df1edd6ce586ee040dd1cfa55bca9a9dfa60e70f",
|
| 4 |
+
"tensor_count": 1386,
|
| 5 |
+
"all_floating_tensors_finite": true,
|
| 6 |
+
"training_steps": 5000,
|
| 7 |
+
"global_batch": 128,
|
| 8 |
+
"saved_model_gpu_forward": "NOT_RUN",
|
| 9 |
+
"closed_loop_evaluation": "NOT_RUN",
|
| 10 |
+
"verified_at": "2026-09-21T15:24:41.867755+00:00"
|
| 11 |
+
}
|