Publish hist8 zero demon_attack qwenpi_v3 step5000

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/README.md

@@ -0,0 +1,36 @@
+# demon_attack / qwenpi_v3 — hist8 zero training
+
+Run `demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2`; final optimizer step **5000**, seed **42**. [W&B](https://wandb.ai/saberrr-zju/starvla_tasks/runs/186aea40).
+
+Checkpoint SHA256: `f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e`.
+
+## Model and inputs
+
+Full StarVLA state dict in `checkpoints/model.pt` (original evaluated bytes). Initialize the matching Qwen model with `config.yaml` and `dataset_statistics.json`. Base: `Qwen/Qwen3-VL-4B-Instruct@ebb281ec70b05090aa6165b016eac8ec08e71b17`; model-specific action head trained from random initialization.
+
+One current RGB image, eight prior causal decision histories (88 raw 0/1 values), action horizon 1. `h1` in this repository path is the action horizon; `hist8` is input history. Pass history as `transport`, preserve all-zero reset, and use identity state normalization. Prompt and action order are in `task_contract.json` and `manifest.json`.
+
+Training: 2 GPUs, bf16/ZeRO-2, batch 64 per rank, accumulation 1, global batch 128; 16 dataloader workers per rank and prefetch 4. Backbone LR 3e-6, action head 1e-4; other groups retain the recorded configuration. Warmup 100, cosine min_lr_rate 1/30, 5000 steps. Full historical training configuration and code snapshot are included.
+
+## Formal evaluation
+
+| Environment | Episodes | Return mean ± std | Mean raw frames |
+|---|---:|---:|---:|
+| zero | 100 | 2350.9500 ± 351.0183 | 7199.39 |
+| profile | 100 | 112.3000 ± 54.4124 | 2222.20 |
+
+Seeds 1,000,000–1,000,099; parallel 32; capacity 1; FPS/decision Hz 60/15; max 7200 raw frames. Zero-trained models have both zero and profile evaluations; profile-trained models have the matching profile evaluation. `profiles/profile.json` is the exact model-specific latency profile, with SHA in provenance.
+
+Each `evaluations/<condition>/` contains the evaluated config, 100 episode records, action audit including raw-score summaries, verification, provenance and evaluator code snapshot. Evaluation configs retain original machine paths as execution evidence; replace checkpoint, model-config, backbone, profile and output paths when replaying locally. Deadly Corridor requires 160×120 RGB with HUD, no crosshair, weapon enabled, decals/particles disabled before resizing.
+
+These are one-training-seed results. Architectures use different latency profiles. Zero/profile training also uses different teachers and collected data, so their score difference is not an isolated learning-rate ablation.
+
+## Download
+
+```python
+from huggingface_hub import snapshot_download
+prefix = "zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2"
+repo = snapshot_download("latency-sensitive-bench/benchmark-models", allow_patterns=[prefix + "/**"])
+```
+
+Use a pinned repository commit for reproduction. Preserve the original checkpoint SHA above. Optimizer/RNG resume state remains in the source training archive; this publication contains the inference checkpoint.

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/bundle.complete.json

@@ -0,0 +1,4 @@
+{
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "training_step": 5000
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoint.sha256

@@ -0,0 +1 @@
+f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e  checkpoints/model.pt

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e
+size 10922799261

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/collection_quality_report.json

@@ -0,0 +1,33 @@
+{
+  "episodes": 200,
+  "train_episodes": 180,
+  "val_episodes": 20,
+  "train_labels": 324000,
+  "val_labels": 36000,
+  "raw_frames_quantiles": [
+    7200.0,
+    7200.0,
+    7200.0,
+    7200.0,
+    7200.0
+  ],
+  "return_quantiles": [
+    1620.0,
+    2040.0,
+    2505.0,
+    2805.0,
+    3500.0
+  ],
+  "termination_reasons": {
+    "horizon": 200
+  },
+  "action_id_counts": {
+    "0": 67142,
+    "1": 58967,
+    "2": 55608,
+    "3": 66806,
+    "4": 62506,
+    "5": 48971
+  },
+  "previous_decision_admitted_fraction": 0.9999277376320178
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/config.full.yaml

@@ -0,0 +1,300 @@
+framework:
+  name: QwenPI_v3
+  qwenvl:
+    base_vlm: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+    attn_implementation: flash_attention_2
+    vl_hidden_dim: 2560
+    num_vl_layers: 36
+    enable_gradient_checkpointing: true
+  action_model:
+    action_model_type: LayerwiseFM
+    action_dim: 6
+    state_dim: 88
+    state_encoding: continuous_projector
+    task_objective: null
+    action_horizon: 1
+    repeated_diffusion_steps: 2
+    num_inference_timesteps: 4
+    add_pos_embed: true
+    max_seq_len: 1024
+    num_target_vision_tokens: 32
+    noise_beta_alpha: 1.5
+    noise_beta_beta: 1.0
+    noise_s: 0.999
+    num_timestep_buckets: 1000
+    diffusion_model_cfg:
+      action_dit_hidden_dim: 1024
+      dropout: 0.2
+      final_dropout: true
+      interleave_self_attention: true
+      norm_type: ada_norm
+      positional_embeddings: null
+      attention_head_dim: 64
+      output_dim: 1024
+      num_layers: 36
+      input_embedding_dim: 1024
+      cross_attention_dim: 1024
+      num_attention_heads: 16
+    loss_type: l1
+    future_action_window_size: 0
+    past_action_window_size: 0
+    action_env_dim: 6
+  kv_memory:
+    enabled: false
+    window: 4
+    rollout_len: 8
+    packed_train: false
+    rebased_sink: true
+datasets:
+  vla_data:
+    dataset_py: lerobot_datasets
+    include_state: true
+    data_root_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack
+    data_mix: lerobot
+    eval_data_mix: lerobot__val
+    custom_mixtures_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/_generated_mixtures/lerobot.json
+    action_type: discrete
+    sequential_step_sampling: false
+    eval_sequential_step_sampling: null
+    num_workers: 16
+    eval_num_workers: 16
+    prefetch_factor: 4
+    persistent_workers: true
+    pin_memory: true
+    shuffle: true
+    action_balance:
+      enabled: false
+      strategy: balanced_epoch
+      action_key: action_id
+      target_flap_fraction: 0.3
+      noop_id: 0
+      flap_id: 1
+    latency_curriculum:
+      enabled: false
+      strategy: exclusive
+      latencies: null
+      phase_steps: null
+      phase_distributions: null
+      new_latency_passes: 1.0
+      replay_passes: 0.25
+      target_total_passes: 2.0
+      final_equalization: true
+      step_budget_mode: auto
+      eval_at_phase_end: false
+      save_at_phase_end: false
+      computed_plan: null
+    per_device_batch_size: 64
+    load_all_data_for_training: true
+    num_obs_frames: 1
+    image_mode: single
+    prompt_mode: raw
+    stitch_grid:
+    - 2
+    - 2
+    obs_image_size: null
+    video_backend: torchvision_av
+dataset:
+  source_hf: ''
+  config_name: null
+  source_subdir: null
+  converted_name: demon_attack_train
+  single_source_hf: ''
+  mixed_source_hf: ''
+  single_converted_name: demon_attack_train
+  mixed_converted_name: demon_attack_mixed_latency_train
+  single_latency_filter: null
+  mixed_latency_filter: null
+  force_download: false
+  setup_force: false
+  skip_verification: false
+  target_latency_unit: observation_steps
+  verify_rows: 200
+  max_episodes: null
+  episodes_per_latency: null
+  latency_filter: null
+  debug_subset:
+    enabled: false
+    max_episodes: 5
+    suffix: debug
+base_model:
+  repo_id: Qwen/Qwen3-VL-4B-Instruct
+initialization:
+  checkpoint_local_dir: null
+  checkpoint_hf_repo_id: null
+  checkpoint_filename: null
+trainer:
+  max_train_steps: 5000
+  num_warmup_steps: 100
+  save_interval: 500
+  eval_interval: 500
+  eval_num_batches: 50
+  per_latency_eval_num_batches: null
+  eval_action_classification: false
+  eval_action_classification_interval: null
+  cc_f1_tolerance: 1
+  learning_rate:
+    base: 3.0e-05
+    qwen_vl_interface: 3.0e-06
+    action_model: 0.0001
+  lr_scheduler_type: cosine_with_min_lr
+  scheduler_specific_kwargs:
+    min_lr_rate: 0.03333333333333333
+  freeze_modules: ''
+  freeze_vit: false
+  freeze_tied_embedding: false
+  freeze_llm_layers: []
+  loss_scale:
+    vla: 1.0
+    vlm: 0.0
+  max_grad_norm: 1.0
+  weight_decay: 0.0
+  logging_frequency: 1
+  profile_timing:
+    enabled: false
+    log_interval: 10
+  gradient_clipping: 1.0
+  gradient_accumulation_steps: 1
+  distributed_backend: deepspeed
+  is_resume: false
+  pretrained_checkpoint: null
+  resume_step: 0
+  reload_modules: null
+  optimizer:
+    name: AdamW
+    betas:
+    - 0.9
+    - 0.95
+    eps: 1.0e-08
+    weight_decay: 1.0e-08
+    fused: true
+  save_format: pt
+  hist8_diagnostics:
+    steps:
+    - 0
+    - 500
+    - 1000
+    - 2500
+    - 5000
+    sample_count: 2048
+    noise_seeds:
+    - 1729
+    - 1730
+    - 1731
+    - 1732
+    sample_seed: 42
+    batch_size: 8
+    bootstrap_repeats: 4000
+workspace_dir: WORKSPACE_DIR
+run_root_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train
+seed: 42
+wandb_entity: saberrr-zju
+wandb_project: starvla_tasks
+auth:
+  env_file: null
+  hf_token_env: HF_TOKEN
+  wandb_api_key_env: WANDB_API_KEY
+paths:
+  run_root_dir: results/Checkpoints
+  dataset_local_dir: playground/Datasets/rl_games
+  dataset_cache_dir: null
+  base_model_dir: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  accelerate_config: starVLA/config/deepseeds/deepspeed_zero2.yaml
+launch:
+  use_accelerate: true
+  gpus: null
+  num_processes: 1
+  dry_run: false
+conda:
+  enabled: true
+  env_name: null
+rl_games:
+  model_alias: pi-0.5
+  env_eval:
+    image_size: 224
+    frameskip: 4
+    image_transform: raw_rgb
+    prompt_mode: raw
+    ghost_trail:
+      history_frames: 5
+      gamma: 1.3
+      min_alpha: 35
+      scroll_px_per_step: 4.0
+      ground_fraction: 0.22
+    seed: 42
+    fixed_episode_seeds: true
+    latency_seed_stride: 0
+    task_seed_stride: 0
+    task_description: 'You are playing Demon Attack from a single game image. Choose
+      exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE.'
+    eval_parallel_envs: 5
+    action_chunk_execution:
+      enabled: false
+      chunk_size: null
+    demon_attack:
+      noop_max: 30
+    enabled: false
+    eval_backend: latency_bench
+    distributed_mode: none
+    vectorized:
+      enabled: false
+      batch_size: 1
+    latency:
+      prompt_map_path: null
+      mode: single
+      values:
+      - 0
+    mid_train:
+      enabled: false
+      interval_steps: 100
+      latencies:
+      - 0
+      num_episodes: 5
+      max_steps_per_episode: 3600
+    post_train:
+      enabled: false
+      latencies:
+      - 0
+      - 1
+      - 2
+      - 3
+      - 4
+      num_episodes: 5
+      max_steps_per_episode: 3600
+  task: demon_attack
+  initialization_mode: scratch
+  action_carrier: native
+model: pi05
+env: demon_attack
+init: scratch
+mode: single
+checkpoint:
+  load: none
+  hf_repo_id: null
+  save_best_model: false
+  save_final_model: true
+  save_pt_file: true
+  save_training_state: true
+  save_safetensors_file: false
+  local:
+    keep_last_n: 2
+  sync:
+    enabled: false
+    repo_id: null
+    keep_last_n: 0
+    sync_every_n_checkpoints: 1
+    resume_policy: local_latest
+run_id: demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2
+output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2
+config_yaml: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/train.yaml
+is_debug: false
+version_id: '0.21'
+wandb_name: demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2
+wandb_group: decision-history-vla-h8-v2
+wandb_tags:
+- demon_attack
+- qwenpi_v3
+- hist8-v2
+- history01
+- scratch
+- zero-latency
+training_latency_condition: zero-latency

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/config.yaml

@@ -0,0 +1,57 @@
+framework:
+  name: QwenPI_v3
+  qwenvl:
+    base_vlm: Qwen/Qwen3-VL-4B-Instruct
+    attn_implementation: flash_attention_2
+    vl_hidden_dim: 2560
+    num_vl_layers: 36
+    enable_gradient_checkpointing: true
+  action_model:
+    action_model_type: LayerwiseFM
+    action_dim: 6
+    state_dim: 88
+    state_encoding: continuous_projector
+    task_objective: null
+    action_horizon: 1
+    repeated_diffusion_steps: 2
+    num_inference_timesteps: 4
+    add_pos_embed: true
+    max_seq_len: 1024
+    num_target_vision_tokens: 32
+    noise_beta_alpha: 1.5
+    noise_beta_beta: 1.0
+    noise_s: 0.999
+    num_timestep_buckets: 1000
+    diffusion_model_cfg:
+      action_dit_hidden_dim: 1024
+      dropout: 0.2
+      final_dropout: true
+      interleave_self_attention: true
+      norm_type: ada_norm
+      positional_embeddings: null
+      attention_head_dim: 64
+      output_dim: 1024
+      num_layers: 36
+      input_embedding_dim: 1024
+      cross_attention_dim: 1024
+      num_attention_heads: 16
+    loss_type: l1
+    future_action_window_size: 0
+    past_action_window_size: 0
+    action_env_dim: 6
+  kv_memory:
+    enabled: false
+    window: 4
+    rollout_len: 8
+    packed_train: false
+    rebased_sink: true
+version_id: '0.21'
+datasets:
+  vla_data:
+    include_state: true
+    obs_image_size: null
+    image_mode: single
+    num_obs_frames: 1
+    robot_type: rl_games_demon_attack
+trainer:
+  pretrained_checkpoint: null

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/dataset_statistics.json

@@ -0,0 +1,606 @@
+{
+  "new_embodiment": {
+    "action": {
+      "mean": [
+        0.186212956905365,
+        0.16403703391551971,
+        0.15452778339385986,
+        0.18537653982639313,
+        0.17363271117210388,
+        0.13621295988559723
+      ],
+      "std": [
+        0.3898249864578247,
+        0.37076491117477417,
+        0.36105018854141235,
+        0.38919636607170105,
+        0.378946453332901,
+        0.3426312804222107
+      ],
+      "max": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "min": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q01": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q99": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "mask": [
+        true,
+        true,
+        true,
+        true,
+        true,
+        true
+      ]
+    },
+    "state": {
+      "mean": [
+        0.9949135780334473,
+        0.1635771542787552,
+        0.15375925600528717,
+        0.18431790173053741,
+        0.17239506542682648,
+        0.135799378156662,
+        0.1635771542787552,
+        0.15375925600528717,
+        0.18431790173053741,
+        0.17239506542682648,
+        0.135799378156662,
+        0.9955493807792664,
+        0.16362345218658447,
+        0.15380863845348358,
+        0.18452468514442444,
+        0.1725771576166153,
+        0.13588272035121918,
+        0.16362345218658447,
+        0.15380863845348358,
+        0.18452468514442444,
+        0.1725771576166153,
+        0.13588272035121918,
+        0.9961851835250854,
+        0.16370061039924622,
+        0.1539197564125061,
+        0.1847500056028366,
+        0.17267900705337524,
+        0.13596296310424805,
+        0.16370061039924622,
+        0.1539197564125061,
+        0.1847500056028366,
+        0.17267900705337524,
+        0.13596296310424805,
+        0.9968209862709045,
+        0.1637592613697052,
+        0.1539537012577057,
+        0.18497531116008759,
+        0.17288272082805634,
+        0.13596296310424805,
+        0.1637592613697052,
+        0.1539537012577057,
+        0.18497531116008759,
+        0.17288272082805634,
+        0.13596296310424805,
+        0.9974567890167236,
+        0.16383333504199982,
+        0.1539907455444336,
+        0.1851203739643097,
+        0.1730956733226776,
+        0.135981485247612,
+        0.16383333504199982,
+        0.1539907455444336,
+        0.1851203739643097,
+        0.1730956733226776,
+        0.135981485247612,
+        0.9980925917625427,
+        0.1638919711112976,
+        0.15408951044082642,
+        0.1852283924818039,
+        0.1732993870973587,
+        0.13600000739097595,
+        0.1638919711112976,
+        0.15408951044082642,
+        0.1852283924818039,
+        0.1732993870973587,
+        0.13600000739097595,
+        0.9987283945083618,
+        0.1639506220817566,
+        0.15422530472278595,
+        0.18530863523483276,
+        0.17342284321784973,
+        0.1360401213169098,
+        0.1639506220817566,
+        0.15422530472278595,
+        0.18530863523483276,
+        0.17342284321784973,
+        0.1360401213169098,
+        0.9993641972541809,
+        0.16400925815105438,
+        0.154388889670372,
+        0.18537653982639313,
+        0.17349691689014435,
+        0.1360895037651062,
+        0.16400925815105438,
+        0.154388889670372,
+        0.18537653982639313,
+        0.17349691689014435,
+        0.1360895037651062
+      ],
+      "std": [
+        0.07101495563983917,
+        0.3701695501804352,
+        0.36049050092697144,
+        0.3878783881664276,
+        0.37791910767555237,
+        0.34225910902023315,
+        0.3701695501804352,
+        0.36049050092697144,
+        0.3878783881664276,
+        0.37791910767555237,
+        0.34225910902023315,
+        0.06647672504186589,
+        0.3702095150947571,
+        0.3605283200740814,
+        0.3878776729106903,
+        0.378066748380661,
+        0.3423354923725128,
+        0.3702095150947571,
+        0.3605283200740814,
+        0.3878776729106903,
+        0.378066748380661,
+        0.3423354923725128,
+        0.061554547399282344,
+        0.3702716529369354,
+        0.36068475246429443,
+        0.3880579471588135,
+        0.3781836926937103,
+        0.34237855672836304,
+        0.3702716529369354,
+        0.36068475246429443,
+        0.3880579471588135,
+        0.3781836926937103,
+        0.34237855672836304,
+        0.056230042129754895,
+        0.3703220784664154,
+        0.3605552315711975,
+        0.3888765275478363,
+        0.3783469498157501,
+        0.34237855672836304,
+        0.3703220784664154,
+        0.3605552315711975,
+        0.3888765275478363,
+        0.3783469498157501,
+        0.34237855672836304,
+        0.0503141917288302,
+        0.37038931250572205,
+        0.36059075593948364,
+        0.38899245858192444,
+        0.37848997116088867,
+        0.3423982560634613,
+        0.37038931250572205,
+        0.36059075593948364,
+        0.38899245858192444,
+        0.37848997116088867,
+        0.3423982560634613,
+        0.04359520971775055,
+        0.3706468939781189,
+        0.3606751561164856,
+        0.38908714056015015,
+        0.3787112534046173,
+        0.3424212634563446,
+        0.3706468939781189,
+        0.3606751561164856,
+        0.38908714056015015,
+        0.3787112534046173,
+        0.3424212634563446,
+        0.035616517066955566,
+        0.3706991672515869,
+        0.360801637172699,
+        0.3891419470310211,
+        0.3788077235221863,
+        0.34246116876602173,
+        0.3706991672515869,
+        0.360801637172699,
+        0.3891419470310211,
+        0.3788077235221863,
+        0.34246116876602173,
+        0.025199506431817734,
+        0.37074217200279236,
+        0.36091822385787964,
+        0.38919636607170105,
+        0.37887200713157654,
+        0.34251368045806885,
+        0.37074217200279236,
+        0.36091822385787964,
+        0.38919636607170105,
+        0.37887200713157654,
+        0.34251368045806885
+      ],
+      "max": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "min": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q01": [
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q99": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ]
+    },
+    "num_transitions": 324000,
+    "num_trajectories": 180
+  }
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/eval_l0.json

@@ -0,0 +1,42 @@
+{
+  "job_id": "eval_zero_to_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "training_step": 5000,
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "profile_sha256": null,
+  "mean_return": 2350.95,
+  "std_return": 351.018300804958,
+  "mean_length": 7199.39,
+  "episodes": 100,
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "issued_actions": 179985,
+  "top_action": "NOOP",
+  "largest_action_fraction": 0.19317720921187878,
+  "unique_action_values": 6,
+  "episode_final_done": 1,
+  "episodes_at_frame_cap": 99,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "environment_condition": "zero"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/eval_profile.json

@@ -0,0 +1,42 @@
+{
+  "job_id": "eval_zero_to_profile__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "training_step": 5000,
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "profile_sha256": "5c2895d34b3d821c7b24a14d9acd84e416baec9eebc87083ba86b9c8954696ae",
+  "mean_return": 112.3,
+  "std_return": 54.41240667347843,
+  "mean_length": 2222.2,
+  "episodes": 100,
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "issued_actions": 17926,
+  "top_action": "RIGHTFIRE",
+  "largest_action_fraction": 0.2610175164565436,
+  "unique_action_values": 6,
+  "episode_final_done": 100,
+  "episodes_at_frame_cap": 0,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "environment_condition": "profile"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/profile/action_audit.json

@@ -0,0 +1,141 @@
+{
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "episode_seeds": [
+    1000000,
+    1000001,
+    1000002,
+    1000003,
+    1000004,
+    1000005,
+    1000006,
+    1000007,
+    1000008,
+    1000009,
+    1000010,
+    1000011,
+    1000012,
+    1000013,
+    1000014,
+    1000015,
+    1000016,
+    1000017,
+    1000018,
+    1000019,
+    1000020,
+    1000021,
+    1000022,
+    1000023,
+    1000024,
+    1000025,
+    1000026,
+    1000027,
+    1000028,
+    1000029,
+    1000030,
+    1000031,
+    1000032,
+    1000033,
+    1000034,
+    1000035,
+    1000036,
+    1000037,
+    1000038,
+    1000039,
+    1000040,
+    1000041,
+    1000042,
+    1000043,
+    1000044,
+    1000045,
+    1000046,
+    1000047,
+    1000048,
+    1000049,
+    1000050,
+    1000051,
+    1000052,
+    1000053,
+    1000054,
+    1000055,
+    1000056,
+    1000057,
+    1000058,
+    1000059,
+    1000060,
+    1000061,
+    1000062,
+    1000063,
+    1000064,
+    1000065,
+    1000066,
+    1000067,
+    1000068,
+    1000069,
+    1000070,
+    1000071,
+    1000072,
+    1000073,
+    1000074,
+    1000075,
+    1000076,
+    1000077,
+    1000078,
+    1000079,
+    1000080,
+    1000081,
+    1000082,
+    1000083,
+    1000084,
+    1000085,
+    1000086,
+    1000087,
+    1000088,
+    1000089,
+    1000090,
+    1000091,
+    1000092,
+    1000093,
+    1000094,
+    1000095,
+    1000096,
+    1000097,
+    1000098,
+    1000099
+  ],
+  "issued_actions": 17926,
+  "action_counts": {
+    "4": 4679,
+    "2": 2130,
+    "3": 3740,
+    "0": 2224,
+    "5": 2469,
+    "1": 2684
+  },
+  "largest_action_fraction": 0.2610175164565436,
+  "raw_score_min": [
+    -0.07735985517501831,
+    -0.07981708645820618,
+    -0.1071595847606659,
+    -0.08325910568237305,
+    -0.06552350521087646,
+    -0.11361204087734222
+  ],
+  "raw_score_max": [
+    1.0555351972579956,
+    1.0913633108139038,
+    1.0603924989700317,
+    1.084080696105957,
+    1.0643740892410278,
+    1.0838565826416016
+  ],
+  "raw_score_mean": [
+    0.12381529821921275,
+    0.14945072387748556,
+    0.11697202737641717,
+    0.20533074754276567,
+    0.2654304792185208,
+    0.1346056251604811
+  ]
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/profile/eval_config.yaml

@@ -0,0 +1,118 @@
+experiment:
+  name: demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2-step5000-history01-profile-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: temporal
+  profile_path: /home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/pi05/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json
+  profile_worker_slot: 0
+  seed: 271828
+  add_latency_info: false
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_profile
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/profile/provenance.json

@@ -0,0 +1,46 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "5b533937a72e9fa923ecf28b1c1be5a16bad488d",
+    "teacher_path": "zero-latency/demon-attack/small-policy/sample-factory-v1",
+    "teacher_checkpoint": "best_000048704_24936448_reward_27118.050.pth",
+    "teacher_sha256": "f06e92be4b26fc883db66b355476d503aed4a6c8464d5e8f4c158f50ca2422ae",
+    "rollout_overrides": {
+      "env_fps": 60,
+      "obs_fps": 15,
+      "latency_type": "fixed",
+      "fixed_latency_ms": 0.0,
+      "seed": 42
+    },
+    "training_latency_condition": "zero",
+    "history": "decision_v1",
+    "history_decisions": 8,
+    "history_source": "zero_latency_issued_equals_applied",
+    "student_image_frames": 1,
+    "max_episode_raw_frames": 7200,
+    "episodes": 200,
+    "train_labels": 324000,
+    "filter_preset": "none"
+  },
+  "training_run_id": "demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "186aea40",
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "env_condition": "profile",
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "inference_devices": [
+    "cuda:0",
+    "cuda:1"
+  ],
+  "episode_seeds": [
+    1000000,
+    1000099
+  ],
+  "profile_sha256": "5c2895d34b3d821c7b24a14d9acd84e416baec9eebc87083ba86b9c8954696ae"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/profile/resolved_config.yaml

@@ -0,0 +1,121 @@
+experiment:
+  name: demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2-step5000-history01-profile-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: temporal
+  profile_path: /home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/pi05/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json
+  profile_worker_slot: 0
+  seed: 271828
+  add_latency_info: false
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+  action_prefix:
+    mode: none
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_profile
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''
+  simulated_pipeline_profile: false

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/profile/summary.json

@@ -0,0 +1,217 @@
+{
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt",
+  "experiment_name": "demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2-step5000-history01-profile-par32",
+  "latency": "profile_sample",
+  "latency_type": "profile_sample",
+  "lengths": [
+    1522,
+    2712,
+    1879,
+    1735,
+    1492,
+    1904,
+    1200,
+    1939,
+    2875,
+    2108,
+    1999,
+    2109,
+    2088,
+    1529,
+    3049,
+    2375,
+    3066,
+    1788,
+    1249,
+    1920,
+    1337,
+    1575,
+    1191,
+    1699,
+    1287,
+    1424,
+    1931,
+    2681,
+    1126,
+    2195,
+    3872,
+    1290,
+    1731,
+    1956,
+    2786,
+    1177,
+    2762,
+    1545,
+    1459,
+    2683,
+    5475,
+    2775,
+    1791,
+    1564,
+    1763,
+    2472,
+    2809,
+    2158,
+    2424,
+    1710,
+    1255,
+    2299,
+    1937,
+    1847,
+    4217,
+    1985,
+    2132,
+    2413,
+    2899,
+    1113,
+    4306,
+    2812,
+    4433,
+    2415,
+    2238,
+    2525,
+    1231,
+    2091,
+    2495,
+    2382,
+    1947,
+    1451,
+    1526,
+    2205,
+    2093,
+    4982,
+    2095,
+    3144,
+    2012,
+    1781,
+    3396,
+    1743,
+    3074,
+    4584,
+    1145,
+    1503,
+    1966,
+    1685,
+    2347,
+    2659,
+    2548,
+    1892,
+    2253,
+    1927,
+    2293,
+    3494,
+    1412,
+    2151,
+    2211,
+    2490
+  ],
+  "mean_length": 2222.2,
+  "mean_return": 112.3,
+  "returns": [
+    40.0,
+    80.0,
+    80.0,
+    80.0,
+    110.0,
+    80.0,
+    20.0,
+    100.0,
+    175.0,
+    120.0,
+    120.0,
+    90.0,
+    100.0,
+    50.0,
+    190.0,
+    100.0,
+    160.0,
+    80.0,
+    50.0,
+    110.0,
+    90.0,
+    90.0,
+    60.0,
+    110.0,
+    40.0,
+    100.0,
+    120.0,
+    120.0,
+    50.0,
+    120.0,
+    235.0,
+    60.0,
+    100.0,
+    100.0,
+    120.0,
+    60.0,
+    160.0,
+    80.0,
+    60.0,
+    130.0,
+    325.0,
+    150.0,
+    90.0,
+    70.0,
+    80.0,
+    80.0,
+    80.0,
+    110.0,
+    130.0,
+    110.0,
+    70.0,
+    160.0,
+    80.0,
+    90.0,
+    220.0,
+    100.0,
+    40.0,
+    120.0,
+    160.0,
+    50.0,
+    235.0,
+    175.0,
+    235.0,
+    110.0,
+    90.0,
+    190.0,
+    50.0,
+    100.0,
+    130.0,
+    130.0,
+    90.0,
+    60.0,
+    60.0,
+    110.0,
+    120.0,
+    325.0,
+    150.0,
+    205.0,
+    120.0,
+    60.0,
+    160.0,
+    100.0,
+    140.0,
+    190.0,
+    40.0,
+    70.0,
+    130.0,
+    80.0,
+    90.0,
+    80.0,
+    140.0,
+    100.0,
+    90.0,
+    110.0,
+    130.0,
+    160.0,
+    90.0,
+    80.0,
+    120.0,
+    130.0
+  ],
+  "seed": 1000000,
+  "source_profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/pi05/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+  "std_return": 54.41240667347841,
+  "suite_name": "profile_sample",
+  "timestamp_utc": "2026-09-24T00:10:36.382503+00:00"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/profile/verification.json

@@ -0,0 +1,69 @@
+{
+  "verification_status": "verified",
+  "job_id": "eval_zero_to_profile__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "task": "demon_attack",
+  "model": "qwenpi_v3",
+  "remote_eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_profile",
+  "checked_at": 1790210223.967754,
+  "training_step": 5000,
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "profile_sha256": "5c2895d34b3d821c7b24a14d9acd84e416baec9eebc87083ba86b9c8954696ae",
+  "wandb_run_id": "186aea40",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "max_episode_raw_frames": 7200,
+  "parallel_envs": 32,
+  "mean_return": 112.3,
+  "std_return": 54.41240667347843,
+  "mean_length": 2222.2,
+  "episodes": 100,
+  "issued_actions": 17926,
+  "top_action": "RIGHTFIRE",
+  "largest_action_fraction": 0.2610175164565436,
+  "unique_action_values": 6,
+  "episode_final_done": 100,
+  "episodes_at_frame_cap": 0,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "job": {
+    "id": "eval_zero_to_profile__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+    "kind": "eval_ready",
+    "source": "v2",
+    "task": "demon_attack",
+    "model": "qwenpi_v3",
+    "python": "/home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python",
+    "backbone": "/home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17",
+    "bundle_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+    "profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/pi05/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "env_condition": "profile",
+    "parallel_envs": 32,
+    "metric_prefix": "eval_hist8_v3/zero_to_profile",
+    "eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_profile",
+    "gpus_required": 2,
+    "priority": 1102,
+    "depends_on": [
+      "package_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2"
+    ],
+    "runtime_root": "/home/ubuntu/codex/hist8-vla-v2-20260923"
+  },
+  "evidence_dir": "/home/lixinyuan/latency-sensitive-bench/outputs/tasks/decision_history_vla_hist8_v2/evaluation_receipts/h200-2/eval_zero_to_profile__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/hist8-history01-par32-v3"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/zero/action_audit.json

@@ -0,0 +1,141 @@
+{
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "episode_seeds": [
+    1000000,
+    1000001,
+    1000002,
+    1000003,
+    1000004,
+    1000005,
+    1000006,
+    1000007,
+    1000008,
+    1000009,
+    1000010,
+    1000011,
+    1000012,
+    1000013,
+    1000014,
+    1000015,
+    1000016,
+    1000017,
+    1000018,
+    1000019,
+    1000020,
+    1000021,
+    1000022,
+    1000023,
+    1000024,
+    1000025,
+    1000026,
+    1000027,
+    1000028,
+    1000029,
+    1000030,
+    1000031,
+    1000032,
+    1000033,
+    1000034,
+    1000035,
+    1000036,
+    1000037,
+    1000038,
+    1000039,
+    1000040,
+    1000041,
+    1000042,
+    1000043,
+    1000044,
+    1000045,
+    1000046,
+    1000047,
+    1000048,
+    1000049,
+    1000050,
+    1000051,
+    1000052,
+    1000053,
+    1000054,
+    1000055,
+    1000056,
+    1000057,
+    1000058,
+    1000059,
+    1000060,
+    1000061,
+    1000062,
+    1000063,
+    1000064,
+    1000065,
+    1000066,
+    1000067,
+    1000068,
+    1000069,
+    1000070,
+    1000071,
+    1000072,
+    1000073,
+    1000074,
+    1000075,
+    1000076,
+    1000077,
+    1000078,
+    1000079,
+    1000080,
+    1000081,
+    1000082,
+    1000083,
+    1000084,
+    1000085,
+    1000086,
+    1000087,
+    1000088,
+    1000089,
+    1000090,
+    1000091,
+    1000092,
+    1000093,
+    1000094,
+    1000095,
+    1000096,
+    1000097,
+    1000098,
+    1000099
+  ],
+  "issued_actions": 179985,
+  "action_counts": {
+    "4": 31396,
+    "2": 26687,
+    "3": 32861,
+    "0": 34769,
+    "5": 24109,
+    "1": 30163
+  },
+  "largest_action_fraction": 0.19317720921187878,
+  "raw_score_min": [
+    -0.16609728336334229,
+    -0.2231910228729248,
+    -0.1326204538345337,
+    -0.13992559909820557,
+    -0.08449506759643555,
+    -0.1267552673816681
+  ],
+  "raw_score_max": [
+    1.1282202005386353,
+    1.1061875820159912,
+    1.0776598453521729,
+    1.1403387784957886,
+    1.1267261505126953,
+    1.118543028831482
+  ],
+  "raw_score_mean": [
+    0.19295044941523593,
+    0.1691077674905997,
+    0.14604465145036943,
+    0.17826294220371872,
+    0.17757856645283146,
+    0.13091073683947624
+  ]
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/zero/eval_config.yaml

@@ -0,0 +1,114 @@
+experiment:
+  name: demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2-step5000-history01-zero-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: zero
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_zero
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/zero/provenance.json

@@ -0,0 +1,46 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "5b533937a72e9fa923ecf28b1c1be5a16bad488d",
+    "teacher_path": "zero-latency/demon-attack/small-policy/sample-factory-v1",
+    "teacher_checkpoint": "best_000048704_24936448_reward_27118.050.pth",
+    "teacher_sha256": "f06e92be4b26fc883db66b355476d503aed4a6c8464d5e8f4c158f50ca2422ae",
+    "rollout_overrides": {
+      "env_fps": 60,
+      "obs_fps": 15,
+      "latency_type": "fixed",
+      "fixed_latency_ms": 0.0,
+      "seed": 42
+    },
+    "training_latency_condition": "zero",
+    "history": "decision_v1",
+    "history_decisions": 8,
+    "history_source": "zero_latency_issued_equals_applied",
+    "student_image_frames": 1,
+    "max_episode_raw_frames": 7200,
+    "episodes": 200,
+    "train_labels": 324000,
+    "filter_preset": "none"
+  },
+  "training_run_id": "demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "186aea40",
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "env_condition": "zero",
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "inference_devices": [
+    "cuda:0",
+    "cuda:1"
+  ],
+  "episode_seeds": [
+    1000000,
+    1000099
+  ],
+  "profile_sha256": null
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/zero/resolved_config.yaml

@@ -0,0 +1,117 @@
+experiment:
+  name: demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2-step5000-history01-zero-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: zero
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+  action_prefix:
+    mode: none
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_zero
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''
+  simulated_pipeline_profile: false

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/zero/summary.json

@@ -0,0 +1,216 @@
+{
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/checkpoints/model.pt",
+  "experiment_name": "demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2-step5000-history01-zero-par32",
+  "latency": 0,
+  "latency_type": "zero",
+  "lengths": [
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7139,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200
+  ],
+  "mean_length": 7199.39,
+  "mean_return": 2350.95,
+  "returns": [
+    2140.0,
+    2160.0,
+    2200.0,
+    1800.0,
+    2240.0,
+    2900.0,
+    2200.0,
+    1820.0,
+    2790.0,
+    1860.0,
+    2790.0,
+    2450.0,
+    2140.0,
+    2200.0,
+    2805.0,
+    2790.0,
+    2500.0,
+    2730.0,
+    2180.0,
+    2790.0,
+    2140.0,
+    2730.0,
+    2220.0,
+    2200.0,
+    2140.0,
+    2790.0,
+    2180.0,
+    2140.0,
+    2140.0,
+    2280.0,
+    2140.0,
+    1960.0,
+    2675.0,
+    2140.0,
+    2790.0,
+    2200.0,
+    2100.0,
+    2790.0,
+    2465.0,
+    1720.0,
+    2790.0,
+    2140.0,
+    2400.0,
+    2790.0,
+    2790.0,
+    2140.0,
+    2805.0,
+    2280.0,
+    2200.0,
+    3315.0,
+    2240.0,
+    2200.0,
+    2765.0,
+    2280.0,
+    1980.0,
+    2790.0,
+    2000.0,
+    2080.0,
+    2140.0,
+    2360.0,
+    2765.0,
+    2805.0,
+    2280.0,
+    2160.0,
+    2000.0,
+    2200.0,
+    2140.0,
+    2805.0,
+    1920.0,
+    2770.0,
+    2160.0,
+    2765.0,
+    2790.0,
+    2805.0,
+    2140.0,
+    2845.0,
+    2925.0,
+    1920.0,
+    2790.0,
+    2280.0,
+    2080.0,
+    2280.0,
+    2805.0,
+    1960.0,
+    2200.0,
+    1860.0,
+    2805.0,
+    2200.0,
+    2340.0,
+    1440.0,
+    2020.0,
+    2200.0,
+    2360.0,
+    1860.0,
+    2140.0,
+    2140.0,
+    2790.0,
+    2000.0,
+    2140.0,
+    2300.0
+  ],
+  "seed": 1000000,
+  "std_return": 351.0183008049579,
+  "suite_name": "fixed_0",
+  "timestamp_utc": "2026-09-24T00:30:51.485442+00:00"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/evaluations/zero/verification.json

@@ -0,0 +1,69 @@
+{
+  "verification_status": "verified",
+  "job_id": "eval_zero_to_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "task": "demon_attack",
+  "model": "qwenpi_v3",
+  "remote_eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_zero",
+  "checked_at": 1790210216.461496,
+  "training_step": 5000,
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "profile_sha256": null,
+  "wandb_run_id": "186aea40",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "max_episode_raw_frames": 7200,
+  "parallel_envs": 32,
+  "mean_return": 2350.95,
+  "std_return": 351.018300804958,
+  "mean_length": 7199.39,
+  "episodes": 100,
+  "issued_actions": 179985,
+  "top_action": "NOOP",
+  "largest_action_fraction": 0.19317720921187878,
+  "unique_action_values": 6,
+  "episode_final_done": 1,
+  "episodes_at_frame_cap": 99,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "job": {
+    "id": "eval_zero_to_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+    "kind": "eval_ready",
+    "source": "v2",
+    "task": "demon_attack",
+    "model": "qwenpi_v3",
+    "python": "/home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python",
+    "backbone": "/home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17",
+    "bundle_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+    "profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/pi05/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "env_condition": "zero",
+    "parallel_envs": 32,
+    "metric_prefix": "eval_hist8_v3/zero_to_zero",
+    "eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/to_zero",
+    "gpus_required": 2,
+    "priority": 1102,
+    "depends_on": [
+      "package_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2"
+    ],
+    "runtime_root": "/home/ubuntu/codex/hist8-vla-v2-20260923"
+  },
+  "evidence_dir": "/home/lixinyuan/latency-sensitive-bench/outputs/tasks/decision_history_vla_hist8_v2/evaluation_receipts/h200-2/eval_zero_to_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/hist8-history01-par32-v3"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/manifest.json

@@ -0,0 +1,307 @@
+{
+  "dataset_name": "lerobot",
+  "env_name": "demon_attack",
+  "episodes": 180,
+  "frames": 324000,
+  "task_prompts": [
+    "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score."
+  ],
+  "format": "starvla_lerobot_v2_decision_v1",
+  "source": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/raw",
+  "robot_type": "rl_games_demon_attack",
+  "action_layout": "demon_attack_discrete",
+  "source_action_layout": "demon_attack_discrete",
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_dim": 6,
+  "active_action_dim": 6,
+  "state_source": "decision_v1",
+  "state_dim": 88,
+  "state_labels": [
+    "decision_history_0",
+    "decision_history_1",
+    "decision_history_2",
+    "decision_history_3",
+    "decision_history_4",
+    "decision_history_5",
+    "decision_history_6",
+    "decision_history_7",
+    "decision_history_8",
+    "decision_history_9",
+    "decision_history_10",
+    "decision_history_11",
+    "decision_history_12",
+    "decision_history_13",
+    "decision_history_14",
+    "decision_history_15",
+    "decision_history_16",
+    "decision_history_17",
+    "decision_history_18",
+    "decision_history_19",
+    "decision_history_20",
+    "decision_history_21",
+    "decision_history_22",
+    "decision_history_23",
+    "decision_history_24",
+    "decision_history_25",
+    "decision_history_26",
+    "decision_history_27",
+    "decision_history_28",
+    "decision_history_29",
+    "decision_history_30",
+    "decision_history_31",
+    "decision_history_32",
+    "decision_history_33",
+    "decision_history_34",
+    "decision_history_35",
+    "decision_history_36",
+    "decision_history_37",
+    "decision_history_38",
+    "decision_history_39",
+    "decision_history_40",
+    "decision_history_41",
+    "decision_history_42",
+    "decision_history_43",
+    "decision_history_44",
+    "decision_history_45",
+    "decision_history_46",
+    "decision_history_47",
+    "decision_history_48",
+    "decision_history_49",
+    "decision_history_50",
+    "decision_history_51",
+    "decision_history_52",
+    "decision_history_53",
+    "decision_history_54",
+    "decision_history_55",
+    "decision_history_56",
+    "decision_history_57",
+    "decision_history_58",
+    "decision_history_59",
+    "decision_history_60",
+    "decision_history_61",
+    "decision_history_62",
+    "decision_history_63",
+    "decision_history_64",
+    "decision_history_65",
+    "decision_history_66",
+    "decision_history_67",
+    "decision_history_68",
+    "decision_history_69",
+    "decision_history_70",
+    "decision_history_71",
+    "decision_history_72",
+    "decision_history_73",
+    "decision_history_74",
+    "decision_history_75",
+    "decision_history_76",
+    "decision_history_77",
+    "decision_history_78",
+    "decision_history_79",
+    "decision_history_80",
+    "decision_history_81",
+    "decision_history_82",
+    "decision_history_83",
+    "decision_history_84",
+    "decision_history_85",
+    "decision_history_86",
+    "decision_history_87"
+  ],
+  "state_normalization": {
+    "min": [
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0
+    ],
+    "max": [
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0
+    ]
+  },
+  "action_history_decisions": 8,
+  "rows_unit": "decision_step",
+  "obs_fps": 15.0,
+  "obs_stride_raw_frames": 4,
+  "latency_prompt_map_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/lerobot/latency_prompt_map.json",
+  "custom_mixtures_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/_generated_mixtures/lerobot.json",
+  "validation_dataset_name": "lerobot__val",
+  "validation_episodes": 20,
+  "validation_frames": 36000
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/profiles/hardware.json

@@ -0,0 +1,40 @@
+{
+  "driver_version": "595.58.03",
+  "gpu_class": "1x-rtx3090",
+  "gpus": [
+    {
+      "name": "NVIDIA GeForce RTX 3090",
+      "slot": 0
+    }
+  ],
+  "instance_id": "instance_a5037b165aa0cedc",
+  "topology_links": [],
+  "torch": {
+    "backends": {
+      "cuda_cudnn_sdp_enabled": true,
+      "cuda_flash_sdp_enabled": true,
+      "cuda_math_sdp_enabled": true,
+      "cuda_matmul_allow_tf32": false,
+      "cuda_mem_efficient_sdp_enabled": true,
+      "cudnn_allow_tf32": true,
+      "cudnn_benchmark": false
+    },
+    "cuda_available": true,
+    "cuda_device_count": 1,
+    "cuda_version": "12.8",
+    "current_device": 0,
+    "current_device_name": "NVIDIA GeForce RTX 3090",
+    "device_properties": [
+      {
+        "index": 0,
+        "major": 8,
+        "minor": 6,
+        "multi_processor_count": 82,
+        "name": "NVIDIA GeForce RTX 3090",
+        "total_memory": 25298141184
+      }
+    ],
+    "float32_matmul_precision": "highest",
+    "version": "2.11.0+cu128"
+  }
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/profiles/latency_burst_model.json

@@ -0,0 +1,30 @@
+{
+  "burst_dwell_distribution": null,
+  "burst_dwell_lengths": [],
+  "burst_merge_gap_records": 30,
+  "burst_rank_processes": [],
+  "burst_slot_rank_templates": [],
+  "model_type": "hidden_regime",
+  "pre_worker_time_ms": null,
+  "regime_step_counts": {
+    "burst": 0,
+    "calm": 8328
+  },
+  "regime_transition_counts": {
+    "burst": {
+      "burst": 0,
+      "calm": 0
+    },
+    "calm": {
+      "burst": 0,
+      "calm": 8323
+    }
+  },
+  "reset_scope": "session",
+  "schema_version": 12,
+  "spike_median_multiplier": 1.25,
+  "spike_threshold_ms_by_worker_slot": {
+    "0": 233.3663308620453
+  },
+  "worker_count": 1
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/profiles/latency_distribution.json

@@ -0,0 +1,1027 @@
+{
+  "schema_version": 3,
+  "worker_slots": {
+    "0": {
+      "all": {
+        "count": 8328,
+        "observation_to_action_latency_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            182.51190090179443,
+            182.5990712020874,
+            183.4172144546509,
+            183.53287933921814,
+            183.68841939544677,
+            183.74431874656676,
+            183.8525206336975,
+            183.94236397743225,
+            183.98504809570312,
+            184.0675267868042,
+            184.09871429634094,
+            184.14161424255371,
+            184.16426149368286,
+            184.48534727096558,
+            184.81943870544433,
+            185.1558120441437,
+            185.32273693084716,
+            185.45555639266968,
+            185.6245580482483,
+            185.82641991615296,
+            186.16743684768676,
+            186.33602075576783,
+            186.41803936004638,
+            186.5140625858307,
+            186.624109582901,
+            186.80681640625,
+            187.01032037734984,
+            187.29441248893738,
+            187.46500878334047,
+            187.53854700088502,
+            187.60008964538574,
+            187.67686405181885,
+            187.76799886703492,
+            187.88990026474,
+            188.1008325767517,
+            188.3116830730438,
+            188.42966318130493,
+            188.51301991462708,
+            188.56810091972352,
+            188.61034175872803,
+            188.65191658973694,
+            188.69371542930602,
+            188.73418128967285,
+            188.78441771507264,
+            188.82482461929322,
+            188.89144421577453,
+            188.9759087562561,
+            189.08284409523012,
+            189.2247434902191,
+            189.33029368400574,
+            189.45147812843322,
+            189.57831025123596,
+            189.69101704597472,
+            189.76690547943116,
+            189.84563495635987,
+            189.92592880249023,
+            190.0234211921692,
+            190.14828969955445,
+            190.29293252944947,
+            190.50890069007875,
+            190.6970445537567,
+            190.8119831085205,
+            190.90444152832032,
+            190.97853907585144,
+            191.0897048473358,
+            191.2094977092743,
+            191.40050406455993,
+            191.59974979400636,
+            191.84850975036622,
+            192.0045140171051,
+            192.11931913375855,
+            192.30210518836975,
+            192.59804566383363,
+            192.99531942367554,
+            193.22267506599425,
+            193.50659142494203,
+            193.9568331718445,
+            194.38524813652037,
+            195.02711208343507,
+            195.58670283317565,
+            196.3085237121582,
+            196.89071383476258,
+            197.35467219352722,
+            197.5683025932312,
+            198.12311701774598,
+            198.22810070991517,
+            198.31867027282715,
+            198.41009971618652,
+            198.50640604019165,
+            198.64412717819215,
+            199.15643096923827,
+            199.32172160148622,
+            199.44297847747802,
+            199.54182436943054,
+            199.64378875732422,
+            199.80405416488648,
+            200.2002462387085,
+            200.38092680931092,
+            200.53608797073363,
+            200.7666387271881,
+            201.13586576461793,
+            201.29075889587403,
+            201.45281374931335,
+            202.11063161849975,
+            202.33715315818787,
+            202.5248878479004,
+            203.18934173583983,
+            203.65286708831786,
+            204.5427226448059,
+            205.44157928466797,
+            206.7019635391235,
+            206.84175895309448,
+            206.89302425384523,
+            207.02788418388366,
+            207.1739716567993,
+            207.71871750831605,
+            208.23820437431337,
+            209.15504163742065,
+            209.8539750652311,
+            212.21866829299933,
+            213.91959929657048,
+            217.08671239929174,
+            217.72784996032715
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        },
+        "spearman_rho": 0.9994883552848496,
+        "worker_service_time_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            181.9307312965393,
+            182.01240357437135,
+            182.94116981887817,
+            183.0318695487976,
+            183.12884718894958,
+            183.17945246315003,
+            183.29248803138734,
+            183.3800907611847,
+            183.47948854446412,
+            183.5283155899048,
+            183.55904664802551,
+            183.58743359947204,
+            183.63745485305787,
+            184.00119165420531,
+            184.28999422073363,
+            184.60930625915526,
+            184.7334228038788,
+            184.88578115463258,
+            185.05682493209838,
+            185.40284130096435,
+            185.67920280456542,
+            185.79937958717346,
+            185.87819798469545,
+            185.9986312484741,
+            186.14060600280763,
+            186.36523722648622,
+            186.57824540138245,
+            186.81760482788087,
+            186.9774268245697,
+            187.12979630470275,
+            187.21207374572754,
+            187.27716727256774,
+            187.3637762928009,
+            187.478848695755,
+            187.67751008033753,
+            187.85748026847838,
+            187.9655556678772,
+            188.07783451080323,
+            188.1729390144348,
+            188.2325493812561,
+            188.27165616989134,
+            188.31511178016663,
+            188.35669506072998,
+            188.39684857368468,
+            188.4446281337738,
+            188.49345670700075,
+            188.5634792327881,
+            188.64958543777465,
+            188.76797508239747,
+            188.86869332313537,
+            188.98380474090575,
+            189.13013701438905,
+            189.26046120643616,
+            189.3796493244171,
+            189.46548888206482,
+            189.53376358032227,
+            189.6276993751526,
+            189.72276918411254,
+            189.87590394973753,
+            190.0510313129425,
+            190.23041208267213,
+            190.41963505744934,
+            190.5264718914032,
+            190.60255604743958,
+            190.68570804595947,
+            190.80044733047487,
+            190.95925040245055,
+            191.14267282485963,
+            191.41743394851684,
+            191.60182864189147,
+            191.7279572868347,
+            191.87225198745728,
+            192.13181191444397,
+            192.55928177833556,
+            192.82688624382018,
+            193.0616827583313,
+            193.48284039497375,
+            193.96575827598573,
+            194.52746960639953,
+            195.1384625816345,
+            195.8656856536865,
+            196.49564743041992,
+            196.89556968688964,
+            197.15528915405272,
+            197.69073113441468,
+            197.79420471191406,
+            197.87992572784424,
+            197.9641825389862,
+            198.05644748687743,
+            198.19007545471192,
+            198.70488401412965,
+            198.87457370758057,
+            198.98056531906127,
+            199.06644088745117,
+            199.14478649139403,
+            199.2934562587738,
+            199.72445402145385,
+            199.86636287689208,
+            199.9965406703949,
+            200.22921152114867,
+            200.67906792640687,
+            200.8188724040985,
+            200.97715708732605,
+            201.67116280555726,
+            201.88992466926575,
+            202.04733855247497,
+            202.71588783264158,
+            203.18766300201415,
+            204.10976705551147,
+            205.01407122612,
+            206.22394678115842,
+            206.40730081367494,
+            206.4462922782898,
+            206.57172914886473,
+            206.7382697124481,
+            207.30015013694765,
+            207.80899495887758,
+            208.72462501716612,
+            209.42250462913503,
+            211.75020676612854,
+            213.50648151397775,
+            216.73891432037325,
+            217.41652011871338
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        }
+      },
+      "steady": {
+        "count": 8328,
+        "observation_to_action_latency_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            182.51190090179443,
+            182.5990712020874,
+            183.4172144546509,
+            183.53287933921814,
+            183.68841939544677,
+            183.74431874656676,
+            183.8525206336975,
+            183.94236397743225,
+            183.98504809570312,
+            184.0675267868042,
+            184.09871429634094,
+            184.14161424255371,
+            184.16426149368286,
+            184.48534727096558,
+            184.81943870544433,
+            185.1558120441437,
+            185.32273693084716,
+            185.45555639266968,
+            185.6245580482483,
+            185.82641991615296,
+            186.16743684768676,
+            186.33602075576783,
+            186.41803936004638,
+            186.5140625858307,
+            186.624109582901,
+            186.80681640625,
+            187.01032037734984,
+            187.29441248893738,
+            187.46500878334047,
+            187.53854700088502,
+            187.60008964538574,
+            187.67686405181885,
+            187.76799886703492,
+            187.88990026474,
+            188.1008325767517,
+            188.3116830730438,
+            188.42966318130493,
+            188.51301991462708,
+            188.56810091972352,
+            188.61034175872803,
+            188.65191658973694,
+            188.69371542930602,
+            188.73418128967285,
+            188.78441771507264,
+            188.82482461929322,
+            188.89144421577453,
+            188.9759087562561,
+            189.08284409523012,
+            189.2247434902191,
+            189.33029368400574,
+            189.45147812843322,
+            189.57831025123596,
+            189.69101704597472,
+            189.76690547943116,
+            189.84563495635987,
+            189.92592880249023,
+            190.0234211921692,
+            190.14828969955445,
+            190.29293252944947,
+            190.50890069007875,
+            190.6970445537567,
+            190.8119831085205,
+            190.90444152832032,
+            190.97853907585144,
+            191.0897048473358,
+            191.2094977092743,
+            191.40050406455993,
+            191.59974979400636,
+            191.84850975036622,
+            192.0045140171051,
+            192.11931913375855,
+            192.30210518836975,
+            192.59804566383363,
+            192.99531942367554,
+            193.22267506599425,
+            193.50659142494203,
+            193.9568331718445,
+            194.38524813652037,
+            195.02711208343507,
+            195.58670283317565,
+            196.3085237121582,
+            196.89071383476258,
+            197.35467219352722,
+            197.5683025932312,
+            198.12311701774598,
+            198.22810070991517,
+            198.31867027282715,
+            198.41009971618652,
+            198.50640604019165,
+            198.64412717819215,
+            199.15643096923827,
+            199.32172160148622,
+            199.44297847747802,
+            199.54182436943054,
+            199.64378875732422,
+            199.80405416488648,
+            200.2002462387085,
+            200.38092680931092,
+            200.53608797073363,
+            200.7666387271881,
+            201.13586576461793,
+            201.29075889587403,
+            201.45281374931335,
+            202.11063161849975,
+            202.33715315818787,
+            202.5248878479004,
+            203.18934173583983,
+            203.65286708831786,
+            204.5427226448059,
+            205.44157928466797,
+            206.7019635391235,
+            206.84175895309448,
+            206.89302425384523,
+            207.02788418388366,
+            207.1739716567993,
+            207.71871750831605,
+            208.23820437431337,
+            209.15504163742065,
+            209.8539750652311,
+            212.21866829299933,
+            213.91959929657048,
+            217.08671239929174,
+            217.72784996032715
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        },
+        "spearman_rho": 0.9994883552848496,
+        "worker_service_time_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            181.9307312965393,
+            182.01240357437135,
+            182.94116981887817,
+            183.0318695487976,
+            183.12884718894958,
+            183.17945246315003,
+            183.29248803138734,
+            183.3800907611847,
+            183.47948854446412,
+            183.5283155899048,
+            183.55904664802551,
+            183.58743359947204,
+            183.63745485305787,
+            184.00119165420531,
+            184.28999422073363,
+            184.60930625915526,
+            184.7334228038788,
+            184.88578115463258,
+            185.05682493209838,
+            185.40284130096435,
+            185.67920280456542,
+            185.79937958717346,
+            185.87819798469545,
+            185.9986312484741,
+            186.14060600280763,
+            186.36523722648622,
+            186.57824540138245,
+            186.81760482788087,
+            186.9774268245697,
+            187.12979630470275,
+            187.21207374572754,
+            187.27716727256774,
+            187.3637762928009,
+            187.478848695755,
+            187.67751008033753,
+            187.85748026847838,
+            187.9655556678772,
+            188.07783451080323,
+            188.1729390144348,
+            188.2325493812561,
+            188.27165616989134,
+            188.31511178016663,
+            188.35669506072998,
+            188.39684857368468,
+            188.4446281337738,
+            188.49345670700075,
+            188.5634792327881,
+            188.64958543777465,
+            188.76797508239747,
+            188.86869332313537,
+            188.98380474090575,
+            189.13013701438905,
+            189.26046120643616,
+            189.3796493244171,
+            189.46548888206482,
+            189.53376358032227,
+            189.6276993751526,
+            189.72276918411254,
+            189.87590394973753,
+            190.0510313129425,
+            190.23041208267213,
+            190.41963505744934,
+            190.5264718914032,
+            190.60255604743958,
+            190.68570804595947,
+            190.80044733047487,
+            190.95925040245055,
+            191.14267282485963,
+            191.41743394851684,
+            191.60182864189147,
+            191.7279572868347,
+            191.87225198745728,
+            192.13181191444397,
+            192.55928177833556,
+            192.82688624382018,
+            193.0616827583313,
+            193.48284039497375,
+            193.96575827598573,
+            194.52746960639953,
+            195.1384625816345,
+            195.8656856536865,
+            196.49564743041992,
+            196.89556968688964,
+            197.15528915405272,
+            197.69073113441468,
+            197.79420471191406,
+            197.87992572784424,
+            197.9641825389862,
+            198.05644748687743,
+            198.19007545471192,
+            198.70488401412965,
+            198.87457370758057,
+            198.98056531906127,
+            199.06644088745117,
+            199.14478649139403,
+            199.2934562587738,
+            199.72445402145385,
+            199.86636287689208,
+            199.9965406703949,
+            200.22921152114867,
+            200.67906792640687,
+            200.8188724040985,
+            200.97715708732605,
+            201.67116280555726,
+            201.88992466926575,
+            202.04733855247497,
+            202.71588783264158,
+            203.18766300201415,
+            204.10976705551147,
+            205.01407122612,
+            206.22394678115842,
+            206.40730081367494,
+            206.4462922782898,
+            206.57172914886473,
+            206.7382697124481,
+            207.30015013694765,
+            207.80899495887758,
+            208.72462501716612,
+            209.42250462913503,
+            211.75020676612854,
+            213.50648151397775,
+            216.73891432037325,
+            217.41652011871338
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        }
+      }
+    }
+  }
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/profiles/profile.json

@@ -0,0 +1,66 @@
+{
+  "burst_model_path": "latency_burst_model.json",
+  "distribution_path": "latency_distribution.json",
+  "env_fps": 60,
+  "frame_ms": 16.666666666666668,
+  "gpu_class": "1x-rtx3090",
+  "instance_id": "instance_a5037b165aa0cedc",
+  "latency_kind": "observation_to_action_latency",
+  "latency_method": "temporal",
+  "model_id": "pi05",
+  "n_admitted_observations": 8328,
+  "n_capacity_drops": 17566,
+  "n_observation_attempts": 25894,
+  "per_slot_summary": {
+    "0": {
+      "admitted_count": 8328,
+      "mean_observation_to_action_latency_ms": 192.75256956877558,
+      "mean_worker_service_time_ms": 192.30478083789635,
+      "p95_observation_to_action_latency_ms": 203.17504091262816,
+      "p95_worker_service_time_ms": 202.71020216941832,
+      "p99_worker_service_time_ms": 206.2041941642761
+    }
+  },
+  "provenance": {
+    "base_config": "configs/experiments/demon_attack/starvla_profile.yaml",
+    "checkpoint_kind": "best",
+    "model_artifact": {
+      "checkpoint": "checkpoints/steps_5000_pytorch_model.pt",
+      "model_config": "config.full.yaml",
+      "path_in_repo": ".",
+      "repo_id": "latency-sensitive-bench/pi05_demon_attack_fix_latency_0",
+      "source": "local"
+    },
+    "session_ids": [
+      0,
+      1,
+      2,
+      3,
+      4
+    ]
+  },
+  "sample_model_type": "hidden_regime",
+  "source_run_id": "20260914T151446207384Z",
+  "summary": {
+    "frame_ms": 16.666666666666668,
+    "max_ms": 217.72784996032715,
+    "mean_effective_frames": 11.565154174126533,
+    "mean_ms": 192.75256956877558,
+    "min_ms": 182.51190090179443,
+    "n_samples": 8328,
+    "p50_frames": 11.44871898651123,
+    "p50_ms": 190.8119831085205,
+    "p90_frames": 12.077434913635253,
+    "p90_ms": 201.2905818939209,
+    "p95_frames": 12.19050245475769,
+    "p95_ms": 203.17504091262816,
+    "p99_frames": 12.401722709083556,
+    "p99_ms": 206.69537848472595,
+    "prob_latency_gt_1_frame": 1.0,
+    "prob_latency_gt_2_frames": 1.0,
+    "prob_latency_gt_3_frames": 1.0,
+    "std_ms": 5.908028363032917
+  },
+  "visualization_path": "latency_profile.png",
+  "workload_id": "demon_attack"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/provenance.json

@@ -0,0 +1,123 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "5b533937a72e9fa923ecf28b1c1be5a16bad488d",
+    "teacher_path": "zero-latency/demon-attack/small-policy/sample-factory-v1",
+    "teacher_checkpoint": "best_000048704_24936448_reward_27118.050.pth",
+    "teacher_sha256": "f06e92be4b26fc883db66b355476d503aed4a6c8464d5e8f4c158f50ca2422ae",
+    "rollout_overrides": {
+      "env_fps": 60,
+      "obs_fps": 15,
+      "latency_type": "fixed",
+      "fixed_latency_ms": 0.0,
+      "seed": 42
+    },
+    "training_latency_condition": "zero",
+    "history": "decision_v1",
+    "history_decisions": 8,
+    "history_source": "zero_latency_issued_equals_applied",
+    "student_image_frames": 1,
+    "max_episode_raw_frames": 7200,
+    "episodes": 200,
+    "train_labels": 324000,
+    "filter_preset": "none"
+  },
+  "training_run_id": "demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "186aea40",
+  "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "training_condition": "zero",
+  "base_model_revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17",
+  "hf_repo_id": "latency-sensitive-bench/benchmark-models",
+  "hf_path": "zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "evaluations": [
+    {
+      "job_id": "eval_zero_to_zero__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+      "eval_protocol_version": "hist8-history01-par32-v3",
+      "training_step": 5000,
+      "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+      "profile_sha256": null,
+      "mean_return": 2350.95,
+      "std_return": 351.018300804958,
+      "mean_length": 7199.39,
+      "episodes": 100,
+      "parallel_envs": 32,
+      "max_episode_raw_frames": 7200,
+      "issued_actions": 179985,
+      "top_action": "NOOP",
+      "largest_action_fraction": 0.19317720921187878,
+      "unique_action_values": 6,
+      "episode_final_done": 1,
+      "episodes_at_frame_cap": 99,
+      "checks": {
+        "100_exact_seeds": true,
+        "checkpoint_sha": true,
+        "bundle_step": true,
+        "training_step_matches_plan": true,
+        "profile_sha": true,
+        "binary_history": true,
+        "raw_score_means_match": true,
+        "action_counts_match": true,
+        "action_total_match": true,
+        "summary_returns_match": true,
+        "summary_lengths_match": true,
+        "100_final_steps": true,
+        "final_step_lengths_match": true,
+        "parallel_capacity_horizon": true,
+        "fps_history": true,
+        "environment_latency_matches": true,
+        "episode_latency_protocol": true,
+        "training_recipe": true,
+        "training_dimensions": true,
+        "initialization_revision": true
+      },
+      "environment_condition": "zero"
+    },
+    {
+      "job_id": "eval_zero_to_profile__demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+      "eval_protocol_version": "hist8-history01-par32-v3",
+      "training_step": 5000,
+      "checkpoint_sha256": "f9fd075da0d3258d5fd283779b7ef642cc7a6540951aca5060f2cf721851e19e",
+      "profile_sha256": "5c2895d34b3d821c7b24a14d9acd84e416baec9eebc87083ba86b9c8954696ae",
+      "mean_return": 112.3,
+      "std_return": 54.41240667347843,
+      "mean_length": 2222.2,
+      "episodes": 100,
+      "parallel_envs": 32,
+      "max_episode_raw_frames": 7200,
+      "issued_actions": 17926,
+      "top_action": "RIGHTFIRE",
+      "largest_action_fraction": 0.2610175164565436,
+      "unique_action_values": 6,
+      "episode_final_done": 100,
+      "episodes_at_frame_cap": 0,
+      "checks": {
+        "100_exact_seeds": true,
+        "checkpoint_sha": true,
+        "bundle_step": true,
+        "training_step_matches_plan": true,
+        "profile_sha": true,
+        "binary_history": true,
+        "raw_score_means_match": true,
+        "action_counts_match": true,
+        "action_total_match": true,
+        "summary_returns_match": true,
+        "summary_lengths_match": true,
+        "100_final_steps": true,
+        "final_step_lengths_match": true,
+        "parallel_capacity_horizon": true,
+        "fps_history": true,
+        "environment_latency_matches": true,
+        "episode_latency_protocol": true,
+        "training_recipe": true,
+        "training_dimensions": true,
+        "initialization_revision": true
+      },
+      "environment_condition": "profile"
+    }
+  ]
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/rollout_metadata.json

@@ -0,0 +1,338 @@
+{
+  "action_history_decisions": 8,
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_layout": "demon_attack_discrete",
+  "base_prompt": "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score.",
+  "checkpoint_config": {
+    "actor_critic_share_weights": true,
+    "actor_worker_gpus": [
+      0
+    ],
+    "adam_beta1": 0.9,
+    "adam_beta2": 0.999,
+    "adam_eps": 1e-05,
+    "adaptive_stddev": true,
+    "add_latency_info": false,
+    "algo": "APPO",
+    "async_rl": true,
+    "batch_size": 1024,
+    "batched_sampling": true,
+    "benchmark": false,
+    "cli_args": {
+      "actor_worker_gpus": [
+        0
+      ],
+      "add_latency_info": false,
+      "algo": "APPO",
+      "async_rl": true,
+      "batch_size": 1024,
+      "batched_sampling": true,
+      "clip_reward": true,
+      "device": "gpu",
+      "env": "latency_demon_attack",
+      "env_fps": 60.0,
+      "env_gpu_actions": true,
+      "env_gpu_observations": true,
+      "env_id": "ALE/DemonAttack-v5",
+      "episode_metrics_path": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0/demon_attack_teacher_fixed_l0_obs15_seed0/episode_metrics.jsonl",
+      "eval_deterministic": true,
+      "eval_episodes": 100,
+      "eval_max_steps": 7200,
+      "eval_parallel_envs": 50,
+      "eval_raw_reward": true,
+      "experiment": "demon_attack_teacher_fixed_l0_obs15_seed0",
+      "experiment_summaries_interval": 1,
+      "fixed_latency_ms": 0.0,
+      "frame_stack": 4,
+      "full_action_space": false,
+      "gae_lambda": 0.95,
+      "gamma": 0.99,
+      "gpu_env_batch_size": 512,
+      "gpu_env_device": "auto",
+      "hold_policy": "hold",
+      "keep_checkpoints": 5,
+      "latency_type": "fixed",
+      "learning_rate": 0.000303,
+      "max_episode_steps": 25000,
+      "max_grad_norm": 0.0,
+      "max_policy_lag": 300,
+      "mode": "train",
+      "noop_max": 30,
+      "normalize_input": true,
+      "normalize_returns": true,
+      "num_batches_per_epoch": 8,
+      "num_envs_per_worker": 1,
+      "num_epochs": 2,
+      "num_policies": 1,
+      "num_workers": 1,
+      "obs_fps": 15.0,
+      "ordering_policy": "latest_ready",
+      "ppo_clip_ratio": 0.1,
+      "ppo_clip_value": 0.2,
+      "recurrence": 32,
+      "repeat_action_probability": 0.0,
+      "reset_mode": "fire",
+      "restart_behavior": "resume",
+      "rollout": 64,
+      "save_every_sec": 600,
+      "screen_size": 84,
+      "seed": 0,
+      "simulator": "gpu",
+      "stats_avg": 100,
+      "terminal_on_life_loss": true,
+      "train_dir": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0",
+      "train_for_env_steps": 25000000,
+      "use_rnn": false,
+      "value_loss_coeff": 0.5,
+      "wandb_group": "demon-attack-obs15-fixed_l0",
+      "wandb_job_type": "sample_factory",
+      "wandb_project": "latency-sensitive-bench",
+      "wandb_tags": [
+        "real_profile_latency0_teacher",
+        "demon-attack",
+        "teacher",
+        "fixed",
+        "fixed_l0",
+        "obs15",
+        "seed0"
+      ],
+      "with_wandb": true,
+      "worker_num_splits": 1
+    },
+    "clip_reward": true,
+    "command_line": "--mode train --algo APPO --env latency_demon_attack --experiment demon_attack_teacher_fixed_l0_obs15_seed0 --train_dir results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0 --restart_behavior resume --device gpu --actor_worker_gpus 0 --env_gpu_observations True --env_gpu_actions True --gpu-env-batch-size 512 --seed 0 --episode_metrics_path results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0/demon_attack_teacher_fixed_l0_obs15_seed0/episode_metrics.jsonl --train_for_env_steps 25000000 --num_workers 1 --num_envs_per_worker 1 --num_policies 1 --batch_size 1024 --rollout 64 --recurrence 32 --num_epochs 2 --num_batches_per_epoch 8 --worker_num_splits 1 --max_policy_lag 300 --learning_rate 0.000303 --gamma 0.99 --gae_lambda 0.95 --ppo_clip_ratio 0.1 --ppo_clip_value 0.2 --value_loss_coeff 0.5 --max_grad_norm 0.0 --save_every_sec 600 --keep_checkpoints 5 --stats_avg 100 --experiment_summaries_interval 1 --batched_sampling True --async_rl True --batched_sampling True --use_rnn False --normalize_returns True --normalize_input True --latency-type fixed --fixed-latency-ms 0.0 --add-latency-info False --eval-episodes 100 --eval-parallel-envs 50 --eval-max-steps 7200 --eval-deterministic True --eval-raw-reward --with_wandb True --wandb_project latency-sensitive-bench --wandb_group demon-attack-obs15-fixed_l0 --wandb_job_type sample_factory --wandb_tags real_profile_latency0_teacher demon-attack teacher fixed fixed_l0 obs15 seed0 --env_id ALE/DemonAttack-v5 --env-fps 60 --obs-fps 15.0 --screen_size 84 --noop_max 30 --reset-mode fire --frame_stack 4 --terminal_on_life_loss True --clip_reward True --repeat_action_probability 0.0 --full_action_space False --max_episode_steps 25000 --simulator gpu --gpu-env-device auto --hold-policy hold --ordering-policy latest_ready",
+    "continuous_tanh_scale": 0.0,
+    "decoder_mlp_layers": [],
+    "decorrelate_envs_on_one_worker": true,
+    "decorrelate_experience_max_seconds": 0,
+    "default_niceness": 0,
+    "device": "gpu",
+    "encoder_conv_architecture": "convnet_atari",
+    "encoder_conv_mlp_layers": [
+      512
+    ],
+    "encoder_mlp_layers": [
+      512,
+      512
+    ],
+    "env": "latency_demon_attack",
+    "env_fps": 60,
+    "env_frameskip": 1,
+    "env_framestack": 1,
+    "env_gpu_actions": true,
+    "env_gpu_observations": true,
+    "env_id": "ALE/DemonAttack-v5",
+    "episode_metrics_path": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0/demon_attack_teacher_fixed_l0_obs15_seed0/episode_metrics.jsonl",
+    "eval_deterministic": true,
+    "eval_env_frameskip": 1,
+    "eval_episodes": 100,
+    "eval_latency_raw_frame_values": "0,1,2,3,4,5",
+    "eval_max_steps": 7200,
+    "eval_parallel_envs": 50,
+    "eval_raw_reward": true,
+    "experiment": "demon_attack_teacher_fixed_l0_obs15_seed0",
+    "experiment_summaries_interval": 1,
+    "exploration_loss": "entropy",
+    "exploration_loss_coeff": 0.003,
+    "export_env_raw_rgb_frames": false,
+    "fixed_latency_ms": 0.0,
+    "flush_summaries_interval": 30,
+    "force_envs_single_thread": false,
+    "frame_stack": 4,
+    "full_action_space": false,
+    "gae_lambda": 0.95,
+    "gamma": 0.99,
+    "git_hash": "unknown",
+    "git_repo_name": "not a git repository",
+    "gpu_env_batch_size": 512,
+    "gpu_env_device": "auto",
+    "heartbeat_interval": 20,
+    "heartbeat_reporting_interval": 180,
+    "help": false,
+    "hold_policy": "hold",
+    "initial_stddev": 1.0,
+    "keep_checkpoints": 5,
+    "kl_loss_coeff": 0.0,
+    "latency_seed": null,
+    "latency_type": "fixed",
+    "learning_rate": 0.000303,
+    "load_checkpoint_kind": "latest",
+    "log_to_file": true,
+    "lr_adaptive_max": 0.01,
+    "lr_adaptive_min": 1e-06,
+    "lr_schedule": "linear_decay",
+    "lr_schedule_kl_threshold": 0.008,
+    "max_episode_steps": 25000,
+    "max_grad_norm": 0.0,
+    "max_latency_ms": null,
+    "max_pending_actions": null,
+    "max_policy_lag": 300,
+    "mean_latency_ms": null,
+    "min_latency_ms": null,
+    "mode": "train",
+    "nonlinearity": "elu",
+    "noop_max": 30,
+    "normalize_input": true,
+    "normalize_input_keys": null,
+    "normalize_returns": true,
+    "num_batches_per_epoch": 8,
+    "num_batches_to_accumulate": 2,
+    "num_envs_per_worker": 1,
+    "num_epochs": 2,
+    "num_policies": 1,
+    "num_workers": 1,
+    "obs_fps": 15,
+    "obs_scale": 255.0,
+    "obs_subtract_mean": 0.0,
+    "optimizer": "adam",
+    "ordering_policy": "latest_ready",
+    "output_dir": "outputs/jitter_destructiveness/real_profile/teacher_latency0/demon_attack/train/teacher/fixed_l0/obs15/seed_0",
+    "pbt_mix_policies_in_one_env": true,
+    "pbt_mutation_rate": 0.15,
+    "pbt_optimize_gamma": false,
+    "pbt_period_env_steps": 5000000,
+    "pbt_perturb_max": 1.5,
+    "pbt_perturb_min": 1.1,
+    "pbt_replace_fraction": 0.3,
+    "pbt_replace_reward_gap": 0.1,
+    "pbt_replace_reward_gap_absolute": 1e-06,
+    "pbt_start_mutation": 20000000,
+    "pbt_target_objective": "true_objective",
+    "pixel_format": "CHW",
+    "policy_init_gain": 1.0,
+    "policy_initialization": "orthogonal",
+    "policy_workers_per_policy": 1,
+    "ppo_clip_ratio": 0.1,
+    "ppo_clip_value": 0.2,
+    "recurrence": 32,
+    "repeat_action_probability": 0.0,
+    "reset_mode": "fire",
+    "restart_behavior": "resume",
+    "reward_clip": 1000.0,
+    "reward_scale": 1.0,
+    "rnn_num_layers": 1,
+    "rnn_size": 512,
+    "rnn_type": "gru",
+    "rollout": 64,
+    "save_best_after": 100000,
+    "save_best_every_sec": 5,
+    "save_best_metric": "reward",
+    "save_every_sec": 600,
+    "save_milestones_sec": -1,
+    "screen_size": 84,
+    "seed": 42,
+    "serial_mode": false,
+    "set_workers_cpu_affinity": true,
+    "shuffle_minibatches": false,
+    "simulator": "gpu",
+    "stats_avg": 100,
+    "std_latency_ms": null,
+    "summaries_use_frameskip": true,
+    "terminal_on_life_loss": true,
+    "train_dir": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0",
+    "train_for_env_steps": 25000000,
+    "train_for_seconds": 10000000000,
+    "use_env_info_cache": false,
+    "use_record_episode_statistics": false,
+    "use_rnn": false,
+    "value_bootstrap": false,
+    "value_loss_coeff": 0.5,
+    "vtrace_c": 1.0,
+    "vtrace_rho": 1.0,
+    "wandb_group": "demon-attack-obs15-fixed_l0",
+    "wandb_job_type": "sample_factory",
+    "wandb_project": "latency-sensitive-bench",
+    "wandb_tags": [
+      "real_profile_latency0_teacher",
+      "demon-attack",
+      "teacher",
+      "fixed",
+      "fixed_l0",
+      "obs15",
+      "seed0"
+    ],
+    "wandb_unique_id": "demon-attack-obs15-fixed_l0-s0",
+    "wandb_user": null,
+    "with_pbt": false,
+    "with_vtrace": false,
+    "with_wandb": true,
+    "worker_num_splits": 1
+  },
+  "checkpoint_experiment_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/teacher_runtime",
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/teacher_runtime/best_000048704_24936448_reward_27118.050.pth",
+  "checkpoint_train_step": 48704,
+  "config_source": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/teacher_runtime/config.json",
+  "context_image_count": 0,
+  "context_window": 1,
+  "env_fps": 60.0,
+  "env_name": "demon_attack",
+  "episode_return_field": "episode_raw_return",
+  "filter_preset": "none",
+  "filter_report": {
+    "accepted_episodes": 200,
+    "accepted_train_episodes": 180,
+    "accepted_val_episodes": 20,
+    "attempted_episodes": 200,
+    "preset": "none",
+    "raw_score_bins": {
+      "6460-6889": 0,
+      "6890-7309": 0,
+      "7310-7999": 0,
+      "<6460": 200,
+      ">=8000": 0
+    },
+    "rejected_episodes": 0,
+    "train_rows_after_row_filter": 324000,
+    "train_rows_before_row_filter": 324000,
+    "val_rows_after_row_filter": 36000,
+    "val_rows_before_row_filter": 36000
+  },
+  "frame_stack": 4,
+  "image_resolution": [
+    210,
+    160,
+    3
+  ],
+  "image_source": "env_raw_rgb",
+  "image_transform": {
+    "gamma": 1.3,
+    "ground_fraction": 0.22,
+    "history_frames": 5,
+    "image_transform": "raw_rgb",
+    "min_alpha": 35,
+    "scroll_px_per_step": 4.0
+  },
+  "image_transform_prompt_contexts": {
+    "demon_attack_ghost_trail": " You can see the recent motion of the ship, missiles, and demons in the image. Use it to make your decision.",
+    "flappy_ghost_trail": " You can see the past motion of the bird in the image. Use it to make your decision."
+  },
+  "latency_override": null,
+  "latency_source": "checkpoint",
+  "max_episodes": 200,
+  "max_steps_per_episode": 7200,
+  "max_steps_unit": "raw_frame",
+  "num_envs": 256,
+  "obs_fps": 15.0,
+  "obs_stride_raw_frames": 4,
+  "prompt_source": "sample_factory_checkpoint:base_prompt",
+  "replay_num_envs": 256,
+  "reward_field": "raw_reward",
+  "reward_semantics": "raw_reward",
+  "rows_unit": "decision_step",
+  "schema_version": 2,
+  "split_seed": 0,
+  "total_episodes": 200,
+  "total_rows": 360000,
+  "train_episodes": 180,
+  "train_rows": 324000,
+  "val_episodes": 20,
+  "val_fraction": 0.1,
+  "val_rows": 36000
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/run_metadata.json

@@ -0,0 +1,18 @@
+{
+  "training_run_id": "demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2",
+  "wandb_run_id": "186aea40",
+  "recipe_version": "hist8-v2",
+  "history_encoding": "binary_0_1",
+  "training_condition": "zero",
+  "initialization_seed": 42,
+  "vlm_lr": 3e-06,
+  "max_train_steps": 5000,
+  "stop_after_steps": null,
+  "num_workers_per_rank": 16,
+  "eval_num_workers_per_rank": 16,
+  "prefetch_factor": 4,
+  "base_model_revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17",
+  "dataset_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/lerobot",
+  "dataset_manifest_sha256": "688b6b9bc596d345659e3be392e6336078d0a268e3ee24347f31e0b85d93bb5b",
+  "code_snapshot_sha256": "4fdfd05c7faaa60fb697f4d2bd169b94979d9626b8ebe52ac01b9b6a6faecf8d"
+}

zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/demon_attack-qwenpi_v3-hist8-zero-scratch-s42-v2/task_contract.json

@@ -0,0 +1,51 @@
+{
+  "task": "demon_attack",
+  "model": "qwenpi_v3",
+  "action_horizon": 1,
+  "image_frames": 1,
+  "state_source": "transport",
+  "state_dim": 88,
+  "history_decisions": 8,
+  "history_encoding": "binary_0_1",
+  "history_normalization": "identity",
+  "history_reset": "all_zero",
+  "history_order": "oldest_to_newest",
+  "history_entry_fields": [
+    "admission_bit",
+    "admitted_command_non_noop_bits",
+    "last_applied_action_non_noop_bits"
+  ],
+  "history_action_bit_order": [
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_dim": 6,
+  "action_layout": "demon_attack_discrete",
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "task_prompts": [
+    "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score."
+  ],
+  "env_fps": 60,
+  "obs_fps": 15,
+  "evaluation": {
+    "episodes": 100,
+    "seeds": [
+      1000000,
+      1000099
+    ],
+    "parallel_envs": 32,
+    "capacity": 1,
+    "max_raw_frames": 7200,
+    "protocol_version": "hist8-history01-par32-v3"
+  }
+}