Publish hist8 zero demon_attack qwengr00t step5000

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/README.md

@@ -0,0 +1,36 @@
+# demon_attack / qwengr00t — hist8 zero training
+
+Run `demon_attack-qwengr00t-hist8-zero-scratch-s42-v2`; final optimizer step **5000**, seed **42**. [W&B](https://wandb.ai/saberrr-zju/starvla_tasks/runs/b2048a00).
+
+Checkpoint SHA256: `6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff`.
+
+## Model and inputs
+
+Full StarVLA state dict in `checkpoints/model.pt` (original evaluated bytes). Initialize the matching Qwen model with `config.yaml` and `dataset_statistics.json`. Base: `Qwen/Qwen3-VL-4B-Instruct@ebb281ec70b05090aa6165b016eac8ec08e71b17`; model-specific action head trained from random initialization.
+
+One current RGB image, eight prior causal decision histories (88 raw 0/1 values), action horizon 1. `h1` in this repository path is the action horizon; `hist8` is input history. Pass history as `transport`, preserve all-zero reset, and use identity state normalization. Prompt and action order are in `task_contract.json` and `manifest.json`.
+
+Training: 2 GPUs, bf16/ZeRO-2, batch 64 per rank, accumulation 1, global batch 128; 16 dataloader workers per rank and prefetch 4. Backbone LR 3e-6, action head 1e-4; other groups retain the recorded configuration. Warmup 100, cosine min_lr_rate 1/30, 5000 steps. Full historical training configuration and code snapshot are included.
+
+## Formal evaluation
+
+| Environment | Episodes | Return mean ± std | Mean raw frames |
+|---|---:|---:|---:|
+| zero | 100 | 2370.9000 ± 369.3240 | 7190.83 |
+| profile | 100 | 231.9000 ± 109.1989 | 3294.29 |
+
+Seeds 1,000,000–1,000,099; parallel 32; capacity 1; FPS/decision Hz 60/15; max 7200 raw frames. Zero-trained models have both zero and profile evaluations; profile-trained models have the matching profile evaluation. `profiles/profile.json` is the exact model-specific latency profile, with SHA in provenance.
+
+Each `evaluations/<condition>/` contains the evaluated config, 100 episode records, action audit including raw-score summaries, verification, provenance and evaluator code snapshot. Evaluation configs retain original machine paths as execution evidence; replace checkpoint, model-config, backbone, profile and output paths when replaying locally. Deadly Corridor requires 160×120 RGB with HUD, no crosshair, weapon enabled, decals/particles disabled before resizing.
+
+These are one-training-seed results. Architectures use different latency profiles. Zero/profile training also uses different teachers and collected data, so their score difference is not an isolated learning-rate ablation.
+
+## Download
+
+```python
+from huggingface_hub import snapshot_download
+prefix = "zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2"
+repo = snapshot_download("latency-sensitive-bench/benchmark-models", allow_patterns=[prefix + "/**"])
+```
+
+Use a pinned repository commit for reproduction. Preserve the original checkpoint SHA above. Optimizer/RNG resume state remains in the source training archive; this publication contains the inference checkpoint.

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/bundle.complete.json

@@ -0,0 +1,4 @@
+{
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "training_step": 5000
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoint.sha256

@@ -0,0 +1 @@
+6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff  checkpoints/model.pt

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff
+size 9977006371

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/collection_quality_report.json

@@ -0,0 +1,33 @@
+{
+  "episodes": 200,
+  "train_episodes": 180,
+  "val_episodes": 20,
+  "train_labels": 324000,
+  "val_labels": 36000,
+  "raw_frames_quantiles": [
+    7200.0,
+    7200.0,
+    7200.0,
+    7200.0,
+    7200.0
+  ],
+  "return_quantiles": [
+    1620.0,
+    2040.0,
+    2505.0,
+    2805.0,
+    3500.0
+  ],
+  "termination_reasons": {
+    "horizon": 200
+  },
+  "action_id_counts": {
+    "0": 67142,
+    "1": 58967,
+    "2": 55608,
+    "3": 66806,
+    "4": 62506,
+    "5": 48971
+  },
+  "previous_decision_admitted_fraction": 0.9999277376320178
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/config.full.yaml

@@ -0,0 +1,297 @@
+framework:
+  name: QwenGR00T
+  qwenvl:
+    base_vlm: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+    attn_implementation: flash_attention_2
+    vl_hidden_dim: 2048
+    enable_gradient_checkpointing: true
+  action_model:
+    action_model_type: DiT-B
+    action_hidden_dim: 1024
+    hidden_size: 1024
+    add_pos_embed: true
+    max_seq_len: 1024
+    action_dim: 6
+    state_dim: 88
+    task_objective: null
+    action_horizon: 1
+    repeated_diffusion_steps: 8
+    noise_beta_alpha: 1.5
+    noise_beta_beta: 1.0
+    noise_s: 0.999
+    num_timestep_buckets: 1000
+    num_inference_timesteps: 4
+    num_target_vision_tokens: 32
+    diffusion_model_cfg:
+      cross_attention_dim: 2560
+      dropout: 0.2
+      final_dropout: true
+      interleave_self_attention: true
+      norm_type: ada_norm
+      num_layers: 16
+      output_dim: 1024
+      positional_embeddings: null
+      attention_head_dim: 64
+    loss_type: l1
+    future_action_window_size: 0
+    past_action_window_size: 0
+    action_env_dim: 6
+  kv_memory:
+    enabled: false
+    window: 4
+    rollout_len: 8
+    packed_train: false
+    rebased_sink: true
+datasets:
+  vla_data:
+    dataset_py: lerobot_datasets
+    include_state: true
+    data_root_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack
+    data_mix: lerobot
+    eval_data_mix: lerobot__val
+    custom_mixtures_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/_generated_mixtures/lerobot.json
+    action_type: discrete
+    sequential_step_sampling: false
+    eval_sequential_step_sampling: null
+    num_workers: 16
+    eval_num_workers: 16
+    prefetch_factor: 4
+    persistent_workers: true
+    pin_memory: true
+    shuffle: true
+    action_balance:
+      enabled: false
+      strategy: balanced_epoch
+      action_key: action_id
+      target_flap_fraction: 0.3
+      noop_id: 0
+      flap_id: 1
+    latency_curriculum:
+      enabled: false
+      strategy: exclusive
+      latencies: null
+      phase_steps: null
+      phase_distributions: null
+      new_latency_passes: 1.0
+      replay_passes: 0.25
+      target_total_passes: 2.0
+      final_equalization: true
+      step_budget_mode: auto
+      eval_at_phase_end: false
+      save_at_phase_end: false
+      computed_plan: null
+    per_device_batch_size: 64
+    load_all_data_for_training: true
+    num_obs_frames: 1
+    image_mode: single
+    prompt_mode: raw
+    stitch_grid:
+    - 2
+    - 2
+    obs_image_size: null
+    video_backend: torchvision_av
+dataset:
+  source_hf: ''
+  config_name: null
+  source_subdir: null
+  converted_name: demon_attack_train
+  single_source_hf: ''
+  mixed_source_hf: ''
+  single_converted_name: demon_attack_train
+  mixed_converted_name: demon_attack_mixed_latency_train
+  single_latency_filter: null
+  mixed_latency_filter: null
+  force_download: false
+  setup_force: false
+  skip_verification: false
+  target_latency_unit: observation_steps
+  verify_rows: 200
+  max_episodes: null
+  episodes_per_latency: null
+  latency_filter: null
+  debug_subset:
+    enabled: false
+    max_episodes: 5
+    suffix: debug
+base_model:
+  repo_id: Qwen/Qwen3-VL-4B-Instruct
+initialization:
+  checkpoint_local_dir: null
+  checkpoint_hf_repo_id: null
+  checkpoint_filename: null
+trainer:
+  max_train_steps: 5000
+  num_warmup_steps: 100
+  save_interval: 500
+  eval_interval: 500
+  eval_num_batches: 50
+  per_latency_eval_num_batches: null
+  eval_action_classification: false
+  eval_action_classification_interval: null
+  cc_f1_tolerance: 1
+  learning_rate:
+    base: 3.0e-05
+    qwen_vl_interface: 3.0e-06
+    action_model: 0.0001
+  lr_scheduler_type: cosine_with_min_lr
+  scheduler_specific_kwargs:
+    min_lr_rate: 0.03333333333333333
+  freeze_modules: ''
+  freeze_vit: false
+  freeze_tied_embedding: false
+  freeze_llm_layers: []
+  loss_scale:
+    vla: 1.0
+    vlm: 0.0
+  max_grad_norm: 1.0
+  weight_decay: 0.0
+  logging_frequency: 1
+  profile_timing:
+    enabled: false
+    log_interval: 10
+  gradient_clipping: 1.0
+  gradient_accumulation_steps: 1
+  distributed_backend: deepspeed
+  is_resume: false
+  pretrained_checkpoint: null
+  resume_step: 0
+  reload_modules: null
+  optimizer:
+    name: AdamW
+    betas:
+    - 0.9
+    - 0.95
+    eps: 1.0e-08
+    weight_decay: 1.0e-08
+    fused: true
+  save_format: pt
+  hist8_diagnostics:
+    steps:
+    - 0
+    - 500
+    - 1000
+    - 2500
+    - 5000
+    sample_count: 2048
+    noise_seeds:
+    - 1729
+    - 1730
+    - 1731
+    - 1732
+    sample_seed: 42
+    batch_size: 8
+    bootstrap_repeats: 4000
+workspace_dir: WORKSPACE_DIR
+run_root_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train
+seed: 42
+wandb_entity: saberrr-zju
+wandb_project: starvla_tasks
+auth:
+  env_file: null
+  hf_token_env: HF_TOKEN
+  wandb_api_key_env: WANDB_API_KEY
+paths:
+  run_root_dir: results/Checkpoints
+  dataset_local_dir: playground/Datasets/rl_games
+  dataset_cache_dir: null
+  base_model_dir: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  accelerate_config: starVLA/config/deepseeds/deepspeed_zero2.yaml
+launch:
+  use_accelerate: true
+  gpus: null
+  num_processes: 1
+  dry_run: false
+conda:
+  enabled: true
+  env_name: null
+rl_games:
+  model_alias: gr00t
+  env_eval:
+    image_size: 224
+    frameskip: 4
+    image_transform: raw_rgb
+    prompt_mode: raw
+    ghost_trail:
+      history_frames: 5
+      gamma: 1.3
+      min_alpha: 35
+      scroll_px_per_step: 4.0
+      ground_fraction: 0.22
+    seed: 42
+    fixed_episode_seeds: true
+    latency_seed_stride: 0
+    task_seed_stride: 0
+    task_description: 'You are playing Demon Attack from a single game image. Choose
+      exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE.'
+    eval_parallel_envs: 5
+    action_chunk_execution:
+      enabled: false
+      chunk_size: null
+    demon_attack:
+      noop_max: 30
+    enabled: false
+    eval_backend: latency_bench
+    distributed_mode: none
+    vectorized:
+      enabled: false
+      batch_size: 1
+    latency:
+      prompt_map_path: null
+      mode: single
+      values:
+      - 0
+    mid_train:
+      enabled: false
+      interval_steps: 100
+      latencies:
+      - 0
+      num_episodes: 5
+      max_steps_per_episode: 3600
+    post_train:
+      enabled: false
+      latencies:
+      - 0
+      - 1
+      - 2
+      - 3
+      - 4
+      num_episodes: 5
+      max_steps_per_episode: 3600
+  task: demon_attack
+  initialization_mode: scratch
+  action_carrier: native
+model: gr00t
+env: demon_attack
+init: scratch
+mode: single
+checkpoint:
+  load: none
+  hf_repo_id: null
+  save_best_model: false
+  save_final_model: true
+  save_pt_file: true
+  save_training_state: true
+  save_safetensors_file: false
+  local:
+    keep_last_n: 2
+  sync:
+    enabled: false
+    repo_id: null
+    keep_last_n: 0
+    sync_every_n_checkpoints: 1
+    resume_policy: local_latest
+run_id: demon_attack-qwengr00t-hist8-zero-scratch-s42-v2
+output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2
+config_yaml: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/train.yaml
+is_debug: false
+version_id: '0.21'
+wandb_name: demon_attack-qwengr00t-hist8-zero-scratch-s42-v2
+wandb_group: decision-history-vla-h8-v2
+wandb_tags:
+- demon_attack
+- qwengr00t
+- hist8-v2
+- history01
+- scratch
+- zero-latency
+training_latency_condition: zero-latency

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/config.yaml

@@ -0,0 +1,54 @@
+framework:
+  name: QwenGR00T
+  qwenvl:
+    base_vlm: Qwen/Qwen3-VL-4B-Instruct
+    attn_implementation: flash_attention_2
+    vl_hidden_dim: 2048
+    enable_gradient_checkpointing: true
+  action_model:
+    action_model_type: DiT-B
+    action_hidden_dim: 1024
+    hidden_size: 1024
+    add_pos_embed: true
+    max_seq_len: 1024
+    action_dim: 6
+    state_dim: 88
+    task_objective: null
+    action_horizon: 1
+    repeated_diffusion_steps: 8
+    noise_beta_alpha: 1.5
+    noise_beta_beta: 1.0
+    noise_s: 0.999
+    num_timestep_buckets: 1000
+    num_inference_timesteps: 4
+    num_target_vision_tokens: 32
+    diffusion_model_cfg:
+      cross_attention_dim: 2560
+      dropout: 0.2
+      final_dropout: true
+      interleave_self_attention: true
+      norm_type: ada_norm
+      num_layers: 16
+      output_dim: 1024
+      positional_embeddings: null
+      attention_head_dim: 64
+    loss_type: l1
+    future_action_window_size: 0
+    past_action_window_size: 0
+    action_env_dim: 6
+  kv_memory:
+    enabled: false
+    window: 4
+    rollout_len: 8
+    packed_train: false
+    rebased_sink: true
+version_id: '0.21'
+datasets:
+  vla_data:
+    include_state: true
+    obs_image_size: null
+    image_mode: single
+    num_obs_frames: 1
+    robot_type: rl_games_demon_attack
+trainer:
+  pretrained_checkpoint: null

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/dataset_statistics.json

@@ -0,0 +1,606 @@
+{
+  "new_embodiment": {
+    "action": {
+      "mean": [
+        0.186212956905365,
+        0.16403703391551971,
+        0.15452778339385986,
+        0.18537653982639313,
+        0.17363271117210388,
+        0.13621295988559723
+      ],
+      "std": [
+        0.3898249864578247,
+        0.37076491117477417,
+        0.36105018854141235,
+        0.38919636607170105,
+        0.378946453332901,
+        0.3426312804222107
+      ],
+      "max": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "min": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q01": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q99": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "mask": [
+        true,
+        true,
+        true,
+        true,
+        true,
+        true
+      ]
+    },
+    "state": {
+      "mean": [
+        0.9949135780334473,
+        0.1635771542787552,
+        0.15375925600528717,
+        0.18431790173053741,
+        0.17239506542682648,
+        0.135799378156662,
+        0.1635771542787552,
+        0.15375925600528717,
+        0.18431790173053741,
+        0.17239506542682648,
+        0.135799378156662,
+        0.9955493807792664,
+        0.16362345218658447,
+        0.15380863845348358,
+        0.18452468514442444,
+        0.1725771576166153,
+        0.13588272035121918,
+        0.16362345218658447,
+        0.15380863845348358,
+        0.18452468514442444,
+        0.1725771576166153,
+        0.13588272035121918,
+        0.9961851835250854,
+        0.16370061039924622,
+        0.1539197564125061,
+        0.1847500056028366,
+        0.17267900705337524,
+        0.13596296310424805,
+        0.16370061039924622,
+        0.1539197564125061,
+        0.1847500056028366,
+        0.17267900705337524,
+        0.13596296310424805,
+        0.9968209862709045,
+        0.1637592613697052,
+        0.1539537012577057,
+        0.18497531116008759,
+        0.17288272082805634,
+        0.13596296310424805,
+        0.1637592613697052,
+        0.1539537012577057,
+        0.18497531116008759,
+        0.17288272082805634,
+        0.13596296310424805,
+        0.9974567890167236,
+        0.16383333504199982,
+        0.1539907455444336,
+        0.1851203739643097,
+        0.1730956733226776,
+        0.135981485247612,
+        0.16383333504199982,
+        0.1539907455444336,
+        0.1851203739643097,
+        0.1730956733226776,
+        0.135981485247612,
+        0.9980925917625427,
+        0.1638919711112976,
+        0.15408951044082642,
+        0.1852283924818039,
+        0.1732993870973587,
+        0.13600000739097595,
+        0.1638919711112976,
+        0.15408951044082642,
+        0.1852283924818039,
+        0.1732993870973587,
+        0.13600000739097595,
+        0.9987283945083618,
+        0.1639506220817566,
+        0.15422530472278595,
+        0.18530863523483276,
+        0.17342284321784973,
+        0.1360401213169098,
+        0.1639506220817566,
+        0.15422530472278595,
+        0.18530863523483276,
+        0.17342284321784973,
+        0.1360401213169098,
+        0.9993641972541809,
+        0.16400925815105438,
+        0.154388889670372,
+        0.18537653982639313,
+        0.17349691689014435,
+        0.1360895037651062,
+        0.16400925815105438,
+        0.154388889670372,
+        0.18537653982639313,
+        0.17349691689014435,
+        0.1360895037651062
+      ],
+      "std": [
+        0.07101495563983917,
+        0.3701695501804352,
+        0.36049050092697144,
+        0.3878783881664276,
+        0.37791910767555237,
+        0.34225910902023315,
+        0.3701695501804352,
+        0.36049050092697144,
+        0.3878783881664276,
+        0.37791910767555237,
+        0.34225910902023315,
+        0.06647672504186589,
+        0.3702095150947571,
+        0.3605283200740814,
+        0.3878776729106903,
+        0.378066748380661,
+        0.3423354923725128,
+        0.3702095150947571,
+        0.3605283200740814,
+        0.3878776729106903,
+        0.378066748380661,
+        0.3423354923725128,
+        0.061554547399282344,
+        0.3702716529369354,
+        0.36068475246429443,
+        0.3880579471588135,
+        0.3781836926937103,
+        0.34237855672836304,
+        0.3702716529369354,
+        0.36068475246429443,
+        0.3880579471588135,
+        0.3781836926937103,
+        0.34237855672836304,
+        0.056230042129754895,
+        0.3703220784664154,
+        0.3605552315711975,
+        0.3888765275478363,
+        0.3783469498157501,
+        0.34237855672836304,
+        0.3703220784664154,
+        0.3605552315711975,
+        0.3888765275478363,
+        0.3783469498157501,
+        0.34237855672836304,
+        0.0503141917288302,
+        0.37038931250572205,
+        0.36059075593948364,
+        0.38899245858192444,
+        0.37848997116088867,
+        0.3423982560634613,
+        0.37038931250572205,
+        0.36059075593948364,
+        0.38899245858192444,
+        0.37848997116088867,
+        0.3423982560634613,
+        0.04359520971775055,
+        0.3706468939781189,
+        0.3606751561164856,
+        0.38908714056015015,
+        0.3787112534046173,
+        0.3424212634563446,
+        0.3706468939781189,
+        0.3606751561164856,
+        0.38908714056015015,
+        0.3787112534046173,
+        0.3424212634563446,
+        0.035616517066955566,
+        0.3706991672515869,
+        0.360801637172699,
+        0.3891419470310211,
+        0.3788077235221863,
+        0.34246116876602173,
+        0.3706991672515869,
+        0.360801637172699,
+        0.3891419470310211,
+        0.3788077235221863,
+        0.34246116876602173,
+        0.025199506431817734,
+        0.37074217200279236,
+        0.36091822385787964,
+        0.38919636607170105,
+        0.37887200713157654,
+        0.34251368045806885,
+        0.37074217200279236,
+        0.36091822385787964,
+        0.38919636607170105,
+        0.37887200713157654,
+        0.34251368045806885
+      ],
+      "max": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "min": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q01": [
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        1.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q99": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ]
+    },
+    "num_transitions": 324000,
+    "num_trajectories": 180
+  }
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/eval_l0.json

@@ -0,0 +1,42 @@
+{
+  "job_id": "eval_zero_to_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "training_step": 5000,
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "profile_sha256": null,
+  "mean_return": 2370.9,
+  "std_return": 369.3239634792197,
+  "mean_length": 7190.83,
+  "episodes": 100,
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "issued_actions": 179771,
+  "top_action": "NOOP",
+  "largest_action_fraction": 0.18576967364035357,
+  "unique_action_values": 6,
+  "episode_final_done": 1,
+  "episodes_at_frame_cap": 99,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "environment_condition": "zero"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/eval_profile.json

@@ -0,0 +1,42 @@
+{
+  "job_id": "eval_zero_to_profile__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "training_step": 5000,
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+  "mean_return": 231.9,
+  "std_return": 109.19885530535565,
+  "mean_length": 3294.29,
+  "episodes": 100,
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "issued_actions": 38112,
+  "top_action": "RIGHTFIRE",
+  "largest_action_fraction": 0.27802267002518893,
+  "unique_action_values": 6,
+  "episode_final_done": 99,
+  "episodes_at_frame_cap": 1,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "environment_condition": "profile"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/profile/action_audit.json

@@ -0,0 +1,141 @@
+{
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "episode_seeds": [
+    1000000,
+    1000001,
+    1000002,
+    1000003,
+    1000004,
+    1000005,
+    1000006,
+    1000007,
+    1000008,
+    1000009,
+    1000010,
+    1000011,
+    1000012,
+    1000013,
+    1000014,
+    1000015,
+    1000016,
+    1000017,
+    1000018,
+    1000019,
+    1000020,
+    1000021,
+    1000022,
+    1000023,
+    1000024,
+    1000025,
+    1000026,
+    1000027,
+    1000028,
+    1000029,
+    1000030,
+    1000031,
+    1000032,
+    1000033,
+    1000034,
+    1000035,
+    1000036,
+    1000037,
+    1000038,
+    1000039,
+    1000040,
+    1000041,
+    1000042,
+    1000043,
+    1000044,
+    1000045,
+    1000046,
+    1000047,
+    1000048,
+    1000049,
+    1000050,
+    1000051,
+    1000052,
+    1000053,
+    1000054,
+    1000055,
+    1000056,
+    1000057,
+    1000058,
+    1000059,
+    1000060,
+    1000061,
+    1000062,
+    1000063,
+    1000064,
+    1000065,
+    1000066,
+    1000067,
+    1000068,
+    1000069,
+    1000070,
+    1000071,
+    1000072,
+    1000073,
+    1000074,
+    1000075,
+    1000076,
+    1000077,
+    1000078,
+    1000079,
+    1000080,
+    1000081,
+    1000082,
+    1000083,
+    1000084,
+    1000085,
+    1000086,
+    1000087,
+    1000088,
+    1000089,
+    1000090,
+    1000091,
+    1000092,
+    1000093,
+    1000094,
+    1000095,
+    1000096,
+    1000097,
+    1000098,
+    1000099
+  ],
+  "issued_actions": 38112,
+  "action_counts": {
+    "4": 10596,
+    "2": 4216,
+    "3": 6580,
+    "0": 4785,
+    "5": 5475,
+    "1": 6460
+  },
+  "largest_action_fraction": 0.27802267002518893,
+  "raw_score_min": [
+    -0.08713753521442413,
+    -0.12720078229904175,
+    -0.08844619989395142,
+    -0.16566789150238037,
+    -0.11502376943826675,
+    -0.10234387964010239
+  ],
+  "raw_score_max": [
+    1.0851538181304932,
+    1.0779279470443726,
+    1.0839998722076416,
+    1.070520281791687,
+    1.0941221714019775,
+    1.0788639783859253
+  ],
+  "raw_score_mean": [
+    0.12883773234674042,
+    0.17647383294813002,
+    0.11177733052170988,
+    0.17544857569702538,
+    0.2830546502561464,
+    0.14318830382725256
+  ]
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/profile/eval_config.yaml

@@ -0,0 +1,118 @@
+experiment:
+  name: demon_attack-qwengr00t-hist8-zero-scratch-s42-v2-step5000-history01-profile-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: temporal
+  profile_path: /home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json
+  profile_worker_slot: 0
+  seed: 271828
+  add_latency_info: false
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_profile
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/profile/provenance.json

@@ -0,0 +1,46 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "5b533937a72e9fa923ecf28b1c1be5a16bad488d",
+    "teacher_path": "zero-latency/demon-attack/small-policy/sample-factory-v1",
+    "teacher_checkpoint": "best_000048704_24936448_reward_27118.050.pth",
+    "teacher_sha256": "f06e92be4b26fc883db66b355476d503aed4a6c8464d5e8f4c158f50ca2422ae",
+    "rollout_overrides": {
+      "env_fps": 60,
+      "obs_fps": 15,
+      "latency_type": "fixed",
+      "fixed_latency_ms": 0.0,
+      "seed": 42
+    },
+    "training_latency_condition": "zero",
+    "history": "decision_v1",
+    "history_decisions": 8,
+    "history_source": "zero_latency_issued_equals_applied",
+    "student_image_frames": 1,
+    "max_episode_raw_frames": 7200,
+    "episodes": 200,
+    "train_labels": 324000,
+    "filter_preset": "none"
+  },
+  "training_run_id": "demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "b2048a00",
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "env_condition": "profile",
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "inference_devices": [
+    "cuda:0",
+    "cuda:1"
+  ],
+  "episode_seeds": [
+    1000000,
+    1000099
+  ],
+  "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/profile/resolved_config.yaml

@@ -0,0 +1,121 @@
+experiment:
+  name: demon_attack-qwengr00t-hist8-zero-scratch-s42-v2-step5000-history01-profile-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: temporal
+  profile_path: /home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json
+  profile_worker_slot: 0
+  seed: 271828
+  add_latency_info: false
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+  action_prefix:
+    mode: none
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_profile
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''
+  simulated_pipeline_profile: false

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/profile/summary.json

@@ -0,0 +1,217 @@
+{
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt",
+  "experiment_name": "demon_attack-qwengr00t-hist8-zero-scratch-s42-v2-step5000-history01-profile-par32",
+  "latency": "profile_sample",
+  "latency_type": "profile_sample",
+  "lengths": [
+    2580,
+    1981,
+    1951,
+    3798,
+    3534,
+    2948,
+    1904,
+    1878,
+    4428,
+    4031,
+    4005,
+    2571,
+    3013,
+    3829,
+    2073,
+    3238,
+    2001,
+    5328,
+    2301,
+    4949,
+    1961,
+    7200,
+    3871,
+    1769,
+    2333,
+    4079,
+    2291,
+    4296,
+    1845,
+    3009,
+    3942,
+    4248,
+    4266,
+    2506,
+    2395,
+    1566,
+    2753,
+    1362,
+    1480,
+    3519,
+    4121,
+    3961,
+    3177,
+    3918,
+    4681,
+    2647,
+    2426,
+    3207,
+    3737,
+    3364,
+    2513,
+    4345,
+    4948,
+    3634,
+    3583,
+    4142,
+    4985,
+    3824,
+    4199,
+    3964,
+    4052,
+    2262,
+    2356,
+    3199,
+    3363,
+    3255,
+    2736,
+    4114,
+    4996,
+    4067,
+    3612,
+    3669,
+    3744,
+    3490,
+    2857,
+    4454,
+    3532,
+    3764,
+    4396,
+    3305,
+    2109,
+    2772,
+    4620,
+    2829,
+    3895,
+    2956,
+    3991,
+    1937,
+    1786,
+    2307,
+    2967,
+    1810,
+    4005,
+    2559,
+    2720,
+    2930,
+    3303,
+    1681,
+    4002,
+    4619
+  ],
+  "mean_length": 3294.29,
+  "mean_return": 231.9,
+  "returns": [
+    175.0,
+    130.0,
+    100.0,
+    280.0,
+    250.0,
+    205.0,
+    120.0,
+    130.0,
+    250.0,
+    220.0,
+    235.0,
+    160.0,
+    220.0,
+    370.0,
+    140.0,
+    280.0,
+    100.0,
+    620.0,
+    140.0,
+    480.0,
+    100.0,
+    740.0,
+    280.0,
+    110.0,
+    140.0,
+    355.0,
+    130.0,
+    280.0,
+    140.0,
+    205.0,
+    295.0,
+    280.0,
+    295.0,
+    130.0,
+    110.0,
+    80.0,
+    140.0,
+    60.0,
+    80.0,
+    220.0,
+    280.0,
+    295.0,
+    235.0,
+    355.0,
+    295.0,
+    235.0,
+    220.0,
+    205.0,
+    280.0,
+    160.0,
+    130.0,
+    340.0,
+    295.0,
+    280.0,
+    295.0,
+    325.0,
+    295.0,
+    310.0,
+    295.0,
+    325.0,
+    340.0,
+    130.0,
+    175.0,
+    140.0,
+    280.0,
+    235.0,
+    220.0,
+    190.0,
+    295.0,
+    280.0,
+    190.0,
+    295.0,
+    250.0,
+    295.0,
+    160.0,
+    295.0,
+    205.0,
+    325.0,
+    280.0,
+    205.0,
+    110.0,
+    190.0,
+    520.0,
+    160.0,
+    355.0,
+    190.0,
+    220.0,
+    100.0,
+    90.0,
+    140.0,
+    235.0,
+    90.0,
+    325.0,
+    250.0,
+    250.0,
+    175.0,
+    140.0,
+    110.0,
+    220.0,
+    310.0
+  ],
+  "seed": 1000000,
+  "source_profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+  "std_return": 109.19885530535569,
+  "suite_name": "profile_sample",
+  "timestamp_utc": "2026-09-23T23:45:38.447668+00:00"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/profile/verification.json

@@ -0,0 +1,68 @@
+{
+  "verification_status": "verified",
+  "job_id": "eval_zero_to_profile__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "task": "demon_attack",
+  "model": "qwengr00t",
+  "remote_eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_profile",
+  "checked_at": 1790208017.277865,
+  "training_step": 5000,
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+  "wandb_run_id": "b2048a00",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "max_episode_raw_frames": 7200,
+  "parallel_envs": 32,
+  "mean_return": 231.9,
+  "std_return": 109.19885530535565,
+  "mean_length": 3294.29,
+  "episodes": 100,
+  "issued_actions": 38112,
+  "top_action": "RIGHTFIRE",
+  "largest_action_fraction": 0.27802267002518893,
+  "unique_action_values": 6,
+  "episode_final_done": 99,
+  "episodes_at_frame_cap": 1,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "job": {
+    "id": "eval_zero_to_profile__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+    "kind": "eval_ready",
+    "source": "v2",
+    "task": "demon_attack",
+    "model": "qwengr00t",
+    "python": "/home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python",
+    "backbone": "/home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17",
+    "bundle_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+    "profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "env_condition": "profile",
+    "parallel_envs": 32,
+    "metric_prefix": "eval_hist8_v3/zero_to_profile",
+    "eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_profile",
+    "gpus_required": 2,
+    "priority": 1101,
+    "depends_on": [
+      "package_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2"
+    ]
+  },
+  "evidence_dir": "/home/lixinyuan/latency-sensitive-bench/outputs/tasks/decision_history_vla_hist8_v2/evaluation_receipts/h200-2/eval_zero_to_profile__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/zero/action_audit.json

@@ -0,0 +1,141 @@
+{
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "episode_seeds": [
+    1000000,
+    1000001,
+    1000002,
+    1000003,
+    1000004,
+    1000005,
+    1000006,
+    1000007,
+    1000008,
+    1000009,
+    1000010,
+    1000011,
+    1000012,
+    1000013,
+    1000014,
+    1000015,
+    1000016,
+    1000017,
+    1000018,
+    1000019,
+    1000020,
+    1000021,
+    1000022,
+    1000023,
+    1000024,
+    1000025,
+    1000026,
+    1000027,
+    1000028,
+    1000029,
+    1000030,
+    1000031,
+    1000032,
+    1000033,
+    1000034,
+    1000035,
+    1000036,
+    1000037,
+    1000038,
+    1000039,
+    1000040,
+    1000041,
+    1000042,
+    1000043,
+    1000044,
+    1000045,
+    1000046,
+    1000047,
+    1000048,
+    1000049,
+    1000050,
+    1000051,
+    1000052,
+    1000053,
+    1000054,
+    1000055,
+    1000056,
+    1000057,
+    1000058,
+    1000059,
+    1000060,
+    1000061,
+    1000062,
+    1000063,
+    1000064,
+    1000065,
+    1000066,
+    1000067,
+    1000068,
+    1000069,
+    1000070,
+    1000071,
+    1000072,
+    1000073,
+    1000074,
+    1000075,
+    1000076,
+    1000077,
+    1000078,
+    1000079,
+    1000080,
+    1000081,
+    1000082,
+    1000083,
+    1000084,
+    1000085,
+    1000086,
+    1000087,
+    1000088,
+    1000089,
+    1000090,
+    1000091,
+    1000092,
+    1000093,
+    1000094,
+    1000095,
+    1000096,
+    1000097,
+    1000098,
+    1000099
+  ],
+  "issued_actions": 179771,
+  "action_counts": {
+    "4": 31374,
+    "2": 27047,
+    "3": 32313,
+    "0": 33396,
+    "5": 24497,
+    "1": 31144
+  },
+  "largest_action_fraction": 0.18576967364035357,
+  "raw_score_min": [
+    -0.2752455472946167,
+    -0.14941245317459106,
+    -0.1413244605064392,
+    -0.34913134574890137,
+    -0.17256572842597961,
+    -0.1458253264427185
+  ],
+  "raw_score_max": [
+    1.0812829732894897,
+    1.088009238243103,
+    1.0831573009490967,
+    1.071962833404541,
+    1.226496696472168,
+    1.064323902130127
+  ],
+  "raw_score_mean": [
+    0.18954913945489046,
+    0.1814721992846953,
+    0.15168402922870536,
+    0.18109792914299855,
+    0.17830944721757114,
+    0.1348956185145383
+  ]
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/zero/eval_config.yaml

@@ -0,0 +1,114 @@
+experiment:
+  name: demon_attack-qwengr00t-hist8-zero-scratch-s42-v2-step5000-history01-zero-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: zero
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_zero
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/zero/provenance.json

@@ -0,0 +1,46 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "5b533937a72e9fa923ecf28b1c1be5a16bad488d",
+    "teacher_path": "zero-latency/demon-attack/small-policy/sample-factory-v1",
+    "teacher_checkpoint": "best_000048704_24936448_reward_27118.050.pth",
+    "teacher_sha256": "f06e92be4b26fc883db66b355476d503aed4a6c8464d5e8f4c158f50ca2422ae",
+    "rollout_overrides": {
+      "env_fps": 60,
+      "obs_fps": 15,
+      "latency_type": "fixed",
+      "fixed_latency_ms": 0.0,
+      "seed": 42
+    },
+    "training_latency_condition": "zero",
+    "history": "decision_v1",
+    "history_decisions": 8,
+    "history_source": "zero_latency_issued_equals_applied",
+    "student_image_frames": 1,
+    "max_episode_raw_frames": 7200,
+    "episodes": 200,
+    "train_labels": 324000,
+    "filter_preset": "none"
+  },
+  "training_run_id": "demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "b2048a00",
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "env_condition": "zero",
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "inference_devices": [
+    "cuda:0",
+    "cuda:1"
+  ],
+  "episode_seeds": [
+    1000000,
+    1000099
+  ],
+  "profile_sha256": null
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/zero/resolved_config.yaml

@@ -0,0 +1,117 @@
+experiment:
+  name: demon_attack-qwengr00t-hist8-zero-scratch-s42-v2-step5000-history01-zero-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: zero
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  worker_python_executable: /home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+  action_prefix:
+    mode: none
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_zero
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''
+  simulated_pipeline_profile: false

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/zero/summary.json

@@ -0,0 +1,216 @@
+{
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/checkpoints/model.pt",
+  "experiment_name": "demon_attack-qwengr00t-hist8-zero-scratch-s42-v2-step5000-history01-zero-par32",
+  "latency": 0,
+  "latency_type": "zero",
+  "lengths": [
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    6283,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200
+  ],
+  "mean_length": 7190.83,
+  "mean_return": 2370.9,
+  "returns": [
+    2140.0,
+    2575.0,
+    2200.0,
+    2550.0,
+    2320.0,
+    2400.0,
+    2000.0,
+    2200.0,
+    2790.0,
+    2550.0,
+    2790.0,
+    1080.0,
+    2140.0,
+    2200.0,
+    2200.0,
+    2790.0,
+    2435.0,
+    3020.0,
+    3020.0,
+    2790.0,
+    2140.0,
+    3025.0,
+    2930.0,
+    2200.0,
+    2140.0,
+    2790.0,
+    2000.0,
+    2140.0,
+    1820.0,
+    2200.0,
+    2140.0,
+    2400.0,
+    2120.0,
+    2140.0,
+    2790.0,
+    2200.0,
+    2595.0,
+    2790.0,
+    1960.0,
+    2040.0,
+    2575.0,
+    2140.0,
+    2320.0,
+    2790.0,
+    2735.0,
+    2020.0,
+    2280.0,
+    2200.0,
+    2200.0,
+    2040.0,
+    2675.0,
+    2200.0,
+    2765.0,
+    2400.0,
+    2060.0,
+    2790.0,
+    2200.0,
+    2490.0,
+    2140.0,
+    3020.0,
+    2765.0,
+    2600.0,
+    3170.0,
+    2995.0,
+    3070.0,
+    1380.0,
+    2140.0,
+    2805.0,
+    2685.0,
+    1920.0,
+    2280.0,
+    2280.0,
+    2790.0,
+    2160.0,
+    2140.0,
+    2320.0,
+    2300.0,
+    2320.0,
+    2790.0,
+    2490.0,
+    2040.0,
+    2040.0,
+    2695.0,
+    2040.0,
+    2200.0,
+    1960.0,
+    2140.0,
+    2200.0,
+    2300.0,
+    2225.0,
+    2760.0,
+    2200.0,
+    2320.0,
+    2120.0,
+    1500.0,
+    2395.0,
+    2790.0,
+    2475.0,
+    2140.0,
+    2360.0
+  ],
+  "seed": 1000000,
+  "std_return": 369.3239634792198,
+  "suite_name": "fixed_0",
+  "timestamp_utc": "2026-09-23T23:55:40.786803+00:00"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/evaluations/zero/verification.json

@@ -0,0 +1,68 @@
+{
+  "verification_status": "verified",
+  "job_id": "eval_zero_to_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "task": "demon_attack",
+  "model": "qwengr00t",
+  "remote_eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_zero",
+  "checked_at": 1790208009.9249282,
+  "training_step": 5000,
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "profile_sha256": null,
+  "wandb_run_id": "b2048a00",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "max_episode_raw_frames": 7200,
+  "parallel_envs": 32,
+  "mean_return": 2370.9,
+  "std_return": 369.3239634792197,
+  "mean_length": 7190.83,
+  "episodes": 100,
+  "issued_actions": 179771,
+  "top_action": "NOOP",
+  "largest_action_fraction": 0.18576967364035357,
+  "unique_action_values": 6,
+  "episode_final_done": 1,
+  "episodes_at_frame_cap": 99,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "training_step_matches_plan": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "job": {
+    "id": "eval_zero_to_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+    "kind": "eval_ready",
+    "source": "v2",
+    "task": "demon_attack",
+    "model": "qwengr00t",
+    "python": "/home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python",
+    "backbone": "/home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17",
+    "bundle_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+    "profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "env_condition": "zero",
+    "parallel_envs": 32,
+    "metric_prefix": "eval_hist8_v3/zero_to_zero",
+    "eval_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/to_zero",
+    "gpus_required": 2,
+    "priority": 1101,
+    "depends_on": [
+      "package_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2"
+    ]
+  },
+  "evidence_dir": "/home/lixinyuan/latency-sensitive-bench/outputs/tasks/decision_history_vla_hist8_v2/evaluation_receipts/h200-2/eval_zero_to_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/manifest.json

@@ -0,0 +1,307 @@
+{
+  "dataset_name": "lerobot",
+  "env_name": "demon_attack",
+  "episodes": 180,
+  "frames": 324000,
+  "task_prompts": [
+    "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score."
+  ],
+  "format": "starvla_lerobot_v2_decision_v1",
+  "source": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/raw",
+  "robot_type": "rl_games_demon_attack",
+  "action_layout": "demon_attack_discrete",
+  "source_action_layout": "demon_attack_discrete",
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_dim": 6,
+  "active_action_dim": 6,
+  "state_source": "decision_v1",
+  "state_dim": 88,
+  "state_labels": [
+    "decision_history_0",
+    "decision_history_1",
+    "decision_history_2",
+    "decision_history_3",
+    "decision_history_4",
+    "decision_history_5",
+    "decision_history_6",
+    "decision_history_7",
+    "decision_history_8",
+    "decision_history_9",
+    "decision_history_10",
+    "decision_history_11",
+    "decision_history_12",
+    "decision_history_13",
+    "decision_history_14",
+    "decision_history_15",
+    "decision_history_16",
+    "decision_history_17",
+    "decision_history_18",
+    "decision_history_19",
+    "decision_history_20",
+    "decision_history_21",
+    "decision_history_22",
+    "decision_history_23",
+    "decision_history_24",
+    "decision_history_25",
+    "decision_history_26",
+    "decision_history_27",
+    "decision_history_28",
+    "decision_history_29",
+    "decision_history_30",
+    "decision_history_31",
+    "decision_history_32",
+    "decision_history_33",
+    "decision_history_34",
+    "decision_history_35",
+    "decision_history_36",
+    "decision_history_37",
+    "decision_history_38",
+    "decision_history_39",
+    "decision_history_40",
+    "decision_history_41",
+    "decision_history_42",
+    "decision_history_43",
+    "decision_history_44",
+    "decision_history_45",
+    "decision_history_46",
+    "decision_history_47",
+    "decision_history_48",
+    "decision_history_49",
+    "decision_history_50",
+    "decision_history_51",
+    "decision_history_52",
+    "decision_history_53",
+    "decision_history_54",
+    "decision_history_55",
+    "decision_history_56",
+    "decision_history_57",
+    "decision_history_58",
+    "decision_history_59",
+    "decision_history_60",
+    "decision_history_61",
+    "decision_history_62",
+    "decision_history_63",
+    "decision_history_64",
+    "decision_history_65",
+    "decision_history_66",
+    "decision_history_67",
+    "decision_history_68",
+    "decision_history_69",
+    "decision_history_70",
+    "decision_history_71",
+    "decision_history_72",
+    "decision_history_73",
+    "decision_history_74",
+    "decision_history_75",
+    "decision_history_76",
+    "decision_history_77",
+    "decision_history_78",
+    "decision_history_79",
+    "decision_history_80",
+    "decision_history_81",
+    "decision_history_82",
+    "decision_history_83",
+    "decision_history_84",
+    "decision_history_85",
+    "decision_history_86",
+    "decision_history_87"
+  ],
+  "state_normalization": {
+    "min": [
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0
+    ],
+    "max": [
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0
+    ]
+  },
+  "action_history_decisions": 8,
+  "rows_unit": "decision_step",
+  "obs_fps": 15.0,
+  "obs_stride_raw_frames": 4,
+  "latency_prompt_map_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/lerobot/latency_prompt_map.json",
+  "custom_mixtures_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/_generated_mixtures/lerobot.json",
+  "validation_dataset_name": "lerobot__val",
+  "validation_episodes": 20,
+  "validation_frames": 36000
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/profiles/hardware.json

@@ -0,0 +1,40 @@
+{
+  "driver_version": "595.58.03",
+  "gpu_class": "1x-rtx3090",
+  "gpus": [
+    {
+      "name": "NVIDIA GeForce RTX 3090",
+      "slot": 0
+    }
+  ],
+  "instance_id": "instance_a5037b165aa0cedc",
+  "topology_links": [],
+  "torch": {
+    "backends": {
+      "cuda_cudnn_sdp_enabled": true,
+      "cuda_flash_sdp_enabled": true,
+      "cuda_math_sdp_enabled": true,
+      "cuda_matmul_allow_tf32": false,
+      "cuda_mem_efficient_sdp_enabled": true,
+      "cudnn_allow_tf32": true,
+      "cudnn_benchmark": false
+    },
+    "cuda_available": true,
+    "cuda_device_count": 1,
+    "cuda_version": "12.8",
+    "current_device": 0,
+    "current_device_name": "NVIDIA GeForce RTX 3090",
+    "device_properties": [
+      {
+        "index": 0,
+        "major": 8,
+        "minor": 6,
+        "multi_processor_count": 82,
+        "name": "NVIDIA GeForce RTX 3090",
+        "total_memory": 25298141184
+      }
+    ],
+    "float32_matmul_precision": "highest",
+    "version": "2.11.0+cu128"
+  }
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/profiles/latency_burst_model.json

@@ -0,0 +1,30 @@
+{
+  "burst_dwell_distribution": null,
+  "burst_dwell_lengths": [],
+  "burst_merge_gap_records": 30,
+  "burst_rank_processes": [],
+  "burst_slot_rank_templates": [],
+  "model_type": "hidden_regime",
+  "pre_worker_time_ms": null,
+  "regime_step_counts": {
+    "burst": 0,
+    "calm": 10948
+  },
+  "regime_transition_counts": {
+    "burst": {
+      "burst": 0,
+      "calm": 0
+    },
+    "calm": {
+      "burst": 0,
+      "calm": 10943
+    }
+  },
+  "reset_scope": "session",
+  "schema_version": 12,
+  "spike_median_multiplier": 1.25,
+  "spike_threshold_ms_by_worker_slot": {
+    "0": 154.9665704369545
+  },
+  "worker_count": 1
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/profiles/latency_distribution.json

@@ -0,0 +1,1027 @@
+{
+  "schema_version": 3,
+  "worker_slots": {
+    "0": {
+      "all": {
+        "count": 10948,
+        "observation_to_action_latency_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.79631185531616,
+            122.83055476341248,
+            122.96048029518127,
+            123.12548810958862,
+            123.20885604858398,
+            123.24038108825684,
+            123.2696556816101,
+            123.31733936309814,
+            123.34817198753358,
+            123.3781309890747,
+            123.40057138252259,
+            123.45452119445801,
+            123.48554271697998,
+            124.04004166603089,
+            124.28913790702819,
+            124.39105031967163,
+            124.45440249443054,
+            124.5571064376831,
+            124.7361155986786,
+            124.91622240066528,
+            125.00360578536987,
+            125.08328070640565,
+            125.13830080032349,
+            125.2295347213745,
+            125.35394525527954,
+            125.49435075759888,
+            125.60458269119263,
+            125.72243936538696,
+            125.82663643836975,
+            125.93300409317017,
+            126.02435782432556,
+            126.09885621070862,
+            126.16651153564453,
+            126.24060009002686,
+            126.31888152122498,
+            126.41316819190979,
+            126.54280662536621,
+            126.68462894439698,
+            126.77580438613892,
+            126.8230891609192,
+            126.85537923812866,
+            126.88363008499145,
+            126.91282826423645,
+            126.94254455566406,
+            126.9707493877411,
+            127.00030161857605,
+            127.02929482460021,
+            127.06760904312134,
+            127.0986561870575,
+            127.13863806724548,
+            127.17745053291321,
+            127.23237829208374,
+            127.29776979446412,
+            127.37165050506592,
+            127.46985033035278,
+            127.56723865509034,
+            127.68258781433106,
+            127.80308091163636,
+            127.87982371330261,
+            127.94324188232422,
+            127.98972443580628,
+            128.03023529052734,
+            128.07307104110717,
+            128.10850659370422,
+            128.1489437198639,
+            128.19575679779052,
+            128.24768528938293,
+            128.30849837303163,
+            128.37751910209656,
+            128.46356166839598,
+            128.59914545059203,
+            128.72301177978517,
+            128.85909510612487,
+            129.01047629356384,
+            129.09596959114074,
+            129.18290879249574,
+            129.2668813228607,
+            129.36923629760742,
+            129.49136459350586,
+            129.69063343048094,
+            129.89646366119385,
+            130.11991477012634,
+            130.3491042804718,
+            130.65597107887268,
+            130.98567969322204,
+            131.44593645095824,
+            132.1362121105194,
+            132.61222920417785,
+            132.77006802558898,
+            133.17581831932068,
+            133.52350569725036,
+            133.65027599334718,
+            133.74947697639465,
+            133.81022834777832,
+            133.8869441986084,
+            134.19105182647704,
+            134.37844815254212,
+            134.45609179496765,
+            134.54267152786255,
+            134.66409388542175,
+            134.83887226104736,
+            135.3399015903473,
+            135.44952299118043,
+            135.52058424949647,
+            135.5928444480896,
+            135.68735381126405,
+            136.16950192451478,
+            136.5521870613098,
+            136.71048418045044,
+            137.00765167236327,
+            137.9891162967682,
+            138.02192653274537,
+            138.04894944381715,
+            138.12427546310423,
+            138.50976154518128,
+            138.873538646698,
+            138.9841242351532,
+            139.11370658874515,
+            139.35008063316337,
+            140.1876000556946,
+            140.31456637382485,
+            147.51668910312227,
+            150.8394160270691
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        },
+        "spearman_rho": 0.9989411839039446,
+        "worker_service_time_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.20177268981934,
+            122.30283569774627,
+            122.5205600452423,
+            122.60929537200927,
+            122.66797201156616,
+            122.6971018486023,
+            122.73601416778564,
+            122.77037023544311,
+            122.81257249641419,
+            122.8390096206665,
+            122.88044651412964,
+            122.92808966827393,
+            122.97536842346192,
+            123.46291953086853,
+            123.76542267799377,
+            123.86257653236389,
+            123.92213554382325,
+            124.01939237594604,
+            124.222943983078,
+            124.36276661872864,
+            124.43211780548096,
+            124.50857553482055,
+            124.57027664184571,
+            124.67785886764527,
+            124.87234741210938,
+            124.98412243843079,
+            125.0936541557312,
+            125.26090567588807,
+            125.40969181060791,
+            125.49145776748657,
+            125.54093709945678,
+            125.59061560630798,
+            125.64770420074463,
+            125.7151317501068,
+            125.79718364715576,
+            125.92450232505799,
+            126.07124304771423,
+            126.24277823448182,
+            126.39197353363038,
+            126.4476409626007,
+            126.48959280014039,
+            126.51886591911315,
+            126.54474408149719,
+            126.56929949760438,
+            126.59623449325562,
+            126.62515710830688,
+            126.64931235313415,
+            126.67885724067688,
+            126.70889680862427,
+            126.73626960754395,
+            126.76666728019714,
+            126.80187697410584,
+            126.84883865356446,
+            126.90541676521302,
+            126.9881226158142,
+            127.11017844200134,
+            127.22859001159668,
+            127.3837945842743,
+            127.49648622512818,
+            127.56595790863037,
+            127.62109510421753,
+            127.65714049339294,
+            127.69538656234741,
+            127.73405620574951,
+            127.76645929336549,
+            127.80690549850463,
+            127.85590953826905,
+            127.90466072082519,
+            127.95096551895142,
+            128.02613214492797,
+            128.11823890686034,
+            128.2333468437195,
+            128.37978899002076,
+            128.57277998924255,
+            128.7053997516632,
+            128.78535892486573,
+            128.8680805206299,
+            128.94854549407958,
+            129.04876315116883,
+            129.18656414031983,
+            129.40402382850647,
+            129.65059328079224,
+            129.9080189704895,
+            130.1638106918335,
+            130.47888251304627,
+            130.98551317214967,
+            131.60869455337524,
+            132.15558164596558,
+            132.28427990913391,
+            132.5974653530121,
+            133.0116798877716,
+            133.07106366157532,
+            133.11581961631774,
+            133.16094108581544,
+            133.23522979736327,
+            133.73099293708802,
+            133.92880964279175,
+            133.98194127082826,
+            134.03434896469116,
+            134.1034224128723,
+            134.27159962654113,
+            134.9040030002594,
+            135.01462589263917,
+            135.0814479827881,
+            135.14531938552855,
+            135.22710026741026,
+            135.60060482025148,
+            136.11188952445983,
+            136.27149866104125,
+            136.48072841644287,
+            137.520674533844,
+            137.57785969924927,
+            137.60559056091307,
+            137.66266886901855,
+            137.89541630744932,
+            138.43089353561402,
+            138.55013104438783,
+            138.6332070503235,
+            138.83003143692017,
+            139.75485095214844,
+            139.88365561103805,
+            146.72983264789096,
+            150.52015590667725
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        }
+      },
+      "steady": {
+        "count": 10948,
+        "observation_to_action_latency_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.79631185531616,
+            122.83055476341248,
+            122.96048029518127,
+            123.12548810958862,
+            123.20885604858398,
+            123.24038108825684,
+            123.2696556816101,
+            123.31733936309814,
+            123.34817198753358,
+            123.3781309890747,
+            123.40057138252259,
+            123.45452119445801,
+            123.48554271697998,
+            124.04004166603089,
+            124.28913790702819,
+            124.39105031967163,
+            124.45440249443054,
+            124.5571064376831,
+            124.7361155986786,
+            124.91622240066528,
+            125.00360578536987,
+            125.08328070640565,
+            125.13830080032349,
+            125.2295347213745,
+            125.35394525527954,
+            125.49435075759888,
+            125.60458269119263,
+            125.72243936538696,
+            125.82663643836975,
+            125.93300409317017,
+            126.02435782432556,
+            126.09885621070862,
+            126.16651153564453,
+            126.24060009002686,
+            126.31888152122498,
+            126.41316819190979,
+            126.54280662536621,
+            126.68462894439698,
+            126.77580438613892,
+            126.8230891609192,
+            126.85537923812866,
+            126.88363008499145,
+            126.91282826423645,
+            126.94254455566406,
+            126.9707493877411,
+            127.00030161857605,
+            127.02929482460021,
+            127.06760904312134,
+            127.0986561870575,
+            127.13863806724548,
+            127.17745053291321,
+            127.23237829208374,
+            127.29776979446412,
+            127.37165050506592,
+            127.46985033035278,
+            127.56723865509034,
+            127.68258781433106,
+            127.80308091163636,
+            127.87982371330261,
+            127.94324188232422,
+            127.98972443580628,
+            128.03023529052734,
+            128.07307104110717,
+            128.10850659370422,
+            128.1489437198639,
+            128.19575679779052,
+            128.24768528938293,
+            128.30849837303163,
+            128.37751910209656,
+            128.46356166839598,
+            128.59914545059203,
+            128.72301177978517,
+            128.85909510612487,
+            129.01047629356384,
+            129.09596959114074,
+            129.18290879249574,
+            129.2668813228607,
+            129.36923629760742,
+            129.49136459350586,
+            129.69063343048094,
+            129.89646366119385,
+            130.11991477012634,
+            130.3491042804718,
+            130.65597107887268,
+            130.98567969322204,
+            131.44593645095824,
+            132.1362121105194,
+            132.61222920417785,
+            132.77006802558898,
+            133.17581831932068,
+            133.52350569725036,
+            133.65027599334718,
+            133.74947697639465,
+            133.81022834777832,
+            133.8869441986084,
+            134.19105182647704,
+            134.37844815254212,
+            134.45609179496765,
+            134.54267152786255,
+            134.66409388542175,
+            134.83887226104736,
+            135.3399015903473,
+            135.44952299118043,
+            135.52058424949647,
+            135.5928444480896,
+            135.68735381126405,
+            136.16950192451478,
+            136.5521870613098,
+            136.71048418045044,
+            137.00765167236327,
+            137.9891162967682,
+            138.02192653274537,
+            138.04894944381715,
+            138.12427546310423,
+            138.50976154518128,
+            138.873538646698,
+            138.9841242351532,
+            139.11370658874515,
+            139.35008063316337,
+            140.1876000556946,
+            140.31456637382485,
+            147.51668910312227,
+            150.8394160270691
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        },
+        "spearman_rho": 0.9989411839039446,
+        "worker_service_time_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.20177268981934,
+            122.30283569774627,
+            122.5205600452423,
+            122.60929537200927,
+            122.66797201156616,
+            122.6971018486023,
+            122.73601416778564,
+            122.77037023544311,
+            122.81257249641419,
+            122.8390096206665,
+            122.88044651412964,
+            122.92808966827393,
+            122.97536842346192,
+            123.46291953086853,
+            123.76542267799377,
+            123.86257653236389,
+            123.92213554382325,
+            124.01939237594604,
+            124.222943983078,
+            124.36276661872864,
+            124.43211780548096,
+            124.50857553482055,
+            124.57027664184571,
+            124.67785886764527,
+            124.87234741210938,
+            124.98412243843079,
+            125.0936541557312,
+            125.26090567588807,
+            125.40969181060791,
+            125.49145776748657,
+            125.54093709945678,
+            125.59061560630798,
+            125.64770420074463,
+            125.7151317501068,
+            125.79718364715576,
+            125.92450232505799,
+            126.07124304771423,
+            126.24277823448182,
+            126.39197353363038,
+            126.4476409626007,
+            126.48959280014039,
+            126.51886591911315,
+            126.54474408149719,
+            126.56929949760438,
+            126.59623449325562,
+            126.62515710830688,
+            126.64931235313415,
+            126.67885724067688,
+            126.70889680862427,
+            126.73626960754395,
+            126.76666728019714,
+            126.80187697410584,
+            126.84883865356446,
+            126.90541676521302,
+            126.9881226158142,
+            127.11017844200134,
+            127.22859001159668,
+            127.3837945842743,
+            127.49648622512818,
+            127.56595790863037,
+            127.62109510421753,
+            127.65714049339294,
+            127.69538656234741,
+            127.73405620574951,
+            127.76645929336549,
+            127.80690549850463,
+            127.85590953826905,
+            127.90466072082519,
+            127.95096551895142,
+            128.02613214492797,
+            128.11823890686034,
+            128.2333468437195,
+            128.37978899002076,
+            128.57277998924255,
+            128.7053997516632,
+            128.78535892486573,
+            128.8680805206299,
+            128.94854549407958,
+            129.04876315116883,
+            129.18656414031983,
+            129.40402382850647,
+            129.65059328079224,
+            129.9080189704895,
+            130.1638106918335,
+            130.47888251304627,
+            130.98551317214967,
+            131.60869455337524,
+            132.15558164596558,
+            132.28427990913391,
+            132.5974653530121,
+            133.0116798877716,
+            133.07106366157532,
+            133.11581961631774,
+            133.16094108581544,
+            133.23522979736327,
+            133.73099293708802,
+            133.92880964279175,
+            133.98194127082826,
+            134.03434896469116,
+            134.1034224128723,
+            134.27159962654113,
+            134.9040030002594,
+            135.01462589263917,
+            135.0814479827881,
+            135.14531938552855,
+            135.22710026741026,
+            135.60060482025148,
+            136.11188952445983,
+            136.27149866104125,
+            136.48072841644287,
+            137.520674533844,
+            137.57785969924927,
+            137.60559056091307,
+            137.66266886901855,
+            137.89541630744932,
+            138.43089353561402,
+            138.55013104438783,
+            138.6332070503235,
+            138.83003143692017,
+            139.75485095214844,
+            139.88365561103805,
+            146.72983264789096,
+            150.52015590667725
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        }
+      }
+    }
+  }
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/profiles/profile.json

@@ -0,0 +1,66 @@
+{
+  "burst_model_path": "latency_burst_model.json",
+  "distribution_path": "latency_distribution.json",
+  "env_fps": 60,
+  "frame_ms": 16.666666666666668,
+  "gpu_class": "1x-rtx3090",
+  "instance_id": "instance_a5037b165aa0cedc",
+  "latency_kind": "observation_to_action_latency",
+  "latency_method": "temporal",
+  "model_id": "gr00t",
+  "n_admitted_observations": 10948,
+  "n_capacity_drops": 12532,
+  "n_observation_attempts": 23480,
+  "per_slot_summary": {
+    "0": {
+      "admitted_count": 10948,
+      "mean_observation_to_action_latency_ms": 129.1559397943446,
+      "mean_worker_service_time_ms": 128.68966885653123,
+      "p95_observation_to_action_latency_ms": 136.16566524505615,
+      "p95_worker_service_time_ms": 135.59763724803923,
+      "p99_worker_service_time_ms": 137.51246279716491
+    }
+  },
+  "provenance": {
+    "base_config": "configs/experiments/demon_attack/starvla_profile.yaml",
+    "checkpoint_kind": "best",
+    "model_artifact": {
+      "checkpoint": "checkpoints/steps_5000_model.safetensors",
+      "model_config": "config.full.yaml",
+      "path_in_repo": ".",
+      "repo_id": "latency-sensitive-bench/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6",
+      "source": "local"
+    },
+    "session_ids": [
+      0,
+      1,
+      2,
+      3,
+      4
+    ]
+  },
+  "sample_model_type": "hidden_regime",
+  "source_run_id": "20260914T155907935196Z",
+  "summary": {
+    "frame_ms": 16.666666666666668,
+    "max_ms": 150.8394160270691,
+    "mean_effective_frames": 7.749356387660675,
+    "mean_ms": 129.1559397943446,
+    "min_ms": 122.79631185531616,
+    "n_samples": 10948,
+    "p50_frames": 7.68181411743164,
+    "p50_ms": 128.03023529052734,
+    "p90_frames": 8.12030839061737,
+    "p90_ms": 135.33847317695617,
+    "p95_frames": 8.169939914703368,
+    "p95_ms": 136.16566524505615,
+    "p99_frames": 8.279290914344788,
+    "p99_ms": 137.98818190574647,
+    "prob_latency_gt_1_frame": 1.0,
+    "prob_latency_gt_2_frames": 1.0,
+    "prob_latency_gt_3_frames": 1.0,
+    "std_ms": 3.754014501652407
+  },
+  "visualization_path": "latency_profile.png",
+  "workload_id": "demon_attack"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/provenance.json

@@ -0,0 +1,123 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "5b533937a72e9fa923ecf28b1c1be5a16bad488d",
+    "teacher_path": "zero-latency/demon-attack/small-policy/sample-factory-v1",
+    "teacher_checkpoint": "best_000048704_24936448_reward_27118.050.pth",
+    "teacher_sha256": "f06e92be4b26fc883db66b355476d503aed4a6c8464d5e8f4c158f50ca2422ae",
+    "rollout_overrides": {
+      "env_fps": 60,
+      "obs_fps": 15,
+      "latency_type": "fixed",
+      "fixed_latency_ms": 0.0,
+      "seed": 42
+    },
+    "training_latency_condition": "zero",
+    "history": "decision_v1",
+    "history_decisions": 8,
+    "history_source": "zero_latency_issued_equals_applied",
+    "student_image_frames": 1,
+    "max_episode_raw_frames": 7200,
+    "episodes": 200,
+    "train_labels": 324000,
+    "filter_preset": "none"
+  },
+  "training_run_id": "demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "b2048a00",
+  "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "training_condition": "zero",
+  "base_model_revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17",
+  "hf_repo_id": "latency-sensitive-bench/benchmark-models",
+  "hf_path": "zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "evaluations": [
+    {
+      "job_id": "eval_zero_to_zero__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+      "eval_protocol_version": "hist8-history01-par32-v3",
+      "training_step": 5000,
+      "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+      "profile_sha256": null,
+      "mean_return": 2370.9,
+      "std_return": 369.3239634792197,
+      "mean_length": 7190.83,
+      "episodes": 100,
+      "parallel_envs": 32,
+      "max_episode_raw_frames": 7200,
+      "issued_actions": 179771,
+      "top_action": "NOOP",
+      "largest_action_fraction": 0.18576967364035357,
+      "unique_action_values": 6,
+      "episode_final_done": 1,
+      "episodes_at_frame_cap": 99,
+      "checks": {
+        "100_exact_seeds": true,
+        "checkpoint_sha": true,
+        "bundle_step": true,
+        "training_step_matches_plan": true,
+        "profile_sha": true,
+        "binary_history": true,
+        "raw_score_means_match": true,
+        "action_counts_match": true,
+        "action_total_match": true,
+        "summary_returns_match": true,
+        "summary_lengths_match": true,
+        "100_final_steps": true,
+        "final_step_lengths_match": true,
+        "parallel_capacity_horizon": true,
+        "fps_history": true,
+        "environment_latency_matches": true,
+        "episode_latency_protocol": true,
+        "training_recipe": true,
+        "training_dimensions": true,
+        "initialization_revision": true
+      },
+      "environment_condition": "zero"
+    },
+    {
+      "job_id": "eval_zero_to_profile__demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+      "eval_protocol_version": "hist8-history01-par32-v3",
+      "training_step": 5000,
+      "checkpoint_sha256": "6458aec364fec2757982bb8a79aba118b68cc58e08d887ce88d27c93250a56ff",
+      "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+      "mean_return": 231.9,
+      "std_return": 109.19885530535565,
+      "mean_length": 3294.29,
+      "episodes": 100,
+      "parallel_envs": 32,
+      "max_episode_raw_frames": 7200,
+      "issued_actions": 38112,
+      "top_action": "RIGHTFIRE",
+      "largest_action_fraction": 0.27802267002518893,
+      "unique_action_values": 6,
+      "episode_final_done": 99,
+      "episodes_at_frame_cap": 1,
+      "checks": {
+        "100_exact_seeds": true,
+        "checkpoint_sha": true,
+        "bundle_step": true,
+        "training_step_matches_plan": true,
+        "profile_sha": true,
+        "binary_history": true,
+        "raw_score_means_match": true,
+        "action_counts_match": true,
+        "action_total_match": true,
+        "summary_returns_match": true,
+        "summary_lengths_match": true,
+        "100_final_steps": true,
+        "final_step_lengths_match": true,
+        "parallel_capacity_horizon": true,
+        "fps_history": true,
+        "environment_latency_matches": true,
+        "episode_latency_protocol": true,
+        "training_recipe": true,
+        "training_dimensions": true,
+        "initialization_revision": true
+      },
+      "environment_condition": "profile"
+    }
+  ]
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/rollout_metadata.json

@@ -0,0 +1,338 @@
+{
+  "action_history_decisions": 8,
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_layout": "demon_attack_discrete",
+  "base_prompt": "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score.",
+  "checkpoint_config": {
+    "actor_critic_share_weights": true,
+    "actor_worker_gpus": [
+      0
+    ],
+    "adam_beta1": 0.9,
+    "adam_beta2": 0.999,
+    "adam_eps": 1e-05,
+    "adaptive_stddev": true,
+    "add_latency_info": false,
+    "algo": "APPO",
+    "async_rl": true,
+    "batch_size": 1024,
+    "batched_sampling": true,
+    "benchmark": false,
+    "cli_args": {
+      "actor_worker_gpus": [
+        0
+      ],
+      "add_latency_info": false,
+      "algo": "APPO",
+      "async_rl": true,
+      "batch_size": 1024,
+      "batched_sampling": true,
+      "clip_reward": true,
+      "device": "gpu",
+      "env": "latency_demon_attack",
+      "env_fps": 60.0,
+      "env_gpu_actions": true,
+      "env_gpu_observations": true,
+      "env_id": "ALE/DemonAttack-v5",
+      "episode_metrics_path": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0/demon_attack_teacher_fixed_l0_obs15_seed0/episode_metrics.jsonl",
+      "eval_deterministic": true,
+      "eval_episodes": 100,
+      "eval_max_steps": 7200,
+      "eval_parallel_envs": 50,
+      "eval_raw_reward": true,
+      "experiment": "demon_attack_teacher_fixed_l0_obs15_seed0",
+      "experiment_summaries_interval": 1,
+      "fixed_latency_ms": 0.0,
+      "frame_stack": 4,
+      "full_action_space": false,
+      "gae_lambda": 0.95,
+      "gamma": 0.99,
+      "gpu_env_batch_size": 512,
+      "gpu_env_device": "auto",
+      "hold_policy": "hold",
+      "keep_checkpoints": 5,
+      "latency_type": "fixed",
+      "learning_rate": 0.000303,
+      "max_episode_steps": 25000,
+      "max_grad_norm": 0.0,
+      "max_policy_lag": 300,
+      "mode": "train",
+      "noop_max": 30,
+      "normalize_input": true,
+      "normalize_returns": true,
+      "num_batches_per_epoch": 8,
+      "num_envs_per_worker": 1,
+      "num_epochs": 2,
+      "num_policies": 1,
+      "num_workers": 1,
+      "obs_fps": 15.0,
+      "ordering_policy": "latest_ready",
+      "ppo_clip_ratio": 0.1,
+      "ppo_clip_value": 0.2,
+      "recurrence": 32,
+      "repeat_action_probability": 0.0,
+      "reset_mode": "fire",
+      "restart_behavior": "resume",
+      "rollout": 64,
+      "save_every_sec": 600,
+      "screen_size": 84,
+      "seed": 0,
+      "simulator": "gpu",
+      "stats_avg": 100,
+      "terminal_on_life_loss": true,
+      "train_dir": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0",
+      "train_for_env_steps": 25000000,
+      "use_rnn": false,
+      "value_loss_coeff": 0.5,
+      "wandb_group": "demon-attack-obs15-fixed_l0",
+      "wandb_job_type": "sample_factory",
+      "wandb_project": "latency-sensitive-bench",
+      "wandb_tags": [
+        "real_profile_latency0_teacher",
+        "demon-attack",
+        "teacher",
+        "fixed",
+        "fixed_l0",
+        "obs15",
+        "seed0"
+      ],
+      "with_wandb": true,
+      "worker_num_splits": 1
+    },
+    "clip_reward": true,
+    "command_line": "--mode train --algo APPO --env latency_demon_attack --experiment demon_attack_teacher_fixed_l0_obs15_seed0 --train_dir results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0 --restart_behavior resume --device gpu --actor_worker_gpus 0 --env_gpu_observations True --env_gpu_actions True --gpu-env-batch-size 512 --seed 0 --episode_metrics_path results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0/demon_attack_teacher_fixed_l0_obs15_seed0/episode_metrics.jsonl --train_for_env_steps 25000000 --num_workers 1 --num_envs_per_worker 1 --num_policies 1 --batch_size 1024 --rollout 64 --recurrence 32 --num_epochs 2 --num_batches_per_epoch 8 --worker_num_splits 1 --max_policy_lag 300 --learning_rate 0.000303 --gamma 0.99 --gae_lambda 0.95 --ppo_clip_ratio 0.1 --ppo_clip_value 0.2 --value_loss_coeff 0.5 --max_grad_norm 0.0 --save_every_sec 600 --keep_checkpoints 5 --stats_avg 100 --experiment_summaries_interval 1 --batched_sampling True --async_rl True --batched_sampling True --use_rnn False --normalize_returns True --normalize_input True --latency-type fixed --fixed-latency-ms 0.0 --add-latency-info False --eval-episodes 100 --eval-parallel-envs 50 --eval-max-steps 7200 --eval-deterministic True --eval-raw-reward --with_wandb True --wandb_project latency-sensitive-bench --wandb_group demon-attack-obs15-fixed_l0 --wandb_job_type sample_factory --wandb_tags real_profile_latency0_teacher demon-attack teacher fixed fixed_l0 obs15 seed0 --env_id ALE/DemonAttack-v5 --env-fps 60 --obs-fps 15.0 --screen_size 84 --noop_max 30 --reset-mode fire --frame_stack 4 --terminal_on_life_loss True --clip_reward True --repeat_action_probability 0.0 --full_action_space False --max_episode_steps 25000 --simulator gpu --gpu-env-device auto --hold-policy hold --ordering-policy latest_ready",
+    "continuous_tanh_scale": 0.0,
+    "decoder_mlp_layers": [],
+    "decorrelate_envs_on_one_worker": true,
+    "decorrelate_experience_max_seconds": 0,
+    "default_niceness": 0,
+    "device": "gpu",
+    "encoder_conv_architecture": "convnet_atari",
+    "encoder_conv_mlp_layers": [
+      512
+    ],
+    "encoder_mlp_layers": [
+      512,
+      512
+    ],
+    "env": "latency_demon_attack",
+    "env_fps": 60,
+    "env_frameskip": 1,
+    "env_framestack": 1,
+    "env_gpu_actions": true,
+    "env_gpu_observations": true,
+    "env_id": "ALE/DemonAttack-v5",
+    "episode_metrics_path": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0/demon_attack_teacher_fixed_l0_obs15_seed0/episode_metrics.jsonl",
+    "eval_deterministic": true,
+    "eval_env_frameskip": 1,
+    "eval_episodes": 100,
+    "eval_latency_raw_frame_values": "0,1,2,3,4,5",
+    "eval_max_steps": 7200,
+    "eval_parallel_envs": 50,
+    "eval_raw_reward": true,
+    "experiment": "demon_attack_teacher_fixed_l0_obs15_seed0",
+    "experiment_summaries_interval": 1,
+    "exploration_loss": "entropy",
+    "exploration_loss_coeff": 0.003,
+    "export_env_raw_rgb_frames": false,
+    "fixed_latency_ms": 0.0,
+    "flush_summaries_interval": 30,
+    "force_envs_single_thread": false,
+    "frame_stack": 4,
+    "full_action_space": false,
+    "gae_lambda": 0.95,
+    "gamma": 0.99,
+    "git_hash": "unknown",
+    "git_repo_name": "not a git repository",
+    "gpu_env_batch_size": 512,
+    "gpu_env_device": "auto",
+    "heartbeat_interval": 20,
+    "heartbeat_reporting_interval": 180,
+    "help": false,
+    "hold_policy": "hold",
+    "initial_stddev": 1.0,
+    "keep_checkpoints": 5,
+    "kl_loss_coeff": 0.0,
+    "latency_seed": null,
+    "latency_type": "fixed",
+    "learning_rate": 0.000303,
+    "load_checkpoint_kind": "latest",
+    "log_to_file": true,
+    "lr_adaptive_max": 0.01,
+    "lr_adaptive_min": 1e-06,
+    "lr_schedule": "linear_decay",
+    "lr_schedule_kl_threshold": 0.008,
+    "max_episode_steps": 25000,
+    "max_grad_norm": 0.0,
+    "max_latency_ms": null,
+    "max_pending_actions": null,
+    "max_policy_lag": 300,
+    "mean_latency_ms": null,
+    "min_latency_ms": null,
+    "mode": "train",
+    "nonlinearity": "elu",
+    "noop_max": 30,
+    "normalize_input": true,
+    "normalize_input_keys": null,
+    "normalize_returns": true,
+    "num_batches_per_epoch": 8,
+    "num_batches_to_accumulate": 2,
+    "num_envs_per_worker": 1,
+    "num_epochs": 2,
+    "num_policies": 1,
+    "num_workers": 1,
+    "obs_fps": 15,
+    "obs_scale": 255.0,
+    "obs_subtract_mean": 0.0,
+    "optimizer": "adam",
+    "ordering_policy": "latest_ready",
+    "output_dir": "outputs/jitter_destructiveness/real_profile/teacher_latency0/demon_attack/train/teacher/fixed_l0/obs15/seed_0",
+    "pbt_mix_policies_in_one_env": true,
+    "pbt_mutation_rate": 0.15,
+    "pbt_optimize_gamma": false,
+    "pbt_period_env_steps": 5000000,
+    "pbt_perturb_max": 1.5,
+    "pbt_perturb_min": 1.1,
+    "pbt_replace_fraction": 0.3,
+    "pbt_replace_reward_gap": 0.1,
+    "pbt_replace_reward_gap_absolute": 1e-06,
+    "pbt_start_mutation": 20000000,
+    "pbt_target_objective": "true_objective",
+    "pixel_format": "CHW",
+    "policy_init_gain": 1.0,
+    "policy_initialization": "orthogonal",
+    "policy_workers_per_policy": 1,
+    "ppo_clip_ratio": 0.1,
+    "ppo_clip_value": 0.2,
+    "recurrence": 32,
+    "repeat_action_probability": 0.0,
+    "reset_mode": "fire",
+    "restart_behavior": "resume",
+    "reward_clip": 1000.0,
+    "reward_scale": 1.0,
+    "rnn_num_layers": 1,
+    "rnn_size": 512,
+    "rnn_type": "gru",
+    "rollout": 64,
+    "save_best_after": 100000,
+    "save_best_every_sec": 5,
+    "save_best_metric": "reward",
+    "save_every_sec": 600,
+    "save_milestones_sec": -1,
+    "screen_size": 84,
+    "seed": 42,
+    "serial_mode": false,
+    "set_workers_cpu_affinity": true,
+    "shuffle_minibatches": false,
+    "simulator": "gpu",
+    "stats_avg": 100,
+    "std_latency_ms": null,
+    "summaries_use_frameskip": true,
+    "terminal_on_life_loss": true,
+    "train_dir": "results/checkpoints/jitter_destructiveness/real_profile/teachers_latency0",
+    "train_for_env_steps": 25000000,
+    "train_for_seconds": 10000000000,
+    "use_env_info_cache": false,
+    "use_record_episode_statistics": false,
+    "use_rnn": false,
+    "value_bootstrap": false,
+    "value_loss_coeff": 0.5,
+    "vtrace_c": 1.0,
+    "vtrace_rho": 1.0,
+    "wandb_group": "demon-attack-obs15-fixed_l0",
+    "wandb_job_type": "sample_factory",
+    "wandb_project": "latency-sensitive-bench",
+    "wandb_tags": [
+      "real_profile_latency0_teacher",
+      "demon-attack",
+      "teacher",
+      "fixed",
+      "fixed_l0",
+      "obs15",
+      "seed0"
+    ],
+    "wandb_unique_id": "demon-attack-obs15-fixed_l0-s0",
+    "wandb_user": null,
+    "with_pbt": false,
+    "with_vtrace": false,
+    "with_wandb": true,
+    "worker_num_splits": 1
+  },
+  "checkpoint_experiment_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/teacher_runtime",
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/teacher_runtime/best_000048704_24936448_reward_27118.050.pth",
+  "checkpoint_train_step": 48704,
+  "config_source": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/teacher_runtime/config.json",
+  "context_image_count": 0,
+  "context_window": 1,
+  "env_fps": 60.0,
+  "env_name": "demon_attack",
+  "episode_return_field": "episode_raw_return",
+  "filter_preset": "none",
+  "filter_report": {
+    "accepted_episodes": 200,
+    "accepted_train_episodes": 180,
+    "accepted_val_episodes": 20,
+    "attempted_episodes": 200,
+    "preset": "none",
+    "raw_score_bins": {
+      "6460-6889": 0,
+      "6890-7309": 0,
+      "7310-7999": 0,
+      "<6460": 200,
+      ">=8000": 0
+    },
+    "rejected_episodes": 0,
+    "train_rows_after_row_filter": 324000,
+    "train_rows_before_row_filter": 324000,
+    "val_rows_after_row_filter": 36000,
+    "val_rows_before_row_filter": 36000
+  },
+  "frame_stack": 4,
+  "image_resolution": [
+    210,
+    160,
+    3
+  ],
+  "image_source": "env_raw_rgb",
+  "image_transform": {
+    "gamma": 1.3,
+    "ground_fraction": 0.22,
+    "history_frames": 5,
+    "image_transform": "raw_rgb",
+    "min_alpha": 35,
+    "scroll_px_per_step": 4.0
+  },
+  "image_transform_prompt_contexts": {
+    "demon_attack_ghost_trail": " You can see the recent motion of the ship, missiles, and demons in the image. Use it to make your decision.",
+    "flappy_ghost_trail": " You can see the past motion of the bird in the image. Use it to make your decision."
+  },
+  "latency_override": null,
+  "latency_source": "checkpoint",
+  "max_episodes": 200,
+  "max_steps_per_episode": 7200,
+  "max_steps_unit": "raw_frame",
+  "num_envs": 256,
+  "obs_fps": 15.0,
+  "obs_stride_raw_frames": 4,
+  "prompt_source": "sample_factory_checkpoint:base_prompt",
+  "replay_num_envs": 256,
+  "reward_field": "raw_reward",
+  "reward_semantics": "raw_reward",
+  "rows_unit": "decision_step",
+  "schema_version": 2,
+  "split_seed": 0,
+  "total_episodes": 200,
+  "total_rows": 360000,
+  "train_episodes": 180,
+  "train_rows": 324000,
+  "val_episodes": 20,
+  "val_fraction": 0.1,
+  "val_rows": 36000
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/run_metadata.json

@@ -0,0 +1,18 @@
+{
+  "training_run_id": "demon_attack-qwengr00t-hist8-zero-scratch-s42-v2",
+  "wandb_run_id": "b2048a00",
+  "recipe_version": "hist8-v2",
+  "history_encoding": "binary_0_1",
+  "training_condition": "zero",
+  "initialization_seed": 42,
+  "vlm_lr": 3e-06,
+  "max_train_steps": 5000,
+  "stop_after_steps": null,
+  "num_workers_per_rank": 16,
+  "eval_num_workers_per_rank": 16,
+  "prefetch_factor": 4,
+  "base_model_revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17",
+  "dataset_dir": "/home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/data_zero/demon_attack/lerobot",
+  "dataset_manifest_sha256": "688b6b9bc596d345659e3be392e6336078d0a268e3ee24347f31e0b85d93bb5b",
+  "code_snapshot_sha256": "4fdfd05c7faaa60fb697f4d2bd169b94979d9626b8ebe52ac01b9b6a6faecf8d"
+}

zero-latency/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-zero-scratch-s42-v2/task_contract.json

@@ -0,0 +1,51 @@
+{
+  "task": "demon_attack",
+  "model": "qwengr00t",
+  "action_horizon": 1,
+  "image_frames": 1,
+  "state_source": "transport",
+  "state_dim": 88,
+  "history_decisions": 8,
+  "history_encoding": "binary_0_1",
+  "history_normalization": "identity",
+  "history_reset": "all_zero",
+  "history_order": "oldest_to_newest",
+  "history_entry_fields": [
+    "admission_bit",
+    "admitted_command_non_noop_bits",
+    "last_applied_action_non_noop_bits"
+  ],
+  "history_action_bit_order": [
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_dim": 6,
+  "action_layout": "demon_attack_discrete",
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "task_prompts": [
+    "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score."
+  ],
+  "env_fps": 60,
+  "obs_fps": 15,
+  "evaluation": {
+    "episodes": 100,
+    "seeds": [
+      1000000,
+      1000099
+    ],
+    "parallel_envs": 32,
+    "capacity": 1,
+    "max_raw_frames": 7200,
+    "protocol_version": "hist8-history01-par32-v3"
+  }
+}