Publish hist8 profile demon_attack qwengr00t step5000

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/README.md

@@ -0,0 +1,35 @@
+# demon_attack / qwengr00t — hist8 profile training
+
+Run `demon_attack-qwengr00t-hist8-scratch-s42-v2`; final optimizer step **5000**, seed **42**. [W&B](https://wandb.ai/saberrr-zju/starvla_tasks/runs/7f1c60f6).
+
+Checkpoint SHA256: `a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8`.
+
+## Model and inputs
+
+Full StarVLA state dict in `checkpoints/model.pt` (original evaluated bytes). Initialize the matching Qwen model with `config.yaml` and `dataset_statistics.json`. Base: `Qwen/Qwen3-VL-4B-Instruct@ebb281ec70b05090aa6165b016eac8ec08e71b17`; model-specific action head trained from random initialization.
+
+One current RGB image, eight prior causal decision histories (88 raw 0/1 values), action horizon 1. `h1` in this repository path is the action horizon; `hist8` is input history. Pass history as `transport`, preserve all-zero reset, and use identity state normalization. Prompt and action order are in `task_contract.json` and `manifest.json`.
+
+Training: 2 GPUs, bf16/ZeRO-2, batch 64 per rank, accumulation 1, global batch 128; 16 dataloader workers per rank and prefetch 4. Backbone LR 3e-6, action head 1e-4; other groups retain the recorded configuration. Warmup 100, cosine min_lr_rate 1/30, 5000 steps. Full historical training configuration and code snapshot are included.
+
+## Formal evaluation
+
+| Environment | Episodes | Return mean ± std | Mean raw frames |
+|---|---:|---:|---:|
+| profile | 100 | 1203.1000 ± 310.3271 | 7111.02 |
+
+Seeds 1,000,000–1,000,099; parallel 32; capacity 1; FPS/decision Hz 60/15; max 7200 raw frames. Zero-trained models have both zero and profile evaluations; profile-trained models have the matching profile evaluation. `profiles/profile.json` is the exact model-specific latency profile, with SHA in provenance.
+
+Each `evaluations/<condition>/` contains the evaluated config, 100 episode records, action audit including raw-score summaries, verification, provenance and evaluator code snapshot. Evaluation configs retain original machine paths as execution evidence; replace checkpoint, model-config, backbone, profile and output paths when replaying locally. Deadly Corridor requires 160×120 RGB with HUD, no crosshair, weapon enabled, decals/particles disabled before resizing.
+
+These are one-training-seed results. Architectures use different latency profiles. Zero/profile training also uses different teachers and collected data, so their score difference is not an isolated learning-rate ablation.
+
+## Download
+
+```python
+from huggingface_hub import snapshot_download
+prefix = "latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2"
+repo = snapshot_download("latency-sensitive-bench/benchmark-models", allow_patterns=[prefix + "/**"])
+```
+
+Use a pinned repository commit for reproduction. Preserve the original checkpoint SHA above. Optimizer/RNG resume state remains in the source training archive; this publication contains the inference checkpoint.

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/bundle.complete.json

@@ -0,0 +1,4 @@
+{
+  "checkpoint_sha256": "a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8",
+  "training_step": 5000
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/checkpoint.sha256

@@ -0,0 +1 @@
+a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8  checkpoints/model.pt

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/checkpoints/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8
+size 9977006371

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/collection_quality_report.json

@@ -0,0 +1,34 @@
+{
+  "episodes": 200,
+  "train_episodes": 180,
+  "val_episodes": 20,
+  "train_labels": 608054,
+  "val_labels": 71062,
+  "raw_frames_quantiles": [
+    5200.0,
+    10988.800000000001,
+    14400.0,
+    14400.0,
+    14400.0
+  ],
+  "return_quantiles": [
+    620.0,
+    2504.0,
+    4330.0,
+    5144.0,
+    6630.0
+  ],
+  "termination_reasons": {
+    "terminated": 60,
+    "horizon": 140
+  },
+  "action_id_counts": {
+    "0": 17422,
+    "1": 192366,
+    "2": 74888,
+    "3": 75277,
+    "4": 169250,
+    "5": 149913
+  },
+  "previous_decision_admitted_fraction": 0.4609701347442099
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/config.full.yaml

@@ -0,0 +1,297 @@
+framework:
+  name: QwenGR00T
+  qwenvl:
+    base_vlm: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+    attn_implementation: flash_attention_2
+    vl_hidden_dim: 2048
+    enable_gradient_checkpointing: true
+  action_model:
+    action_model_type: DiT-B
+    action_hidden_dim: 1024
+    hidden_size: 1024
+    add_pos_embed: true
+    max_seq_len: 1024
+    action_dim: 6
+    state_dim: 88
+    task_objective: null
+    action_horizon: 1
+    repeated_diffusion_steps: 8
+    noise_beta_alpha: 1.5
+    noise_beta_beta: 1.0
+    noise_s: 0.999
+    num_timestep_buckets: 1000
+    num_inference_timesteps: 4
+    num_target_vision_tokens: 32
+    diffusion_model_cfg:
+      cross_attention_dim: 2560
+      dropout: 0.2
+      final_dropout: true
+      interleave_self_attention: true
+      norm_type: ada_norm
+      num_layers: 16
+      output_dim: 1024
+      positional_embeddings: null
+      attention_head_dim: 64
+    loss_type: l1
+    future_action_window_size: 0
+    past_action_window_size: 0
+    action_env_dim: 6
+  kv_memory:
+    enabled: false
+    window: 4
+    rollout_len: 8
+    packed_train: false
+    rebased_sink: true
+datasets:
+  vla_data:
+    dataset_py: lerobot_datasets
+    include_state: true
+    data_root_dir: /home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t
+    data_mix: lerobot
+    eval_data_mix: lerobot__val
+    custom_mixtures_path: /home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/_generated_mixtures/lerobot.json
+    action_type: discrete
+    sequential_step_sampling: false
+    eval_sequential_step_sampling: null
+    num_workers: 16
+    eval_num_workers: 16
+    prefetch_factor: 4
+    persistent_workers: true
+    pin_memory: true
+    shuffle: true
+    action_balance:
+      enabled: false
+      strategy: balanced_epoch
+      action_key: action_id
+      target_flap_fraction: 0.3
+      noop_id: 0
+      flap_id: 1
+    latency_curriculum:
+      enabled: false
+      strategy: exclusive
+      latencies: null
+      phase_steps: null
+      phase_distributions: null
+      new_latency_passes: 1.0
+      replay_passes: 0.25
+      target_total_passes: 2.0
+      final_equalization: true
+      step_budget_mode: auto
+      eval_at_phase_end: false
+      save_at_phase_end: false
+      computed_plan: null
+    per_device_batch_size: 64
+    load_all_data_for_training: true
+    num_obs_frames: 1
+    image_mode: single
+    prompt_mode: raw
+    stitch_grid:
+    - 2
+    - 2
+    obs_image_size: null
+    video_backend: torchvision_av
+dataset:
+  source_hf: ''
+  config_name: null
+  source_subdir: null
+  converted_name: demon_attack_train
+  single_source_hf: ''
+  mixed_source_hf: ''
+  single_converted_name: demon_attack_train
+  mixed_converted_name: demon_attack_mixed_latency_train
+  single_latency_filter: null
+  mixed_latency_filter: null
+  force_download: false
+  setup_force: false
+  skip_verification: false
+  target_latency_unit: observation_steps
+  verify_rows: 200
+  max_episodes: null
+  episodes_per_latency: null
+  latency_filter: null
+  debug_subset:
+    enabled: false
+    max_episodes: 5
+    suffix: debug
+base_model:
+  repo_id: Qwen/Qwen3-VL-4B-Instruct
+initialization:
+  checkpoint_local_dir: null
+  checkpoint_hf_repo_id: null
+  checkpoint_filename: null
+trainer:
+  max_train_steps: 5000
+  num_warmup_steps: 100
+  save_interval: 500
+  eval_interval: 500
+  eval_num_batches: 50
+  per_latency_eval_num_batches: null
+  eval_action_classification: false
+  eval_action_classification_interval: null
+  cc_f1_tolerance: 1
+  learning_rate:
+    base: 3.0e-05
+    qwen_vl_interface: 3.0e-06
+    action_model: 0.0001
+  lr_scheduler_type: cosine_with_min_lr
+  scheduler_specific_kwargs:
+    min_lr_rate: 0.03333333333333333
+  freeze_modules: ''
+  freeze_vit: false
+  freeze_tied_embedding: false
+  freeze_llm_layers: []
+  loss_scale:
+    vla: 1.0
+    vlm: 0.0
+  max_grad_norm: 1.0
+  weight_decay: 0.0
+  logging_frequency: 1
+  profile_timing:
+    enabled: false
+    log_interval: 10
+  gradient_clipping: 1.0
+  gradient_accumulation_steps: 1
+  distributed_backend: deepspeed
+  is_resume: true
+  pretrained_checkpoint: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwengr00t-hist8-scratch-s42-v2/checkpoints/steps_1259_state
+  resume_step: 1259
+  reload_modules: null
+  optimizer:
+    name: AdamW
+    betas:
+    - 0.9
+    - 0.95
+    eps: 1.0e-08
+    weight_decay: 1.0e-08
+    fused: true
+  save_format: pt
+  hist8_diagnostics:
+    steps:
+    - 0
+    - 500
+    - 1000
+    - 2500
+    - 5000
+    sample_count: 2048
+    noise_seeds:
+    - 1729
+    - 1730
+    - 1731
+    - 1732
+    sample_seed: 42
+    batch_size: 8
+    bootstrap_repeats: 4000
+workspace_dir: WORKSPACE_DIR
+run_root_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train
+seed: 42
+wandb_entity: saberrr-zju
+wandb_project: starvla_tasks
+auth:
+  env_file: null
+  hf_token_env: HF_TOKEN
+  wandb_api_key_env: WANDB_API_KEY
+paths:
+  run_root_dir: results/Checkpoints
+  dataset_local_dir: playground/Datasets/rl_games
+  dataset_cache_dir: null
+  base_model_dir: /home/ubuntu/.cache/huggingface/hub/models--Qwen--Qwen3-VL-4B-Instruct/snapshots/ebb281ec70b05090aa6165b016eac8ec08e71b17
+  accelerate_config: starVLA/config/deepseeds/deepspeed_zero2.yaml
+launch:
+  use_accelerate: true
+  gpus: null
+  num_processes: 1
+  dry_run: false
+conda:
+  enabled: true
+  env_name: null
+rl_games:
+  model_alias: gr00t
+  env_eval:
+    image_size: 224
+    frameskip: 4
+    image_transform: raw_rgb
+    prompt_mode: raw
+    ghost_trail:
+      history_frames: 5
+      gamma: 1.3
+      min_alpha: 35
+      scroll_px_per_step: 4.0
+      ground_fraction: 0.22
+    seed: 42
+    fixed_episode_seeds: true
+    latency_seed_stride: 0
+    task_seed_stride: 0
+    task_description: 'You are playing Demon Attack from a single game image. Choose
+      exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE.'
+    eval_parallel_envs: 5
+    action_chunk_execution:
+      enabled: false
+      chunk_size: null
+    demon_attack:
+      noop_max: 30
+    enabled: false
+    eval_backend: latency_bench
+    distributed_mode: none
+    vectorized:
+      enabled: false
+      batch_size: 1
+    latency:
+      prompt_map_path: null
+      mode: single
+      values:
+      - 0
+    mid_train:
+      enabled: false
+      interval_steps: 100
+      latencies:
+      - 0
+      num_episodes: 5
+      max_steps_per_episode: 3600
+    post_train:
+      enabled: false
+      latencies:
+      - 0
+      - 1
+      - 2
+      - 3
+      - 4
+      num_episodes: 5
+      max_steps_per_episode: 3600
+  task: demon_attack
+  initialization_mode: scratch
+  action_carrier: native
+model: gr00t
+env: demon_attack
+init: scratch
+mode: single
+checkpoint:
+  load: none
+  hf_repo_id: null
+  save_best_model: false
+  save_final_model: true
+  save_pt_file: true
+  save_training_state: true
+  save_safetensors_file: false
+  local:
+    keep_last_n: 2
+  sync:
+    enabled: false
+    repo_id: null
+    keep_last_n: 0
+    sync_every_n_checkpoints: 1
+    resume_policy: local_latest
+run_id: demon_attack-qwengr00t-hist8-scratch-s42-v2
+output_dir: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwengr00t-hist8-scratch-s42-v2
+config_yaml: /home/ubuntu/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/train/demon_attack-qwengr00t-hist8-scratch-s42-v2/train.yaml
+is_debug: false
+version_id: '0.21'
+wandb_name: demon_attack-qwengr00t-hist8-scratch-s42-v2
+wandb_group: decision-history-vla-h8-v2
+wandb_tags:
+- demon_attack
+- qwengr00t
+- hist8-v2
+- history01
+- scratch
+- profile-latency
+training_latency_condition: profile-latency

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/config.yaml

@@ -0,0 +1,54 @@
+framework:
+  name: QwenGR00T
+  qwenvl:
+    base_vlm: Qwen/Qwen3-VL-4B-Instruct
+    attn_implementation: flash_attention_2
+    vl_hidden_dim: 2048
+    enable_gradient_checkpointing: true
+  action_model:
+    action_model_type: DiT-B
+    action_hidden_dim: 1024
+    hidden_size: 1024
+    add_pos_embed: true
+    max_seq_len: 1024
+    action_dim: 6
+    state_dim: 88
+    task_objective: null
+    action_horizon: 1
+    repeated_diffusion_steps: 8
+    noise_beta_alpha: 1.5
+    noise_beta_beta: 1.0
+    noise_s: 0.999
+    num_timestep_buckets: 1000
+    num_inference_timesteps: 4
+    num_target_vision_tokens: 32
+    diffusion_model_cfg:
+      cross_attention_dim: 2560
+      dropout: 0.2
+      final_dropout: true
+      interleave_self_attention: true
+      norm_type: ada_norm
+      num_layers: 16
+      output_dim: 1024
+      positional_embeddings: null
+      attention_head_dim: 64
+    loss_type: l1
+    future_action_window_size: 0
+    past_action_window_size: 0
+    action_env_dim: 6
+  kv_memory:
+    enabled: false
+    window: 4
+    rollout_len: 8
+    packed_train: false
+    rebased_sink: true
+version_id: '0.21'
+datasets:
+  vla_data:
+    include_state: true
+    obs_image_size: null
+    image_mode: single
+    num_obs_frames: 1
+    robot_type: rl_games_demon_attack
+trainer:
+  pretrained_checkpoint: null

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/dataset_statistics.json

@@ -0,0 +1,606 @@
+{
+  "new_embodiment": {
+    "action": {
+      "mean": [
+        0.025843098759651184,
+        0.2827610671520233,
+        0.1105247214436531,
+        0.11113486438989639,
+        0.24912919104099274,
+        0.22060705721378326
+      ],
+      "std": [
+        0.15897421538829803,
+        0.4495506286621094,
+        0.31325262784957886,
+        0.3136650025844574,
+        0.43261080980300903,
+        0.4138864576816559
+      ],
+      "max": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "min": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q01": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q99": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "mask": [
+        true,
+        true,
+        true,
+        true,
+        true,
+        true
+      ]
+    },
+    "state": {
+      "mean": [
+        0.4550747275352478,
+        0.1818506270647049,
+        0.007395724765956402,
+        0.004659125581383705,
+        0.15608645975589752,
+        0.09358872473239899,
+        0.3935917019844055,
+        0.015990355983376503,
+        0.010048449970781803,
+        0.3353501558303833,
+        0.20209060609340668,
+        0.45587727427482605,
+        0.18195587396621704,
+        0.007428616750985384,
+        0.004662415012717247,
+        0.1566028743982315,
+        0.09371864795684814,
+        0.3938893675804138,
+        0.015995290130376816,
+        0.01005173847079277,
+        0.3365342617034912,
+        0.20236031711101532,
+        0.456743985414505,
+        0.18202002346515656,
+        0.007540448568761349,
+        0.004662415012717247,
+        0.1571192741394043,
+        0.09387324005365372,
+        0.39408835768699646,
+        0.01600022427737713,
+        0.010053383186459541,
+        0.3377973139286041,
+        0.20265305042266846,
+        0.4575432538986206,
+        0.18210718035697937,
+        0.007606232538819313,
+        0.004664059262722731,
+        0.15760935842990875,
+        0.09401467442512512,
+        0.3942774832248688,
+        0.01603640429675579,
+        0.010058317333459854,
+        0.33903568983078003,
+        0.20295566320419312,
+        0.4584066569805145,
+        0.1821811944246292,
+        0.007652280852198601,
+        0.004665703978389502,
+        0.1581783890724182,
+        0.09417419880628586,
+        0.3944600224494934,
+        0.016181128099560738,
+        0.010061606764793396,
+        0.3401770293712616,
+        0.20325826108455658,
+        0.45920097827911377,
+        0.1822584867477417,
+        0.0076802391558885574,
+        0.0046673486940562725,
+        0.15870794653892517,
+        0.09432221204042435,
+        0.39462941884994507,
+        0.01637190207839012,
+        0.010063250549137592,
+        0.34127068519592285,
+        0.20358553528785706,
+        0.46010223031044006,
+        0.18232755362987518,
+        0.007693395484238863,
+        0.0046689934097230434,
+        0.15933947265148163,
+        0.09448996186256409,
+        0.39480045437812805,
+        0.0165034681558609,
+        0.010066539980471134,
+        0.3424186110496521,
+        0.20392103493213654,
+        0.46087682247161865,
+        0.1823752522468567,
+        0.007706552278250456,
+        0.0046689934097230434,
+        0.1599019169807434,
+        0.09463139623403549,
+        0.3949698507785797,
+        0.016590632498264313,
+        0.010069829411804676,
+        0.34361913800239563,
+        0.20425324141979218
+      ],
+      "std": [
+        0.49854785203933716,
+        0.384589821100235,
+        0.08544375002384186,
+        0.06797321885824203,
+        0.3619530200958252,
+        0.2902158498764038,
+        0.48927322030067444,
+        0.12567216157913208,
+        0.09942686557769775,
+        0.4716968834400177,
+        0.40011945366859436,
+        0.49862566590309143,
+        0.384681761264801,
+        0.08562635630369186,
+        0.06799715757369995,
+        0.362786203622818,
+        0.2903884947299957,
+        0.48931920528411865,
+        0.12569044530391693,
+        0.09944307804107666,
+        0.4706987738609314,
+        0.4002951979637146,
+        0.49871915578842163,
+        0.38472938537597656,
+        0.08625543117523193,
+        0.06799715757369995,
+        0.36326897144317627,
+        0.2914486825466156,
+        0.4888802468776703,
+        0.12570007145404816,
+        0.09945118427276611,
+        0.47343480587005615,
+        0.4017679989337921,
+        0.4988429546356201,
+        0.38480108976364136,
+        0.08662756532430649,
+        0.06800912320613861,
+        0.3636360168457031,
+        0.2916356027126312,
+        0.4889160394668579,
+        0.12583738565444946,
+        0.09947548806667328,
+        0.4739202857017517,
+        0.40190577507019043,
+        0.49893417954444885,
+        0.3847790062427521,
+        0.0868857279419899,
+        0.06802072376012802,
+        0.3639001250267029,
+        0.2918242812156677,
+        0.48894163966178894,
+        0.1263713538646698,
+        0.09949168562889099,
+        0.474515825510025,
+        0.40211808681488037,
+        0.49746397137641907,
+        0.3863386809825897,
+        0.0870376005768776,
+        0.06803268939256668,
+        0.3643128275871277,
+        0.29202571511268616,
+        0.48897871375083923,
+        0.1270582228899002,
+        0.09949978440999985,
+        0.47495630383491516,
+        0.4020144045352936,
+        0.49854376912117004,
+        0.38638991117477417,
+        0.08711083233356476,
+        0.06804463267326355,
+        0.36454275250434875,
+        0.29226168990135193,
+        0.48904359340667725,
+        0.127530038356781,
+        0.09951598197221756,
+        0.47436973452568054,
+        0.4022477865219116,
+        0.498345285654068,
+        0.38642722368240356,
+        0.08718468993902206,
+        0.06804463267326355,
+        0.3667284846305847,
+        0.29242798686027527,
+        0.48899203538894653,
+        0.12785986065864563,
+        0.09953217953443527,
+        0.4744252562522888,
+        0.4024665653705597
+      ],
+      "max": [
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ],
+      "min": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q01": [
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0,
+        0.0
+      ],
+      "q99": [
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        0.0,
+        0.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0,
+        1.0
+      ]
+    },
+    "num_transitions": 608054,
+    "num_trajectories": 180
+  }
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/eval_profile.json

@@ -0,0 +1,41 @@
+{
+  "job_id": "eval_v2__demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "training_step": 5000,
+  "checkpoint_sha256": "a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8",
+  "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+  "mean_return": 1203.1,
+  "std_return": 310.3270693961453,
+  "mean_length": 7111.02,
+  "episodes": 100,
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "issued_actions": 82064,
+  "top_action": "FIRE",
+  "largest_action_fraction": 0.3779976603626438,
+  "unique_action_values": 6,
+  "episode_final_done": 4,
+  "episodes_at_frame_cap": 96,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "environment_condition": "profile"
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/evaluations/profile/action_audit.json

@@ -0,0 +1,141 @@
+{
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "episode_seeds": [
+    1000000,
+    1000001,
+    1000002,
+    1000003,
+    1000004,
+    1000005,
+    1000006,
+    1000007,
+    1000008,
+    1000009,
+    1000010,
+    1000011,
+    1000012,
+    1000013,
+    1000014,
+    1000015,
+    1000016,
+    1000017,
+    1000018,
+    1000019,
+    1000020,
+    1000021,
+    1000022,
+    1000023,
+    1000024,
+    1000025,
+    1000026,
+    1000027,
+    1000028,
+    1000029,
+    1000030,
+    1000031,
+    1000032,
+    1000033,
+    1000034,
+    1000035,
+    1000036,
+    1000037,
+    1000038,
+    1000039,
+    1000040,
+    1000041,
+    1000042,
+    1000043,
+    1000044,
+    1000045,
+    1000046,
+    1000047,
+    1000048,
+    1000049,
+    1000050,
+    1000051,
+    1000052,
+    1000053,
+    1000054,
+    1000055,
+    1000056,
+    1000057,
+    1000058,
+    1000059,
+    1000060,
+    1000061,
+    1000062,
+    1000063,
+    1000064,
+    1000065,
+    1000066,
+    1000067,
+    1000068,
+    1000069,
+    1000070,
+    1000071,
+    1000072,
+    1000073,
+    1000074,
+    1000075,
+    1000076,
+    1000077,
+    1000078,
+    1000079,
+    1000080,
+    1000081,
+    1000082,
+    1000083,
+    1000084,
+    1000085,
+    1000086,
+    1000087,
+    1000088,
+    1000089,
+    1000090,
+    1000091,
+    1000092,
+    1000093,
+    1000094,
+    1000095,
+    1000096,
+    1000097,
+    1000098,
+    1000099
+  ],
+  "issued_actions": 82064,
+  "action_counts": {
+    "3": 902,
+    "1": 31020,
+    "0": 2339,
+    "4": 30784,
+    "5": 16103,
+    "2": 916
+  },
+  "largest_action_fraction": 0.3779976603626438,
+  "raw_score_min": [
+    -0.49585282802581787,
+    -0.25202274322509766,
+    -0.16281169652938843,
+    -0.16717469692230225,
+    -0.1584365963935852,
+    -0.3656187057495117
+  ],
+  "raw_score_max": [
+    1.105427622795105,
+    1.0956369638442993,
+    1.0767080783843994,
+    1.084166169166565,
+    1.0817185640335083,
+    1.0875451564788818
+  ],
+  "raw_score_mean": [
+    0.03585946677442583,
+    0.38701489358942487,
+    0.007062421356321068,
+    0.008692177730815667,
+    0.3784177685486968,
+    0.19780218006596298
+  ]
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/evaluations/profile/eval_config.yaml

@@ -0,0 +1,118 @@
+experiment:
+  name: demon_attack-qwengr00t-hist8-scratch-s42-v2-step5000-history01-profile-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: temporal
+  profile_path: /mnt/ssd/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json
+  profile_worker_slot: 0
+  seed: 271828
+  add_latency_info: false
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /mnt/ssd/codex/hist8-vla-20260923/backbone/Qwen3-VL-4B-Instruct
+  worker_python_executable: /mnt/ssd/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-scratch-s42-v2-to-profile-par32
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/evaluations/profile/provenance.json

@@ -0,0 +1,35 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "af125bd372c22c5b00e326d9af1af64ea3751b56",
+    "teacher_path": "latency-aware/demon-attack/small-policy/sample-factory-gr00t-rtx3090-temporal-hist8-capacity1-s42-v1",
+    "teacher_checkpoint": "best_000047744_24444928_reward_4477.300.pth",
+    "teacher_sha256": "b5430581140648264f8ddb2eab6d0fa45491687e90a5cf391ef047e5dbcf18b1",
+    "profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+    "episodes": 200,
+    "filter_preset": "none",
+    "history": "decision_v1"
+  },
+  "training_run_id": "demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "7f1c60f6",
+  "checkpoint_sha256": "a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "episodes": 100,
+  "env_condition": "profile",
+  "parallel_envs": 32,
+  "max_episode_raw_frames": 7200,
+  "inference_devices": [
+    "cuda:0",
+    "cuda:1"
+  ],
+  "episode_seeds": [
+    1000000,
+    1000099
+  ],
+  "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68"
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/evaluations/profile/resolved_config.yaml

@@ -0,0 +1,121 @@
+experiment:
+  name: demon_attack-qwengr00t-hist8-scratch-s42-v2-step5000-history01-profile-par32
+  seed: 1000000
+backend:
+  type: sample_factory
+  algo: APPO
+  device: cpu
+  train_dir: results/sample_factory
+  restart_behavior: resume
+  run_mode: eval
+executor:
+  mode: simulated
+  simulated_worker_capacity: 1
+  simulated_inference_pool: true
+  inference_devices:
+  - cuda:0
+  - cuda:1
+  inference_batch_size: 16
+env:
+  name: demon_attack
+  env_id: ALE/DemonAttack-v5
+  env_fps: 60
+  obs_fps: 15
+  screen_size: 84
+  noop_max: 30
+  reset_mode: fire
+  frame_stack: 1
+  terminal_on_life_loss: true
+  clip_reward: false
+  repeat_action_probability: 0.0
+  full_action_space: false
+  max_episode_steps: 25000
+  noop_action: 0
+  simulator: gpu
+  gpu_env_device: auto
+  obs_resize:
+  - 224
+  - 224
+  action_history_decisions: 8
+latency:
+  method: temporal
+  profile_path: /mnt/ssd/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json
+  profile_worker_slot: 0
+  seed: 271828
+  add_latency_info: false
+scheduler:
+  hold_policy: hold
+  ordering_policy: latest_ready
+policy:
+  type: starvla
+  actions:
+  - NOOP
+  - FIRE
+  - RIGHT
+  - LEFT
+  - RIGHTFIRE
+  - LEFTFIRE
+  checkpoint_path: /mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2/checkpoints/model.pt
+  model_config_path: /mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2/config.yaml
+  device: cuda:0
+  unnorm_key: new_embodiment
+  prompt_mode: latency_neutral
+  backbone_path: /mnt/ssd/codex/hist8-vla-20260923/backbone/Qwen3-VL-4B-Instruct
+  worker_python_executable: /mnt/ssd/miniconda3/envs/starvla_rl_games_openvla/bin/python3.10
+  state_source: transport
+  action_prefix:
+    mode: none
+training:
+  train_for_env_steps: 25000000
+  num_workers: 1
+  num_envs_per_worker: 512
+  worker_num_splits: 1
+  num_policies: 1
+  batch_size: 1024
+  batched_sampling: true
+  rollout: 64
+  recurrence: 32
+  num_epochs: 2
+  num_batches_per_epoch: 8
+  max_policy_lag: 300
+  learning_rate: 0.000303
+  gamma: 0.99
+  gae_lambda: 0.95
+  ppo_clip_ratio: 0.1
+  ppo_clip_value: 0.2
+  value_loss_coeff: 0.5
+  max_grad_norm: 0.0
+  async_rl: true
+  use_rnn: false
+  normalize_input: true
+  normalize_returns: true
+  stats_avg: 100
+  experiment_summaries_interval: 1
+  save_every_sec: 600
+  keep_checkpoints: 5
+evaluation:
+  eval_interval_steps: 1000000
+  eval_episodes: 100
+  eval_parallel_envs: 32
+  eval_max_steps: 7200
+  eval_deterministic: true
+  eval_raw_reward: true
+  eval_suites:
+    fixed: []
+    normal: []
+    uniform: []
+  latency_bench_env_backend: demon_attack_gpu_batched
+  eval_latency_values: null
+logging:
+  output_dir: /mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-scratch-s42-v2-to-profile-par32
+  video:
+    enabled: false
+    num_bins: 10
+  save_step_records: true
+  save_action_records: true
+  save_latency_records: true
+  wandb_project: null
+  wandb_group: null
+  wandb_job_type: null
+  wandb_tags: ''
+  simulated_pipeline_profile: false

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/evaluations/profile/summary.json

@@ -0,0 +1,217 @@
+{
+  "checkpoint_path": "/mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2/checkpoints/model.pt",
+  "experiment_name": "demon_attack-qwengr00t-hist8-scratch-s42-v2-step5000-history01-profile-par32",
+  "latency": "profile_sample",
+  "latency_type": "profile_sample",
+  "lengths": [
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    5489,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    5323,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    4148,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    4942,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200,
+    7200
+  ],
+  "mean_length": 7111.02,
+  "mean_return": 1203.1,
+  "returns": [
+    1240.0,
+    920.0,
+    1140.0,
+    1260.0,
+    720.0,
+    780.0,
+    1260.0,
+    1060.0,
+    1300.0,
+    840.0,
+    480.0,
+    1540.0,
+    1700.0,
+    1260.0,
+    1160.0,
+    1240.0,
+    1460.0,
+    1500.0,
+    980.0,
+    1180.0,
+    1000.0,
+    1500.0,
+    1520.0,
+    1420.0,
+    1200.0,
+    1240.0,
+    1440.0,
+    720.0,
+    1140.0,
+    1480.0,
+    1120.0,
+    920.0,
+    940.0,
+    385.0,
+    1760.0,
+    1320.0,
+    1120.0,
+    1120.0,
+    1260.0,
+    1260.0,
+    940.0,
+    1240.0,
+    1340.0,
+    340.0,
+    1260.0,
+    1120.0,
+    1040.0,
+    1260.0,
+    1060.0,
+    480.0,
+    1020.0,
+    1480.0,
+    1080.0,
+    1620.0,
+    1180.0,
+    1200.0,
+    1280.0,
+    1260.0,
+    1460.0,
+    1580.0,
+    1260.0,
+    1400.0,
+    1260.0,
+    1300.0,
+    1200.0,
+    1400.0,
+    1280.0,
+    1320.0,
+    560.0,
+    385.0,
+    1760.0,
+    1040.0,
+    1340.0,
+    960.0,
+    2200.0,
+    1100.0,
+    1280.0,
+    1740.0,
+    900.0,
+    1020.0,
+    1200.0,
+    1340.0,
+    1360.0,
+    680.0,
+    1080.0,
+    1200.0,
+    1080.0,
+    1580.0,
+    1600.0,
+    1160.0,
+    1300.0,
+    1120.0,
+    1600.0,
+    1620.0,
+    1220.0,
+    1160.0,
+    1280.0,
+    1180.0,
+    1240.0,
+    1480.0
+  ],
+  "seed": 1000000,
+  "source_profile_path": "/mnt/ssd/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+  "std_return": 310.32706939614525,
+  "suite_name": "profile_sample",
+  "timestamp_utc": "2026-09-23T19:51:16.519497+00:00"
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/evaluations/profile/verification.json

@@ -0,0 +1,66 @@
+{
+  "job_id": "eval_v2__demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "task": "demon_attack",
+  "model": "qwengr00t",
+  "remote_eval_dir": "/mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-scratch-s42-v2-to-profile-par32",
+  "checked_at": 1790193230.6011114,
+  "training_step": 5000,
+  "checkpoint_sha256": "a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8",
+  "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+  "wandb_run_id": "7f1c60f6",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "max_episode_raw_frames": 7200,
+  "parallel_envs": 32,
+  "mean_return": 1203.1,
+  "std_return": 310.3270693961453,
+  "mean_length": 7111.02,
+  "episodes": 100,
+  "issued_actions": 82064,
+  "top_action": "FIRE",
+  "largest_action_fraction": 0.3779976603626438,
+  "unique_action_values": 6,
+  "episode_final_done": 4,
+  "episodes_at_frame_cap": 96,
+  "checks": {
+    "100_exact_seeds": true,
+    "checkpoint_sha": true,
+    "bundle_step": true,
+    "profile_sha": true,
+    "binary_history": true,
+    "raw_score_means_match": true,
+    "action_counts_match": true,
+    "action_total_match": true,
+    "summary_returns_match": true,
+    "summary_lengths_match": true,
+    "100_final_steps": true,
+    "final_step_lengths_match": true,
+    "parallel_capacity_horizon": true,
+    "fps_history": true,
+    "environment_latency_matches": true,
+    "episode_latency_protocol": true,
+    "training_recipe": true,
+    "training_dimensions": true,
+    "initialization_revision": true
+  },
+  "job": {
+    "id": "eval_v2__demon_attack-qwengr00t-hist8-scratch-s42-v2",
+    "source": "v2",
+    "python": "/home/ubuntu/miniconda3/envs/starvla_rl_games_openvla/bin/python",
+    "task": "demon_attack",
+    "model": "qwengr00t",
+    "env_condition": "profile",
+    "parallel_envs": 32,
+    "metric_prefix": "eval_hist8_v3/profile_to_profile",
+    "kind": "eval_ready",
+    "backbone": "/mnt/ssd/codex/hist8-vla-20260923/backbone/Qwen3-VL-4B-Instruct",
+    "profile_path": "/mnt/ssd/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "bundle_dir": "/mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2",
+    "ready_path": "/mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/bundles/demon_attack-qwengr00t-hist8-scratch-s42-v2/bundle.complete.json",
+    "eval_dir": "/mnt/ssd/codex/hist8-vla-v2-20260923/outputs/tasks/decision_history_vla_hist8_v2/evals/demon_attack-qwengr00t-hist8-scratch-s42-v2-to-profile-par32",
+    "gpus_required": 2,
+    "priority": 1000,
+    "depends_on": []
+  },
+  "evidence_dir": "/home/lixinyuan/latency-sensitive-bench/outputs/tasks/decision_history_vla_hist8_v2/evaluation_receipts/h100/eval_v2__demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "verification_status": "verified"
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/manifest.json

@@ -0,0 +1,307 @@
+{
+  "dataset_name": "lerobot",
+  "env_name": "demon_attack",
+  "episodes": 180,
+  "frames": 608054,
+  "task_prompts": [
+    "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score."
+  ],
+  "format": "starvla_lerobot_v2_decision_v1",
+  "source": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/raw",
+  "robot_type": "rl_games_demon_attack",
+  "action_layout": "demon_attack_discrete",
+  "source_action_layout": "demon_attack_discrete",
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_dim": 6,
+  "active_action_dim": 6,
+  "state_source": "decision_v1",
+  "state_dim": 88,
+  "state_labels": [
+    "decision_history_0",
+    "decision_history_1",
+    "decision_history_2",
+    "decision_history_3",
+    "decision_history_4",
+    "decision_history_5",
+    "decision_history_6",
+    "decision_history_7",
+    "decision_history_8",
+    "decision_history_9",
+    "decision_history_10",
+    "decision_history_11",
+    "decision_history_12",
+    "decision_history_13",
+    "decision_history_14",
+    "decision_history_15",
+    "decision_history_16",
+    "decision_history_17",
+    "decision_history_18",
+    "decision_history_19",
+    "decision_history_20",
+    "decision_history_21",
+    "decision_history_22",
+    "decision_history_23",
+    "decision_history_24",
+    "decision_history_25",
+    "decision_history_26",
+    "decision_history_27",
+    "decision_history_28",
+    "decision_history_29",
+    "decision_history_30",
+    "decision_history_31",
+    "decision_history_32",
+    "decision_history_33",
+    "decision_history_34",
+    "decision_history_35",
+    "decision_history_36",
+    "decision_history_37",
+    "decision_history_38",
+    "decision_history_39",
+    "decision_history_40",
+    "decision_history_41",
+    "decision_history_42",
+    "decision_history_43",
+    "decision_history_44",
+    "decision_history_45",
+    "decision_history_46",
+    "decision_history_47",
+    "decision_history_48",
+    "decision_history_49",
+    "decision_history_50",
+    "decision_history_51",
+    "decision_history_52",
+    "decision_history_53",
+    "decision_history_54",
+    "decision_history_55",
+    "decision_history_56",
+    "decision_history_57",
+    "decision_history_58",
+    "decision_history_59",
+    "decision_history_60",
+    "decision_history_61",
+    "decision_history_62",
+    "decision_history_63",
+    "decision_history_64",
+    "decision_history_65",
+    "decision_history_66",
+    "decision_history_67",
+    "decision_history_68",
+    "decision_history_69",
+    "decision_history_70",
+    "decision_history_71",
+    "decision_history_72",
+    "decision_history_73",
+    "decision_history_74",
+    "decision_history_75",
+    "decision_history_76",
+    "decision_history_77",
+    "decision_history_78",
+    "decision_history_79",
+    "decision_history_80",
+    "decision_history_81",
+    "decision_history_82",
+    "decision_history_83",
+    "decision_history_84",
+    "decision_history_85",
+    "decision_history_86",
+    "decision_history_87"
+  ],
+  "state_normalization": {
+    "min": [
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0,
+      0.0
+    ],
+    "max": [
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0,
+      1.0
+    ]
+  },
+  "action_history_decisions": 8,
+  "rows_unit": "decision_step",
+  "obs_fps": 15.0,
+  "obs_stride_raw_frames": 4,
+  "latency_prompt_map_path": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/lerobot/latency_prompt_map.json",
+  "custom_mixtures_path": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/_generated_mixtures/lerobot.json",
+  "validation_dataset_name": "lerobot__val",
+  "validation_episodes": 20,
+  "validation_frames": 71062
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/profiles/hardware.json

@@ -0,0 +1,40 @@
+{
+  "driver_version": "595.58.03",
+  "gpu_class": "1x-rtx3090",
+  "gpus": [
+    {
+      "name": "NVIDIA GeForce RTX 3090",
+      "slot": 0
+    }
+  ],
+  "instance_id": "instance_a5037b165aa0cedc",
+  "topology_links": [],
+  "torch": {
+    "backends": {
+      "cuda_cudnn_sdp_enabled": true,
+      "cuda_flash_sdp_enabled": true,
+      "cuda_math_sdp_enabled": true,
+      "cuda_matmul_allow_tf32": false,
+      "cuda_mem_efficient_sdp_enabled": true,
+      "cudnn_allow_tf32": true,
+      "cudnn_benchmark": false
+    },
+    "cuda_available": true,
+    "cuda_device_count": 1,
+    "cuda_version": "12.8",
+    "current_device": 0,
+    "current_device_name": "NVIDIA GeForce RTX 3090",
+    "device_properties": [
+      {
+        "index": 0,
+        "major": 8,
+        "minor": 6,
+        "multi_processor_count": 82,
+        "name": "NVIDIA GeForce RTX 3090",
+        "total_memory": 25298141184
+      }
+    ],
+    "float32_matmul_precision": "highest",
+    "version": "2.11.0+cu128"
+  }
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/profiles/latency_burst_model.json

@@ -0,0 +1,30 @@
+{
+  "burst_dwell_distribution": null,
+  "burst_dwell_lengths": [],
+  "burst_merge_gap_records": 30,
+  "burst_rank_processes": [],
+  "burst_slot_rank_templates": [],
+  "model_type": "hidden_regime",
+  "pre_worker_time_ms": null,
+  "regime_step_counts": {
+    "burst": 0,
+    "calm": 10948
+  },
+  "regime_transition_counts": {
+    "burst": {
+      "burst": 0,
+      "calm": 0
+    },
+    "calm": {
+      "burst": 0,
+      "calm": 10943
+    }
+  },
+  "reset_scope": "session",
+  "schema_version": 12,
+  "spike_median_multiplier": 1.25,
+  "spike_threshold_ms_by_worker_slot": {
+    "0": 154.9665704369545
+  },
+  "worker_count": 1
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/profiles/latency_distribution.json

@@ -0,0 +1,1027 @@
+{
+  "schema_version": 3,
+  "worker_slots": {
+    "0": {
+      "all": {
+        "count": 10948,
+        "observation_to_action_latency_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.79631185531616,
+            122.83055476341248,
+            122.96048029518127,
+            123.12548810958862,
+            123.20885604858398,
+            123.24038108825684,
+            123.2696556816101,
+            123.31733936309814,
+            123.34817198753358,
+            123.3781309890747,
+            123.40057138252259,
+            123.45452119445801,
+            123.48554271697998,
+            124.04004166603089,
+            124.28913790702819,
+            124.39105031967163,
+            124.45440249443054,
+            124.5571064376831,
+            124.7361155986786,
+            124.91622240066528,
+            125.00360578536987,
+            125.08328070640565,
+            125.13830080032349,
+            125.2295347213745,
+            125.35394525527954,
+            125.49435075759888,
+            125.60458269119263,
+            125.72243936538696,
+            125.82663643836975,
+            125.93300409317017,
+            126.02435782432556,
+            126.09885621070862,
+            126.16651153564453,
+            126.24060009002686,
+            126.31888152122498,
+            126.41316819190979,
+            126.54280662536621,
+            126.68462894439698,
+            126.77580438613892,
+            126.8230891609192,
+            126.85537923812866,
+            126.88363008499145,
+            126.91282826423645,
+            126.94254455566406,
+            126.9707493877411,
+            127.00030161857605,
+            127.02929482460021,
+            127.06760904312134,
+            127.0986561870575,
+            127.13863806724548,
+            127.17745053291321,
+            127.23237829208374,
+            127.29776979446412,
+            127.37165050506592,
+            127.46985033035278,
+            127.56723865509034,
+            127.68258781433106,
+            127.80308091163636,
+            127.87982371330261,
+            127.94324188232422,
+            127.98972443580628,
+            128.03023529052734,
+            128.07307104110717,
+            128.10850659370422,
+            128.1489437198639,
+            128.19575679779052,
+            128.24768528938293,
+            128.30849837303163,
+            128.37751910209656,
+            128.46356166839598,
+            128.59914545059203,
+            128.72301177978517,
+            128.85909510612487,
+            129.01047629356384,
+            129.09596959114074,
+            129.18290879249574,
+            129.2668813228607,
+            129.36923629760742,
+            129.49136459350586,
+            129.69063343048094,
+            129.89646366119385,
+            130.11991477012634,
+            130.3491042804718,
+            130.65597107887268,
+            130.98567969322204,
+            131.44593645095824,
+            132.1362121105194,
+            132.61222920417785,
+            132.77006802558898,
+            133.17581831932068,
+            133.52350569725036,
+            133.65027599334718,
+            133.74947697639465,
+            133.81022834777832,
+            133.8869441986084,
+            134.19105182647704,
+            134.37844815254212,
+            134.45609179496765,
+            134.54267152786255,
+            134.66409388542175,
+            134.83887226104736,
+            135.3399015903473,
+            135.44952299118043,
+            135.52058424949647,
+            135.5928444480896,
+            135.68735381126405,
+            136.16950192451478,
+            136.5521870613098,
+            136.71048418045044,
+            137.00765167236327,
+            137.9891162967682,
+            138.02192653274537,
+            138.04894944381715,
+            138.12427546310423,
+            138.50976154518128,
+            138.873538646698,
+            138.9841242351532,
+            139.11370658874515,
+            139.35008063316337,
+            140.1876000556946,
+            140.31456637382485,
+            147.51668910312227,
+            150.8394160270691
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        },
+        "spearman_rho": 0.9989411839039446,
+        "worker_service_time_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.20177268981934,
+            122.30283569774627,
+            122.5205600452423,
+            122.60929537200927,
+            122.66797201156616,
+            122.6971018486023,
+            122.73601416778564,
+            122.77037023544311,
+            122.81257249641419,
+            122.8390096206665,
+            122.88044651412964,
+            122.92808966827393,
+            122.97536842346192,
+            123.46291953086853,
+            123.76542267799377,
+            123.86257653236389,
+            123.92213554382325,
+            124.01939237594604,
+            124.222943983078,
+            124.36276661872864,
+            124.43211780548096,
+            124.50857553482055,
+            124.57027664184571,
+            124.67785886764527,
+            124.87234741210938,
+            124.98412243843079,
+            125.0936541557312,
+            125.26090567588807,
+            125.40969181060791,
+            125.49145776748657,
+            125.54093709945678,
+            125.59061560630798,
+            125.64770420074463,
+            125.7151317501068,
+            125.79718364715576,
+            125.92450232505799,
+            126.07124304771423,
+            126.24277823448182,
+            126.39197353363038,
+            126.4476409626007,
+            126.48959280014039,
+            126.51886591911315,
+            126.54474408149719,
+            126.56929949760438,
+            126.59623449325562,
+            126.62515710830688,
+            126.64931235313415,
+            126.67885724067688,
+            126.70889680862427,
+            126.73626960754395,
+            126.76666728019714,
+            126.80187697410584,
+            126.84883865356446,
+            126.90541676521302,
+            126.9881226158142,
+            127.11017844200134,
+            127.22859001159668,
+            127.3837945842743,
+            127.49648622512818,
+            127.56595790863037,
+            127.62109510421753,
+            127.65714049339294,
+            127.69538656234741,
+            127.73405620574951,
+            127.76645929336549,
+            127.80690549850463,
+            127.85590953826905,
+            127.90466072082519,
+            127.95096551895142,
+            128.02613214492797,
+            128.11823890686034,
+            128.2333468437195,
+            128.37978899002076,
+            128.57277998924255,
+            128.7053997516632,
+            128.78535892486573,
+            128.8680805206299,
+            128.94854549407958,
+            129.04876315116883,
+            129.18656414031983,
+            129.40402382850647,
+            129.65059328079224,
+            129.9080189704895,
+            130.1638106918335,
+            130.47888251304627,
+            130.98551317214967,
+            131.60869455337524,
+            132.15558164596558,
+            132.28427990913391,
+            132.5974653530121,
+            133.0116798877716,
+            133.07106366157532,
+            133.11581961631774,
+            133.16094108581544,
+            133.23522979736327,
+            133.73099293708802,
+            133.92880964279175,
+            133.98194127082826,
+            134.03434896469116,
+            134.1034224128723,
+            134.27159962654113,
+            134.9040030002594,
+            135.01462589263917,
+            135.0814479827881,
+            135.14531938552855,
+            135.22710026741026,
+            135.60060482025148,
+            136.11188952445983,
+            136.27149866104125,
+            136.48072841644287,
+            137.520674533844,
+            137.57785969924927,
+            137.60559056091307,
+            137.66266886901855,
+            137.89541630744932,
+            138.43089353561402,
+            138.55013104438783,
+            138.6332070503235,
+            138.83003143692017,
+            139.75485095214844,
+            139.88365561103805,
+            146.72983264789096,
+            150.52015590667725
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        }
+      },
+      "steady": {
+        "count": 10948,
+        "observation_to_action_latency_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.79631185531616,
+            122.83055476341248,
+            122.96048029518127,
+            123.12548810958862,
+            123.20885604858398,
+            123.24038108825684,
+            123.2696556816101,
+            123.31733936309814,
+            123.34817198753358,
+            123.3781309890747,
+            123.40057138252259,
+            123.45452119445801,
+            123.48554271697998,
+            124.04004166603089,
+            124.28913790702819,
+            124.39105031967163,
+            124.45440249443054,
+            124.5571064376831,
+            124.7361155986786,
+            124.91622240066528,
+            125.00360578536987,
+            125.08328070640565,
+            125.13830080032349,
+            125.2295347213745,
+            125.35394525527954,
+            125.49435075759888,
+            125.60458269119263,
+            125.72243936538696,
+            125.82663643836975,
+            125.93300409317017,
+            126.02435782432556,
+            126.09885621070862,
+            126.16651153564453,
+            126.24060009002686,
+            126.31888152122498,
+            126.41316819190979,
+            126.54280662536621,
+            126.68462894439698,
+            126.77580438613892,
+            126.8230891609192,
+            126.85537923812866,
+            126.88363008499145,
+            126.91282826423645,
+            126.94254455566406,
+            126.9707493877411,
+            127.00030161857605,
+            127.02929482460021,
+            127.06760904312134,
+            127.0986561870575,
+            127.13863806724548,
+            127.17745053291321,
+            127.23237829208374,
+            127.29776979446412,
+            127.37165050506592,
+            127.46985033035278,
+            127.56723865509034,
+            127.68258781433106,
+            127.80308091163636,
+            127.87982371330261,
+            127.94324188232422,
+            127.98972443580628,
+            128.03023529052734,
+            128.07307104110717,
+            128.10850659370422,
+            128.1489437198639,
+            128.19575679779052,
+            128.24768528938293,
+            128.30849837303163,
+            128.37751910209656,
+            128.46356166839598,
+            128.59914545059203,
+            128.72301177978517,
+            128.85909510612487,
+            129.01047629356384,
+            129.09596959114074,
+            129.18290879249574,
+            129.2668813228607,
+            129.36923629760742,
+            129.49136459350586,
+            129.69063343048094,
+            129.89646366119385,
+            130.11991477012634,
+            130.3491042804718,
+            130.65597107887268,
+            130.98567969322204,
+            131.44593645095824,
+            132.1362121105194,
+            132.61222920417785,
+            132.77006802558898,
+            133.17581831932068,
+            133.52350569725036,
+            133.65027599334718,
+            133.74947697639465,
+            133.81022834777832,
+            133.8869441986084,
+            134.19105182647704,
+            134.37844815254212,
+            134.45609179496765,
+            134.54267152786255,
+            134.66409388542175,
+            134.83887226104736,
+            135.3399015903473,
+            135.44952299118043,
+            135.52058424949647,
+            135.5928444480896,
+            135.68735381126405,
+            136.16950192451478,
+            136.5521870613098,
+            136.71048418045044,
+            137.00765167236327,
+            137.9891162967682,
+            138.02192653274537,
+            138.04894944381715,
+            138.12427546310423,
+            138.50976154518128,
+            138.873538646698,
+            138.9841242351532,
+            139.11370658874515,
+            139.35008063316337,
+            140.1876000556946,
+            140.31456637382485,
+            147.51668910312227,
+            150.8394160270691
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        },
+        "spearman_rho": 0.9989411839039446,
+        "worker_service_time_ms": {
+          "distribution_type": "inverse_cdf",
+          "latency_ms": [
+            122.20177268981934,
+            122.30283569774627,
+            122.5205600452423,
+            122.60929537200927,
+            122.66797201156616,
+            122.6971018486023,
+            122.73601416778564,
+            122.77037023544311,
+            122.81257249641419,
+            122.8390096206665,
+            122.88044651412964,
+            122.92808966827393,
+            122.97536842346192,
+            123.46291953086853,
+            123.76542267799377,
+            123.86257653236389,
+            123.92213554382325,
+            124.01939237594604,
+            124.222943983078,
+            124.36276661872864,
+            124.43211780548096,
+            124.50857553482055,
+            124.57027664184571,
+            124.67785886764527,
+            124.87234741210938,
+            124.98412243843079,
+            125.0936541557312,
+            125.26090567588807,
+            125.40969181060791,
+            125.49145776748657,
+            125.54093709945678,
+            125.59061560630798,
+            125.64770420074463,
+            125.7151317501068,
+            125.79718364715576,
+            125.92450232505799,
+            126.07124304771423,
+            126.24277823448182,
+            126.39197353363038,
+            126.4476409626007,
+            126.48959280014039,
+            126.51886591911315,
+            126.54474408149719,
+            126.56929949760438,
+            126.59623449325562,
+            126.62515710830688,
+            126.64931235313415,
+            126.67885724067688,
+            126.70889680862427,
+            126.73626960754395,
+            126.76666728019714,
+            126.80187697410584,
+            126.84883865356446,
+            126.90541676521302,
+            126.9881226158142,
+            127.11017844200134,
+            127.22859001159668,
+            127.3837945842743,
+            127.49648622512818,
+            127.56595790863037,
+            127.62109510421753,
+            127.65714049339294,
+            127.69538656234741,
+            127.73405620574951,
+            127.76645929336549,
+            127.80690549850463,
+            127.85590953826905,
+            127.90466072082519,
+            127.95096551895142,
+            128.02613214492797,
+            128.11823890686034,
+            128.2333468437195,
+            128.37978899002076,
+            128.57277998924255,
+            128.7053997516632,
+            128.78535892486573,
+            128.8680805206299,
+            128.94854549407958,
+            129.04876315116883,
+            129.18656414031983,
+            129.40402382850647,
+            129.65059328079224,
+            129.9080189704895,
+            130.1638106918335,
+            130.47888251304627,
+            130.98551317214967,
+            131.60869455337524,
+            132.15558164596558,
+            132.28427990913391,
+            132.5974653530121,
+            133.0116798877716,
+            133.07106366157532,
+            133.11581961631774,
+            133.16094108581544,
+            133.23522979736327,
+            133.73099293708802,
+            133.92880964279175,
+            133.98194127082826,
+            134.03434896469116,
+            134.1034224128723,
+            134.27159962654113,
+            134.9040030002594,
+            135.01462589263917,
+            135.0814479827881,
+            135.14531938552855,
+            135.22710026741026,
+            135.60060482025148,
+            136.11188952445983,
+            136.27149866104125,
+            136.48072841644287,
+            137.520674533844,
+            137.57785969924927,
+            137.60559056091307,
+            137.66266886901855,
+            137.89541630744932,
+            138.43089353561402,
+            138.55013104438783,
+            138.6332070503235,
+            138.83003143692017,
+            139.75485095214844,
+            139.88365561103805,
+            146.72983264789096,
+            150.52015590667725
+          ],
+          "quantile_levels": [
+            0.0,
+            0.0001,
+            0.0005,
+            0.001,
+            0.002,
+            0.003,
+            0.004,
+            0.005,
+            0.006,
+            0.007,
+            0.008,
+            0.009,
+            0.01,
+            0.02,
+            0.03,
+            0.04,
+            0.05,
+            0.06,
+            0.07,
+            0.08,
+            0.09,
+            0.1,
+            0.11,
+            0.12,
+            0.13,
+            0.14,
+            0.15,
+            0.16,
+            0.17,
+            0.18,
+            0.19,
+            0.2,
+            0.21,
+            0.22,
+            0.23,
+            0.24,
+            0.25,
+            0.26,
+            0.27,
+            0.28,
+            0.29,
+            0.3,
+            0.31,
+            0.32,
+            0.33,
+            0.34,
+            0.35,
+            0.36,
+            0.37,
+            0.38,
+            0.39,
+            0.4,
+            0.41,
+            0.42,
+            0.43,
+            0.44,
+            0.45,
+            0.46,
+            0.47,
+            0.48,
+            0.49,
+            0.5,
+            0.51,
+            0.52,
+            0.53,
+            0.54,
+            0.55,
+            0.56,
+            0.57,
+            0.58,
+            0.59,
+            0.6,
+            0.61,
+            0.62,
+            0.63,
+            0.64,
+            0.65,
+            0.66,
+            0.67,
+            0.68,
+            0.69,
+            0.7,
+            0.71,
+            0.72,
+            0.73,
+            0.74,
+            0.75,
+            0.76,
+            0.77,
+            0.78,
+            0.79,
+            0.8,
+            0.81,
+            0.82,
+            0.83,
+            0.84,
+            0.85,
+            0.86,
+            0.87,
+            0.88,
+            0.89,
+            0.9,
+            0.91,
+            0.92,
+            0.93,
+            0.94,
+            0.95,
+            0.96,
+            0.97,
+            0.98,
+            0.99,
+            0.991,
+            0.992,
+            0.993,
+            0.994,
+            0.995,
+            0.996,
+            0.997,
+            0.998,
+            0.999,
+            0.9995,
+            0.9999,
+            1.0
+          ]
+        }
+      }
+    }
+  }
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/profiles/profile.json

@@ -0,0 +1,66 @@
+{
+  "burst_model_path": "latency_burst_model.json",
+  "distribution_path": "latency_distribution.json",
+  "env_fps": 60,
+  "frame_ms": 16.666666666666668,
+  "gpu_class": "1x-rtx3090",
+  "instance_id": "instance_a5037b165aa0cedc",
+  "latency_kind": "observation_to_action_latency",
+  "latency_method": "temporal",
+  "model_id": "gr00t",
+  "n_admitted_observations": 10948,
+  "n_capacity_drops": 12532,
+  "n_observation_attempts": 23480,
+  "per_slot_summary": {
+    "0": {
+      "admitted_count": 10948,
+      "mean_observation_to_action_latency_ms": 129.1559397943446,
+      "mean_worker_service_time_ms": 128.68966885653123,
+      "p95_observation_to_action_latency_ms": 136.16566524505615,
+      "p95_worker_service_time_ms": 135.59763724803923,
+      "p99_worker_service_time_ms": 137.51246279716491
+    }
+  },
+  "provenance": {
+    "base_config": "configs/experiments/demon_attack/starvla_profile.yaml",
+    "checkpoint_kind": "best",
+    "model_artifact": {
+      "checkpoint": "checkpoints/steps_5000_model.safetensors",
+      "model_config": "config.full.yaml",
+      "path_in_repo": ".",
+      "repo_id": "latency-sensitive-bench/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6",
+      "source": "local"
+    },
+    "session_ids": [
+      0,
+      1,
+      2,
+      3,
+      4
+    ]
+  },
+  "sample_model_type": "hidden_regime",
+  "source_run_id": "20260914T155907935196Z",
+  "summary": {
+    "frame_ms": 16.666666666666668,
+    "max_ms": 150.8394160270691,
+    "mean_effective_frames": 7.749356387660675,
+    "mean_ms": 129.1559397943446,
+    "min_ms": 122.79631185531616,
+    "n_samples": 10948,
+    "p50_frames": 7.68181411743164,
+    "p50_ms": 128.03023529052734,
+    "p90_frames": 8.12030839061737,
+    "p90_ms": 135.33847317695617,
+    "p95_frames": 8.169939914703368,
+    "p95_ms": 136.16566524505615,
+    "p99_frames": 8.279290914344788,
+    "p99_ms": 137.98818190574647,
+    "prob_latency_gt_1_frame": 1.0,
+    "prob_latency_gt_2_frames": 1.0,
+    "prob_latency_gt_3_frames": 1.0,
+    "std_ms": 3.754014501652407
+  },
+  "visualization_path": "latency_profile.png",
+  "workload_id": "demon_attack"
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/provenance.json

@@ -0,0 +1,69 @@
+{
+  "collection": {
+    "teacher_repo": "latency-sensitive-bench/benchmark-models",
+    "teacher_revision": "af125bd372c22c5b00e326d9af1af64ea3751b56",
+    "teacher_path": "latency-aware/demon-attack/small-policy/sample-factory-gr00t-rtx3090-temporal-hist8-capacity1-s42-v1",
+    "teacher_checkpoint": "best_000047744_24444928_reward_4477.300.pth",
+    "teacher_sha256": "b5430581140648264f8ddb2eab6d0fa45491687e90a5cf391ef047e5dbcf18b1",
+    "profile_path": "/home/ubuntu/codex/hist8-vla-20260923/results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+    "episodes": 200,
+    "filter_preset": "none",
+    "history": "decision_v1"
+  },
+  "training_run_id": "demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "training_step": 5000,
+  "global_batch": 128,
+  "base_model": "Qwen/Qwen3-VL-4B-Instruct",
+  "wandb_run_id": "7f1c60f6",
+  "checkpoint_sha256": "a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8",
+  "eval_protocol_version": "hist8-history01-par32-v3",
+  "history_encoding": "binary_0_1",
+  "training_condition": "profile",
+  "base_model_revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17",
+  "hf_repo_id": "latency-sensitive-bench/benchmark-models",
+  "hf_path": "latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "evaluations": [
+    {
+      "job_id": "eval_v2__demon_attack-qwengr00t-hist8-scratch-s42-v2",
+      "eval_protocol_version": "hist8-history01-par32-v3",
+      "training_step": 5000,
+      "checkpoint_sha256": "a059ad8efbed631dc1963c9128bd033f6065671aa6b053d6bc3e57438d98fab8",
+      "profile_sha256": "98b0d13a45e305ca635c472444081c48b77afcc157c77f0ce61e47a111b19e68",
+      "mean_return": 1203.1,
+      "std_return": 310.3270693961453,
+      "mean_length": 7111.02,
+      "episodes": 100,
+      "parallel_envs": 32,
+      "max_episode_raw_frames": 7200,
+      "issued_actions": 82064,
+      "top_action": "FIRE",
+      "largest_action_fraction": 0.3779976603626438,
+      "unique_action_values": 6,
+      "episode_final_done": 4,
+      "episodes_at_frame_cap": 96,
+      "checks": {
+        "100_exact_seeds": true,
+        "checkpoint_sha": true,
+        "bundle_step": true,
+        "profile_sha": true,
+        "binary_history": true,
+        "raw_score_means_match": true,
+        "action_counts_match": true,
+        "action_total_match": true,
+        "summary_returns_match": true,
+        "summary_lengths_match": true,
+        "100_final_steps": true,
+        "final_step_lengths_match": true,
+        "parallel_capacity_horizon": true,
+        "fps_history": true,
+        "environment_latency_matches": true,
+        "episode_latency_protocol": true,
+        "training_recipe": true,
+        "training_dimensions": true,
+        "initialization_revision": true
+      },
+      "environment_condition": "profile"
+    }
+  ]
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/rollout_metadata.json

@@ -0,0 +1,362 @@
+{
+  "action_history_decisions": 8,
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_layout": "demon_attack_discrete",
+  "base_prompt": "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score.",
+  "checkpoint_config": {
+    "action_history_decisions": 8,
+    "actor_critic_share_weights": true,
+    "actor_worker_gpus": [
+      0
+    ],
+    "adam_beta1": 0.9,
+    "adam_beta2": 0.999,
+    "adam_eps": 1e-05,
+    "adaptive_stddev": true,
+    "add_latency_info": false,
+    "algo": "APPO",
+    "async_rl": true,
+    "batch_size": 1024,
+    "batched_sampling": true,
+    "benchmark": false,
+    "cli_args": {
+      "action_history_decisions": 8,
+      "actor_worker_gpus": [
+        0
+      ],
+      "add_latency_info": false,
+      "algo": "APPO",
+      "async_rl": true,
+      "batch_size": 1024,
+      "batched_sampling": true,
+      "clip_reward": true,
+      "device": "gpu",
+      "env": "latency_demon_attack",
+      "env_fps": 60.0,
+      "env_gpu_actions": true,
+      "env_gpu_observations": true,
+      "env_id": "ALE/DemonAttack-v5",
+      "episode_metrics_path": "results/checkpoints/demon_attack/decision_history_temporal_25m_seed42/demon_attack_frame_stack_gr00t_rtx3090_temporal_hist8_capacity1_fs4_seed42/episode_metrics.jsonl",
+      "eval_deterministic": true,
+      "eval_episodes": 100,
+      "eval_max_steps": 14400,
+      "eval_parallel_envs": 16,
+      "eval_raw_reward": true,
+      "experiment": "demon_attack_frame_stack_gr00t_rtx3090_temporal_hist8_capacity1_fs4_seed42",
+      "experiment_summaries_interval": 1,
+      "frame_stack": 4,
+      "full_action_space": false,
+      "gae_lambda": 0.95,
+      "gamma": 0.99,
+      "gpu_env_batch_size": 512,
+      "gpu_env_device": "auto",
+      "hold_policy": "hold",
+      "keep_checkpoints": 5,
+      "latency_profile_path": "results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+      "latency_profile_worker_slot": 0,
+      "latency_seed": 42,
+      "latency_type": "profile_sample",
+      "learning_rate": 0.000303,
+      "lr_schedule": "linear_decay",
+      "max_episode_steps": 25000,
+      "max_grad_norm": 0.0,
+      "max_policy_lag": 300,
+      "mode": "train",
+      "noop_max": 30,
+      "normalize_input": true,
+      "normalize_returns": true,
+      "num_batches_per_epoch": 8,
+      "num_envs_per_worker": 1,
+      "num_epochs": 2,
+      "num_policies": 1,
+      "num_workers": 1,
+      "obs_fps": 15.0,
+      "ordering_policy": "latest_ready",
+      "output_dir": "outputs/tasks/demon_attack/decision_history_temporal_25m_seed42/train/frame_stack/gr00t_rtx3090_temporal_hist8_capacity1/fs4/seed_42",
+      "ppo_clip_ratio": 0.1,
+      "ppo_clip_value": 0.2,
+      "recurrence": 32,
+      "repeat_action_probability": 0.0,
+      "reset_mode": "fire",
+      "restart_behavior": "resume",
+      "rollout": 64,
+      "save_every_sec": 600,
+      "screen_size": 84,
+      "seed": 42,
+      "simulated_worker_capacity": 1,
+      "simulator": "gpu",
+      "stats_avg": 100,
+      "terminal_on_life_loss": true,
+      "train_dir": "results/checkpoints/demon_attack/decision_history_temporal_25m_seed42",
+      "train_for_env_steps": 25000000,
+      "use_rnn": false,
+      "value_loss_coeff": 0.5,
+      "wandb_group": "demon-attack-fs4-gr00t_rtx3090_temporal_hist8_capacity1",
+      "wandb_job_type": "demon_attack_decision_history_temporal",
+      "wandb_project": "starvla_tasks",
+      "wandb_tags": [
+        "demon_attack_decision_history_temporal_25m_seed42",
+        "demon-attack",
+        "frame_stack",
+        "temporal",
+        "gr00t_rtx3090_temporal_hist8_capacity1",
+        "fs4",
+        "seed42"
+      ],
+      "wandb_unique_id": "demon-attack-fs4-gr00t_rtx3090_temporal_hist8_capacity1-s42",
+      "with_wandb": true,
+      "worker_num_splits": 1
+    },
+    "clip_reward": true,
+    "command_line": "--mode train --algo APPO --env latency_demon_attack --experiment demon_attack_frame_stack_gr00t_rtx3090_temporal_hist8_capacity1_fs4_seed42 --train_dir results/checkpoints/demon_attack/decision_history_temporal_25m_seed42 --restart_behavior resume --device gpu --actor_worker_gpus 0 --env_gpu_observations True --env_gpu_actions True --gpu-env-batch-size 512 --seed 42 --episode_metrics_path results/checkpoints/demon_attack/decision_history_temporal_25m_seed42/demon_attack_frame_stack_gr00t_rtx3090_temporal_hist8_capacity1_fs4_seed42/episode_metrics.jsonl --train_for_env_steps 25000000 --num_workers 1 --num_envs_per_worker 1 --num_policies 1 --batch_size 1024 --rollout 64 --recurrence 32 --num_epochs 2 --num_batches_per_epoch 8 --worker_num_splits 1 --max_policy_lag 300 --learning_rate 0.000303 --lr_schedule linear_decay --gamma 0.99 --gae_lambda 0.95 --ppo_clip_ratio 0.1 --ppo_clip_value 0.2 --value_loss_coeff 0.5 --max_grad_norm 0.0 --save_every_sec 600 --keep_checkpoints 5 --stats_avg 100 --experiment_summaries_interval 1 --batched_sampling True --async_rl True --batched_sampling True --use_rnn False --normalize_returns True --normalize_input True --latency-type profile_sample --latency-seed 42 --latency-profile-path results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json --latency-profile-worker-slot 0 --simulated-worker-capacity 1 --add-latency-info False --eval-episodes 100 --eval-parallel-envs 16 --eval-max-steps 14400 --eval-deterministic True --eval-raw-reward --with_wandb True --wandb_project starvla_tasks --wandb_group demon-attack-fs4-gr00t_rtx3090_temporal_hist8_capacity1 --wandb_job_type demon_attack_decision_history_temporal --wandb_tags demon_attack_decision_history_temporal_25m_seed42 demon-attack frame_stack temporal gr00t_rtx3090_temporal_hist8_capacity1 fs4 seed42 --env_id ALE/DemonAttack-v5 --env-fps 60 --obs-fps 15.0 --screen_size 84 --noop_max 30 --reset-mode fire --frame_stack 4 --action-history-decisions 8 --terminal_on_life_loss True --clip_reward True --repeat_action_probability 0.0 --full_action_space False --max_episode_steps 25000 --simulator gpu --gpu-env-device auto --hold-policy hold --ordering-policy latest_ready",
+    "continuous_tanh_scale": 0.0,
+    "decoder_mlp_layers": [],
+    "decorrelate_envs_on_one_worker": true,
+    "decorrelate_experience_max_seconds": 0,
+    "default_niceness": 0,
+    "device": "gpu",
+    "encoder_conv_architecture": "convnet_atari",
+    "encoder_conv_mlp_layers": [
+      512
+    ],
+    "encoder_mlp_layers": [
+      512,
+      512
+    ],
+    "env": "latency_demon_attack",
+    "env_fps": 60.0,
+    "env_frameskip": 1,
+    "env_framestack": 1,
+    "env_gpu_actions": true,
+    "env_gpu_observations": true,
+    "env_id": "ALE/DemonAttack-v5",
+    "episode_counter": false,
+    "episode_metrics_path": "results/checkpoints/demon_attack/decision_history_temporal_25m_seed42/demon_attack_frame_stack_gr00t_rtx3090_temporal_hist8_capacity1_fs4_seed42/episode_metrics.jsonl",
+    "eval_deterministic": true,
+    "eval_env_frameskip": 1,
+    "eval_episodes": 100,
+    "eval_latency_raw_frame_values": "0,1,2,3,4,5",
+    "eval_max_steps": 14400,
+    "eval_parallel_envs": 16,
+    "eval_raw_reward": true,
+    "experiment": "demon_attack_frame_stack_gr00t_rtx3090_temporal_hist8_capacity1_fs4_seed42",
+    "experiment_summaries_interval": 1,
+    "exploration_loss": "entropy",
+    "exploration_loss_coeff": 0.003,
+    "export_env_raw_rgb_frames": false,
+    "fasttd3_action_chunk_horizon": 1,
+    "fasttd3_actor_action_l2": 0.0,
+    "fasttd3_compile": true,
+    "fasttd3_replay_batch_size": 32768,
+    "fasttd3_replay_capacity": 6553600,
+    "fasttd3_train_for_optimizer_steps": 10000000000,
+    "fasttd3_transitions_per_update": 64,
+    "fasttd3_v_max": 250.0,
+    "fasttd3_v_min": -250.0,
+    "fixed_latency_ms": null,
+    "flush_summaries_interval": 30,
+    "force_envs_single_thread": false,
+    "frame_stack": 4,
+    "full_action_space": false,
+    "gae_lambda": 0.95,
+    "gamma": 0.99,
+    "git_hash": "unknown",
+    "git_repo_name": "not a git repository",
+    "gpu_env_batch_size": 512,
+    "gpu_env_device": "auto",
+    "heartbeat_interval": 20,
+    "heartbeat_reporting_interval": 180,
+    "help": false,
+    "hold_policy": "hold",
+    "initial_model_path": null,
+    "initial_stddev": 1.0,
+    "keep_checkpoints": 5,
+    "kl_loss_coeff": 0.0,
+    "latency_profile_path": "results/profiling/profiles/gr00t/1x-rtx3090/demon_attack/instance_a5037b165aa0cedc/profile.json",
+    "latency_profile_worker_slot": 0,
+    "latency_seed": 42,
+    "latency_type": "profile_sample",
+    "learning_rate": 0.000303,
+    "load_checkpoint_kind": "latest",
+    "log_to_file": true,
+    "lr_adaptive_max": 0.01,
+    "lr_adaptive_min": 1e-06,
+    "lr_schedule": "linear_decay",
+    "lr_schedule_kl_threshold": 0.008,
+    "max_episode_steps": 25000,
+    "max_grad_norm": 0.0,
+    "max_latency_ms": null,
+    "max_pending_actions": null,
+    "max_policy_lag": 300,
+    "mean_latency_ms": null,
+    "min_latency_ms": null,
+    "mode": "train",
+    "nonlinearity": "elu",
+    "noop_max": 30,
+    "normalize_input": true,
+    "normalize_input_keys": null,
+    "normalize_returns": true,
+    "num_batches_per_epoch": 8,
+    "num_batches_to_accumulate": 2,
+    "num_envs_per_worker": 1,
+    "num_epochs": 2,
+    "num_policies": 1,
+    "num_workers": 1,
+    "obs_fps": 15.0,
+    "obs_scale": 255.0,
+    "obs_subtract_mean": 0.0,
+    "optimizer": "adam",
+    "ordering_policy": "latest_ready",
+    "output_dir": "outputs/tasks/demon_attack/decision_history_temporal_25m_seed42/train/frame_stack/gr00t_rtx3090_temporal_hist8_capacity1/fs4/seed_42",
+    "pbt_mix_policies_in_one_env": true,
+    "pbt_mutation_rate": 0.15,
+    "pbt_optimize_gamma": false,
+    "pbt_period_env_steps": 5000000,
+    "pbt_perturb_max": 1.5,
+    "pbt_perturb_min": 1.1,
+    "pbt_replace_fraction": 0.3,
+    "pbt_replace_reward_gap": 0.1,
+    "pbt_replace_reward_gap_absolute": 1e-06,
+    "pbt_start_mutation": 20000000,
+    "pbt_target_objective": "true_objective",
+    "pixel_format": "CHW",
+    "policy_init_gain": 1.0,
+    "policy_initialization": "orthogonal",
+    "policy_workers_per_policy": 1,
+    "ppo_clip_ratio": 0.1,
+    "ppo_clip_value": 0.2,
+    "recurrence": 32,
+    "repeat_action_probability": 0.0,
+    "reset_mode": "fire",
+    "restart_behavior": "resume",
+    "reward_clip": 1000.0,
+    "reward_scale": 1.0,
+    "rnn_num_layers": 1,
+    "rnn_size": 512,
+    "rnn_type": "gru",
+    "rollout": 64,
+    "save_best_after": 100000,
+    "save_best_every_sec": 5,
+    "save_best_metric": "reward",
+    "save_every_sec": 600,
+    "save_milestones_sec": -1,
+    "screen_size": 84,
+    "seed": 42,
+    "serial_mode": false,
+    "set_workers_cpu_affinity": true,
+    "shuffle_minibatches": false,
+    "simulated_worker_capacity": 1,
+    "simulator": "gpu",
+    "stats_avg": 100,
+    "std_latency_ms": null,
+    "summaries_use_frameskip": true,
+    "terminal_on_life_loss": true,
+    "train_dir": "results/checkpoints/demon_attack/decision_history_temporal_25m_seed42",
+    "train_for_env_steps": 25000000,
+    "train_for_seconds": 10000000000,
+    "use_env_info_cache": false,
+    "use_record_episode_statistics": false,
+    "use_rnn": false,
+    "value_bootstrap": false,
+    "value_loss_coeff": 0.5,
+    "vtrace_c": 1.0,
+    "vtrace_rho": 1.0,
+    "wandb_dir": "/mnt/ssd/latency-sensitive-bench/wandb",
+    "wandb_group": "demon-attack-fs4-gr00t_rtx3090_temporal_hist8_capacity1",
+    "wandb_job_type": "demon_attack_decision_history_temporal",
+    "wandb_project": "starvla_tasks",
+    "wandb_tags": [
+      "demon_attack_decision_history_temporal_25m_seed42",
+      "demon-attack",
+      "frame_stack",
+      "temporal",
+      "gr00t_rtx3090_temporal_hist8_capacity1",
+      "fs4",
+      "seed42"
+    ],
+    "wandb_unique_id": "demon-attack-fs4-gr00t_rtx3090_temporal_hist8_capacity1-s42",
+    "wandb_user": null,
+    "with_pbt": false,
+    "with_vtrace": false,
+    "with_wandb": true,
+    "worker_num_splits": 1
+  },
+  "checkpoint_experiment_dir": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/models/latency-aware/demon-attack/small-policy/sample-factory-gr00t-rtx3090-temporal-hist8-capacity1-s42-v1",
+  "checkpoint_path": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/models/latency-aware/demon-attack/small-policy/sample-factory-gr00t-rtx3090-temporal-hist8-capacity1-s42-v1/best_000047744_24444928_reward_4477.300.pth",
+  "checkpoint_train_step": 47744,
+  "config_source": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/models/latency-aware/demon-attack/small-policy/sample-factory-gr00t-rtx3090-temporal-hist8-capacity1-s42-v1/config.json",
+  "context_image_count": 0,
+  "context_window": 1,
+  "env_fps": 60.0,
+  "env_name": "demon_attack",
+  "episode_return_field": "episode_raw_return",
+  "filter_preset": "none",
+  "filter_report": {
+    "accepted_episodes": 200,
+    "accepted_train_episodes": 180,
+    "accepted_val_episodes": 20,
+    "attempted_episodes": 200,
+    "preset": "none",
+    "raw_score_bins": {
+      "6460-6889": 1,
+      "6890-7309": 0,
+      "7310-7999": 0,
+      "<6460": 199,
+      ">=8000": 0
+    },
+    "rejected_episodes": 0,
+    "train_rows_after_row_filter": 608054,
+    "train_rows_before_row_filter": 608054,
+    "val_rows_after_row_filter": 71062,
+    "val_rows_before_row_filter": 71062
+  },
+  "frame_stack": 4,
+  "image_resolution": [
+    210,
+    160,
+    3
+  ],
+  "image_source": "env_raw_rgb",
+  "image_transform": {
+    "gamma": 1.3,
+    "ground_fraction": 0.22,
+    "history_frames": 5,
+    "image_transform": "raw_rgb",
+    "min_alpha": 35,
+    "scroll_px_per_step": 4.0
+  },
+  "image_transform_prompt_contexts": {
+    "demon_attack_ghost_trail": " You can see the recent motion of the ship, missiles, and demons in the image. Use it to make your decision.",
+    "flappy_ghost_trail": " You can see the past motion of the bird in the image. Use it to make your decision."
+  },
+  "latency_override": null,
+  "latency_source": "checkpoint",
+  "max_episodes": 200,
+  "max_steps_per_episode": 14400,
+  "max_steps_unit": "raw_frame",
+  "num_envs": 256,
+  "obs_fps": 15.0,
+  "obs_stride_raw_frames": 4,
+  "profile_seed_by_reset": "env_reset_seed",
+  "prompt_source": "sample_factory_checkpoint:base_prompt",
+  "replay_num_envs": 256,
+  "reward_field": "raw_reward",
+  "reward_semantics": "raw_reward",
+  "rows_unit": "decision_step",
+  "schema_version": 2,
+  "split_seed": 0,
+  "total_episodes": 200,
+  "total_rows": 679116,
+  "train_episodes": 180,
+  "train_rows": 608054,
+  "val_episodes": 20,
+  "val_fraction": 0.1,
+  "val_rows": 71062
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/run_metadata.json

@@ -0,0 +1,17 @@
+{
+  "training_run_id": "demon_attack-qwengr00t-hist8-scratch-s42-v2",
+  "wandb_run_id": "7f1c60f6",
+  "recipe_version": "hist8-v2",
+  "history_encoding": "binary_0_1",
+  "initialization_seed": 42,
+  "vlm_lr": 3e-06,
+  "max_train_steps": 5000,
+  "stop_after_steps": null,
+  "num_workers_per_rank": 16,
+  "eval_num_workers_per_rank": 16,
+  "prefetch_factor": 4,
+  "base_model_revision": "ebb281ec70b05090aa6165b016eac8ec08e71b17",
+  "dataset_dir": "/home/ubuntu/codex/hist8-vla-20260923/outputs/tasks/decision_history_vla_hist8/data/demon_attack/qwengr00t/lerobot",
+  "dataset_manifest_sha256": "7e88488550acbacb0d82b33bab9b8ce8764c4196799f435e148dd0b1194ce029",
+  "code_snapshot_sha256": "11c1165a89f6f358bf7169d368bc45ad618d688d703cbb74fc9041ca463ead31"
+}

latency-aware/demon-attack/vla/starvla-qwengr00t-h1/demon_attack-qwengr00t-hist8-scratch-s42-v2/task_contract.json

@@ -0,0 +1,51 @@
+{
+  "task": "demon_attack",
+  "model": "qwengr00t",
+  "action_horizon": 1,
+  "image_frames": 1,
+  "state_source": "transport",
+  "state_dim": 88,
+  "history_decisions": 8,
+  "history_encoding": "binary_0_1",
+  "history_normalization": "identity",
+  "history_reset": "all_zero",
+  "history_order": "oldest_to_newest",
+  "history_entry_fields": [
+    "admission_bit",
+    "admitted_command_non_noop_bits",
+    "last_applied_action_non_noop_bits"
+  ],
+  "history_action_bit_order": [
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "action_dim": 6,
+  "action_layout": "demon_attack_discrete",
+  "action_labels": [
+    "NOOP",
+    "FIRE",
+    "RIGHT",
+    "LEFT",
+    "RIGHTFIRE",
+    "LEFTFIRE"
+  ],
+  "task_prompts": [
+    "You are playing Demon Attack from a single game image. Choose exactly one action from: NOOP, FIRE, RIGHT, LEFT, RIGHTFIRE, LEFTFIRE. Survive, avoid enemy fire, and shoot enemies to maximize score."
+  ],
+  "env_fps": 60,
+  "obs_fps": 15,
+  "evaluation": {
+    "episodes": 100,
+    "seeds": [
+      1000000,
+      1000099
+    ],
+    "parallel_envs": 32,
+    "capacity": 1,
+    "max_raw_frames": 7200,
+    "protocol_version": "hist8-history01-par32-v3"
+  }
+}