tinyvla / ablation.md

Commit History

  1. Add section 12: RoboCasa fine-tune (0/15 -> 7/15 on trained task, 0/45 held-out); qualify section 11's rotation-frame hypothesis

    Verified signature
    3938c9e
  2. Complete section 11: all 5 RoboCasa tasks, zero-shot 0/60 on arm-only tasks

    Verified signature
    c25bc9b
  3. Add section 11 (RoboCasa zero-shot transfer); extend section 10 with pretrain_C fine-tune + B-vs-C head-to-head

    Verified signature
    ada945e

  1. ablation.md: section 7 - fixed vs adaptive gate comparison at matched call budget (17-30x fewer calls, no difference vs full-rate); documents the bootstrap-call counting bug found and fixed along the way

    Verified signature
    ce9a3ee

  1. ablation.md: add section 10 - fine-tuning pretrain_B on LIBERO with the ft4 recipe (69.0% vs ft4's 85.2%, significant)

    Verified signature
    3c5abcc

  1. ablation.md: add pretrain_B (same-harness LIBERO+profile); pretrain_C flagged as unrunnable here (missing morph-conditioning code/descriptors), cite author's own A/B/C few-shot table instead

    Verified signature
    52bfbbe

  1. ablation.md: complete consistent-lag test (3 ages, fixes a filename-mapping bug that silently dropped the 1s row)

    Verified signature
    59cf920
  2. ablation.md: add pre-LIBERO checkpoint comparison (stage2/stage3/pretrain_A, all 0% on LIBERO closed-loop)

    Verified signature
    2e262f4
  3. ablation.md: shuffle control, consistent-lag test (proprio staling makes it worse, not better)

    Verified signature
    fef8b93
  4. ablation.md: add the causal staleness grid (semantic vs geometric) and the zeroed-latent control

    Verified signature
    faa4ba7

  1. Add ablation.md: corrected rate-separated evaluation, 500 paired episodes, system profile

    Verified signature
    4d39a68