Commit History

  1. Upload train/preflight.py with huggingface_hub

    Verified signature
    758d461
  2. audit: vectorised rolling-hash grams + sorted-array lookup; the Python-set version could not finish 1.2B tokens

    Verified signature
    66e6f6e
  3. train: --grad-ckpt, and record attn/grad_ckpt in every result line

    Verified signature
    a477d8d
  4. train: --benchmark N runs the same step with no Trainer, to attribute the P2 throughput gap

    Verified signature
    182a8d9
  5. train: explicit attention kernel (default eager, per p0c on Turing); report requested vs effective

    Verified signature
    3880d41
  6. train: preflight -- static-review fixes: absolute-step cursor, hub_listing pagination, cursor required on resume, repo_type everywhere, rank-0 repo create

    Verified signature
    658b0a8
  7. train: train_ounce100m -- static-review fixes: absolute-step cursor, hub_listing pagination, cursor required on resume, repo_type everywhere, rank-0 repo create

    Verified signature
    11456a3
  8. train: hubckpt -- static-review fixes: absolute-step cursor, hub_listing pagination, cursor required on resume, repo_type everywhere, rank-0 repo create

    Verified signature
    7c925b7
  9. train: shard_dataset -- static-review fixes: absolute-step cursor, hub_listing pagination, cursor required on resume, repo_type everywhere, rank-0 repo create

    Verified signature
    cfc38f1
  10. preflight: P2 fast-fails after the first dead cell (each repeat bills a GPU session)

    Verified signature
    51eb041
  11. preflight: P2 parses RUN_JSON per cell and requires the frozen 22L/2048 cell to report

    Verified signature
    7aab8c2
  12. train: frozen-width keeps GQA 3:1; report peak_gpu_gb and per-run tok/s

    Verified signature
    db65aa1
  13. shard_dataset: drop the removed drop_last param's leftover body check (NameError at first call)

    Verified signature
    d5f46da
  14. preflight: assert the trapezoid SHAPE (off-by-one at the last step is expected, not a bug)

    Verified signature
    e687c2c
  15. train: train_ounce100m -- readback counts as verification; GQA kv must divide heads; pargs reports before optional probe

    Verified signature
    9bf38c0
  16. train: preflight -- readback counts as verification; GQA kv must divide heads; pargs reports before optional probe

    Verified signature
    48c0e43
  17. train: hubckpt -- readback counts as verification; GQA kv must divide heads; pargs reports before optional probe

    Verified signature
    51574f8
  18. train: train_ounce100m -- download_checkpoint prefix/landing-dir fix (found by P1 v2)

    Verified signature
    4a89fe7
  19. train: preflight -- download_checkpoint prefix/landing-dir fix (found by P1 v2)

    Verified signature
    9a7dcc5
  20. train: hubckpt -- download_checkpoint prefix/landing-dir fix (found by P1 v2)

    Verified signature
    5f6c3e9
  21. train: fix SwiGLU width in build_config variants (was 2x)

    Verified signature
    b09a370
  22. preflight: stage pargs -- construct TrainingArguments/model/schedule on the Kaggle image, cross-check 22L=106,194,240 and 20L=99,114,048

    Verified signature
    87df298
  23. train: train_ounce100m -- hubckpt.ensure_repo writes LFS attributes before the first checkpoint push (found by P1)

    Verified signature
    7a667d0
  24. train: hubckpt -- hubckpt.ensure_repo writes LFS attributes before the first checkpoint push (found by P1)

    Verified signature
    f7ea5a1
  25. train: preflight -- hubckpt.ensure_repo writes LFS attributes before the first checkpoint push (found by P1)

    Verified signature
    1279da6
  26. train: state which tokenizer files shipped with the export

    Verified signature
    38d1f55
  27. publish: ship tokenizer.json with the mix, sha-checked against the manifest

    Verified signature
    d3739eb
  28. train: create the ckpt repo if absent before the first push

    Verified signature
    0538d57
  29. train: Gate 3 preflight driver (reader, hub cycle, T1 throughput, cold resume)

    Verified signature
    e7ee32a
  30. train: add train_ounce100m (Phase 3/4 glue)

    Verified signature
    6ddf1d2
  31. train: add hubckpt (Phase 3/4 glue)

    Verified signature
    2297a33
  32. train: add shard_dataset (Phase 3/4 glue)

    Verified signature
    644b0cd
  33. audit: composite AUDIT_PASSED verdict; missing shards are unmeasured, not clean

    Verified signature
    98e4956
  34. rehearsal: make the script self-contained re sys.path/cwd (E-021)

    Verified signature
    428c523
  35. rehearsal: grab_json returns a reason, manifest fallback, single-line VERDICT

    Verified signature
    840f0b2
  36. build_mix: no stray print inside BUILD_JSON block (E-019); manifest gains n_shards

    Verified signature
    7fd3601
  37. download_missing must fetch record.json too (.bin-only filter broke restore); rehearsal pre-cleans stale test repo

    Verified signature
    e8c3967
  38. add publish_mix: LFS-first upload, generated card + attribution, Hub-side verification

    Verified signature
    c12486d
  39. stage listing raises instead of returning {}; empty-repo case handled explicitly; verify refuses manifest-less PASS; +val holdout in merge

    Verified signature
    9f37a2c
  40. hubsync.ensure_repo must install creds first (real cause of the 401); correct E-017 diagnosis

    Verified signature
    15c6b87
  41. build_mix: hub-init failure is fatal (not silent), empty merge exits 4; add token-scope probe

    Verified signature
    a2bfa41
  42. hub sync for staged sources + cold-resume rehearsal script

    Verified signature
    a067bd1
  43. smoke PASSED (4/4 sources per shard, 40/40 boundaries); add contamination audit; raw target 1.23B = 23% headroom

    Verified signature
    18d6af8
  44. build_mix v2: stage->merge interleave + doc offset table; verify_mix asserts source-mix floor

    Verified signature
    20765b9
  45. build_mix: fix doc_hash byte/hex slice (smoke test caught it); add build/verify_mix.py

    Verified signature
    2002986
  46. Phase 2: build_mix -- resumable, cross-source shards, seeded intra-shuffle, mandatory en filter

    Verified signature
    20e54a8
  47. Phase 2: source inventory probe + d576/49152 param candidates

    Verified signature
    fc350c9
  48. add p1_push_bench: Hub upload/download rate at checkpoint sizes

    Verified signature
    0a2e67e
  49. add credential helper + Hub write/bulk-upload roundtrip probe

    Verified signature
    80f5734
  50. add p1_secret_verify: mounted-credential end-to-end auth test

    Verified signature
    90c1cde