ounce100m-code / build /build_mix.py

Commit History

  1. Upload build/build_mix.py with huggingface_hub

    Verified signature
    8138839
  2. Upload build/build_mix.py with huggingface_hub

    Verified signature
    9e79358
  3. Upload build/build_mix.py with huggingface_hub

    Verified signature
    9c74162
  4. Upload build/build_mix.py with huggingface_hub

    Verified signature
    a3bf1dd
  5. build_mix: no stray print inside BUILD_JSON block (E-019); manifest gains n_shards

    Verified signature
    7fd3601
  6. stage listing raises instead of returning {}; empty-repo case handled explicitly; verify refuses manifest-less PASS; +val holdout in merge

    Verified signature
    9f37a2c
  7. build_mix: hub-init failure is fatal (not silent), empty merge exits 4; add token-scope probe

    Verified signature
    a2bfa41
  8. hub sync for staged sources + cold-resume rehearsal script

    Verified signature
    a067bd1
  9. smoke PASSED (4/4 sources per shard, 40/40 boundaries); add contamination audit; raw target 1.23B = 23% headroom

    Verified signature
    18d6af8
  10. build_mix v2: stage->merge interleave + doc offset table; verify_mix asserts source-mix floor

    Verified signature
    20765b9
  11. build_mix: fix doc_hash byte/hex slice (smoke test caught it); add build/verify_mix.py

    Verified signature
    2002986
  12. Phase 2: build_mix -- resumable, cross-source shards, seeded intra-shuffle, mandatory en filter

    Verified signature
    20e54a8