ldt-10m / README.md

Commit History

21 days ago

  1. Update card to v7 checkpoint (step 30000, val 3.6892 / ppl 40.01)

    Verified signature
    e9f874b
  2. Fix over-strong 'no token loops' claim: 40-sample sweep (seeds 0-4) found 1 hard loop (seed 4, loop_frac 1.0) + several elevated-loop samples. Card now says 'occasional/rare token loops' instead of 'no token loops'. All other numbers (val 3.8943, ppl 49.12, ~308M tok) re-verified and unchanged. (#13)⁠

    9165247
  3. Fix v4 token-count arithmetic: v4 data build is 257.9M tok (fw 150.6M + dclm 107.3M), cumulative ~308M, ~30 tok/param, 8.4x shortfall — not the previously stated ~393M/~444M/~43.1. Verified against models/ldt-10m-v4/train.log data-build lines. (#12)⁠

    99e3ef7
  4. Update to v4 checkpoint: 444M tokens, val 3.8943 (ppl 49.12), still incoherent (#11)⁠

    b0a40e0
  5. Fix fabricated sample quote + overstatement: replace sample #1 (not in eval output) with real samples from eval_ldt10m_final.json; correct "coherent/fluency" to "grammatically structured but semantically incoherent" (#10)⁠

    451f582
  6. Add LDT-10M model card (#7)⁠

    1a279d1
  7. Add honest model card (architecture, training, undertraining status, real samples)

    Verified signature
    fc4ad9c