Elastic-forcing-code / 14B /docs /validation.md
Elastic-forcing's picture
Remove auxiliary records
5f90082 verified
|
Raw History Blame Contribute Delete
2.58 kB
# Validation
## Evaluated checkpoint
The restored recipe is the **three-encoder, 8,000-reference-video run**. The original checkpoint header records step **80**, **1,095 generator parameter tensors**, and all three branches: DINOv3, V-JEPA 2, and VideoMAEv2. Its bank identity matches the released training config. The historical human-evaluation generation records and the VLM source-video run point to this same checkpoint.
The original step-80 log reports loss **3.854**, generator gradient norm **10.98**, three encoder VJPs, batch geometry **256 / 128 / 128**, zero reported feature replay error for all three encoders, and a completed optimizer update. These are historical measurements, not a new run of this package.
## Checks of the corrected release
- **51 CPU tests passed; 1 CUDA-only test skipped.** Coverage includes three-encoder configuration, bank loading, MMD gradients, replay/offload, the 200-update cosine curve, DINOv3 metadata relocation, terminal cleanup and context-cache inference, and five-sample noise ordering.
- All **184 fields** from the original training configuration were accounted for. Asset paths and descriptive identities are public equivalents; the public stopping point is 80 rather than 200, while the cosine horizon remains 200. The three active encoders are specified explicitly.
- The public sampler was compared with the actual historical evaluation sampler using a small recording generator and the real scheduler. Outputs and every generator input/timestep matched exactly for two consecutive prompts, both with ordinary random draws and with supplied noise tensors.
- The five-sample adapter draws the same 21 main transition tensors and 14 auxiliary tensors per prompt as the original 81-frame inference adapter, before single-video execution. CPU tests verify noise slices and final RNG state.
- DINOv3 metadata relocation reproduces the complete actual frozen-bank metadata and digest without loading models from the original paths.
- The single-encoder MMD kernel, training rollout, and encoder VJP implementation match the original three-encoder snapshot's executable AST after removing documentation and restoring readability aliases.
- Python parsing, shell syntax, and diff whitespace checks passed.
**Full 14B GPU training, GPU video generation, and VBench were not rerun for this correction.** CPU sampler comparisons use a small test generator, not the 14B network, and do not establish identical generated videos or a new benchmark score.
Run the CPU suite from `14B/`:
```bash
python scripts/test_cpu.py
```