Add teacher cache README
Browse files- teacher_caches/README.md +42 -0
teacher_caches/README.md
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Teacher Reference Caches
|
| 2 |
+
|
| 3 |
+
Ready-made teacher reference artifacts for the teacher-normalized
|
| 4 |
+
distribution evaluation of DistillAlign. They replace the
|
| 5 |
+
`teacher-sample` + `extract` stage entirely: pass the `.npz` file to
|
| 6 |
+
`--teacher-features` and only the student side needs to be generated.
|
| 7 |
+
|
| 8 |
+
## Contents
|
| 9 |
+
|
| 10 |
+
```text
|
| 11 |
+
wan2.1_t2v_1.3b_reference_vjepa2.npz V-JEPA2 features, 256 x 2560
|
| 12 |
+
wan2.1_t2v_1.3b_reference_vjepa2.meta.json extraction + sampling protocol
|
| 13 |
+
wan2.1_t2v_14b_reference_vjepa2.npz
|
| 14 |
+
wan2.1_t2v_14b_reference_vjepa2.meta.json
|
| 15 |
+
```
|
| 16 |
+
|
| 17 |
+
## Protocol
|
| 18 |
+
|
| 19 |
+
Both caches follow the paper protocol:
|
| 20 |
+
|
| 21 |
+
- Teacher: Wan2.1-T2V-1.3B / Wan2.1-T2V-14B, 25-step UniPC, timestep
|
| 22 |
+
shift 8.0, classifier-free guidance 5.0, official negative prompt.
|
| 23 |
+
- Grid: 16 prompts (`prompts/distribution_eval_16.txt`) x 16 seeds
|
| 24 |
+
(`11,22,33,42,44,55,66,77,88,123,456,789,2024,3407,7777,9999`),
|
| 25 |
+
256 samples per teacher.
|
| 26 |
+
- Features: `facebook/vjepa2-vith-fpc64-256`, 8 uniform frames from the
|
| 27 |
+
first 81 frames, token mean/std concat pooling, L2-normalized, 2560-D.
|
| 28 |
+
|
| 29 |
+
The exact extractor fingerprint and prompt/seed hash are embedded in each
|
| 30 |
+
`.npz` and validated by the metric CLI, which rejects incompatible student
|
| 31 |
+
caches instead of producing incomparable numbers.
|
| 32 |
+
|
| 33 |
+
## Usage
|
| 34 |
+
|
| 35 |
+
```bash
|
| 36 |
+
python evaluate_distribution.py run \
|
| 37 |
+
--checkpoint checkpoints/distillalign_distill_14b_teacher.pt \
|
| 38 |
+
--jobs outputs/eval_jobs.jsonl \
|
| 39 |
+
--teacher-model Wan2.1-T2V-14B \
|
| 40 |
+
--teacher-features teacher_caches/wan2.1_t2v_14b_reference_vjepa2.npz \
|
| 41 |
+
--output-dir outputs/my_eval
|
| 42 |
+
```
|