DistillAlign-Anonymous commited on
Commit
42a63d7
·
verified ·
1 Parent(s): d115884

Add teacher cache README

Browse files
Files changed (1) hide show
  1. teacher_caches/README.md +42 -0
teacher_caches/README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Teacher Reference Caches
2
+
3
+ Ready-made teacher reference artifacts for the teacher-normalized
4
+ distribution evaluation of DistillAlign. They replace the
5
+ `teacher-sample` + `extract` stage entirely: pass the `.npz` file to
6
+ `--teacher-features` and only the student side needs to be generated.
7
+
8
+ ## Contents
9
+
10
+ ```text
11
+ wan2.1_t2v_1.3b_reference_vjepa2.npz V-JEPA2 features, 256 x 2560
12
+ wan2.1_t2v_1.3b_reference_vjepa2.meta.json extraction + sampling protocol
13
+ wan2.1_t2v_14b_reference_vjepa2.npz
14
+ wan2.1_t2v_14b_reference_vjepa2.meta.json
15
+ ```
16
+
17
+ ## Protocol
18
+
19
+ Both caches follow the paper protocol:
20
+
21
+ - Teacher: Wan2.1-T2V-1.3B / Wan2.1-T2V-14B, 25-step UniPC, timestep
22
+ shift 8.0, classifier-free guidance 5.0, official negative prompt.
23
+ - Grid: 16 prompts (`prompts/distribution_eval_16.txt`) x 16 seeds
24
+ (`11,22,33,42,44,55,66,77,88,123,456,789,2024,3407,7777,9999`),
25
+ 256 samples per teacher.
26
+ - Features: `facebook/vjepa2-vith-fpc64-256`, 8 uniform frames from the
27
+ first 81 frames, token mean/std concat pooling, L2-normalized, 2560-D.
28
+
29
+ The exact extractor fingerprint and prompt/seed hash are embedded in each
30
+ `.npz` and validated by the metric CLI, which rejects incompatible student
31
+ caches instead of producing incomparable numbers.
32
+
33
+ ## Usage
34
+
35
+ ```bash
36
+ python evaluate_distribution.py run \
37
+ --checkpoint checkpoints/distillalign_distill_14b_teacher.pt \
38
+ --jobs outputs/eval_jobs.jsonl \
39
+ --teacher-model Wan2.1-T2V-14B \
40
+ --teacher-features teacher_caches/wan2.1_t2v_14b_reference_vjepa2.npz \
41
+ --output-dir outputs/my_eval
42
+ ```