SearchingMan commited on
Commit
8e66870
·
verified ·
1 Parent(s): 4de8c64

Document three encoder teacher cosine metrics

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -69,6 +69,18 @@ Download these from [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/Mini
69
 
70
  The showcase used one matched 1344x768, 243-frame, 24 FPS, 25-step T2V contract. The three source outputs and merged comparison are technical assets. They do not establish a visual-quality winner. The recovered 8B showcase uses the BF16 base; the INT8 ConvRot variant has separate numerical conditioning-parity evidence.
71
 
 
 
 
 
 
 
 
 
 
 
 
 
72
  ### Recovered 8B BF16 versus INT8 ConvRot conditioning parity
73
 
74
  For one fixed seven-token prompt, the recovered 8B BF16 and INT8 ConvRot variants produced conditioning tensors with shape `[1, 7, 5120]`. The output tensors were flattened and compared with cosine similarity:
@@ -79,7 +91,7 @@ For one fixed seven-token prompt, the recovered 8B BF16 and INT8 ConvRot variant
79
  | Mean absolute difference | `0.015660330653190613` |
80
  | Maximum absolute difference | `0.6452102661132812` |
81
 
82
- This is a numerical conditioning-parity diagnostic for one prompt. It is not a visual-quality score, a prompt-adherence score, or proof that the INT8 variant produces identical video results. Full details are in `evidence/release_loader_smoke.json`.
83
 
84
  The requested hard cuts at 3 and 7 seconds did not pass for any encoder. Read `evidence/cut_diagnostics.json` before using the showcase as prompt-adherence evidence.
85
 
 
69
 
70
  The showcase used one matched 1344x768, 243-frame, 24 FPS, 25-step T2V contract. The three source outputs and merged comparison are technical assets. They do not establish a visual-quality winner. The recovered 8B showcase uses the BF16 base; the INT8 ConvRot variant has separate numerical conditioning-parity evidence.
71
 
72
+ ### Three-encoder teacher-conditioning cosine
73
+
74
+ The original matched three-encoder comparison reported these mean cosine similarities against the official Qwen3-VL-32B NVFP4/AWQ conditioning reference:
75
+
76
+ | Encoder | Cosine similarity to official reference |
77
+ |---|---:|
78
+ | Official Qwen3-VL-32B NVFP4/AWQ reference | `1.000000000000000` (identity baseline) |
79
+ | Recovered Qwen3-VL-8B + ARA + 4096-to-5120 adapter | `0.938678461010568` |
80
+ | Physical pruned-24 Qwen3-VL-32B-derived INT8 ConvRot + balanced ARA | `0.9404705529707683` |
81
+
82
+ These are text-conditioning diagnostics from the original three-encoder comparison. They are not visual-quality, prompt-adherence, or video-equivalence scores. Details: `evidence/three_encoder_teacher_cosine.json`.
83
+
84
  ### Recovered 8B BF16 versus INT8 ConvRot conditioning parity
85
 
86
  For one fixed seven-token prompt, the recovered 8B BF16 and INT8 ConvRot variants produced conditioning tensors with shape `[1, 7, 5120]`. The output tensors were flattened and compared with cosine similarity:
 
91
  | Mean absolute difference | `0.015660330653190613` |
92
  | Maximum absolute difference | `0.6452102661132812` |
93
 
94
+ This is a separate numerical conditioning-parity diagnostic for one prompt. It is not a visual-quality score, a prompt-adherence score, or proof that the INT8 variant produces identical video results. Full details are in `evidence/release_loader_smoke.json`.
95
 
96
  The requested hard cuts at 3 and 7 seconds did not pass for any encoder. Read `evidence/cut_diagnostics.json` before using the showcase as prompt-adherence evidence.
97