Document three encoder teacher cosine metrics
Browse files
README.md
CHANGED
|
@@ -69,6 +69,18 @@ Download these from [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/Mini
|
|
| 69 |
|
| 70 |
The showcase used one matched 1344x768, 243-frame, 24 FPS, 25-step T2V contract. The three source outputs and merged comparison are technical assets. They do not establish a visual-quality winner. The recovered 8B showcase uses the BF16 base; the INT8 ConvRot variant has separate numerical conditioning-parity evidence.
|
| 71 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
### Recovered 8B BF16 versus INT8 ConvRot conditioning parity
|
| 73 |
|
| 74 |
For one fixed seven-token prompt, the recovered 8B BF16 and INT8 ConvRot variants produced conditioning tensors with shape `[1, 7, 5120]`. The output tensors were flattened and compared with cosine similarity:
|
|
@@ -79,7 +91,7 @@ For one fixed seven-token prompt, the recovered 8B BF16 and INT8 ConvRot variant
|
|
| 79 |
| Mean absolute difference | `0.015660330653190613` |
|
| 80 |
| Maximum absolute difference | `0.6452102661132812` |
|
| 81 |
|
| 82 |
-
This is a numerical conditioning-parity diagnostic for one prompt. It is not a visual-quality score, a prompt-adherence score, or proof that the INT8 variant produces identical video results. Full details are in `evidence/release_loader_smoke.json`.
|
| 83 |
|
| 84 |
The requested hard cuts at 3 and 7 seconds did not pass for any encoder. Read `evidence/cut_diagnostics.json` before using the showcase as prompt-adherence evidence.
|
| 85 |
|
|
|
|
| 69 |
|
| 70 |
The showcase used one matched 1344x768, 243-frame, 24 FPS, 25-step T2V contract. The three source outputs and merged comparison are technical assets. They do not establish a visual-quality winner. The recovered 8B showcase uses the BF16 base; the INT8 ConvRot variant has separate numerical conditioning-parity evidence.
|
| 71 |
|
| 72 |
+
### Three-encoder teacher-conditioning cosine
|
| 73 |
+
|
| 74 |
+
The original matched three-encoder comparison reported these mean cosine similarities against the official Qwen3-VL-32B NVFP4/AWQ conditioning reference:
|
| 75 |
+
|
| 76 |
+
| Encoder | Cosine similarity to official reference |
|
| 77 |
+
|---|---:|
|
| 78 |
+
| Official Qwen3-VL-32B NVFP4/AWQ reference | `1.000000000000000` (identity baseline) |
|
| 79 |
+
| Recovered Qwen3-VL-8B + ARA + 4096-to-5120 adapter | `0.938678461010568` |
|
| 80 |
+
| Physical pruned-24 Qwen3-VL-32B-derived INT8 ConvRot + balanced ARA | `0.9404705529707683` |
|
| 81 |
+
|
| 82 |
+
These are text-conditioning diagnostics from the original three-encoder comparison. They are not visual-quality, prompt-adherence, or video-equivalence scores. Details: `evidence/three_encoder_teacher_cosine.json`.
|
| 83 |
+
|
| 84 |
### Recovered 8B BF16 versus INT8 ConvRot conditioning parity
|
| 85 |
|
| 86 |
For one fixed seven-token prompt, the recovered 8B BF16 and INT8 ConvRot variants produced conditioning tensors with shape `[1, 7, 5120]`. The output tensors were flattened and compared with cosine similarity:
|
|
|
|
| 91 |
| Mean absolute difference | `0.015660330653190613` |
|
| 92 |
| Maximum absolute difference | `0.6452102661132812` |
|
| 93 |
|
| 94 |
+
This is a separate numerical conditioning-parity diagnostic for one prompt. It is not a visual-quality score, a prompt-adherence score, or proof that the INT8 variant produces identical video results. Full details are in `evidence/release_loader_smoke.json`.
|
| 95 |
|
| 96 |
The requested hard cuts at 3 and 7 seconds did not pass for any encoder. Read `evidence/cut_diagnostics.json` before using the showcase as prompt-adherence evidence.
|
| 97 |
|