jennyxue commited on
Commit
704f621
·
verified ·
1 Parent(s): 072644e

Model card

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -9,8 +9,29 @@ MLX builds of [HyperFlow H3 Flash](https://huggingface.co/VideoRebirthAI/hyperfl
9
 
10
  | Precision | Files | Size |
11
  |---|---|---|
 
12
  | `6bit/` | 7 | 11.33 GB |
13
  | `8bit/` | 8 | 14.75 GB |
14
  | `bf16/` | 11 | 27.56 GB |
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  License: MiniMax H3 Community License (derivative; code Apache-2.0). These files carry the original model's license; read it before using them.
 
9
 
10
  | Precision | Files | Size |
11
  |---|---|---|
12
+ | `4bit/` | 6 | 7.92 GB |
13
  | `6bit/` | 7 | 11.33 GB |
14
  | `8bit/` | 8 | 14.75 GB |
15
  | `bf16/` | 11 | 27.56 GB |
16
 
17
+
18
+ ## Builds
19
+
20
+ The transformer only (`fl2va`: text and keyframe to video), converted from the publisher's `fl2va_int8_convrot`
21
+ checkpoint: the int8 weights are dequantized and their Hadamard rotation undone, then stored as bf16 or MLX affine
22
+ quantization (group size 64). No bf16 weights were ever released, so `bf16/` is the int8 model dequantized. Load with
23
+ `mlx_model.py` from the Moonbox lab. The text encoder and VAEs are the base MiniMax-H3 ones.
24
+
25
+ Checked block by block against the PyTorch model (each block fed the same input; pass = every block's cosine
26
+ >= 0.995 and a step-0 video velocity within rel-L2 0.10 of the reference; the shipped W8A8 runtime is at 0.022):
27
+
28
+ | Precision | Block rel-L2 median / max | Worst block cosine | Step-0 video rel-L2 | Status |
29
+ |---|---|---|---|---|
30
+ | `bf16/` | 0.0054 / 0.040 | 0.9992 | - | passes |
31
+ | `8bit/` | 0.0081 / 0.043 | 0.9991 | 0.037 | passes |
32
+ | `6bit/` | 0.0157 / 0.050 | 0.9987 | 0.052 | passes |
33
+ | `4bit/` | 0.0584 / 0.160 | 0.9872 | 0.159 | **below threshold: experimental** |
34
+
35
+ `4bit/` is published on request but fails the lab's threshold; expect visibly lower fidelity than `6bit/`.
36
+
37
  License: MiniMax H3 Community License (derivative; code Apache-2.0). These files carry the original model's license; read it before using them.