DeepBeepMeep commited on
Commit
d1c34b0
·
verified ·
1 Parent(s): 9b5fc50

HyperFlow H3 Flash: low-rank down factors quantized to INT8 ConvRot (smaller files, faster steps); NOTICE updated

Browse files
HyperFlow-H3-Flash-NOTICE CHANGED
@@ -25,4 +25,5 @@ MiniMax-H3-Ref2VA-HyperFlow-Flash-14B_int8_convrot.safetensors are fl2va_int8_co
25
  https://huggingface.co/VideoRebirthAI/hyperflow-h3-flash (revision 9e9ed14b8be4b751d7517b8ca58dd199d509720c), each merged into
26
  one file. Modifications: tensor keys renamed to WanGP's MiniMax H3 names; the two row halves of each feed-forward input
27
  projection swapped (gate | value order); the INT8 weights and their scales stored as WanGP INT8 ConvRot tensors; the RoPE
28
- frequency buffer added. Tensor values are unchanged. The Agreement mentioned above is included here as HyperFlow-H3-Flash-LICENSE.
 
 
25
  https://huggingface.co/VideoRebirthAI/hyperflow-h3-flash (revision 9e9ed14b8be4b751d7517b8ca58dd199d509720c), each merged into
26
  one file. Modifications: tensor keys renamed to WanGP's MiniMax H3 names; the two row halves of each feed-forward input
27
  projection swapped (gate | value order); the INT8 weights and their scales stored as WanGP INT8 ConvRot tensors; the RoPE
28
+ frequency buffer added; the low-rank down factors, stored in BF16 upstream, quantized to INT8 ConvRot (per-row
29
+ scales, Hadamard groups of 256). Other tensor values are unchanged. The Agreement mentioned above is included here as HyperFlow-H3-Flash-LICENSE.
MiniMax-H3-FL2VA-HyperFlow-Flash-14B_int8_convrot.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b3f9d8f5afac040db1bea831480c4e5db3fd5085ce24c6af271bc6952b809e61
3
- size 15880662768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:736c943254732bcd621b43c91181184ea2538f9033288543fbf9cfefe85ab8cb
3
+ size 15272470528
MiniMax-H3-Ref2VA-HyperFlow-Flash-14B_int8_convrot.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:362a043209b312d22198cd72d1091d9529d43c75df5ef9134c986e44d0394282
3
- size 16311238704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1c046a3b51b6e0413ad836d33afe2fd363378103d391e51928a5bbd424d71a4
3
+ size 15598167356