aryan5v commited on
Commit
a92a31a
·
verified ·
1 Parent(s): 9bea10e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # FastH3 Pruned 8-Step (bf16, checkpoint 300)
2
+
3
+ Reference bf16 transformer; source for the FP8/NVFP4 exports.
4
+
5
+ ## Model
6
+ - MiniMax-H3 student pruned from 50 to **42 transformer blocks** (removed blocks 6, 7, 9, 13, 15, 16, 22, 23), rank-16 AdaLN,
7
+ trained with 8-step DMD (timesteps 999, 874, 749, 624, 500, 375, 250, 125) and VSA sparse attention (sparsity 0.8, 64-token tiles).
8
+ - Training checkpoint 300 of run `s42-r16-dmd8-vsa80` (selected over 800 for prompt adherence on a multi-seed evaluation).
9
+ - Sampling contract: video/audio scheduler shift 10/3, guidance 1.0, VSA_sparsity 0.8, VSA_tile_size 64.
10
+ - `text_encoder` is not included; it is identical to the one in `FastVideo/FastVideo-FastH3-8-Step-V2`.
11
+
12
+ **Status: internal, private evaluation build.** License: MiniMax H3 Community License (inherited).