aryan5v commited on
Commit
5534198
·
verified ·
1 Parent(s): 70921da

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # FastH3 Pruned 8-Step (full NVFP4, checkpoint 300)
2
+
3
+ **Full NVFP4 (W4A4), calibrated.** Every block's MLP (`ff.fc_in`, `ff.fc_out`), attention projections
4
+ (`attn.to_q/k/v`, `attn.to_out`) and VSA compression gate (`attn.to_gate_compress`) are NVFP4, each with a **static
5
+ activation scale max-calibrated on 1,000 prompts x all DMD steps**, stored in `transformer/nvfp4_weights.safetensors`
6
+ as `_nvfp4_input_global_sf`. AdaLN, token refiner, embeddings and heads stay in their source precision.
7
+ Requires an NVIDIA Blackwell GPU (sm100/sm120). This is the layout of the RTX 5090 speed configuration
8
+ (the whole DiT stays resident on a 32 GB card).
9
+
10
+ - 42-block pruned FastH3, rank-16 AdaLN, 8-step DMD (999..125), VSA 0.8, training checkpoint 300.
11
+ - `text_encoder`: Qwen3-VL conditioner, NVFP4, 50 of 64 language layers (lossless: H3 reads hidden state 50).
12
+ - `vae`: light VAE: 26-block LynnReal decoder + Kijai int8-convrot overlay.
13
+ - `fastvideo_inference.json`: the sampling contract; FastVideo reads it automatically.
14
+ - Load with `engine.quantization = {"transformer_quant": "NVFP4", "layer_profile": "h3_dit_vsa"}`.
15
+
16
+ **Status: internal, private evaluation build.** License: MiniMax H3 Community License (inherited).