File size: 5,898 Bytes
c8d618e
 
d91ad12
 
c8d618e
d91ad12
 
 
 
 
 
32b98cf
c8d618e
 
32b98cf
c4514bd
32b98cf
c8d618e
d91ad12
c8d618e
d91ad12
c8d618e
d91ad12
 
 
 
 
32b98cf
c8d618e
d91ad12
c8d618e
32b98cf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c8d618e
d91ad12
88d512c
d91ad12
 
 
 
 
 
88d512c
 
d91ad12
32b98cf
88d512c
 
d91ad12
c8d618e
838141d
 
 
 
53e0d26
2e06a9a
d91ad12
c8d618e
d91ad12
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
---
license: other
license_name: minimax-h3-community-license-agreement
license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
base_model: MiniMaxAI/MiniMax-H3
tags:
- video-generation
- reference-to-video
- text-to-audio-video
- fastvideo
- minimax-h3
- fasth3-omni
---

# FastH3 Omni — BF16 Release

**This is the final BF16 release checkpoint of FastH3 Omni.** It generates video with synchronized audio from a text prompt and ordered image, video and audio references, using eight transformer evaluations.

[All release variants](https://huggingface.co/collections/FastVideo/fasth3-omniref) · [UniServe](https://github.com/hao-ai-lab/uniserve) · [FastVideo](https://github.com/hao-ai-lab/FastVideo)

## Choose a runtime

| Hardware | Runtime and setup |
| --- | --- |
| NVIDIA GB200 / B200 | [UniServe deployment guide](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md#deployments) |
| NVIDIA RTX PRO 6000 Blackwell | [UniServe deployment guide](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md#deployments) |
| NVIDIA Hopper, including H100 / H200 | [UniServe requirements and setup](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md#requirements) |
| NVIDIA DGX Spark (GB10) / RTX 5090 | [FastVideo local FastH3 Omni guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) with the [NVFP4 QAD variant](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD) |

For server deployment, use this BF16 checkpoint with UniServe's reference-conditioned (`ref2va`) configurations. The guide covers installation, model downloads, GPU placement, request capacities and the video/audio API. For the BF16 deployment, choose UniServe's `quality` precision preset. NVFP4 presets require Blackwell hardware.

## Local AI on DGX Spark and RTX 5090

Use **FastVideo** with the [NVFP4 QAD variant](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD) for local inference. QAD means quantization-aware distillation; these weights are trained for NVFP4 execution on Blackwell. Start with the [FastVideo cookbook](https://haoailab.com/FastVideo/cookbook/) and [FastH3 Omni recipe builder](https://haoailab.com/FastVideo/cookbook/minimax-h3/fasth3-omniref/).

| Device | Setup and inference recipe |
| --- | --- |
| DGX Spark (GB10, 128 GB unified memory) | [Install FastVideo](https://haoailab.com/FastVideo/getting_started/installation/spark/) · [`spark` recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_spark.yaml) |
| RTX 5090 (32 GB) | [Install FastVideo](https://haoailab.com/FastVideo/getting_started/installation/gpu/) · [`rtx-5090` recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx5090.yaml) |

Both profiles default to 480p. Spark keeps the model components resident; the RTX 5090 offloads the text encoder and requires a precomputed AdaLN table. Follow the [local inference guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) to compose the model directory, prepare the table and choose a decoder. Keep the device recipe's attention and precision settings.

For FP8, see the [FastH3 Omni FP8 weights](https://huggingface.co/FastVideo/FastH3-OmniRef-FP8) and [FP8 device setup](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md#device-profiles), including the [RTX 4090 recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx4090.yaml) for hardware without FP4 support. Its bundled NVFP4 text encoder requires Blackwell; non-FP4 hardware needs compatible BF16 encoder components. FP8 and NVFP4 QAD outputs can differ from BF16.

The optional [NVFP4 VAE decoders](https://huggingface.co/FastVideo/FastH3-NVFP4-VAE-Decoder) offer 36-layer quality and 8-layer fast tiers. The guide documents decoder selection with `--decoder`. These local variants have their own memory and precision settings.

For visual workflows, use the [ComfyUI variants](https://huggingface.co/FastVideo/FastH3-OmniRef-Comfy).

## Inputs and outputs

- **Inputs:** a text prompt plus up to nine images, three videos and three audio clips, with at most twelve references in total. At least one image or video is required.
- **Reference order:** use `<Picture 1>`, `<Video 1>` and `<Audio 1>` tags to refer to the ordered inputs. Video references include their soundtracks.
- **Output:** video with synchronized 32-kHz stereo audio at 24 FPS. Supported request sizes and lengths depend on the runtime and available memory.
- **Sampling:** eight transformer evaluations, guidance 1.0. The supplied configuration sets the video/audio schedule and reference-conditioned attention.

## Download

```bash
hf download FastVideo/FastVideo-FastH3-Omni-8-Step-V1 \
  --local-dir ./FastH3-Omni-BF16
```

The repository includes the BF16 reference transformer, schedulers and inference configuration. The runtime loads the shared text encoder, tokenizer, processor and video/audio VAEs from MiniMax-H3. Follow the runtime guide to prepare those components.

## Acknowledgements

FastH3 Omni was built in close collaboration with [Nuva Lab](https://nuvalab.ai/fasth3/), which co-developed the model with FastVideo, defined and curated the omni reference dataset, and brought production-grounded creative video workflows to FastH3. For dedicated production deployment, fine-tuning on your own data and a creative agent on top, see [Nuva Lab's FastH3-Omni page](https://nuvalab.ai/fasth3/).

Thanks to [Reactor](https://www.reactor.inc/) for providing compute, and to the NVIDIA FastGen team.

## License

Use of these weights is governed by the [MiniMax-H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).