File size: 3,770 Bytes
597a5aa 64290eb 597a5aa 64290eb 597a5aa 64290eb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 | ---
license: other
license_name: minimax-h3-community
license_link: LICENSE
tags:
- video-generation
- streaming
- interactive
- world-model
- minimax-h3
---
# StreamRender-H3: Interactive Coding Worlds with Real-time Streaming Diffusion Render
**Project page:** https://nvlabs.github.io/Sana/Sol-Engine/StreamRender-H3/
StreamRender-H3 splits an interactive world into a **Code Game Engine** and a **Streaming Diffusion Render**. The engine keeps the world state in code (maps, physics, rules) and streams a semantic map for every frame. A two-step streaming video model built on MiniMax-H3 Ref2VA renders those maps into photorealistic video as the player drives, with the look set by a reference image and a prompt.
- Two denoising steps per chunk in the distilled student.
- Diffusion render of 217.96 ms per streaming step on 8 GB200 GPUs, a 3.67× speedup over the PyTorch baseline.
- Fast Causal H3 VAE decodes 2 latent frames at 720p in 24 ms on one GB200, built by a self-improving agent loop.
## Released weights
This repository contains **two trained model components**:
| Directory | Model | Checkpoint |
| --- | --- | --- |
| `backbone/` | Streaming H3 renderer, full 50-layer EMA backbone with LoRA merged | 1008b / step224 |
| `causal_decoder/` | Fast Causal H3 VAE, a pruned and distilled 24-layer causal decoder | step6000 / 20261005-v1 |
The renderer uses two denoising evaluations with the S=2/W=2/C=2 streaming
policy. The decoder processes two available latent frames per call, using
cached past context without future latent frames. These are the trained
renderer and decoder checkpoints, not a bundle of unchanged upstream models.
## Download and use
Runtime code and deployment instructions:
[NVlabs/Sana — StreamRender-H3](https://github.com/NVlabs/Sana/tree/sol-engine/models/streamrender_h3).
```python
from huggingface_hub import snapshot_download
snapshot_download("Efficient-Large-Model/StreamRender-H3",
local_dir="./StreamRender-H3")
```
The download is approximately 72.75 GB. The renderer is stored as nine
safetensors shards, preserving all original tensor values. The current
runtime expects one merged backbone file. Reconstruct it with:
```bash
python StreamRender-H3/download_assets.py
```
Reconstruction needs another 66.28 GB of disk and verifies the original
SHA-256. Point the runtime manifest's `backbone` entry to
`backbone/1008b_step224_backbone_ema_merged.safetensors` and its
`causal_decoder` entry to `causal_decoder/causal_vit24_step6000.safetensors`.
Provide the remaining runtime dependencies separately as described in the
runtime README and `configs/assets.example.json`; this release contains
only the two trained model components. `SHA256SUMS` and `inventory.json`
provide integrity information for the released files.
## License
These model weights are derivatives governed by the MiniMax H3 Community
License, including its territory, use and redistribution terms. See
`LICENSE` and `NOTICE`. The runtime code's license does not replace the
model license.
## Citation
```bibtex
@misc{streamrenderh3_2026,
title = {StreamRender-H3: Interactive Coding Worlds with Real-time Streaming Diffusion Render},
author = {Yanzuo Lu and Tian Ye and Yitong Li and Shuchen Xue and Haozhe Liu and Song Han and Enze Xie},
year = {2026},
howpublished = {\url{https://nvlabs.github.io/Sana/Sol-Engine/StreamRender-H3/}},
note = {Project page}
}
```
## Acknowledgements
We thank the [MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3) team
for the base video generation model and native video codec. Our streaming
renderer and distilled causal decoder build on these components. Their
upstream license and attribution notices remain applicable.
|