Papers
arxiv:2611.00859

Wave Forcing: Towards Speed-of-Light Streaming Video Generation

Published on Oct 31
· Submitted by
Yijie Jin
on Nov 3
#1 Paper of the day
Authors:
,
,
,
,
,
,
,

Abstract

Wave Forcing enables efficient continuous long-video generation with consistent appearance and natural motion through co-designed generation, training, and execution, achieving high throughput and quality.

Real-time long-video generation requires continuous output with consistent appearance and natural motion. Existing chunk-wise autoregressive methods face challenges in both generation efficiency and long-video quality: serialized denoising and history-cache refresh require two forward passes even with one-step denoising, and longer rollouts can degrade quality and cause camera drift. We propose Wave Forcing (WF), which co-designs generation, training, and execution for continuous video output with multi-step denoising. WF uses chunk-wise causal attention to access earlier, cleaner chunks before their denoising is complete, and distributes staggered denoising and cache-refresh stages across full-model replicas to achieve 1F1C: one output chunk per concurrent forward round after pipeline fill. To adapt the model to this continuous generation process, we develop a three-stage training procedure that successively introduces mixed-noise denoising, motion supervision, and causal adaptation using self-generated history. To execute this process efficiently, Wave Runtime (WaveRT) uses Wave Parallelism (WP) for early K/V delivery and communication-computation overlap, together with optimized kernels and pipelined VAE decoding. Experiments on Wan2.1-T2V-1.3B show that 5-step WF maintains overall quality comparable to Rolling Forcing while achieving higher Dynamic Degree on both short and long videos. Our system efficiency experiments show that 4-step WF achieves 147.6 DiT FPS and 134.8 end-to-end FPS on eight H200 GPUs, yielding 7.07x the single-GPU end-to-end throughput. In DiT-only tests with matched SageAttention+W8A8 backends, denoising steps, and GPU counts, WP delivers up to 2.53x the throughput of the faster of the Ulysses and Ring context-parallel baselines across six model scales (1.3B-14B).

Community

Paper author Paper submitter

We introduce Wave Forcing, a training and execution framework for streaming video generation.

The key idea is wavefront scheduling: later video chunks begin denoising before earlier chunks finish, using their cleaner intermediate states as causal context. WaveRT sends K/V ahead of use and overlaps communication with computation. After pipeline fill, each concurrent forward round produces one video chunk.

Key results:
• Quality: On Wan2.1-T2V-1.3B, 5-step WF maintains overall quality comparable to Rolling Forcing. For 100-second videos, Dynamic Degree improves from 36.63 to 91.45 and Subject Preservation from 92.75 to 97.10.
• System efficiency: Our 4-step benchmark on 8×H200 reaches 147.6 DiT FPS and 134.8 end-to-end FPS, delivering 7.07× single-GPU E2E throughput.å
• Parallelism: Up to 2.53× the throughput of the faster Ulysses/Ring baseline in DiT-only tests with matched SageAttention+W8A8 backends, step counts and GPU counts.

Code, training recipes, and 4-step/5-step checkpoints are available. We welcome feedback and discussion!

Project page: https://sjtu-deng-lab.github.io/WaveForcing/
GitHub repo: https://github.com/SJTU-DENG-Lab/WaveForcing

Flash!!!

·

Flashing to the Speed-of-Light!

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.00859
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Datasets citing this paper 1

Spaces citing this paper 2

Collections including this paper 1