RAR: Rate-Adaptive Rollout for Time-Consistent Interactive World Models
Abstract
Rate-Adaptive Rollout enables interactive world models to generate video at variable temporal rates with consistent dynamics and extended physical horizons.
Video-based interactive world models aim to enable real-time, user-controllable environments. Yet most existing systems are trained and rolled out at a fixed temporal rate, limiting both runtime-rate adaptation and physical-horizon coverage -- a limitation we term temporal-rate coupling. Specifically, when runtime generation throughput differs from the learned temporal rate, the generated world evolves unintentionally more slowly or quickly. Moreover, using a single temporal rate imposes an inherent trade-off between temporal granularity and physical horizon: higher rates capture finer motion but cover a shorter duration under a fixed context window. To address both limitations, we introduce Rate-Adaptive Rollout (RAR), a framework that enables interactive world models to roll out at controllable temporal rates. At its core, Stride-RoPE aligns latent frames sampled at different rates on a shared physical-time coordinate, enabling consistent multi-rate rollout, unseen-rate generalization, and online rate switching without discarding history. Meanwhile, RAR uses multi-stride video sampling to enable joint learning of fine-grained dynamics and long-horizon evolution. Across action- and camera-controlled environments, RAR achieves temporally consistent multi-rate rollout and online rate switching while preserving high-rate generation quality and extending physical horizons under matched training budgets. RAR also transfers to pretrained world models while preserving perceptual quality.
Community
Hi everyone! We’re sharing RAR (Rate-Adaptive Rollout), a framework for controllable generation rates in interactive world models.
Most world models run at a fixed temporal rate, so differences in hardware throughput can unintentionally speed up or slow down the generated world. RAR combines physical-time-aligned Stride-RoPE with synchronized multi-stride training, enabling one model to generate at multiple rates—including unseen intermediate rates—and switch rates mid-rollout without resetting the KV cache.
This makes it possible to match the rollout rate to runtime throughput while keeping the world’s physical-time progression consistent.
Happy to discuss and hear your feedback!
Get this paper in your agent:
hf papers read 2610.16302 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper