Papers
arxiv:2610.16302

RAR: Rate-Adaptive Rollout for Time-Consistent Interactive World Models

Published on Oct 12
· Submitted by
Yaoyang Liu
on Oct 15
Authors:
,
,
,
,
,
,

Abstract

Rate-Adaptive Rollout enables interactive world models to generate video at variable temporal rates with consistent dynamics and extended physical horizons.

Video-based interactive world models aim to enable real-time, user-controllable environments. Yet most existing systems are trained and rolled out at a fixed temporal rate, limiting both runtime-rate adaptation and physical-horizon coverage -- a limitation we term temporal-rate coupling. Specifically, when runtime generation throughput differs from the learned temporal rate, the generated world evolves unintentionally more slowly or quickly. Moreover, using a single temporal rate imposes an inherent trade-off between temporal granularity and physical horizon: higher rates capture finer motion but cover a shorter duration under a fixed context window. To address both limitations, we introduce Rate-Adaptive Rollout (RAR), a framework that enables interactive world models to roll out at controllable temporal rates. At its core, Stride-RoPE aligns latent frames sampled at different rates on a shared physical-time coordinate, enabling consistent multi-rate rollout, unseen-rate generalization, and online rate switching without discarding history. Meanwhile, RAR uses multi-stride video sampling to enable joint learning of fine-grained dynamics and long-horizon evolution. Across action- and camera-controlled environments, RAR achieves temporally consistent multi-rate rollout and online rate switching while preserving high-rate generation quality and extending physical horizons under matched training budgets. RAR also transfers to pretrained world models while preserving perceptual quality.

Community

Paper author Paper submitter

Hi everyone! We’re sharing RAR (Rate-Adaptive Rollout), a framework for controllable generation rates in interactive world models.

Most world models run at a fixed temporal rate, so differences in hardware throughput can unintentionally speed up or slow down the generated world. RAR combines physical-time-aligned Stride-RoPE with synchronized multi-stride training, enabling one model to generate at multiple rates—including unseen intermediate rates—and switch rates mid-rollout without resetting the KV cache.
This makes it possible to match the rollout rate to runtime throughput while keeping the world’s physical-time progression consistent.

Happy to discuss and hear your feedback!

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.16302
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.16302 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.16302 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.16302 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.