cccat6 commited on
Commit
15a291b
·
verified ·
1 Parent(s): eb4fc81

Freeze FlowMo ICRA 2027 manuscript and clarify evaluation definitions

Browse files

Clarify velocity-probe targets, task-specific station-keeping success and stopping, and planning initialization. Add temporal and sparse-memory related work. Preserve all experiments, numerical results, weights, data and figure sources. Update the eight-page anonymous manuscript and release manifest; no new license grant.

MANIFEST.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "release": "flowmo-rebuttal-20260913",
3
  "original_hub_revision": "069fbace782c99dffcafc7b783f1e2c2acd8ed4e",
4
  "files": [
5
  {
@@ -19,13 +19,13 @@
19
  },
20
  {
21
  "path": "METRICS.md",
22
- "bytes": 3801,
23
- "sha256": "0b05627525b20248053d2c2238840d2b9c41e072eada13adc6e0224d9dcaa252"
24
  },
25
  {
26
  "path": "README.md",
27
- "bytes": 8289,
28
- "sha256": "86df89aa72429a96b0a99f86a1c4879852ddb398ff22f81470d9faf2e51265f0"
29
  },
30
  {
31
  "path": "assets/FlowMo_WM_architecture.pptx",
@@ -5134,8 +5134,8 @@
5134
  },
5135
  {
5136
  "path": "paper/FlowMo-WM-ICRA2027.pdf",
5137
- "bytes": 2087625,
5138
- "sha256": "8aebaff9bd37371ccc34b0b9472350da6297e561c9dcef671a8ccb9f5795ca3c"
5139
  },
5140
  {
5141
  "path": "paper/IEEEtran.bst",
@@ -5189,13 +5189,13 @@
5189
  },
5190
  {
5191
  "path": "paper/main.tex",
5192
- "bytes": 32471,
5193
- "sha256": "e473d4c07b0ff1bfd88b08c092ec7167a56db89ae578f3f4eec80716c19857a1"
5194
  },
5195
  {
5196
  "path": "paper/reference.bib",
5197
- "bytes": 13371,
5198
- "sha256": "8576d31183975e0922c3e7e7bf24a542f16d54a08446ccc6adc84b0f022b1c96"
5199
  },
5200
  {
5201
  "path": "paper/tables/table_planning_summary.tex",
@@ -5738,5 +5738,6 @@
5738
  "archived_original": 3,
5739
  "reconstructed_from_recorded_protocol": 13,
5740
  "exact_metadata_restoration": 2
5741
- }
 
5742
  }
 
1
  {
2
+ "release": "flowmo-icra2027-20260913",
3
  "original_hub_revision": "069fbace782c99dffcafc7b783f1e2c2acd8ed4e",
4
  "files": [
5
  {
 
19
  },
20
  {
21
  "path": "METRICS.md",
22
+ "bytes": 4981,
23
+ "sha256": "ba98b13b62de6625fb934344f188cf8264ca45cb4d5aaf6a937faea646b1f653"
24
  },
25
  {
26
  "path": "README.md",
27
+ "bytes": 8729,
28
+ "sha256": "589984d8cff811d1a6114a29bd8aceed18c0b7f723eeb884aa237036696d2185"
29
  },
30
  {
31
  "path": "assets/FlowMo_WM_architecture.pptx",
 
5134
  },
5135
  {
5136
  "path": "paper/FlowMo-WM-ICRA2027.pdf",
5137
+ "bytes": 2088555,
5138
+ "sha256": "74917dbf1dc0ce62866feb7c569b33170477492cf8f595453200c7f98fec93a4"
5139
  },
5140
  {
5141
  "path": "paper/IEEEtran.bst",
 
5189
  },
5190
  {
5191
  "path": "paper/main.tex",
5192
+ "bytes": 33197,
5193
+ "sha256": "dd98b0e74120cb1fe885f4f73f891d6fbd428239e0ebf08d8192a64250319b43"
5194
  },
5195
  {
5196
  "path": "paper/reference.bib",
5197
+ "bytes": 13416,
5198
+ "sha256": "86b6aa577b2f1d71a12caa3d724e1ae84a64679ce89f92feedcb9761997b474a"
5199
  },
5200
  {
5201
  "path": "paper/tables/table_planning_summary.tex",
 
5738
  "archived_original": 3,
5739
  "reconstructed_from_recorded_protocol": 13,
5740
  "exact_metadata_restoration": 2
5741
+ },
5742
+ "previous_hub_revision": "eb4fc81b9d6e50ade634b6058f8263c3ccb08bae"
5743
  }
METRICS.md CHANGED
@@ -22,7 +22,11 @@ Paths in the table are relative to the repository or the stated report root. Lar
22
 
23
  **Uncertainty.** Table II uses the sample standard deviation across eight independent model seeds. Figure 6A/C/D/E/F use the archived Student-t 95% mean intervals (seven degrees of freedom). Figure 6B uses the archived 50,000-draw seed bootstrap. These error bars are not independent-window confidence intervals.
24
 
25
- **Success and conditioning.** Planning success is the task-specific Boolean recorded per episode. Table I final distance uses all episodes; energy and number of steps use successful episodes only. The corrected FlowMo initial count is 3,942/4,000, or 98.55%. Counts come directly from individual records, not rounded rates.
 
 
 
 
26
 
27
  **Figure 6E condition labels.** R0: reach in no flow; R1: reach in uniform flow; SV: station keeping in a vortex; SD: station keeping in smooth dynamic flow; S2: station keeping with doubled uniform-flow magnitude; ZF: zigzag in a random Fourier field. Each plotted seed summarizes thirty episodes.
28
 
 
22
 
23
  **Uncertainty.** Table II uses the sample standard deviation across eight independent model seeds. Figure 6A/C/D/E/F use the archived Student-t 95% mean intervals (seven degrees of freedom). Figure 6B uses the archived 50,000-draw seed bootstrap. These error bars are not independent-window confidence intervals.
24
 
25
+ **Success and conditioning.** Planning success is the task-specific Boolean recorded per episode. The goal radius is 6.5% of workspace width. Reaching requires entry into the goal region; waypoint tasks require completing all goals in order. Station keeping uses terminal occupancy of the goal region and stops early on entry or occupancy from step 101 of a 300-step budget. Continuous residence throughout the episode is not required. Table I final distance uses all episodes; energy and number of steps use successful episodes only. The corrected FlowMo initial count is 3,942/4,000, or 98.55%. Counts come directly from individual records, not rounded rates.
26
+
27
+ **Planning initialization.** Planning starts from rest, at `(0.5W, 0.5W)` for station keeping and `(0.2W, 0.2W)` for other tasks. Station heading is 0.3 radians; other initial headings are sampled uniformly over `[-pi, pi]`. The common task initialization and parameter/flow sampling rules differ from the fully sampled prediction dataset. Planning actions are generated online by the evaluated controller.
28
+
29
+ **Velocity probes.** The historical JSON key `momentum` denotes the three-component target `[vx, vy, omega]`: linear and angular velocity. It does not denote `[mass*vx, mass*vy, inertia*omega]`. The historical key and numerical results are retained for compatibility; the manuscript names the actual predicted quantities. The original linear-probe R-squared is 0.667; formal nonlinear means from `c` and `[z,c]` are 0.701 and 0.818.
30
 
31
  **Figure 6E condition labels.** R0: reach in no flow; R1: reach in uniform flow; SV: station keeping in a vortex; SD: station keeping in smooth dynamic flow; S2: station keeping with doubled uniform-flow magnitude; ZF: zigzag in a random Fourier field. Each plotted seed summarizes thirty episodes.
32
 
README.md CHANGED
@@ -11,6 +11,8 @@ library_name: pytorch
11
 
12
  Code, simulation inputs, trained checkpoints, numerical results and figure sources for FlowMo-WM. The [original preprint](https://arxiv.org/abs/2606.13817) and the revised manuscript describe a predictor with a recent-history state, sparse longer-history context and zero-context residual dynamics. This repository contains the original FlowMo study and its completed eight-seed follow-up controls.
13
 
 
 
14
  The matched H60 comparison supports lower error than Recent-8 and error close to Full-32 with 16 instead of 32 image encodings. Image-encoding count is not a measured end-to-end latency improvement. The LeWorldModel-, RSSM- and TD-MPC2-style comparisons are adaptations to the common supervised pose-prediction interface, not reproductions of complete agents.
15
 
16
  ## Rebuild the paper materials
 
11
 
12
  Code, simulation inputs, trained checkpoints, numerical results and figure sources for FlowMo-WM. The [original preprint](https://arxiv.org/abs/2606.13817) and the revised manuscript describe a predictor with a recent-history state, sparse longer-history context and zero-context residual dynamics. This repository contains the original FlowMo study and its completed eight-seed follow-up controls.
13
 
14
+ The ICRA 2027 submission draft was frozen on 2026-09-13 after clarifying velocity-probe terminology, task-specific success/stopping rules and planning initialization, and adding direct temporal/memory related work. These manuscript and documentation changes preserve all recorded experiments, checkpoints, tables and quantitative figures. The source and reviewed eight-page PDF are in `paper/`; the target definitions are in `METRICS.md`.
15
+
16
  The matched H60 comparison supports lower error than Recent-8 and error close to Full-32 with 16 instead of 32 image encodings. Image-encoding count is not a measured end-to-end latency improvement. The LeWorldModel-, RSSM- and TD-MPC2-style comparisons are adaptations to the common supervised pose-prediction interface, not reproductions of complete agents.
17
 
18
  ## Rebuild the paper materials
paper/FlowMo-WM-ICRA2027.pdf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8aebaff9bd37371ccc34b0b9472350da6297e561c9dcef671a8ccb9f5795ca3c
3
- size 2087625
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74917dbf1dc0ce62866feb7c569b33170477492cf8f595453200c7f98fec93a4
3
+ size 2088555
paper/main.tex CHANGED
@@ -70,7 +70,7 @@ Our contributions are: (i) a visual prediction model that combines recent and sp
70
  PlaNet, Dreamer, and TD-MPC2 learn latent dynamics for planning or policy improvement \cite{hafner2019planet,hafner2025dreamerv3,hansen2024tdmpc2}. DINO-WM predicts pretrained visual features for goal-directed action optimization \cite{zhou2025dinowm}. Iso-Dream separates controllable and noncontrollable visual dynamics \cite{pan2022isodream}; ActSWM trains action-sensitive rollouts, and DWM regularizes complementary world and action effects \cite{gan2026actswm,zhang2026dwm}. FlowMo-WM focuses on combining recent observations with a sparse longer history in an end-to-end pose predictor.
71
 
72
  \paragraph{Temporal inference and unknown dynamics}
73
- Recurrent latent models recover predictive state under partial observation \cite{karl2017dvbf,han2020vrm}. Online identification, CaDM, and ProtoCAD infer dynamics information from history \cite{yu2017uposi,lee2020cadm,wang2022protocad}. Context-aware Neural ODE control initially uses privileged environmental information and then infers context from state--action history \cite{yu2026contextode}. ContextWM, Denoised MDPs, and ACRO investigate useful representations under changing or exogenous visual information \cite{wu2023contextwm,wang2022denoisedmdp,islam2023acro}. Our setting makes the disturbance invisible while retaining its effect on observed vehicle motion.
74
 
75
  \paragraph{Motion structure and marine control}
76
  NewtonianVAE introduces physical structure into visual latent dynamics \cite{jaques2021newtonianvae}. Hydrodynamic models and disturbance estimates also support marine control \cite{fossen2021handbook,fossen2017ilos,belleter2019observer}. FlowMo-WM learns a free latent increment from image--action windows and pose targets. It receives no measured velocity, current, or vessel parameters at inference; the temporal representations are evaluated for their predictive content.
@@ -149,7 +149,7 @@ Both sample mass, inertia, drag, thrust scale, and actuator time constant.
149
  For batching, actions are stored as a common length-three thruster-command vector in the 2D simulator; the twin boat uses the first two active thruster commands, while the triangular boat uses all three.
150
  The two morphologies probe different control structures: the twin boat must turn to redirect thrust, while the triangular boat can compensate for lateral drift more directly.
151
  Planning tasks include reaching targets, station-keeping, square waypoints, and zigzag waypoints.
152
- Reaching tests motion toward a fixed goal; station keeping tests holding under drift; the waypoint tasks require repeated redirection.
153
  Training and prediction evaluation were run on an NVIDIA RTX 5090 GPU.
154
 
155
  \begin{figure*}[!tb]
@@ -162,7 +162,7 @@ Training and prediction evaluation were run on an NVIDIA RTX 5090 GPU.
162
  \subsection{Training and Evaluation}
163
  \label{sec:training_evaluation}
164
 
165
- Training uses $2{,}400$ episodes of 300 simulator steps, corresponding to $720{,}000$ training transitions and $722{,}400$ simulator states including initial states. The held-out prediction set contains $480$ episodes, or $144{,}000$ transitions. All reported prediction and planning results are computed on held-out episodes with independently sampled initial conditions, physical parameters, action sequences, and flow-field instances; no test rollout windows are drawn from training episodes.
166
  The $160\times160$ RGB observations are rendered online from stored simulator states without overlays.
167
  The prediction target is pose $y_t=(x_t,y_t,\cos\theta_t,\sin\theta_t)$; positions are normalized from the $[0,10]\times[0,10]$ workspace during training, while heading is represented by cosine and sine.
168
  Episodes vary in vehicle morphology, physical parameters, flow field, and trajectory-generation mode, including random action, push-and-coast, passive drift, goal seeking, and waypoint following.
@@ -178,12 +178,13 @@ Parameter counts are closely matched: FlowMo-WM has $663{,}964$ parameters, LeWo
178
  Prediction evaluation uses $16{,}384$ open-loop 60-step rollout windows with ground-truth future actions.
179
  Spatial error is reported as $E_{\rm pos}(h)=100\|\hat p_{t+h}-p_{t+h}\|_2/W$, averaged over evaluated windows after decoding positions to workspace coordinates. Heading error from predicted and target sine--cosine headings is a secondary diagnostic; the main figures emphasize position error and task success.
180
  For prediction-time context diagnostics, we also evaluate FlowMo-WM with normal context, zero context $c_t=\mathbf{0}$, and shuffled context from another sample.
181
- Frozen linear probes~\cite{alain2016understanding} are fit after training from $z_t$, $c_t$, and $[z_t,c_t]$ to privileged momentum and flow quantities only for analysis.
182
 
183
  For downstream planning, learned world models score sampled candidate action sequences through latent rollout with the same route-aware planner.
184
  Each planning update evaluates 512 sequences over a 45-step horizon for four refinement rounds and updates the sampling distribution from the 64 best-scoring sequences.
185
  We run four tasks, two boats, ten flow families, and 50 episodes per setting.
186
- Success means reaching the active goal within a radius equal to $6.5\%$ of workspace width; final distance $d$ is measured to the active terminal goal and reported as $100d/W$; the reported energy is the action-effort proxy $\sum_t\|a_t\|_2^2$ over successful episodes.
 
187
  We also include LOS references: PID/LOS~\cite{fossen2021handbook}, No-Flow LOS, Current-Estimator LOS, and Oracle-Flow LOS.
188
  These are downstream references with different information assumptions, not direct learned visual world-model comparison methods.
189
  PID/LOS uses hand-designed line-of-sight tracking from pose and goal, No-Flow LOS ignores ambient transport, Current-Estimator LOS uses a recent-displacement heuristic, and Oracle-Flow LOS uses privileged simulator flow as a diagnostic feed-forward signal.
@@ -235,9 +236,9 @@ The shuffled-context condition tests sensitivity to context mismatch. These infe
235
 
236
  \paragraph{Representation analysis}
237
  The context ablations test whether the long-history pathway is functionally used during rollout; frozen probes provide a complementary view of what information is present in the learned factors.
238
- Momentum is linearly decodable from $[z_t,c_t]$ with $R^2=0.667$, indicating that the learned representation contains substantial motion-state information even though velocity is never used as a training target.
239
  Local flow and episode-level drift have near-zero linear $R^2$, which suggests that the context improves prediction through a task-useful latent code rather than by storing a trivially linear physical current vector.
240
- The formal nonlinear probes recover momentum from $c$ and $[z,c]$ with $R^2=0.701$ and $0.818$, respectively, and predict boat type from $c$ with balanced accuracy $0.904$. Expanded flow probes provide no clear evidence for an identifiable local, episode-average, or history-averaged flow representation. The context therefore mixes predictive dynamics information; context use does not establish physical disentanglement.
241
 
242
  \paragraph{Planning results}
243
  Table~\ref{tab:planning_summary} reports aggregate planning results split by boat morphology.
 
70
  PlaNet, Dreamer, and TD-MPC2 learn latent dynamics for planning or policy improvement \cite{hafner2019planet,hafner2025dreamerv3,hansen2024tdmpc2}. DINO-WM predicts pretrained visual features for goal-directed action optimization \cite{zhou2025dinowm}. Iso-Dream separates controllable and noncontrollable visual dynamics \cite{pan2022isodream}; ActSWM trains action-sensitive rollouts, and DWM regularizes complementary world and action effects \cite{gan2026actswm,zhang2026dwm}. FlowMo-WM focuses on combining recent observations with a sparse longer history in an end-to-end pose predictor.
71
 
72
  \paragraph{Temporal inference and unknown dynamics}
73
+ Recurrent latent models recover predictive state under partial observation \cite{karl2017dvbf,han2020vrm}. Online identification, CaDM, and ProtoCAD infer dynamics information from history \cite{yu2017uposi,lee2020cadm,wang2022protocad}. Context-aware Neural ODE control initially uses privileged environmental information and then infers context from state--action history \cite{yu2026contextode}. ContextWM, Denoised MDPs, and ACRO study contextual or exogenous visual information \cite{wu2023contextwm,wang2022denoisedmdp,islam2023acro}. MTS3 couples slow task and fast state dynamics through probabilistic inference \cite{shaj2023mts3}; SF-RSSM coordinates fast and slow branches through distillation \cite{wang2026sfrssm}. WEAVER combines sparse memory and recent history for multiview generation \cite{jain2026weaver}. FlowMo-WM uses a compact history context in each step of a zero-reference residual pose rollout, with matched controls to evaluate this formulation under hidden disturbances.
74
 
75
  \paragraph{Motion structure and marine control}
76
  NewtonianVAE introduces physical structure into visual latent dynamics \cite{jaques2021newtonianvae}. Hydrodynamic models and disturbance estimates also support marine control \cite{fossen2021handbook,fossen2017ilos,belleter2019observer}. FlowMo-WM learns a free latent increment from image--action windows and pose targets. It receives no measured velocity, current, or vessel parameters at inference; the temporal representations are evaluated for their predictive content.
 
149
  For batching, actions are stored as a common length-three thruster-command vector in the 2D simulator; the twin boat uses the first two active thruster commands, while the triangular boat uses all three.
150
  The two morphologies probe different control structures: the twin boat must turn to redirect thrust, while the triangular boat can compensate for lateral drift more directly.
151
  Planning tasks include reaching targets, station-keeping, square waypoints, and zigzag waypoints.
152
+ Reaching tests motion toward a fixed goal; station keeping tests regulation around a target under drift; the waypoint tasks require repeated redirection.
153
  Training and prediction evaluation were run on an NVIDIA RTX 5090 GPU.
154
 
155
  \begin{figure*}[!tb]
 
162
  \subsection{Training and Evaluation}
163
  \label{sec:training_evaluation}
164
 
165
+ Training uses $2{,}400$ episodes of 300 simulator steps, corresponding to $720{,}000$ training transitions and $722{,}400$ simulator states including initial states. The held-out prediction set contains $480$ episodes, or $144{,}000$ transitions. Training and prediction-test episodes independently sample initial conditions, physical parameters, action sequences, and flow-field instances; no test rollout windows are drawn from training episodes.
166
  The $160\times160$ RGB observations are rendered online from stored simulator states without overlays.
167
  The prediction target is pose $y_t=(x_t,y_t,\cos\theta_t,\sin\theta_t)$; positions are normalized from the $[0,10]\times[0,10]$ workspace during training, while heading is represented by cosine and sine.
168
  Episodes vary in vehicle morphology, physical parameters, flow field, and trajectory-generation mode, including random action, push-and-coast, passive drift, goal seeking, and waypoint following.
 
178
  Prediction evaluation uses $16{,}384$ open-loop 60-step rollout windows with ground-truth future actions.
179
  Spatial error is reported as $E_{\rm pos}(h)=100\|\hat p_{t+h}-p_{t+h}\|_2/W$, averaged over evaluated windows after decoding positions to workspace coordinates. Heading error from predicted and target sine--cosine headings is a secondary diagnostic; the main figures emphasize position error and task success.
180
  For prediction-time context diagnostics, we also evaluate FlowMo-WM with normal context, zero context $c_t=\mathbf{0}$, and shuffled context from another sample.
181
+ Frozen linear probes~\cite{alain2016understanding} are fit after training from $z_t$, $c_t$, and $[z_t,c_t]$ to linear and angular velocity $(v_x,v_y,\omega)$ and flow quantities only for analysis.
182
 
183
  For downstream planning, learned world models score sampled candidate action sequences through latent rollout with the same route-aware planner.
184
  Each planning update evaluates 512 sequences over a 45-step horizon for four refinement rounds and updates the sampling distribution from the 64 best-scoring sequences.
185
  We run four tasks, two boats, ten flow families, and 50 episodes per setting.
186
+ Planning starts from rest at $(0.5W,0.5W)$ for station keeping and $(0.2W,0.2W)$ otherwise; heading is fixed at $0.3$ rad for station keeping and sampled uniformly otherwise. All methods share task initializations and parameter/flow sampling rules, with commands generated online.
187
+ The goal radius is $6.5\%$ of workspace width. Reaching succeeds upon entry; waypoints require ordered completion. Station-keeping success uses terminal occupancy of this radius, with early stopping on entry or occupancy from step 101 of a 300-step budget. Final distance $d$ is to the active terminal goal, reported as $100d/W$; energy is the action-effort proxy $\sum_t\|a_t\|_2^2$ over successful episodes.
188
  We also include LOS references: PID/LOS~\cite{fossen2021handbook}, No-Flow LOS, Current-Estimator LOS, and Oracle-Flow LOS.
189
  These are downstream references with different information assumptions, not direct learned visual world-model comparison methods.
190
  PID/LOS uses hand-designed line-of-sight tracking from pose and goal, No-Flow LOS ignores ambient transport, Current-Estimator LOS uses a recent-displacement heuristic, and Oracle-Flow LOS uses privileged simulator flow as a diagnostic feed-forward signal.
 
236
 
237
  \paragraph{Representation analysis}
238
  The context ablations test whether the long-history pathway is functionally used during rollout; frozen probes provide a complementary view of what information is present in the learned factors.
239
+ Linear and angular velocity are jointly decodable from $[z_t,c_t]$ with linear-probe $R^2=0.667$, indicating substantial motion-state information without direct velocity supervision.
240
  Local flow and episode-level drift have near-zero linear $R^2$, which suggests that the context improves prediction through a task-useful latent code rather than by storing a trivially linear physical current vector.
241
+ The formal nonlinear probes recover these velocities from $c$ and $[z,c]$ with $R^2=0.701$ and $0.818$, respectively, and predict boat type from $c$ with balanced accuracy $0.904$. Expanded flow probes provide no clear evidence for an identifiable local, episode-average, or history-averaged flow representation. The context therefore mixes predictive dynamics information; context use does not establish physical disentanglement.
242
 
243
  \paragraph{Planning results}
244
  Table~\ref{tab:planning_summary} reports aggregate planning results split by boat morphology.
paper/reference.bib CHANGED
@@ -11,17 +11,17 @@
11
  @inproceedings{hafner2019planet,
12
  title = {Learning Latent Dynamics for Planning from Pixels},
13
  author = {Hafner, Danijar and Lillicrap, Timothy and Fischer, Ian and Villegas, Ruben and Ha, David and Lee, Honglak and Davidson, James},
14
- booktitle = {Proceedings of the 36th International Conference on Machine Learning},
15
  pages = {2555--2565},
16
  year = {2019},
17
  volume = {97},
18
- series = {Proceedings of Machine Learning Research}
19
  }
20
 
21
  @inproceedings{hafner2020dreamer,
22
  title = {Dream to Control: Learning Behaviors by Latent Imagination},
23
  author = {Hafner, Danijar and Lillicrap, Timothy and Ba, Jimmy and Norouzi, Mohammad},
24
- booktitle = {International Conference on Learning Representations},
25
  year = {2020}
26
  }
27
 
@@ -35,18 +35,18 @@
35
  @inproceedings{hansen2024tdmpc2,
36
  title = {{TD-MPC2}: Scalable, Robust World Models for Continuous Control},
37
  author = {Hansen, Nicklas and Su, Hao and Wang, Xiaolong},
38
- booktitle = {International Conference on Learning Representations},
39
  year = {2024}
40
  }
41
 
42
  @inproceedings{wu2023daydreamer,
43
  title = {{DayDreamer}: World Models for Physical Robot Learning},
44
  author = {Wu, Philipp and Escontrela, Alejandro and Hafner, Danijar and Abbeel, Pieter and Goldberg, Ken},
45
- booktitle = {Proceedings of The 6th Conference on Robot Learning},
46
  pages = {2226--2240},
47
  year = {2023},
48
  volume = {205},
49
- series = {Proceedings of Machine Learning Research}
50
  }
51
 
52
  @article{fossen2017ilos,
@@ -84,14 +84,14 @@
84
  @inproceedings{karl2017dvbf,
85
  title = {Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data},
86
  author = {Karl, Maximilian and Soelch, Maximilian and Bayer, Justin and van der Smagt, Patrick},
87
- booktitle = {International Conference on Learning Representations},
88
  year = {2017}
89
  }
90
 
91
  @inproceedings{han2020vrm,
92
  title = {Variational Recurrent Models for Solving Partially Observable Control Tasks},
93
  author = {Han, Dongqi and Doya, Kenji and Tani, Jun},
94
- booktitle = {International Conference on Learning Representations},
95
  year = {2020}
96
  }
97
 
@@ -134,24 +134,24 @@
134
  @inproceedings{rakelly2019pearl,
135
  title = {Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables},
136
  author = {Rakelly, Kate and Zhou, Aurick and Finn, Chelsea and Levine, Sergey and Quillen, Deirdre},
137
- booktitle = {Proceedings of the 36th International Conference on Machine Learning},
138
  pages = {5331--5340},
139
  year = {2019},
140
  volume = {97},
141
- series = {Proceedings of Machine Learning Research}
142
  }
143
 
144
  @inproceedings{zintgraf2020varibad,
145
  title = {{VariBAD}: A Very Good Method for Bayes-Adaptive Deep {RL} via Meta-Learning},
146
  author = {Zintgraf, Luisa and Shiarlis, Kyriacos and Igl, Maximilian and Schulze, Sebastian and Gal, Yarin and Hofmann, Katja and Whiteson, Shimon},
147
- booktitle = {International Conference on Learning Representations},
148
  year = {2020}
149
  }
150
 
151
  @inproceedings{wu2023contextwm,
152
  title = {Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning},
153
  author = {Wu, Jialong and Ma, Haoyu and Deng, Chaoyi and Long, Mingsheng},
154
- booktitle = {Advances in Neural Information Processing Systems},
155
  volume = {36},
156
  year = {2023}
157
  }
@@ -159,79 +159,76 @@
159
  @inproceedings{wang2022denoisedmdp,
160
  title = {Denoised {MDPs}: Learning World Models Better Than the World Itself},
161
  author = {Wang, Tongzhou and Du, Simon and Torralba, Antonio and Isola, Phillip and Zhang, Amy and Tian, Yuandong},
162
- booktitle = {Proceedings of the 39th International Conference on Machine Learning},
163
  pages = {22591--22612},
164
  year = {2022},
165
  volume = {162},
166
- series = {Proceedings of Machine Learning Research}
167
  }
168
 
169
  @inproceedings{islam2023acro,
170
  title = {Principled Offline {RL} in the Presence of Rich Exogenous Information},
171
  author = {Islam, Riashat and Tomar, Manan and Lamb, Alex and Efroni, Yonathan and Zang, Hongyu and Didolkar, Aniket Rajiv and Misra, Dipendra and Li, Xin and Van Seijen, Harm and Tachet Des Combes, Remi and Langford, John},
172
- booktitle = {Proceedings of the 40th International Conference on Machine Learning},
173
  pages = {14390--14421},
174
  year = {2023},
175
  volume = {202},
176
- series = {Proceedings of Machine Learning Research}
177
  }
178
 
179
  @inproceedings{zhou2025dinowm,
180
  title={{DINO-WM}: World Models on Pre-trained Visual Features enable Zero-shot Planning},
181
  author={Zhou, Gaoyue and Pan, Hengkai and LeCun, Yann and Pinto, Lerrel},
182
- booktitle={International Conference on Machine Learning}, volume={267},
183
- series={Proceedings of Machine Learning Research}, pages={79115--79135}, year={2025},
184
- url={https://proceedings.mlr.press/v267/zhou25t.html}
185
  }
186
 
187
  @inproceedings{pan2022isodream,
188
  title={{Iso-Dream}: Isolating and Leveraging Noncontrollable Visual Dynamics in World Models},
189
  author={Pan, Minting and Zhu, Xiangming and Wang, Yunbo and Yang, Xiaokang},
190
- booktitle={Advances in Neural Information Processing Systems}, volume={35}, year={2022},
191
- url={https://proceedings.neurips.cc/paper_files/paper/2022/hash/9316769afaaeeaad42a9e3633b14e801-Abstract-Conference.html}
192
  }
193
 
194
  @article{gan2026actswm,
195
  title={{ActSWM}: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games},
196
  author={Gan, Zhenfeng and Zeng, ZiTong and Cheng, Jiajun and Song, Yeke and Tang, Yongyi and Wang, Xueqian},
197
  journal={arXiv preprint arXiv:2607.26712}, year={2026},
198
- doi={10.48550/arXiv.2607.26712}, url={https://arxiv.org/abs/2607.26712}
199
  }
200
 
201
  @article{zhang2026dwm,
202
  title={{DWM}: Separating World Effects from Actions in Latent World Models},
203
  author={Zhang, Yi-Ge and Du, Tianqi and Zhang, Qi and Wang, Yisen},
204
  journal={arXiv preprint arXiv:2607.18715}, year={2026},
205
- doi={10.48550/arXiv.2607.18715}, url={https://arxiv.org/abs/2607.18715}
206
  }
207
 
208
  @inproceedings{lee2020cadm,
209
  title={Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learning},
210
  author={Lee, Kimin and Seo, Younggyo and Lee, Seunghyun and Lee, Honglak and Shin, Jinwoo},
211
- booktitle={International Conference on Machine Learning},
212
- pages={5757--5766}, volume={119}, publisher={PMLR}, year={2020},
213
- url={https://proceedings.mlr.press/v119/lee20g.html}
214
  }
215
 
216
  @article{wang2022protocad,
217
  title={Prototypical Context-Aware Dynamics Generalization for High-Dimensional Model-Based Reinforcement Learning},
218
  author={Wang, Junjie and Mu, Yao and Li, Dong and Zhang, Qichao and Zhao, Dongbin and Zhuang, Yuzheng and Luo, Ping and Wang, Bin and Hao, Jianye},
219
  journal={arXiv preprint arXiv:2211.12774}, year={2022},
220
- doi={10.48550/arXiv.2211.12774}, url={https://arxiv.org/abs/2211.12774}
221
  }
222
 
223
  @article{yu2026contextode,
224
  title={Learning Context-Aware Neural ODE Dynamics for Adaptive Robotic Control},
225
  author={Yu, Shao-Yi and Wang, Jen-Wei and Horii, Maya and Tomizuka, Masayoshi and Garg, Vikas},
226
  journal={arXiv preprint arXiv:2606.15469}, year={2026},
227
- doi={10.48550/arXiv.2606.15469}, url={https://arxiv.org/abs/2606.15469}
228
  }
229
 
230
  @inproceedings{jaques2021newtonianvae,
231
  title={{NewtonianVAE}: Proportional Control and Goal Identification from Pixels via Physical Latent Spaces},
232
  author={Jaques, Miguel and Burke, Michael and Hospedales, Timothy},
233
  booktitle={IEEE/CVF Conference on Computer Vision and Pattern Recognition},
234
- year={2021}, url={https://arxiv.org/abs/2006.01959}
235
  }
236
 
237
  @book{fossen2021handbook,
@@ -246,7 +243,7 @@
246
  @inproceedings{liu2018coordconv,
247
  title = {An Intriguing Failing of Convolutional Neural Networks and the {CoordConv} Solution},
248
  author = {Liu, Rosanne and Lehman, Joel and Molino, Piero and Such, Felipe Petroski and Frank, Eric and Sergeev, Alex and Yosinski, Jason},
249
- booktitle = {Advances in Neural Information Processing Systems},
250
  volume = {31},
251
  year = {2018}
252
  }
@@ -271,18 +268,18 @@
271
  @inproceedings{loshchilov2019decoupled,
272
  title = {Decoupled Weight Decay Regularization},
273
  author = {Loshchilov, Ilya and Hutter, Frank},
274
- booktitle = {International Conference on Learning Representations},
275
  year = {2019}
276
  }
277
 
278
  @inproceedings{hansen2022tdmpc,
279
  title = {Temporal Difference Learning for Model Predictive Control},
280
  author = {Hansen, Nicklas A. and Su, Hao and Wang, Xiaolong},
281
- booktitle = {Proceedings of the 39th International Conference on Machine Learning},
282
  pages = {8387--8406},
283
  year = {2022},
284
  volume = {162},
285
- series = {Proceedings of Machine Learning Research}
286
  }
287
 
288
  @article{alain2016understanding,
@@ -302,3 +299,31 @@
302
  year = {2019},
303
  doi = {10.1016/j.automatica.2018.11.008}
304
  }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  @inproceedings{hafner2019planet,
12
  title = {Learning Latent Dynamics for Planning from Pixels},
13
  author = {Hafner, Danijar and Lillicrap, Timothy and Fischer, Ian and Villegas, Ruben and Ha, David and Lee, Honglak and Davidson, James},
14
+ booktitle = {Proc. Int. Conf. Mach. Learn. (ICML)},
15
  pages = {2555--2565},
16
  year = {2019},
17
  volume = {97},
18
+ series = {PMLR}
19
  }
20
 
21
  @inproceedings{hafner2020dreamer,
22
  title = {Dream to Control: Learning Behaviors by Latent Imagination},
23
  author = {Hafner, Danijar and Lillicrap, Timothy and Ba, Jimmy and Norouzi, Mohammad},
24
+ booktitle = {Int. Conf. Learn. Represent. (ICLR)},
25
  year = {2020}
26
  }
27
 
 
35
  @inproceedings{hansen2024tdmpc2,
36
  title = {{TD-MPC2}: Scalable, Robust World Models for Continuous Control},
37
  author = {Hansen, Nicklas and Su, Hao and Wang, Xiaolong},
38
+ booktitle = {Int. Conf. Learn. Represent. (ICLR)},
39
  year = {2024}
40
  }
41
 
42
  @inproceedings{wu2023daydreamer,
43
  title = {{DayDreamer}: World Models for Physical Robot Learning},
44
  author = {Wu, Philipp and Escontrela, Alejandro and Hafner, Danijar and Abbeel, Pieter and Goldberg, Ken},
45
+ booktitle = {Proc. Conf. Robot Learn. (CoRL)},
46
  pages = {2226--2240},
47
  year = {2023},
48
  volume = {205},
49
+ series = {PMLR}
50
  }
51
 
52
  @article{fossen2017ilos,
 
84
  @inproceedings{karl2017dvbf,
85
  title = {Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data},
86
  author = {Karl, Maximilian and Soelch, Maximilian and Bayer, Justin and van der Smagt, Patrick},
87
+ booktitle = {Int. Conf. Learn. Represent. (ICLR)},
88
  year = {2017}
89
  }
90
 
91
  @inproceedings{han2020vrm,
92
  title = {Variational Recurrent Models for Solving Partially Observable Control Tasks},
93
  author = {Han, Dongqi and Doya, Kenji and Tani, Jun},
94
+ booktitle = {Int. Conf. Learn. Represent. (ICLR)},
95
  year = {2020}
96
  }
97
 
 
134
  @inproceedings{rakelly2019pearl,
135
  title = {Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables},
136
  author = {Rakelly, Kate and Zhou, Aurick and Finn, Chelsea and Levine, Sergey and Quillen, Deirdre},
137
+ booktitle = {Proc. Int. Conf. Mach. Learn. (ICML)},
138
  pages = {5331--5340},
139
  year = {2019},
140
  volume = {97},
141
+ series = {PMLR}
142
  }
143
 
144
  @inproceedings{zintgraf2020varibad,
145
  title = {{VariBAD}: A Very Good Method for Bayes-Adaptive Deep {RL} via Meta-Learning},
146
  author = {Zintgraf, Luisa and Shiarlis, Kyriacos and Igl, Maximilian and Schulze, Sebastian and Gal, Yarin and Hofmann, Katja and Whiteson, Shimon},
147
+ booktitle = {Int. Conf. Learn. Represent. (ICLR)},
148
  year = {2020}
149
  }
150
 
151
  @inproceedings{wu2023contextwm,
152
  title = {Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning},
153
  author = {Wu, Jialong and Ma, Haoyu and Deng, Chaoyi and Long, Mingsheng},
154
+ booktitle = {Adv. Neural Inf. Process. Syst.},
155
  volume = {36},
156
  year = {2023}
157
  }
 
159
  @inproceedings{wang2022denoisedmdp,
160
  title = {Denoised {MDPs}: Learning World Models Better Than the World Itself},
161
  author = {Wang, Tongzhou and Du, Simon and Torralba, Antonio and Isola, Phillip and Zhang, Amy and Tian, Yuandong},
162
+ booktitle = {Proc. Int. Conf. Mach. Learn. (ICML)},
163
  pages = {22591--22612},
164
  year = {2022},
165
  volume = {162},
166
+ series = {PMLR}
167
  }
168
 
169
  @inproceedings{islam2023acro,
170
  title = {Principled Offline {RL} in the Presence of Rich Exogenous Information},
171
  author = {Islam, Riashat and Tomar, Manan and Lamb, Alex and Efroni, Yonathan and Zang, Hongyu and Didolkar, Aniket Rajiv and Misra, Dipendra and Li, Xin and Van Seijen, Harm and Tachet Des Combes, Remi and Langford, John},
172
+ booktitle = {Proc. Int. Conf. Mach. Learn. (ICML)},
173
  pages = {14390--14421},
174
  year = {2023},
175
  volume = {202},
176
+ series = {PMLR}
177
  }
178
 
179
  @inproceedings{zhou2025dinowm,
180
  title={{DINO-WM}: World Models on Pre-trained Visual Features enable Zero-shot Planning},
181
  author={Zhou, Gaoyue and Pan, Hengkai and LeCun, Yann and Pinto, Lerrel},
182
+ booktitle={Proc. Int. Conf. Mach. Learn. (ICML)}, volume={267},
183
+ series={PMLR}, pages={79115--79135}, year={2025}
 
184
  }
185
 
186
  @inproceedings{pan2022isodream,
187
  title={{Iso-Dream}: Isolating and Leveraging Noncontrollable Visual Dynamics in World Models},
188
  author={Pan, Minting and Zhu, Xiangming and Wang, Yunbo and Yang, Xiaokang},
189
+ booktitle={Adv. Neural Inf. Process. Syst.}, volume={35}, year={2022}
 
190
  }
191
 
192
  @article{gan2026actswm,
193
  title={{ActSWM}: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games},
194
  author={Gan, Zhenfeng and Zeng, ZiTong and Cheng, Jiajun and Song, Yeke and Tang, Yongyi and Wang, Xueqian},
195
  journal={arXiv preprint arXiv:2607.26712}, year={2026},
196
+ doi={10.48550/arXiv.2607.26712}
197
  }
198
 
199
  @article{zhang2026dwm,
200
  title={{DWM}: Separating World Effects from Actions in Latent World Models},
201
  author={Zhang, Yi-Ge and Du, Tianqi and Zhang, Qi and Wang, Yisen},
202
  journal={arXiv preprint arXiv:2607.18715}, year={2026},
203
+ doi={10.48550/arXiv.2607.18715}
204
  }
205
 
206
  @inproceedings{lee2020cadm,
207
  title={Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learning},
208
  author={Lee, Kimin and Seo, Younggyo and Lee, Seunghyun and Lee, Honglak and Shin, Jinwoo},
209
+ booktitle={Proc. Int. Conf. Mach. Learn. (ICML)},
210
+ pages={5757--5766}, volume={119}, publisher={PMLR}, year={2020}
 
211
  }
212
 
213
  @article{wang2022protocad,
214
  title={Prototypical Context-Aware Dynamics Generalization for High-Dimensional Model-Based Reinforcement Learning},
215
  author={Wang, Junjie and Mu, Yao and Li, Dong and Zhang, Qichao and Zhao, Dongbin and Zhuang, Yuzheng and Luo, Ping and Wang, Bin and Hao, Jianye},
216
  journal={arXiv preprint arXiv:2211.12774}, year={2022},
217
+ doi={10.48550/arXiv.2211.12774}
218
  }
219
 
220
  @article{yu2026contextode,
221
  title={Learning Context-Aware Neural ODE Dynamics for Adaptive Robotic Control},
222
  author={Yu, Shao-Yi and Wang, Jen-Wei and Horii, Maya and Tomizuka, Masayoshi and Garg, Vikas},
223
  journal={arXiv preprint arXiv:2606.15469}, year={2026},
224
+ doi={10.48550/arXiv.2606.15469}
225
  }
226
 
227
  @inproceedings{jaques2021newtonianvae,
228
  title={{NewtonianVAE}: Proportional Control and Goal Identification from Pixels via Physical Latent Spaces},
229
  author={Jaques, Miguel and Burke, Michael and Hospedales, Timothy},
230
  booktitle={IEEE/CVF Conference on Computer Vision and Pattern Recognition},
231
+ year={2021}
232
  }
233
 
234
  @book{fossen2021handbook,
 
243
  @inproceedings{liu2018coordconv,
244
  title = {An Intriguing Failing of Convolutional Neural Networks and the {CoordConv} Solution},
245
  author = {Liu, Rosanne and Lehman, Joel and Molino, Piero and Such, Felipe Petroski and Frank, Eric and Sergeev, Alex and Yosinski, Jason},
246
+ booktitle = {Adv. Neural Inf. Process. Syst.},
247
  volume = {31},
248
  year = {2018}
249
  }
 
268
  @inproceedings{loshchilov2019decoupled,
269
  title = {Decoupled Weight Decay Regularization},
270
  author = {Loshchilov, Ilya and Hutter, Frank},
271
+ booktitle = {Int. Conf. Learn. Represent. (ICLR)},
272
  year = {2019}
273
  }
274
 
275
  @inproceedings{hansen2022tdmpc,
276
  title = {Temporal Difference Learning for Model Predictive Control},
277
  author = {Hansen, Nicklas A. and Su, Hao and Wang, Xiaolong},
278
+ booktitle = {Proc. Int. Conf. Mach. Learn. (ICML)},
279
  pages = {8387--8406},
280
  year = {2022},
281
  volume = {162},
282
+ series = {PMLR}
283
  }
284
 
285
  @article{alain2016understanding,
 
299
  year = {2019},
300
  doi = {10.1016/j.automatica.2018.11.008}
301
  }
302
+
303
+ @inproceedings{shaj2023mts3,
304
+ title = {Multi Time Scale World Models},
305
+ author = {Shaj, Vaisakh and Gholam Zadeh, Saleh and Demir, Ozan and Douat, Luiz Ricardo and Neumann, Gerhard},
306
+ booktitle = {Adv. Neural Inf. Process. Syst.},
307
+ volume = {36},
308
+ year = {2023},
309
+ doi = {10.52202/075280-1163}
310
+ }
311
+
312
+ @inproceedings{wang2026sfrssm,
313
+ title = {Beyond Single-Speed Reasoning: Coordinating Fast and Slow Dynamics for Efficient World Modeling},
314
+ author = {Wang, Hongwei and Huang, Yangru and Chen, Guangyao and Wang, Xu and Jin, Yi},
315
+ booktitle = {Proc. AAAI Conf. Artif. Intell.},
316
+ volume = {40},
317
+ number = {31},
318
+ pages = {26215--26223},
319
+ year = {2026},
320
+ doi = {10.1609/aaai.v40i31.39825}
321
+ }
322
+
323
+ @article{jain2026weaver,
324
+ title = {{WEAVER}, Better, Faster, Longer: An Effective World Model for Robotic Manipulation},
325
+ author = {Jain, Arnav Kumar and Wu, Yilin and Farebrother, Jesse and Swamy, Gokul and Bajcsy, Andrea},
326
+ journal = {arXiv preprint arXiv:2606.13672},
327
+ year = {2026},
328
+ doi = {10.48550/arXiv.2606.13672}
329
+ }