KhalilGao commited on
Commit
b00df57
·
verified ·
1 Parent(s): 925cbb7

Add files using upload-large-folder tool

Browse files
.gitattributes ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ *.pt filter=lfs diff=lfs merge=lfs -text
2
+ *.pth filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
5
+ *.onnx filter=lfs diff=lfs merge=lfs -text
6
+ *.h5 filter=lfs diff=lfs merge=lfs -text
7
+ *.tflite filter=lfs diff=lfs merge=lfs -text
8
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
9
+ *.zip filter=lfs diff=lfs merge=lfs -text
10
+ *.7z filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,201 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Apache License
2
+ Version 2.0, January 2004
3
+ http://www.apache.org/licenses/
4
+
5
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
6
+
7
+ 1. Definitions.
8
+
9
+ "License" shall mean the terms and conditions for use, reproduction,
10
+ and distribution as defined by Sections 1 through 9 of this document.
11
+
12
+ "Licensor" shall mean the copyright owner or entity authorized by
13
+ the copyright owner that is granting the License.
14
+
15
+ "Legal Entity" shall mean the union of the acting entity and all
16
+ other entities that control, are controlled by, or are under common
17
+ control with that entity. For the purposes of this definition,
18
+ "control" means (i) the power, direct or indirect, to cause the
19
+ direction or management of such entity, whether by contract or
20
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
21
+ outstanding shares, or (iii) beneficial ownership of such entity.
22
+
23
+ "You" (or "Your") shall mean an individual or Legal Entity
24
+ exercising permissions granted by this License.
25
+
26
+ "Source" form shall mean the preferred form for making modifications,
27
+ including but not limited to software source code, documentation
28
+ source, and configuration files.
29
+
30
+ "Object" form shall mean any form resulting from mechanical
31
+ transformation or translation of a Source form, including but
32
+ not limited to compiled object code, generated documentation,
33
+ and conversions to other media types.
34
+
35
+ "Work" shall mean the work of authorship, whether in Source or
36
+ Object form, made available under the License, as indicated by a
37
+ copyright notice that is included in or attached to the work
38
+ (an example is provided in the Appendix below).
39
+
40
+ "Derivative Works" shall mean any work, whether in Source or Object
41
+ form, that is based on (or derived from) the Work and for which the
42
+ editorial revisions, annotations, elaborations, or other modifications
43
+ represent, as a whole, an original work of authorship. For the purposes
44
+ of this License, Derivative Works shall not include works that remain
45
+ separable from, or merely link (or bind by name) to the interfaces of,
46
+ the Work and Derivative Works thereof.
47
+
48
+ "Contribution" shall mean any work of authorship, including
49
+ the original version of the Work and any modifications or additions
50
+ to that Work or Derivative Works thereof, that is intentionally
51
+ submitted to Licensor for inclusion in the Work by the copyright owner
52
+ or by an individual or Legal Entity authorized to submit on behalf of
53
+ the copyright owner. For the purposes of this definition, "submitted"
54
+ means any form of electronic, verbal, or written communication sent
55
+ to the Licensor or its representatives, including but not limited to
56
+ communication on electronic mailing lists, source code control systems,
57
+ and issue tracking systems that are managed by, or on behalf of, the
58
+ Licensor for the purpose of discussing and improving the Work, but
59
+ excluding communication that is conspicuously marked or otherwise
60
+ designated in writing by the copyright owner as "Not a Contribution."
61
+
62
+ "Contributor" shall mean Licensor and any individual or Legal Entity
63
+ on behalf of whom a Contribution has been received by Licensor and
64
+ subsequently incorporated within the Work.
65
+
66
+ 2. Grant of Copyright License. Subject to the terms and conditions of
67
+ this License, each Contributor hereby grants to You a perpetual,
68
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
69
+ copyright license to reproduce, prepare Derivative Works of,
70
+ publicly display, publicly perform, sublicense, and distribute the
71
+ Work and such Derivative Works in Source or Object form.
72
+
73
+ 3. Grant of Patent License. Subject to the terms and conditions of
74
+ this License, each Contributor hereby grants to You a perpetual,
75
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
76
+ (except as stated in this section) patent license to make, have made,
77
+ use, offer to sell, sell, import, and otherwise transfer the Work,
78
+ where such license applies only to those patent claims licensable
79
+ by such Contributor that are necessarily infringed by their
80
+ Contribution(s) alone or by combination of their Contribution(s)
81
+ with the Work to which such Contribution(s) was submitted. If You
82
+ institute patent litigation against any entity (including a
83
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
84
+ or a Contribution incorporated within the Work constitutes direct
85
+ or contributory patent infringement, then any patent licenses
86
+ granted to You under this License for that Work shall terminate
87
+ as of the date such litigation is filed.
88
+
89
+ 4. Redistribution. You may reproduce and distribute copies of the
90
+ Work or Derivative Works thereof in any medium, with or without
91
+ modifications, and in Source or Object form, provided that You
92
+ meet the following conditions:
93
+
94
+ (a) You must give any other recipients of the Work or
95
+ Derivative Works a copy of this License; and
96
+
97
+ (b) You must cause any modified files to carry prominent notices
98
+ stating that You changed the files; and
99
+
100
+ (c) You must retain, in the Source form of any Derivative Works
101
+ that You distribute, all copyright, patent, trademark, and
102
+ attribution notices from the Source form of the Work,
103
+ excluding those notices that do not pertain to any part of
104
+ the Derivative Works; and
105
+
106
+ (d) If the Work includes a "NOTICE" text file as part of its
107
+ distribution, then any Derivative Works that You distribute must
108
+ include a readable copy of the attribution notices contained
109
+ within such NOTICE file, excluding those notices that do not
110
+ pertain to any part of the Derivative Works, in at least one
111
+ of the following places: within a NOTICE text file distributed
112
+ as part of the Derivative Works; within the Source form or
113
+ documentation, if provided along with the Derivative Works; or,
114
+ within a display generated by the Derivative Works, if and
115
+ wherever such third-party notices normally appear. The contents
116
+ of the NOTICE file are for informational purposes only and
117
+ do not modify the License. You may add Your own attribution
118
+ notices within Derivative Works that You distribute, alongside
119
+ or as an addendum to the NOTICE text from the Work, provided
120
+ that such additional attribution notices cannot be construed
121
+ as modifying the License.
122
+
123
+ You may add Your own copyright statement to Your modifications and
124
+ may provide additional or different license terms and conditions
125
+ for use, reproduction, or distribution of Your modifications, or
126
+ for any such Derivative Works as a whole, provided Your use,
127
+ reproduction, and distribution of the Work otherwise complies with
128
+ the conditions stated in this License.
129
+
130
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
131
+ any Contribution intentionally submitted for inclusion in the Work
132
+ by You to the Licensor shall be under the terms and conditions of
133
+ this License, without any additional terms or conditions.
134
+ Notwithstanding the above, nothing herein shall supersede or modify
135
+ the terms of any separate license agreement you may have executed
136
+ with Licensor regarding such Contributions.
137
+
138
+ 6. Trademarks. This License does not grant permission to use the trade
139
+ names, trademarks, service marks, or product names of the Licensor,
140
+ except as required for reasonable and customary use in describing the
141
+ origin of the Work and reproducing the content of the NOTICE file.
142
+
143
+ 7. Disclaimer of Warranty. Unless required by applicable law or
144
+ agreed to in writing, Licensor provides the Work (and each
145
+ Contributor provides its Contributions) on an "AS IS" BASIS,
146
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
147
+ implied, including, without limitation, any warranties or conditions
148
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
149
+ PARTICULAR PURPOSE. You are solely responsible for determining the
150
+ appropriateness of using or redistributing the Work and assume any
151
+ risks associated with Your exercise of permissions under this License.
152
+
153
+ 8. Limitation of Liability. In no event and under no legal theory,
154
+ whether in tort (including negligence), contract, or otherwise,
155
+ unless required by applicable law (such as deliberate and grossly
156
+ negligent acts) or agreed to in writing, shall any Contributor be
157
+ liable to You for damages, including any direct, indirect, special,
158
+ incidental, or consequential damages of any character arising as a
159
+ result of this License or out of the use or inability to use the
160
+ Work (including but not limited to damages for loss of goodwill,
161
+ work stoppage, computer failure or malfunction, or any and all
162
+ other commercial damages or losses), even if such Contributor
163
+ has been advised of the possibility of such damages.
164
+
165
+ 9. Accepting Warranty or Additional Liability. While redistributing
166
+ the Work or Derivative Works thereof, You may choose to offer,
167
+ and charge a fee for, acceptance of support, warranty, indemnity,
168
+ or other liability obligations and/or rights consistent with this
169
+ License. However, in accepting such obligations, You may act only
170
+ on Your own behalf and on Your sole responsibility, not on behalf
171
+ of any other Contributor, and only if You agree to indemnify,
172
+ defend, and hold each Contributor harmless for any liability
173
+ incurred by, or claims asserted against, such Contributor by reason
174
+ of your accepting any such warranty or additional liability.
175
+
176
+ END OF TERMS AND CONDITIONS
177
+
178
+ APPENDIX: How to apply the Apache License to your work.
179
+
180
+ To apply the Apache License to your work, attach the following
181
+ boilerplate notice, with the fields enclosed by brackets "[]"
182
+ replaced with your own identifying information. (Don't include
183
+ the brackets!) The text should be enclosed in the appropriate
184
+ comment syntax for the file format. We also recommend that a
185
+ file or class name and description of purpose be included on the
186
+ same "printed page" as the copyright notice for easier
187
+ identification within third-party archives.
188
+
189
+ Copyright [yyyy] [name of copyright owner]
190
+
191
+ Licensed under the Apache License, Version 2.0 (the "License");
192
+ you may not use this file except in compliance with the License.
193
+ You may obtain a copy of the License at
194
+
195
+ http://www.apache.org/licenses/LICENSE-2.0
196
+
197
+ Unless required by applicable law or agreed to in writing, software
198
+ distributed under the License is distributed on an "AS IS" BASIS,
199
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
200
+ See the License for the specific language governing permissions and
201
+ limitations under the License.
MODEL_MANIFEST.json ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema_version": 1,
3
+ "repo_id": "KhalilGao/DynamicWAM",
4
+ "release_date": "2026-08-01",
5
+ "source_repository": "https://github.com/Autumn1337/DynamicWAM",
6
+ "source_revision_at_release": "7d4e83916e2b29bb675c651db5b62eb8b7e9ed9a",
7
+ "variants": [
8
+ {
9
+ "id": "dynamicwam_wo_motion",
10
+ "display_name": "DynamicWAM (w/o motion)",
11
+ "checkpoint": {
12
+ "path": "checkpoints/dynamicwam_wo_motion/model.pt",
13
+ "size_bytes": 1976638827,
14
+ "sha256": "fa88a1f33f2205db5a4534e09bb02d1bee9dea7b2049299ac68932a34de82f03",
15
+ "global_step": 40000,
16
+ "top_level_keys": ["config", "global_step", "model"],
17
+ "state_dict_key_count": 470
18
+ },
19
+ "action_statistics": {
20
+ "path": "checkpoints/dynamicwam_wo_motion/action_stats.json",
21
+ "size_bytes": 1775,
22
+ "sha256": "730a91e41b6a23c70cec49cd222835373ba9364680da5753f4408c5534319b04"
23
+ },
24
+ "motion_conditioning": {
25
+ "history_flow_rgb": true,
26
+ "explicit_absolute_motion_descriptors": false
27
+ },
28
+ "training_data": {
29
+ "repo_id": "KhalilGao/DynamicWAM-data",
30
+ "path": "dynamicwam_wo_motion",
31
+ "dataset_fingerprint": "bc20355aa094585499c2ade05d8bcfdb1f082aabc73259ebcded694e3301c425"
32
+ },
33
+ "domino_level1": {
34
+ "task_count": 35,
35
+ "episodes_per_task": 100,
36
+ "successes": 953,
37
+ "episodes": 3500,
38
+ "success_rate_percent": 27.228571428571428,
39
+ "manipulation_score": 41.6244
40
+ }
41
+ },
42
+ {
43
+ "id": "dynamicwam",
44
+ "display_name": "DynamicWAM",
45
+ "checkpoint": {
46
+ "path": "checkpoints/dynamicwam/model.pt",
47
+ "size_bytes": 1977857939,
48
+ "sha256": "7c0dfc44a785ea1f6bd1f833f09dcadc2e470dadb1ba5508fa98918e147671d7",
49
+ "global_step": 40000,
50
+ "format": "dynamicwam_absolute_motion_checkpoint",
51
+ "version": 2
52
+ },
53
+ "action_statistics": {
54
+ "path": "checkpoints/dynamicwam/action_stats.json",
55
+ "size_bytes": 1775,
56
+ "sha256": "730a91e41b6a23c70cec49cd222835373ba9364680da5753f4408c5534319b04"
57
+ },
58
+ "motion_conditioning": {
59
+ "history_flow_rgb": true,
60
+ "explicit_absolute_motion_descriptors": true
61
+ },
62
+ "training_data": {
63
+ "repo_id": "KhalilGao/DOMINO_absolute_motion_v2",
64
+ "dataset_fingerprint": "2feac8645817e3a896afd855341130f23a6d92bfd28917f4cb3e2dbb4eb68154"
65
+ },
66
+ "domino_level1": {
67
+ "task_count": 35,
68
+ "episodes_per_task": 100,
69
+ "successes": 1337,
70
+ "episodes": 3500,
71
+ "success_rate_percent": 38.2,
72
+ "manipulation_score": 53.16
73
+ }
74
+ }
75
+ ]
76
+ }
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: pytorch
4
+ tags:
5
+ - robotics
6
+ - robot-manipulation
7
+ - world-model
8
+ - imitation-learning
9
+ - video-policy
10
+ - optical-flow
11
+ - domino
12
+ - dynamicwam
13
+ ---
14
+
15
+ # DynamicWAM
16
+
17
+ Official DynamicWAM checkpoints for DOMINO manipulation. This repository is
18
+ organized by paper-facing model variant; each checkpoint is paired with its
19
+ action-normalization statistics and immutable configuration snapshots.
20
+
21
+ ## Released variants
22
+
23
+ | Paper name | Checkpoint | Motion conditioning | DOMINO Level 1 |
24
+ |---|---|---|---:|
25
+ | **DynamicWAM (w/o motion)** | [`checkpoints/dynamicwam_wo_motion/model.pt`](checkpoints/dynamicwam_wo_motion/model.pt) | Four history Flow-RGB intervals; **no explicit absolute-motion descriptor tokens** | 953/3,500, SR 27.23%, MS 41.6244 |
26
+ | **DynamicWAM** | [`checkpoints/dynamicwam/model.pt`](checkpoints/dynamicwam/model.pt) | History Flow RGB + exact-time absolute-motion descriptors | 1,337/3,500, SR 38.20%, MS 53.16 |
27
+
28
+ “w/o motion” refers specifically to removing the explicit numeric
29
+ absolute-motion/kinematic descriptor branch. It does **not** mean that optical
30
+ flow is removed: the variant still consumes history Flow RGB.
31
+
32
+ The reported numbers are the archived 35-task × 100-episode DOMINO Level 1
33
+ system results. They are not a newly rerun benchmark and should not be
34
+ interpreted as a matched one-variable causal estimate beyond the named model
35
+ variants.
36
+
37
+ ## Repository layout
38
+
39
+ ```text
40
+ checkpoints/
41
+ ├── dynamicwam_wo_motion/
42
+ │ ├── model.pt
43
+ │ └── action_stats.json
44
+ └── dynamicwam/
45
+ ├── model.pt
46
+ └── action_stats.json
47
+ configs/
48
+ ├── dynamicwam_wo_motion/
49
+ │ ├── stage1_video.yaml
50
+ │ ├── stage2_action.yaml
51
+ │ ├── stage3_joint.yaml
52
+ │ └── deploy.yaml
53
+ └── dynamicwam/
54
+ └── absolute_motion_v2.yaml
55
+ MODEL_MANIFEST.json
56
+ SHA256SUMS
57
+ ```
58
+
59
+ The `dynamicwam_wo_motion` YAML files are exact historical configuration
60
+ snapshots and therefore retain their original cluster paths. Remap those paths
61
+ to your local checkout and downloaded assets before training or evaluation.
62
+
63
+ ## Download
64
+
65
+ ```bash
66
+ hf download KhalilGao/DynamicWAM \
67
+ --include "checkpoints/dynamicwam_wo_motion/*" \
68
+ --include "configs/dynamicwam_wo_motion/*" \
69
+ --local-dir external/DynamicWAM
70
+ ```
71
+
72
+ The matching packed training corpus is published at
73
+ [`KhalilGao/DynamicWAM-data`](https://huggingface.co/datasets/KhalilGao/DynamicWAM-data)
74
+ under `dynamicwam_wo_motion/`.
75
+
76
+ ## Checkpoint identity
77
+
78
+ | Variant | Global step | Size (bytes) | SHA-256 |
79
+ |---|---:|---:|---|
80
+ | DynamicWAM (w/o motion) | 40,000 | 1,976,638,827 | `fa88a1f33f2205db5a4534e09bb02d1bee9dea7b2049299ac68932a34de82f03` |
81
+ | DynamicWAM | 40,000 | 1,977,857,939 | `7c0dfc44a785ea1f6bd1f833f09dcadc2e470dadb1ba5508fa98918e147671d7` |
82
+
83
+ Both are native PyTorch checkpoint dictionaries. As with any pickle-backed
84
+ PyTorch artifact, load them only from a trusted revision and verify the hashes
85
+ in `SHA256SUMS` first.
86
+
87
+ ## External assets
88
+
89
+ The checkpoints do not bundle Wan2.2-TI2V-5B, its tokenizer/VAE, the DOMINO
90
+ runtime, CuRobo, or simulator assets. See the
91
+ [`DynamicWAM` source repository](https://github.com/Autumn1337/DynamicWAM)
92
+ for environment and evaluation setup.
93
+
94
+ ## License
95
+
96
+ Project-owned release material is provided under Apache-2.0. Upstream assets
97
+ retain their own licenses; this repository does not relicense or redistribute
98
+ the external runtime dependencies listed above.
SHA256SUMS ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ bc62c80cf26f0525af87853e276990ce6bad07a98fdbd4422e070871fc53aef2 ./.gitattributes
2
+ c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 ./LICENSE
3
+ ec85c42b04a8029b79e9205bc355c903f8e0275b8261b1884f6ad45a3480ce3d ./MODEL_MANIFEST.json
4
+ 5682a048d98eecb47525779573431c2648a0aae2e8d70ad608c9109db86cd284 ./README.md
5
+ 730a91e41b6a23c70cec49cd222835373ba9364680da5753f4408c5534319b04 ./checkpoints/dynamicwam/action_stats.json
6
+ 7c0dfc44a785ea1f6bd1f833f09dcadc2e470dadb1ba5508fa98918e147671d7 ./checkpoints/dynamicwam/model.pt
7
+ 730a91e41b6a23c70cec49cd222835373ba9364680da5753f4408c5534319b04 ./checkpoints/dynamicwam_wo_motion/action_stats.json
8
+ fa88a1f33f2205db5a4534e09bb02d1bee9dea7b2049299ac68932a34de82f03 ./checkpoints/dynamicwam_wo_motion/model.pt
9
+ 4dc38bc1aced3cb0ec40a90163ffa59bf26865419ddaeb26ae63bfa8ab3a55be ./configs/dynamicwam/absolute_motion_v2.yaml
10
+ f33d734d83fdfdc93501f588292fa265d1df7024aaf6d671b128065b72d30b8c ./configs/dynamicwam_wo_motion/deploy.yaml
11
+ d9bc45ecafe201b868039b580c2449121a2d8d269c41d986c88b96fc1a41d230 ./configs/dynamicwam_wo_motion/stage1_video.yaml
12
+ 3842d0c6519a771ddd774084c7edafb28a8092575709595d33613aba71907d0f ./configs/dynamicwam_wo_motion/stage2_action.yaml
13
+ 977abdbf2c10ca5fe387e4c4501f2d57426a816be06f391d94cdbece27c4771f ./configs/dynamicwam_wo_motion/stage3_joint.yaml
checkpoints/dynamicwam/action_stats.json ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "robotwin_qpos": {
3
+ "error_count": 0,
4
+ "file_count": 26019,
5
+ "max": [
6
+ 2.9645960330963135,
7
+ 3.408608913421631,
8
+ 3.9797866344451904,
9
+ 1.779821515083313,
10
+ 1.9189316034317017,
11
+ 3.9992024898529053,
12
+ 1.0,
13
+ 3.508810043334961,
14
+ 3.41229248046875,
15
+ 3.9269134998321533,
16
+ 1.9578161239624023,
17
+ 1.6463686227798462,
18
+ 3.971259832382202,
19
+ 1.0
20
+ ],
21
+ "mean": [
22
+ -0.22822394967079163,
23
+ 1.0666611194610596,
24
+ 0.7757362723350525,
25
+ -0.29411253333091736,
26
+ 0.046992022544145584,
27
+ -0.04620293527841568,
28
+ 0.6790317296981812,
29
+ 0.22481641173362732,
30
+ 1.0354361534118652,
31
+ 0.7492874264717102,
32
+ -0.28450194001197815,
33
+ 0.008350813761353493,
34
+ 0.014931226149201393,
35
+ 0.6921340227127075
36
+ ],
37
+ "min": [
38
+ -3.841110944747925,
39
+ -0.5869680047035217,
40
+ -0.16984523832798004,
41
+ -1.9564759731292725,
42
+ -1.6609615087509155,
43
+ -3.9677512645721436,
44
+ 0.0,
45
+ -2.9448800086975098,
46
+ -0.6150436401367188,
47
+ -0.10069078207015991,
48
+ -2.1700572967529297,
49
+ -2.190300941467285,
50
+ -3.9965078830718994,
51
+ 0.0
52
+ ],
53
+ "num_workers": 8,
54
+ "processing_time_seconds": 5.688045024871826,
55
+ "qpos_dim": 14,
56
+ "splits": [
57
+ "clean",
58
+ "randomized"
59
+ ],
60
+ "std": [
61
+ 0.30420008301734924,
62
+ 1.0038063526153564,
63
+ 0.7900750041007996,
64
+ 0.7060451507568359,
65
+ 0.31058570742607117,
66
+ 0.6451691389083862,
67
+ 0.45138606429100037,
68
+ 0.29085657000541687,
69
+ 1.022655963897705,
70
+ 0.8035516142845154,
71
+ 0.7121128439903259,
72
+ 0.25685587525367737,
73
+ 0.6549587845802307,
74
+ 0.4463484585285187
75
+ ],
76
+ "total_frames": 4704574,
77
+ "type": "mean_std"
78
+ }
79
+ }
checkpoints/dynamicwam/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c0dfc44a785ea1f6bd1f833f09dcadc2e470dadb1ba5508fa98918e147671d7
3
+ size 1977857939
checkpoints/dynamicwam_wo_motion/action_stats.json ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "robotwin_qpos": {
3
+ "error_count": 0,
4
+ "file_count": 26019,
5
+ "max": [
6
+ 2.9645960330963135,
7
+ 3.408608913421631,
8
+ 3.9797866344451904,
9
+ 1.779821515083313,
10
+ 1.9189316034317017,
11
+ 3.9992024898529053,
12
+ 1.0,
13
+ 3.508810043334961,
14
+ 3.41229248046875,
15
+ 3.9269134998321533,
16
+ 1.9578161239624023,
17
+ 1.6463686227798462,
18
+ 3.971259832382202,
19
+ 1.0
20
+ ],
21
+ "mean": [
22
+ -0.22822394967079163,
23
+ 1.0666611194610596,
24
+ 0.7757362723350525,
25
+ -0.29411253333091736,
26
+ 0.046992022544145584,
27
+ -0.04620293527841568,
28
+ 0.6790317296981812,
29
+ 0.22481641173362732,
30
+ 1.0354361534118652,
31
+ 0.7492874264717102,
32
+ -0.28450194001197815,
33
+ 0.008350813761353493,
34
+ 0.014931226149201393,
35
+ 0.6921340227127075
36
+ ],
37
+ "min": [
38
+ -3.841110944747925,
39
+ -0.5869680047035217,
40
+ -0.16984523832798004,
41
+ -1.9564759731292725,
42
+ -1.6609615087509155,
43
+ -3.9677512645721436,
44
+ 0.0,
45
+ -2.9448800086975098,
46
+ -0.6150436401367188,
47
+ -0.10069078207015991,
48
+ -2.1700572967529297,
49
+ -2.190300941467285,
50
+ -3.9965078830718994,
51
+ 0.0
52
+ ],
53
+ "num_workers": 8,
54
+ "processing_time_seconds": 5.688045024871826,
55
+ "qpos_dim": 14,
56
+ "splits": [
57
+ "clean",
58
+ "randomized"
59
+ ],
60
+ "std": [
61
+ 0.30420008301734924,
62
+ 1.0038063526153564,
63
+ 0.7900750041007996,
64
+ 0.7060451507568359,
65
+ 0.31058570742607117,
66
+ 0.6451691389083862,
67
+ 0.45138606429100037,
68
+ 0.29085657000541687,
69
+ 1.022655963897705,
70
+ 0.8035516142845154,
71
+ 0.7121128439903259,
72
+ 0.25685587525367737,
73
+ 0.6549587845802307,
74
+ 0.4463484585285187
75
+ ],
76
+ "total_frames": 4704574,
77
+ "type": "mean_std"
78
+ }
79
+ }
checkpoints/dynamicwam_wo_motion/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa88a1f33f2205db5a4534e09bb02d1bee9dea7b2049299ac68932a34de82f03
3
+ size 1976638827
configs/dynamicwam/absolute_motion_v2.yaml ADDED
@@ -0,0 +1,267 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # DynamicWAM quality-filtered exact-time absolute-motion production profile.
2
+ # Every executable derives its resolved settings from this file and snapshots
3
+ # both the source bytes and resolved configuration into its run directory.
4
+ schema_version: 2
5
+ baseline: absolute_motion_v2
6
+
7
+ paths:
8
+ project_root: ..
9
+ raw_dataset: data/raw
10
+ source_dataset: data/converted/domino_exact_time
11
+ packed_dataset: data/packed/domino_absolute_motion_v2
12
+ head_flow_cache: data/flow_cache/domino_absolute_motion_v2
13
+ language_embeddings: data/language_embeddings
14
+ wan_root: external/Wan2.2-TI2V-5B
15
+ external_assets_manifest: manifests/external_assets.json
16
+ checkpoint_manifest: manifests/checkpoints.json
17
+ training_runs: outputs/training
18
+ collection_logs: outputs/collection
19
+ pca_artifacts: outputs/stage1_pca
20
+ stage1_checkpoint: outputs/training/absolute_motion_stage1_video/exports/stage1_step_80000.pt
21
+ base_checkpoint: external/checkpoints/DynamicWAM_wo_motion.pt
22
+ base_action_stats: external/checkpoints/DynamicWAM_wo_motion_action_stats.json
23
+ motion_init_checkpoint: outputs/checkpoint_init/absolute_motion_init.pt
24
+ stage2_checkpoint: outputs/training/absolute_motion_stage2_action/exports/stage2_step_80000.pt
25
+ stage3_checkpoint: external/checkpoints/DynamicWAM_full.pt
26
+ action_stats: external/checkpoints/DynamicWAM_full_action_stats.json
27
+ evaluation_runs: outputs/evaluation
28
+
29
+ method:
30
+ flow_matching:
31
+ shift: 5.0
32
+ sigma_min: 0.0
33
+ extra_one_step: true
34
+ training_timesteps: 1000
35
+ observation:
36
+ head_size: [240, 320]
37
+ wrist_size: [120, 160]
38
+ video:
39
+ num_frames: 8
40
+ size: [384, 320]
41
+ future_size: [192, 160]
42
+ global_downsample_rate: 3
43
+ video_action_frequency_ratio: 2
44
+ head_flow:
45
+ count: 4
46
+ policy_stride: 4
47
+ compute_size: [64, 64]
48
+ container_fps: 30.0
49
+ normalization_percentile: 99.0
50
+ farneback:
51
+ pyr_scale: 0.5
52
+ levels: 3
53
+ winsize: 15
54
+ iterations: 3
55
+ poly_n: 5
56
+ poly_sigma: 1.2
57
+ flags: 0
58
+ quality:
59
+ method: forward_backward_consistency_v1
60
+ relative_error: 0.01
61
+ absolute_error_squared: 0.5
62
+ minimum_reliable_fraction: 0.1
63
+ compact_wan:
64
+ precision: bfloat16
65
+ dim: 2048
66
+ ffn_dim: 8192
67
+ num_heads: 16
68
+ num_layers: 12
69
+ head_dim: 128
70
+ hidden_anchor_layers: [1, 3, 5, 7, 9, 12]
71
+ motion_anchor_layers: [6, 8, 10, 12]
72
+ teacher_layer_mapping: [1, 2, 4, 6, 8, 11, 14, 17, 20, 23, 26, 30]
73
+ action_expert:
74
+ dim: 768
75
+ ffn_dim: 3072
76
+ num_layers: 12
77
+ chunk_size: 16
78
+ state_dim: 14
79
+ action_dim: 14
80
+ normalization_epsilon: 1.0e-6
81
+
82
+ collection:
83
+ domino_commit: 9b1f34129323957baff35bcbc866fceca7e02779
84
+ clean_config_name: absolute_motion_clean
85
+ randomized_config_name: absolute_motion_randomized
86
+ clean_episodes_per_task: 150
87
+ randomized_episodes_per_task: 150
88
+ workers_per_gpu: 2
89
+ planner_workers_per_task: 2
90
+ renderer_workers_per_task: 1
91
+ renderer_recycle_attempts: 16
92
+ ready_buffer_episodes: 8
93
+ worker_poll_seconds: 0.25
94
+ collection_raw_mp4: false
95
+ converter_workers: 96
96
+ motion_statistics_workers: 64
97
+
98
+ initialization:
99
+ base_checkpoint_sha256: fa88a1f33f2205db5a4534e09bb02d1bee9dea7b2049299ac68932a34de82f03
100
+ base_action_stats_sha256: 730a91e41b6a23c70cec49cd222835373ba9364680da5753f4408c5534319b04
101
+ torch_seed: 20260718
102
+
103
+ data:
104
+ splits: [clean, randomized]
105
+ samples_per_episode: 10
106
+ sampler_seed: 2026
107
+ language_prompts_per_task: 100
108
+ language_prompt_seed: 2026
109
+ max_open_shards: 16
110
+
111
+ packing:
112
+ shard_size: 10000
113
+ language_items_per_shard: 64
114
+ max_open_shards: 8
115
+ device: cuda
116
+ batch_size: 64
117
+ num_workers: 8
118
+ pin_memory: true
119
+ persistent_workers: true
120
+ prefetch_factor: 2
121
+ qpos_cache_size: 8
122
+ progress_interval_seconds: 2
123
+ log_level: INFO
124
+ distributed_timeout_minutes: 240
125
+
126
+ training:
127
+ common:
128
+ device: cuda
129
+ log_level: INFO
130
+ per_device_batch_size: 16
131
+ gradient_accumulation_steps: 1
132
+ weight_decay: 1.0e-3
133
+ grad_clip_norm: 1.0
134
+ num_workers: 4
135
+ pin_memory: true
136
+ persistent_workers: true
137
+ prefetch_factor: 2
138
+ log_interval: 10
139
+ checkpoint_interval: 40000
140
+ checkpoint_total_limit: 10
141
+ resume_from: ""
142
+ distributed:
143
+ zero_stage: 0
144
+ bf16: true
145
+ steps_per_print: 2000
146
+ stage1_pca:
147
+ episodes: 1000
148
+ subclips_per_episode: 4
149
+ states_per_subclip: 2
150
+ max_tokens_per_layer: 200000
151
+ seed: 2026
152
+ stage1:
153
+ allow_tf32: true
154
+ cudnn_benchmark: true
155
+ max_steps: 80000
156
+ learning_rate: 5.0e-5
157
+ min_lr_ratio: 0.001
158
+ warmup_steps: 1000
159
+ projection_dim: 256
160
+ hidden_teacher_layers: [1, 4, 8, 14, 20, 30]
161
+ motion_teacher_layers: [11, 17, 23, 30]
162
+ lambda_gt: 1.0
163
+ lambda_hidden_schedule: [0.2, 0.1, 0.0]
164
+ lambda_motion_schedule: [0.2, 0.1, 0.0]
165
+ schedule_boundaries: [0.35, 0.75, 1.0]
166
+ timestep_sampler:
167
+ uniform_weight: 0.25
168
+ low_center: 0.25
169
+ low_weight: 1.0
170
+ mid_center: 0.50
171
+ mid_weight: 1.25
172
+ high_center: 0.75
173
+ high_weight: 0.75
174
+ width: 0.22
175
+ sigma_loss_weights:
176
+ gt:
177
+ max_sigma: 0.75
178
+ softness: 0.12
179
+ floor: 0.25
180
+ hidden:
181
+ center: 0.50
182
+ width: 0.25
183
+ floor: 0.20
184
+ motion:
185
+ center: 0.50
186
+ width: 0.30
187
+ floor: 0.20
188
+ stage2:
189
+ max_steps: 80000
190
+ learning_rate: 5.0e-5
191
+ min_lr_ratio: 1.0e-5
192
+ warmup_steps: 0
193
+ action_weight: 1.0
194
+ stage3:
195
+ max_steps: 40000
196
+ action_learning_rate: 5.0e-5
197
+ video_learning_rate: 1.0e-5
198
+ min_lr_ratio: 1.0e-5
199
+ warmup_steps: 0
200
+ action_weight: 1.0
201
+ video_weight_initial: 0.01
202
+ video_weight: 0.001
203
+ video_weight_anneal_steps: 2000
204
+
205
+ inference:
206
+ device: cuda
207
+ checkpoint_artifact_id: full
208
+ num_inference_steps: 10
209
+ video_refresh_steps: [0, 1]
210
+ action_interval_ms: 100
211
+ scene_prefix: "The whole scene is in a realistic, industrial art style with three views: a fixed rear camera, a movable left arm camera, and a movable right arm camera. The aloha robot is currently performing the following task: "
212
+
213
+ benchmark:
214
+ policy_registration_name: ciwam.adapters.domino.deploy_policy_sync_flow
215
+ task_config: demo_clean_dynamic
216
+ instruction_type: unseen
217
+ checkpoint_label: absolute-motion-v2-stage3-40k-sync-native-exec16-level1
218
+ dynamic_coefficient: 0.1
219
+ episodes_per_task: 100
220
+ start_seed: 100000
221
+ slot_seed_stride: 100000
222
+ execute_steps: 16
223
+ gpus: ["0", "1", "2", "3", "4", "5", "6", "7"]
224
+ task_timeout_seconds: 86400
225
+ bootstrap_replicates: 2000
226
+ bootstrap_seed: 20260714
227
+ python: external/robotwin/bin/python3.10
228
+ domino_root: external/DOMINO
229
+ eval_policy: external/DOMINO/script/eval_policy.py
230
+ curobo_root: external/curobo/src
231
+ curobo_extension_sha256: 477ce47d82ac8bf7204d3c542f8a818be3ee4fcd0d18cdae7ec57d17aa920b81
232
+ tasks:
233
+ - adjust_bottle
234
+ - dump_bin_bigbin
235
+ - grab_roller
236
+ - handover_block
237
+ - handover_mic
238
+ - hanging_mug
239
+ - move_can_pot
240
+ - move_playingcard_away
241
+ - place_a2b_left
242
+ - place_a2b_right
243
+ - place_bread_skillet
244
+ - place_can_basket
245
+ - place_object_basket
246
+ - put_bottles_dustbin
247
+ - put_object_cabinet
248
+ - rotate_qrcode
249
+ - scan_object
250
+ - shake_bottle
251
+ - shake_bottle_horizontally
252
+ - beat_block_hammer
253
+ - click_alarmclock
254
+ - click_bell
255
+ - move_pillbottle_pad
256
+ - move_stapler_pad
257
+ - place_bread_basket
258
+ - place_container_plate
259
+ - place_empty_cup
260
+ - place_fan
261
+ - place_mouse_pad
262
+ - place_object_scale
263
+ - place_object_stand
264
+ - place_phone_stand
265
+ - place_shoe
266
+ - press_stapler
267
+ - stamp_seal
configs/dynamicwam_wo_motion/deploy.yaml ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ robotwin_root: /data/wam-project/DOMINO
2
+ conda_env: /data/wam-project/envs/RoboTwin
3
+ wan_path: /data/wam-project/weights/Wan2.2-TI2V-5B
4
+
5
+ policy_name: EfficientWAM
6
+ task_name: adjust_bottle
7
+ task_config: demo_clean
8
+ ckpt_setting: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs/stage3_flow_joint/exports/stage3_step_40000.pt
9
+ seed: 42
10
+ instruction_type: unseen
11
+ episode_num: 1
12
+ multi_episode_num: 8
13
+ tasks_file: tasks_all.txt
14
+ gpu_ids: [0]
15
+
16
+ common:
17
+ num_video_frames: 8
18
+ video_height: 384
19
+ video_width: 320
20
+
21
+ action_normalization:
22
+ enabled: true
23
+ type: mean_std
24
+ stats_path: /data/wam-project/datasets/packed/DOMINO_flow_head/action_stats.json
25
+
26
+ model:
27
+ compact_wan:
28
+ precision: bfloat16
29
+ dim: 2048
30
+ ffn_dim: 8192
31
+ num_heads: 16
32
+ num_layers: 12
33
+ head_dim: 128
34
+ future_video_size: [192, 160]
35
+ action_expert:
36
+ dim: 768
37
+ ffn_dim: 3072
38
+ num_layers: 12
39
+ chunk_size: 16
40
+ state_dim: 14
41
+ action_dim: 14
42
+
43
+ inference:
44
+ num_inference_steps: 10
45
+ video_refresh_steps: [0, 1]
46
+ video_stop_cosine_threshold: null
47
+ action_skip_cosine_threshold: null
48
+ teacache:
49
+ enabled: false
50
+ delta: 0.2
51
+ poly_coefficients: null
52
+ sync_distributed: false
53
+ force_last_step: false
54
+ action_enabled: true
55
+ action_delta: null
56
+ action_force_last_step: false
configs/dynamicwam_wo_motion/stage1_video.yaml ADDED
@@ -0,0 +1,102 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ system: stage1_video_distill
2
+ name: stage1_flow_video
3
+ max_steps: 80000
4
+ per_device_batch_size: 16
5
+ gradient_accumulation_steps: 1
6
+ learning_rate: 5.0e-5
7
+ weight_decay: 1.0e-3
8
+ scheduler_type: cosine
9
+ min_lr_ratio: 0.001
10
+ warmup_steps: 1000
11
+ num_workers: 4
12
+ pin_memory: true
13
+ persistent_workers: true
14
+ prefetch_factor: 2
15
+ checkpoint_dir: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs
16
+ log_interval: 10
17
+ checkpoint_interval: 40000
18
+ checkpoint_total_limit: 10
19
+ report_to: tensorboard
20
+ resume_from: ""
21
+
22
+ performance:
23
+ reuse_condition_latent_from_clean: true
24
+ verify_condition_latent_reuse: false
25
+
26
+ dataset:
27
+ type: efficient_wam_train
28
+ root: /data/wam-project/datasets/packed/DOMINO_flow_head
29
+ sampling:
30
+ mode: per_episode_random
31
+ samples_per_episode: 10
32
+ seed: 2026
33
+ language_policy: deterministic
34
+ max_open_shards: 16
35
+ include_metadata: false
36
+ validate_runtime: false
37
+
38
+ teacher:
39
+ mode: distill
40
+ checkpoint_path: /data/wam-project/weights/Wan2.2-TI2V-5B
41
+ config_path: /data/wam-project/weights/Wan2.2-TI2V-5B
42
+ vae_path: /data/wam-project/weights/Wan2.2-TI2V-5B/Wan2.2_VAE.pth
43
+ load_vae: false
44
+ precision: bfloat16
45
+ pca_stats_path: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/artifacts/stage1_pca/pca_stats.pt
46
+
47
+ student:
48
+ init_mode: sliced
49
+ checkpoint_path: /data/wam-project/weights/Wan2.2-TI2V-5B
50
+ config_path: /data/wam-project/weights/Wan2.2-TI2V-5B
51
+ vae_path: /data/wam-project/weights/Wan2.2-TI2V-5B/Wan2.2_VAE.pth
52
+ precision: bfloat16
53
+ dim: 2048
54
+ ffn_dim: 8192
55
+ num_heads: 16
56
+ num_layers: 12
57
+ head_dim: 128
58
+ future_video_size: [192, 160]
59
+ hidden_anchor_layers: [1, 3, 5, 7, 9, 12]
60
+ motion_anchor_layers: [6, 8, 10, 12]
61
+ teacher_layer_mapping: [1, 2, 4, 6, 8, 11, 14, 17, 20, 23, 26, 30]
62
+
63
+ distill:
64
+ projection_dim: 256
65
+ hidden_teacher_layers: [1, 4, 8, 14, 20, 30]
66
+ motion_teacher_layers: [11, 17, 23, 30]
67
+ lambda_gt: 1.0
68
+ lambda_hidden_schedule: [0.2, 0.1, 0.0]
69
+ lambda_motion_schedule: [0.2, 0.1, 0.0]
70
+ lambda_velocity_schedule: [0.0, 0.0, 0.0]
71
+ schedule_boundaries: [0.35, 0.75, 1.0]
72
+ timestep_sampler:
73
+ type: sigma_aware
74
+ uniform_weight: 0.25
75
+ low_center: 0.25
76
+ low_weight: 1.0
77
+ mid_center: 0.50
78
+ mid_weight: 1.25
79
+ high_center: 0.75
80
+ high_weight: 0.75
81
+ width: 0.22
82
+ sigma_loss_weights:
83
+ gt:
84
+ mode: low_mid
85
+ max_sigma: 0.75
86
+ softness: 0.12
87
+ floor: 0.25
88
+ hidden:
89
+ mode: mid
90
+ center: 0.50
91
+ width: 0.25
92
+ floor: 0.20
93
+ motion:
94
+ mode: mid
95
+ center: 0.50
96
+ width: 0.30
97
+ floor: 0.20
98
+ velocity:
99
+ mode: mid_high
100
+ min_sigma: 0.25
101
+ softness: 0.12
102
+ floor: 0.20
configs/dynamicwam_wo_motion/stage2_action.yaml ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ system: stage2_action
2
+ training_stage: stage2
3
+ name: stage2_flow_action
4
+ max_steps: 80000
5
+ per_device_batch_size: 16
6
+ gradient_accumulation_steps: 1
7
+ learning_rate: 5.0e-5
8
+ weight_decay: 1.0e-3
9
+ scheduler_type: cosine
10
+ min_lr_ratio: 0.00001
11
+ warmup_steps: 0
12
+ num_workers: 4
13
+ pin_memory: true
14
+ persistent_workers: true
15
+ prefetch_factor: 2
16
+ checkpoint_dir: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs
17
+ log_interval: 10
18
+ checkpoint_interval: 40000
19
+ checkpoint_total_limit: 10
20
+ report_to: tensorboard
21
+ resume_from: ""
22
+
23
+ performance:
24
+ reuse_condition_latent_from_clean: true
25
+ verify_condition_latent_reuse: false
26
+
27
+ dataset:
28
+ type: efficient_wam_train
29
+ root: /data/wam-project/datasets/packed/DOMINO_flow_head
30
+ sampling:
31
+ mode: per_episode_random
32
+ samples_per_episode: 10
33
+ seed: 2026
34
+ language_policy: deterministic
35
+ max_open_shards: 16
36
+ include_metadata: false
37
+ validate_runtime: false
38
+
39
+ model:
40
+ compact_wan_checkpoint: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs/stage1_flow_video/exports/stage1_step_80000.pt
41
+ compact_wan:
42
+ checkpoint_path: /data/wam-project/weights/Wan2.2-TI2V-5B
43
+ config_path: /data/wam-project/weights/Wan2.2-TI2V-5B
44
+ vae_path: /data/wam-project/weights/Wan2.2-TI2V-5B/Wan2.2_VAE.pth
45
+ precision: bfloat16
46
+ dim: 2048
47
+ ffn_dim: 8192
48
+ num_heads: 16
49
+ num_layers: 12
50
+ head_dim: 128
51
+ future_video_size: [192, 160]
52
+ action_expert:
53
+ dim: 768
54
+ ffn_dim: 3072
55
+ num_layers: 12
56
+ chunk_size: 16
57
+ state_dim: 14
58
+ action_dim: 14
59
+ wan_frozen: true
60
+
61
+ loss:
62
+ type: action_flow_matching
63
+ predict_video: false
64
+ action_weight: 1.0
65
+ video_weight: 0.0
66
+ video_weight_anneal_steps: 0
configs/dynamicwam_wo_motion/stage3_joint.yaml ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ system: stage3_joint
2
+ training_stage: stage3
3
+ name: stage3_flow_joint
4
+ max_steps: 80000
5
+ per_device_batch_size: 16
6
+ gradient_accumulation_steps: 1
7
+ action_learning_rate: 5.0e-5
8
+ video_learning_rate: 1.0e-5
9
+ weight_decay: 1.0e-3
10
+ scheduler_type: cosine
11
+ min_lr_ratio: 0.00001
12
+ warmup_steps: 0
13
+ num_workers: 4
14
+ pin_memory: true
15
+ persistent_workers: true
16
+ prefetch_factor: 2
17
+ checkpoint_dir: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs
18
+ log_interval: 10
19
+ checkpoint_interval: 40000
20
+ checkpoint_total_limit: 10
21
+ report_to: tensorboard
22
+ resume_from: ""
23
+
24
+ performance:
25
+ reuse_condition_latent_from_clean: true
26
+ verify_condition_latent_reuse: false
27
+
28
+ dataset:
29
+ type: efficient_wam_train
30
+ root: /data/wam-project/datasets/packed/DOMINO_flow_head
31
+ sampling:
32
+ mode: per_episode_random
33
+ samples_per_episode: 10
34
+ seed: 2026
35
+ language_policy: deterministic
36
+ max_open_shards: 16
37
+ include_metadata: false
38
+ validate_runtime: false
39
+
40
+ model:
41
+ compact_wan_checkpoint: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs/stage1_flow_video/exports/stage1_step_80000.pt
42
+ action_init_checkpoint: /data/wam-project/experiments/head_flow_official_3stage_80k_v1/runs/stage2_flow_action/exports/stage2_step_80000.pt
43
+ compact_wan:
44
+ checkpoint_path: /data/wam-project/weights/Wan2.2-TI2V-5B
45
+ config_path: /data/wam-project/weights/Wan2.2-TI2V-5B
46
+ vae_path: /data/wam-project/weights/Wan2.2-TI2V-5B/Wan2.2_VAE.pth
47
+ precision: bfloat16
48
+ dim: 2048
49
+ ffn_dim: 8192
50
+ num_heads: 16
51
+ num_layers: 12
52
+ head_dim: 128
53
+ future_video_size: [192, 160]
54
+ action_expert:
55
+ dim: 768
56
+ ffn_dim: 3072
57
+ num_layers: 12
58
+ chunk_size: 16
59
+ state_dim: 14
60
+ action_dim: 14
61
+ wan_frozen: false
62
+
63
+ loss:
64
+ type: mot_joint_flow_matching
65
+ predict_video: true
66
+ action_weight: 1.0
67
+ video_weight_initial: 0.01
68
+ video_weight: 0.001
69
+ video_weight_anneal_steps: 2000
70
+ video_weight_anneal_type: linear