Yuyang-z commited on
Commit
1ca9d17
·
verified ·
1 Parent(s): de9111e

Publish WORL model weights and model card

Browse files

Preserve pinned source weights and configurations; update model documentation, attribution and integrity manifests.

.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/worl-framework.png filter=lfs diff=lfs merge=lfs -text
37
+ assets/worl-teaser.webp filter=lfs diff=lfs merge=lfs -text
LICENSE.txt ADDED
@@ -0,0 +1,201 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Apache License
2
+ Version 2.0, January 2004
3
+ http://www.apache.org/licenses/
4
+
5
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
6
+
7
+ 1. Definitions.
8
+
9
+ "License" shall mean the terms and conditions for use, reproduction,
10
+ and distribution as defined by Sections 1 through 9 of this document.
11
+
12
+ "Licensor" shall mean the copyright owner or entity authorized by
13
+ the copyright owner that is granting the License.
14
+
15
+ "Legal Entity" shall mean the union of the acting entity and all
16
+ other entities that control, are controlled by, or are under common
17
+ control with that entity. For the purposes of this definition,
18
+ "control" means (i) the power, direct or indirect, to cause the
19
+ direction or management of such entity, whether by contract or
20
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
21
+ outstanding shares, or (iii) beneficial ownership of such entity.
22
+
23
+ "You" (or "Your") shall mean an individual or Legal Entity
24
+ exercising permissions granted by this License.
25
+
26
+ "Source" form shall mean the preferred form for making modifications,
27
+ including but not limited to software source code, documentation
28
+ source, and configuration files.
29
+
30
+ "Object" form shall mean any form resulting from mechanical
31
+ transformation or translation of a Source form, including but
32
+ not limited to compiled object code, generated documentation,
33
+ and conversions to other media types.
34
+
35
+ "Work" shall mean the work of authorship, whether in Source or
36
+ Object form, made available under the License, as indicated by a
37
+ copyright notice that is included in or attached to the work
38
+ (an example is provided in the Appendix below).
39
+
40
+ "Derivative Works" shall mean any work, whether in Source or Object
41
+ form, that is based on (or derived from) the Work and for which the
42
+ editorial revisions, annotations, elaborations, or other modifications
43
+ represent, as a whole, an original work of authorship. For the purposes
44
+ of this License, Derivative Works shall not include works that remain
45
+ separable from, or merely link (or bind by name) to the interfaces of,
46
+ the Work and Derivative Works thereof.
47
+
48
+ "Contribution" shall mean any work of authorship, including
49
+ the original version of the Work and any modifications or additions
50
+ to that Work or Derivative Works thereof, that is intentionally
51
+ submitted to Licensor for inclusion in the Work by the copyright owner
52
+ or by an individual or Legal Entity authorized to submit on behalf of
53
+ the copyright owner. For the purposes of this definition, "submitted"
54
+ means any form of electronic, verbal, or written communication sent
55
+ to the Licensor or its representatives, including but not limited to
56
+ communication on electronic mailing lists, source code control systems,
57
+ and issue tracking systems that are managed by, or on behalf of, the
58
+ Licensor for the purpose of discussing and improving the Work, but
59
+ excluding communication that is conspicuously marked or otherwise
60
+ designated in writing by the copyright owner as "Not a Contribution."
61
+
62
+ "Contributor" shall mean Licensor and any individual or Legal Entity
63
+ on behalf of whom a Contribution has been received by Licensor and
64
+ subsequently incorporated within the Work.
65
+
66
+ 2. Grant of Copyright License. Subject to the terms and conditions of
67
+ this License, each Contributor hereby grants to You a perpetual,
68
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
69
+ copyright license to reproduce, prepare Derivative Works of,
70
+ publicly display, publicly perform, sublicense, and distribute the
71
+ Work and such Derivative Works in Source or Object form.
72
+
73
+ 3. Grant of Patent License. Subject to the terms and conditions of
74
+ this License, each Contributor hereby grants to You a perpetual,
75
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
76
+ (except as stated in this section) patent license to make, have made,
77
+ use, offer to sell, sell, import, and otherwise transfer the Work,
78
+ where such license applies only to those patent claims licensable
79
+ by such Contributor that are necessarily infringed by their
80
+ Contribution(s) alone or by combination of their Contribution(s)
81
+ with the Work to which such Contribution(s) was submitted. If You
82
+ institute patent litigation against any entity (including a
83
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
84
+ or a Contribution incorporated within the Work constitutes direct
85
+ or contributory patent infringement, then any patent licenses
86
+ granted to You under this License for that Work shall terminate
87
+ as of the date such litigation is filed.
88
+
89
+ 4. Redistribution. You may reproduce and distribute copies of the
90
+ Work or Derivative Works thereof in any medium, with or without
91
+ modifications, and in Source or Object form, provided that You
92
+ meet the following conditions:
93
+
94
+ (a) You must give any other recipients of the Work or
95
+ Derivative Works a copy of this License; and
96
+
97
+ (b) You must cause any modified files to carry prominent notices
98
+ stating that You changed the files; and
99
+
100
+ (c) You must retain, in the Source form of any Derivative Works
101
+ that You distribute, all copyright, patent, trademark, and
102
+ attribution notices from the Source form of the Work,
103
+ excluding those notices that do not pertain to any part of
104
+ the Derivative Works; and
105
+
106
+ (d) If the Work includes a "NOTICE" text file as part of its
107
+ distribution, then any Derivative Works that You distribute must
108
+ include a readable copy of the attribution notices contained
109
+ within such NOTICE file, excluding those notices that do not
110
+ pertain to any part of the Derivative Works, in at least one
111
+ of the following places: within a NOTICE text file distributed
112
+ as part of the Derivative Works; within the Source form or
113
+ documentation, if provided along with the Derivative Works; or,
114
+ within a display generated by the Derivative Works, if and
115
+ wherever such third-party notices normally appear. The contents
116
+ of the NOTICE file are for informational purposes only and
117
+ do not modify the License. You may add Your own attribution
118
+ notices within Derivative Works that You distribute, alongside
119
+ or as an addendum to the NOTICE text from the Work, provided
120
+ that such additional attribution notices cannot be construed
121
+ as modifying the License.
122
+
123
+ You may add Your own copyright statement to Your modifications and
124
+ may provide additional or different license terms and conditions
125
+ for use, reproduction, or distribution of Your modifications, or
126
+ for any such Derivative Works as a whole, provided Your use,
127
+ reproduction, and distribution of the Work otherwise complies with
128
+ the conditions stated in this License.
129
+
130
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
131
+ any Contribution intentionally submitted for inclusion in the Work
132
+ by You to the Licensor shall be under the terms and conditions of
133
+ this License, without any additional terms or conditions.
134
+ Notwithstanding the above, nothing herein shall supersede or modify
135
+ the terms of any separate license agreement you may have executed
136
+ with Licensor regarding such Contributions.
137
+
138
+ 6. Trademarks. This License does not grant permission to use the trade
139
+ names, trademarks, service marks, or product names of the Licensor,
140
+ except as required for reasonable and customary use in describing the
141
+ origin of the Work and reproducing the content of the NOTICE file.
142
+
143
+ 7. Disclaimer of Warranty. Unless required by applicable law or
144
+ agreed to in writing, Licensor provides the Work (and each
145
+ Contributor provides its Contributions) on an "AS IS" BASIS,
146
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
147
+ implied, including, without limitation, any warranties or conditions
148
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
149
+ PARTICULAR PURPOSE. You are solely responsible for determining the
150
+ appropriateness of using or redistributing the Work and assume any
151
+ risks associated with Your exercise of permissions under this License.
152
+
153
+ 8. Limitation of Liability. In no event and under no legal theory,
154
+ whether in tort (including negligence), contract, or otherwise,
155
+ unless required by applicable law (such as deliberate and grossly
156
+ negligent acts) or agreed to in writing, shall any Contributor be
157
+ liable to You for damages, including any direct, indirect, special,
158
+ incidental, or consequential damages of any character arising as a
159
+ result of this License or out of the use or inability to use the
160
+ Work (including but not limited to damages for loss of goodwill,
161
+ work stoppage, computer failure or malfunction, or any and all
162
+ other commercial damages or losses), even if such Contributor
163
+ has been advised of the possibility of such damages.
164
+
165
+ 9. Accepting Warranty or Additional Liability. While redistributing
166
+ the Work or Derivative Works thereof, You may choose to offer,
167
+ and charge a fee for, acceptance of support, warranty, indemnity,
168
+ or other liability obligations and/or rights consistent with this
169
+ License. However, in accepting such obligations, You may act only
170
+ on Your own behalf and on Your sole responsibility, not on behalf
171
+ of any other Contributor, and only if You agree to indemnify,
172
+ defend, and hold each Contributor harmless for any liability
173
+ incurred by, or claims asserted against, such Contributor by reason
174
+ of your accepting any such warranty or additional liability.
175
+
176
+ END OF TERMS AND CONDITIONS
177
+
178
+ APPENDIX: How to apply the Apache License to your work.
179
+
180
+ To apply the Apache License to your work, attach the following
181
+ boilerplate notice, with the fields enclosed by brackets "[]"
182
+ replaced with your own identifying information. (Don't include
183
+ the brackets!) The text should be enclosed in the appropriate
184
+ comment syntax for the file format. We also recommend that a
185
+ file or class name and description of purpose be included on the
186
+ same "printed page" as the copyright notice for easier
187
+ identification within third-party archives.
188
+
189
+ Copyright [yyyy] [name of copyright owner]
190
+
191
+ Licensed under the Apache License, Version 2.0 (the "License");
192
+ you may not use this file except in compliance with the License.
193
+ You may obtain a copy of the License at
194
+
195
+ http://www.apache.org/licenses/LICENSE-2.0
196
+
197
+ Unless required by applicable law or agreed to in writing, software
198
+ distributed under the License is distributed on an "AS IS" BASIS,
199
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
200
+ See the License for the specific language governing permissions and
201
+ limitations under the License.
NOTICE.txt ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ WORL-Lingbot
2
+
3
+ This release republishes the model artifacts from qyoo/lingbot-worl
4
+ at revision d3e449c675f5a8bfb3afd29e30f1675e4445b9c3, with updated documentation
5
+ and release metadata. Weight and model configuration bytes are unchanged.
6
+
7
+ Base model: https://huggingface.co/robbyant/lingbot-world-fast
8
+ The source model card declares Apache License 2.0. See LICENSE.txt.
9
+ Upstream models and separately obtained runtime components retain their
10
+ respective licenses and attribution notices.
README.md ADDED
@@ -0,0 +1,162 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: robbyant/lingbot-world-fast
4
+ library_name: peft
5
+ pipeline_tag: image-to-video
6
+ inference: false
7
+ tags:
8
+ - worl
9
+ - lingbot
10
+ - world-model
11
+ - video-generation
12
+ - camera-control
13
+ - reinforcement-learning
14
+ - lora
15
+ - safetensors
16
+ ---
17
+
18
+ # WORL-Lingbot
19
+
20
+ **WORL-Lingbot** is a camera-conditioned video world-model policy trained with
21
+ WORL on top of [LingBot-World-Fast](https://huggingface.co/robbyant/lingbot-world-fast).
22
+ It generates video continuations conditioned on an initial image, text and
23
+ camera trajectories.
24
+
25
+ <img src="assets/worl-teaser.webp" alt="WORL long-horizon video generation examples" width="100%">
26
+
27
+ Related releases: [WORL-NVRM](https://huggingface.co/Efficient-Large-Model/WORL-NVRM)
28
+ and [WORL-Helios](https://huggingface.co/Efficient-Large-Model/WORL-Helios).
29
+
30
+ ## Model details
31
+
32
+ | Field | Description |
33
+ | --- | --- |
34
+ | Base model | `robbyant/lingbot-world-fast` |
35
+ | Base revision | `b7a1db2da9bd3ba675ee01c228f41db0309b981e` |
36
+ | Base subfolder | `lingbot_world_fast` |
37
+ | Architecture | Camera-conditioned `WanModelFast` transformer |
38
+ | Release formats | BF16 PEFT LoRA adapter and merged BF16 transformer |
39
+ | LoRA rank / alpha | 128 / 128 |
40
+ | Merged parameter count | 18,544,332,864 |
41
+ | Output geometry documented by the source release | 81 frames, 832 × 464 pixels, 16 FPS |
42
+
43
+ The two formats represent the same released policy. The merged transformer
44
+ has the adapter incorporated and does not need PEFT for inference. Both forms
45
+ still require the compatible text encoder, tokenizer, VAE, scheduler and
46
+ LingBot runtime, which are not included in this repository.
47
+
48
+ ## Inputs and outputs
49
+
50
+ | Input | Format |
51
+ | --- | --- |
52
+ | First frame | RGB image |
53
+ | Prompt | Text describing the scene and intended motion |
54
+ | Camera trajectory | Per-frame camera-to-world matrices, `(F, 4, 4)` |
55
+ | Camera intrinsics | Per-frame intrinsic matrices, `(F, 3, 3)` |
56
+
57
+ The output is a camera-conditioned video continuation. The source evaluation
58
+ profile uses an 80-frame stride between 81-frame clips, sharing one boundary
59
+ frame between adjacent clips.
60
+
61
+ ## Training data and method
62
+
63
+ WORL trains policies using autoregressive rollouts, reward evaluation,
64
+ candidate selection and policy updates. The project's LingBot reference
65
+ configuration combines HPSv3, NVRM and VGGT-Omega PI Camera rewards.
66
+
67
+ The team supplied an [OpenScene/revisit training bundle](https://huggingface.co/datasets/qyoo/lingbot-top2400-training-data)
68
+ containing 2,218 records with prompts, initial frames and camera-conditioning
69
+ arrays. Initial scene imagery was generated using gpt-image. This describes
70
+ the supplied project dataset and reference configuration; the exported model
71
+ does not record an exact per-run dataset/configuration binding. The training
72
+ dataset is distributed separately from these weights.
73
+
74
+ ## Download and load
75
+
76
+ For the adapter only:
77
+
78
+ ```bash
79
+ hf download Efficient-Large-Model/WORL-Lingbot \
80
+ --exclude 'merged/*' \
81
+ --local-dir artifacts/WORL-Lingbot
82
+ ```
83
+
84
+ For the full repository, including the merged transformer:
85
+
86
+ ```bash
87
+ hf download Efficient-Large-Model/WORL-Lingbot --local-dir artifacts/WORL-Lingbot
88
+ ```
89
+
90
+ With a compatible LingBot runtime installed, load the merged transformer:
91
+
92
+ ```python
93
+ import torch
94
+ from wan.modules.model_fast import WanModelFast
95
+
96
+ model = WanModelFast.from_pretrained(
97
+ "Efficient-Large-Model/WORL-Lingbot",
98
+ subfolder="merged",
99
+ torch_dtype=torch.bfloat16,
100
+ control_type="cam",
101
+ ).eval()
102
+ ```
103
+
104
+ Alternatively, attach the adapter to the pinned base transformer:
105
+
106
+ ```python
107
+ import torch
108
+ from peft import PeftModel
109
+ from wan.modules.model_fast import WanModelFast
110
+
111
+ base = WanModelFast.from_pretrained(
112
+ "robbyant/lingbot-world-fast",
113
+ revision="b7a1db2da9bd3ba675ee01c228f41db0309b981e",
114
+ subfolder="lingbot_world_fast",
115
+ torch_dtype=torch.bfloat16,
116
+ control_type="cam",
117
+ )
118
+ model = PeftModel.from_pretrained(
119
+ base,
120
+ "Efficient-Large-Model/WORL-Lingbot",
121
+ is_trainable=False,
122
+ ).eval()
123
+ ```
124
+
125
+ These examples load the transformer. Integrate it with the remaining compatible
126
+ pipeline components for complete video generation.
127
+
128
+ ## Files and provenance
129
+
130
+ | Path | Contents |
131
+ | --- | --- |
132
+ | `adapter_model.safetensors` | Approximately 1.23 GB BF16 adapter |
133
+ | `adapter_config.json` | PEFT configuration |
134
+ | `merged/` | Eight indexed BF16 transformer shards, approximately 37.09 GB, and config |
135
+ | `merged/SHA256SUMS` | Checksums for the merged files |
136
+ | `RELEASE_MANIFEST.json` | Source revision and SHA-256 inventory |
137
+
138
+ Weights and model configurations are unchanged from
139
+ [qyoo/lingbot-worl at d3e449c675f5](https://huggingface.co/qyoo/lingbot-worl/tree/d3e449c675f5a8bfb3afd29e30f1675e4445b9c3).
140
+ Documentation and release manifests were updated for this repository. Original
141
+ export, merge and load records remain available at that source revision.
142
+
143
+ The source records report a safe PEFT merge, matching sampled merged weights,
144
+ and an H100 reload with no remaining LoRA state keys. Those checks establish
145
+ merge/load behavior, not a new training run or a general performance claim.
146
+ No new GPU benchmark was performed for this publication.
147
+
148
+ ## Intended use and limitations
149
+
150
+ This model supports research on camera-conditioned video generation and video
151
+ world-model reinforcement learning. Long rollouts can drift in scene identity,
152
+ geometry, camera motion and physical consistency. Synthetic outputs are not
153
+ validated physical simulations or autonomous-control signals. Base-model and
154
+ training-data biases can affect generations; review outputs for the intended
155
+ application and respect rights in input media.
156
+
157
+ ## License
158
+
159
+ This release retains the source model card's
160
+ [Apache License 2.0](LICENSE.txt). The base model and separately obtained runtime
161
+ components retain their upstream terms and notices. See [NOTICE.txt](NOTICE.txt)
162
+ for source attribution.
RELEASE_MANIFEST.json ADDED
@@ -0,0 +1,114 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema": "worl.public-model-release.v1",
3
+ "repository_id": "Efficient-Large-Model/WORL-Lingbot",
4
+ "source_repository_id": "qyoo/lingbot-worl",
5
+ "source_revision": "d3e449c675f5a8bfb3afd29e30f1675e4445b9c3",
6
+ "weights_and_model_configurations_unchanged": true,
7
+ "documentation_updated": true,
8
+ "historical_receipts": "Available at the pinned source repository; not copied into this release.",
9
+ "digest_exclusions": [
10
+ "RELEASE_MANIFEST.json"
11
+ ],
12
+ "files": [
13
+ {
14
+ "path": ".gitattributes",
15
+ "size_bytes": 1641,
16
+ "sha256": "ffbcf2f21dfecdd5943ab4fe5b6bb2d2eb9395bbd6908fb27a7538daef00a529"
17
+ },
18
+ {
19
+ "path": "LICENSE.txt",
20
+ "size_bytes": 11357,
21
+ "sha256": "c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4"
22
+ },
23
+ {
24
+ "path": "NOTICE.txt",
25
+ "size_bytes": 486,
26
+ "sha256": "1a05e96de8160607f20dbf6dcadaf683a1ab9ee41b7b57e5e48d36d4bfe5f35b"
27
+ },
28
+ {
29
+ "path": "README.md",
30
+ "size_bytes": 5828,
31
+ "sha256": "a1597b03b840eb11b05ac7993a566ac0bf125cced7437a08a041bbac4fa768d7"
32
+ },
33
+ {
34
+ "path": "adapter_config.json",
35
+ "size_bytes": 1073,
36
+ "sha256": "cc83adbf3e15bae3f410d6fa3e2bb46537b7342a1cf6130398db5c7beb7c5453"
37
+ },
38
+ {
39
+ "path": "adapter_model.safetensors",
40
+ "size_bytes": 1226935752,
41
+ "sha256": "a14c4275131a98b6bad24aa09ab54a2982c7fed4407bf084a57e582482840648"
42
+ },
43
+ {
44
+ "path": "assets/worl-framework.png",
45
+ "size_bytes": 464758,
46
+ "sha256": "08f3e4338ff4e6487f258c977141eca780f85faaaac72f2a29257a5b6b343224"
47
+ },
48
+ {
49
+ "path": "assets/worl-teaser.webp",
50
+ "size_bytes": 273380,
51
+ "sha256": "4cce61f77c912cfdbeac7a2b6d8626c3d1b77099744fee068aa5e5d2d98c89b3"
52
+ },
53
+ {
54
+ "path": "merged/README.md",
55
+ "size_bytes": 702,
56
+ "sha256": "7b34dc542821a8d5867978b392fd6c086353600970c5a14968864199188ed581"
57
+ },
58
+ {
59
+ "path": "merged/SHA256SUMS",
60
+ "size_bytes": 1203,
61
+ "sha256": "eb9ccb4a64139c585c31c92a265da7791a357d63d0491b56e9de31e5e5224428"
62
+ },
63
+ {
64
+ "path": "merged/config.json",
65
+ "size_bytes": 532,
66
+ "sha256": "8e162023892651c30de45c41d029b2d05767585a2eec25a74fa9becd872e3267"
67
+ },
68
+ {
69
+ "path": "merged/diffusion_pytorch_model-00001-of-00008.safetensors",
70
+ "size_bytes": 4991624976,
71
+ "sha256": "97870275ccec0fa64a213e7909d3bae3d77cb2021ec37609d4c29127f1f05263"
72
+ },
73
+ {
74
+ "path": "merged/diffusion_pytorch_model-00002-of-00008.safetensors",
75
+ "size_bytes": 4982358760,
76
+ "sha256": "3a16767352aea3e7bbd58bc4e92488aac3e24d456131da7c553662ea7769fe3f"
77
+ },
78
+ {
79
+ "path": "merged/diffusion_pytorch_model-00003-of-00008.safetensors",
80
+ "size_bytes": 4861666096,
81
+ "sha256": "fad09faf0c9353f6803c5852fc2aaec7d28d4e5dc049b3db05c6c65221d10288"
82
+ },
83
+ {
84
+ "path": "merged/diffusion_pytorch_model-00004-of-00008.safetensors",
85
+ "size_bytes": 4966568072,
86
+ "sha256": "14cec26b8afe32622f885d3fd32f6732e17eedbee7466a2fe7478d51b2d94703"
87
+ },
88
+ {
89
+ "path": "merged/diffusion_pytorch_model-00005-of-00008.safetensors",
90
+ "size_bytes": 4929878840,
91
+ "sha256": "2411c8bfe88a18816f2195e859910e42786ee4791a5e1c63cfc50ba8d01a5f46"
92
+ },
93
+ {
94
+ "path": "merged/diffusion_pytorch_model-00006-of-00008.safetensors",
95
+ "size_bytes": 4950774384,
96
+ "sha256": "3a7db7a6e36fe047fa66c1f86e67004f6cc3ecb2a5e5ff0066694257ac98fae6"
97
+ },
98
+ {
99
+ "path": "merged/diffusion_pytorch_model-00007-of-00008.safetensors",
100
+ "size_bytes": 4982358936,
101
+ "sha256": "c3dd20329b34c13e79a3c5f6b23171434fea59131d98c37625a23bf339630707"
102
+ },
103
+ {
104
+ "path": "merged/diffusion_pytorch_model-00008-of-00008.safetensors",
105
+ "size_bytes": 2423583064,
106
+ "sha256": "48cc5e471d323e03bcb96ed39f8ea44b307a9f96b84327847c2656f40949e01e"
107
+ },
108
+ {
109
+ "path": "merged/diffusion_pytorch_model.safetensors.index.json",
110
+ "size_bytes": 127685,
111
+ "sha256": "2444bb18169f99786e3aafb3080a8cbd4998359300851c6570f90be57493e6ff"
112
+ }
113
+ ]
114
+ }
adapter_config.json ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": {
6
+ "base_model_class": "WanModelFast",
7
+ "parent_library": "wan.modules.model_fast"
8
+ },
9
+ "base_model_name_or_path": null,
10
+ "bias": "none",
11
+ "corda_config": null,
12
+ "ensure_weight_tying": false,
13
+ "eva_config": null,
14
+ "exclude_modules": null,
15
+ "fan_in_fan_out": false,
16
+ "inference_mode": true,
17
+ "init_lora_weights": true,
18
+ "layer_replication": null,
19
+ "layers_pattern": null,
20
+ "layers_to_transform": null,
21
+ "loftq_config": {},
22
+ "lora_alpha": 128,
23
+ "lora_bias": false,
24
+ "lora_dropout": 0.0,
25
+ "megatron_config": null,
26
+ "megatron_core": "megatron.core",
27
+ "modules_to_save": null,
28
+ "peft_type": "LORA",
29
+ "peft_version": "0.18.1",
30
+ "qalora_group_size": 16,
31
+ "r": 128,
32
+ "rank_pattern": {},
33
+ "revision": null,
34
+ "target_modules": [
35
+ "ffn.2",
36
+ "ffn.0",
37
+ "o",
38
+ "v",
39
+ "k",
40
+ "q"
41
+ ],
42
+ "target_parameters": null,
43
+ "task_type": null,
44
+ "trainable_token_indices": null,
45
+ "use_dora": false,
46
+ "use_qalora": false,
47
+ "use_rslora": false
48
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a14c4275131a98b6bad24aa09ab54a2982c7fed4407bf084a57e582482840648
3
+ size 1226935752
assets/worl-framework.png ADDED

Git LFS Details

  • SHA256: 08f3e4338ff4e6487f258c977141eca780f85faaaac72f2a29257a5b6b343224
  • Pointer size: 131 Bytes
  • Size of remote file: 465 kB
assets/worl-teaser.webp ADDED

Git LFS Details

  • SHA256: 4cce61f77c912cfdbeac7a2b6d8626c3d1b77099744fee068aa5e5d2d98c89b3
  • Pointer size: 131 Bytes
  • Size of remote file: 273 kB
merged/README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # WORL-Lingbot: merged transformer
2
+
3
+ This directory contains the BF16 camera-conditioned `WanModelFast`
4
+ transformer with the WORL adapter merged. It has 18,544,332,864
5
+ parameters stored in eight indexed Safetensors shards.
6
+
7
+ See the [main model card](../README.md) for loading examples, inputs,
8
+ limitations and provenance. The text encoder, tokenizer, VAE, scheduler
9
+ and compatible LingBot runtime are required separately.
10
+
11
+ Weight files and configuration are unchanged from the source release.
12
+ This documentation and `SHA256SUMS` were updated for WORL-Lingbot.
13
+ Run `sha256sum -c SHA256SUMS` from this directory to check its files.
14
+
15
+ License: [Apache 2.0](../LICENSE.txt). See [NOTICE.txt](../NOTICE.txt).
merged/SHA256SUMS ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 7b34dc542821a8d5867978b392fd6c086353600970c5a14968864199188ed581 README.md
2
+ 8e162023892651c30de45c41d029b2d05767585a2eec25a74fa9becd872e3267 config.json
3
+ 97870275ccec0fa64a213e7909d3bae3d77cb2021ec37609d4c29127f1f05263 diffusion_pytorch_model-00001-of-00008.safetensors
4
+ 3a16767352aea3e7bbd58bc4e92488aac3e24d456131da7c553662ea7769fe3f diffusion_pytorch_model-00002-of-00008.safetensors
5
+ fad09faf0c9353f6803c5852fc2aaec7d28d4e5dc049b3db05c6c65221d10288 diffusion_pytorch_model-00003-of-00008.safetensors
6
+ 14cec26b8afe32622f885d3fd32f6732e17eedbee7466a2fe7478d51b2d94703 diffusion_pytorch_model-00004-of-00008.safetensors
7
+ 2411c8bfe88a18816f2195e859910e42786ee4791a5e1c63cfc50ba8d01a5f46 diffusion_pytorch_model-00005-of-00008.safetensors
8
+ 3a7db7a6e36fe047fa66c1f86e67004f6cc3ecb2a5e5ff0066694257ac98fae6 diffusion_pytorch_model-00006-of-00008.safetensors
9
+ c3dd20329b34c13e79a3c5f6b23171434fea59131d98c37625a23bf339630707 diffusion_pytorch_model-00007-of-00008.safetensors
10
+ 48cc5e471d323e03bcb96ed39f8ea44b307a9f96b84327847c2656f40949e01e diffusion_pytorch_model-00008-of-00008.safetensors
11
+ 2444bb18169f99786e3aafb3080a8cbd4998359300851c6570f90be57493e6ff diffusion_pytorch_model.safetensors.index.json
merged/config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "WanModelFast",
3
+ "_diffusers_version": "0.35.2",
4
+ "_name_or_path": "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/qiyuanh/benchmark_experiments/recovery/rev_wbench_candidate_6c391161_parity_20260809/source/checkpoint/models/lingbot_world_fast/base",
5
+ "control_type": "cam",
6
+ "dim": 5120,
7
+ "eps": 1e-06,
8
+ "ffn_dim": 13824,
9
+ "freq_dim": 256,
10
+ "in_dim": 36,
11
+ "local_attn_size": -1,
12
+ "model_type": "i2v",
13
+ "num_heads": 40,
14
+ "num_layers": 40,
15
+ "out_dim": 16,
16
+ "sink_size": 0,
17
+ "text_len": 512
18
+ }
merged/diffusion_pytorch_model-00001-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97870275ccec0fa64a213e7909d3bae3d77cb2021ec37609d4c29127f1f05263
3
+ size 4991624976
merged/diffusion_pytorch_model-00002-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a16767352aea3e7bbd58bc4e92488aac3e24d456131da7c553662ea7769fe3f
3
+ size 4982358760
merged/diffusion_pytorch_model-00003-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fad09faf0c9353f6803c5852fc2aaec7d28d4e5dc049b3db05c6c65221d10288
3
+ size 4861666096
merged/diffusion_pytorch_model-00004-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14cec26b8afe32622f885d3fd32f6732e17eedbee7466a2fe7478d51b2d94703
3
+ size 4966568072
merged/diffusion_pytorch_model-00005-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2411c8bfe88a18816f2195e859910e42786ee4791a5e1c63cfc50ba8d01a5f46
3
+ size 4929878840
merged/diffusion_pytorch_model-00006-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a7db7a6e36fe047fa66c1f86e67004f6cc3ecb2a5e5ff0066694257ac98fae6
3
+ size 4950774384
merged/diffusion_pytorch_model-00007-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3dd20329b34c13e79a3c5f6b23171434fea59131d98c37625a23bf339630707
3
+ size 4982358936
merged/diffusion_pytorch_model-00008-of-00008.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48cc5e471d323e03bcb96ed39f8ea44b307a9f96b84327847c2656f40949e01e
3
+ size 2423583064
merged/diffusion_pytorch_model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff