ziqima commited on
Commit
c0bbbf3
·
0 Parent(s):
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: base-model-terms
4
+ pipeline_tag: image-to-video
5
+ tags:
6
+ - world-model
7
+ - video-generation
8
+ - camera-control
9
+ - reinforcement-learning
10
+ - lora
11
+ base_model:
12
+ - nvidia/Lyra-2.0
13
+ - robbyant/lingbot-world-v2-14b-causal-fast
14
+ - Drexubery/UniView
15
+ datasets:
16
+ - ziqima/TrajectoryBench
17
+ ---
18
+
19
+ # LoGo checkpoints
20
+
21
+ The LoRA adapter each model was post-trained to with the LoGo reward.
22
+
23
+ | file | model | base weights |
24
+ |---|---|---|
25
+ | `logo-lyra2-lora.pt` | Lyra-2 (use DMD scheduler) | `nvidia/Lyra-2.0` |
26
+ | `logo-lingbot-world-v2-lora.pt` | LingBot-World 2.0 | `robbyant/lingbot-world-v2-14b-causal-fast` |
27
+ | `logo-uniworld-view-lora.safetensors` | UniWorld-View | `Drexubery/UniView` + `Wan-AI/Wan2.1-VACE-14B-diffusers` + CausVid LoRA |
28
+
29
+ Usage, with the code at https://github.com/ziqi-ma/logo.
30
+
31
+ # Lyra-2
32
+ torchrun --standalone --nproc_per_node=8 -m lyra_2._src.rl.inference.evaluate \
33
+ --adapter logo-lyra2-lora.pt --scenes-root <scene dir> --scenes "<ids>"
34
+
35
+ # LingBot-World 2.0
36
+ python -m wan.rl.inference.gen_scenes --input_base <scene root> --videos_base <out> \
37
+ --lora_path logo-lingbot-world-v2-lora.pt
38
+
39
+ # UniWorld-View
40
+ python -m rl.inference.eval_gen --ws_prefix <out> \
41
+ --rl-ckpt logo-uniworld-view-lora.safetensors --pose-scale 1.5
42
+
43
+ Evaluation on TrajectoryBench, including the per-group generation settings, is described in
44
+ `eval/README.md` in that repository.
logo-lingbot-world-v2-lora.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dbef65230de466866c9719407562b8772a3bd673820cf4b23b28be4cc047c02
3
+ size 823497293
logo-lyra2-lora.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42ec3fc50f5d6b6fe92c38d4f0bd2dedd6579941075eb3b70b15722be77cc981
3
+ size 458729333
logo-uniworld-view-lora.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cfeddcc83381620ed3d5b13384877b2cb0fef7a1671e6a944326e419f375515
3
+ size 204547664