ZeyuLing commited on
Commit
e77d64d
·
verified ·
1 Parent(s): 0adfa59

Update supplied-video FlowHMR mesh and tracking demo

Browse files
README.md CHANGED
@@ -38,21 +38,27 @@ Official source: [FlowHMR](https://github.com/flowhmr/flowhmr), revision
38
 
39
  ## Visual Results
40
 
41
- ### Supplied-video demo — Latest (PHC+ GRPO)
42
 
43
  <video src="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4" poster="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh_preview.png" controls playsinline preload="metadata" width="100%"></video>
44
 
45
  [Input video](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_input.mp4) · [Download demo](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4) ·
46
- [Render provenance](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.json)
 
47
 
48
  **Checkpoint:** [Motius-FlowHMR-Latest](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest),
49
- the official Latest release after PHC+ GRPO post-training.
50
 
51
  - Official checkpoint SHA256: `b7eb06b119feaf5ad7287bafdb2fff38d42dfc22ea9d256f8cdd2ada26dfc53a`.
52
  - Motius inference safetensors SHA256: `f4ae4168a6f576ffe08a3a19b245e0fd65c0d304b8e93bc2c6ab0a46a6f86912`.
53
  - 750 frames, 25 seconds, 30 fps; seed 0, 20 Euler steps, CFG 1.
54
  - VGGT camera sampling every 100 frames (9 keyframes interpolated to 750).
55
 
 
 
 
 
 
56
  The left panel displays the supplied video with the Motius frontend's tracking
57
  bbox. The right panel reconstructs SMPL-H vertices from the saved predicted
58
  rotations, shape and translation, using Motius's bundled implementation.
 
38
 
39
  ## Visual Results
40
 
41
+ ### Supplied-video demo — Latest
42
 
43
  <video src="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4" poster="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh_preview.png" controls playsinline preload="metadata" width="100%"></video>
44
 
45
  [Input video](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_input.mp4) · [Download demo](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4) ·
46
+ [Render provenance](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.json) ·
47
+ [Other checkpoint on the same video](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Base#visual-results)
48
 
49
  **Checkpoint:** [Motius-FlowHMR-Latest](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest),
50
+ the official Latest release after PHC+ GRPO post-training. This video is an actual Latest prediction.
51
 
52
  - Official checkpoint SHA256: `b7eb06b119feaf5ad7287bafdb2fff38d42dfc22ea9d256f8cdd2ada26dfc53a`.
53
  - Motius inference safetensors SHA256: `f4ae4168a6f576ffe08a3a19b245e0fd65c0d304b8e93bc2c6ab0a46a6f86912`.
54
  - 750 frames, 25 seconds, 30 fps; seed 0, 20 Euler steps, CFG 1.
55
  - VGGT camera sampling every 100 frames (9 keyframes interpolated to 750).
56
 
57
+ Base and Latest use the exact same cached tracking boxes, SAM features and camera
58
+ estimates (shared frontend SHA256: `c26b81670919b5b78b3661a022e3e7db294078cfbb464825fdd8246ea5b8419b`).
59
+ Both use the same seed and sampling settings. A single camera framing fits both
60
+ predicted sequences, so the display scale and view are identical.
61
+
62
  The left panel displays the supplied video with the Motius frontend's tracking
63
  bbox. The right panel reconstructs SMPL-H vertices from the saved predicted
64
  rotations, shape and translation, using Motius's bundled implementation.
media/demo_latest_mesh.json CHANGED
@@ -15,18 +15,28 @@
15
  "height": 585,
16
  "frames": 750,
17
  "vertex_count": 6890,
18
- "half_height": 1.1323156712833715,
19
  "camera_target": [
20
- -0.005707634257960004,
21
- 0.8669544873149713,
22
- 0.1286162645327557
23
  ],
24
  "camera_position": [
25
- 1.4343384479539978,
26
- 1.730982136642146,
27
- -5.631568064315076
28
  ]
29
  },
30
  "source_sha256": "8f9e9c1193163940eafb512e9a0621a31fe316406e7a69aa3a357f6deceb17f1",
31
- "video_sha256": "ddfd29ce41206457c9e5150b72bf9d1e7eae52f0725eb049442b7bf21404b60d"
 
 
 
 
 
 
 
 
 
 
32
  }
 
15
  "height": 585,
16
  "frames": 750,
17
  "vertex_count": 6890,
18
+ "half_height": 1.1555242160887533,
19
  "camera_target": [
20
+ 0.01125761379322961,
21
+ 0.8669598787713986,
22
+ 0.1328583852640172
23
  ],
24
  "camera_position": [
25
+ 1.4513036960051875,
26
+ 1.7309875280985734,
27
+ -5.6273259435838145
28
  ]
29
  },
30
  "source_sha256": "8f9e9c1193163940eafb512e9a0621a31fe316406e7a69aa3a357f6deceb17f1",
31
+ "video_sha256": "76b0c753a950b2b6fd43f9dab38f41371a9aa9eb1d5d33077cf589cc245a0960",
32
+ "inference": {
33
+ "camera_translation": "conditioning only; no metric world alignment",
34
+ "cfg_scale": 1.0,
35
+ "euler_steps": 20,
36
+ "seed": 0,
37
+ "shared_frontend_sha256": "c26b81670919b5b78b3661a022e3e7db294078cfbb464825fdd8246ea5b8419b",
38
+ "source_video_sha256": "8f9e9c1193163940eafb512e9a0621a31fe316406e7a69aa3a357f6deceb17f1",
39
+ "vggt_frame_interval": 100
40
+ },
41
+ "camera_reference_sha256": "29177e7879f9753cf84ce32714b5107f2e3125ea49db8292d3a9f5fdcfab7f1d"
42
  }
media/demo_latest_mesh.mp4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ddfd29ce41206457c9e5150b72bf9d1e7eae52f0725eb049442b7bf21404b60d
3
- size 7564846
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76b0c753a950b2b6fd43f9dab38f41371a9aa9eb1d5d33077cf589cc245a0960
3
+ size 7538359
media/demo_latest_mesh_preview.png CHANGED

Git LFS Details

  • SHA256: 77aac93373dea54a9ecda2df14af41389de2da447f11b3ff0fe7d67b80890459
  • Pointer size: 131 Bytes
  • Size of remote file: 637 kB

Git LFS Details

  • SHA256: 162c53435da3bcfbeef986c1c6912ef2ecf1e50ab7c80b6f7db660d247e8f8c7
  • Pointer size: 131 Bytes
  • Size of remote file: 636 kB