Update supplied-video FlowHMR mesh and tracking demo
Browse files- README.md +9 -3
- media/demo_latest_mesh.json +18 -8
- media/demo_latest_mesh.mp4 +2 -2
- media/demo_latest_mesh_preview.png +2 -2
README.md
CHANGED
|
@@ -38,21 +38,27 @@ Official source: [FlowHMR](https://github.com/flowhmr/flowhmr), revision
|
|
| 38 |
|
| 39 |
## Visual Results
|
| 40 |
|
| 41 |
-
### Supplied-video demo — Latest
|
| 42 |
|
| 43 |
<video src="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4" poster="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh_preview.png" controls playsinline preload="metadata" width="100%"></video>
|
| 44 |
|
| 45 |
[Input video](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_input.mp4) · [Download demo](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4) ·
|
| 46 |
-
[Render provenance](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.json)
|
|
|
|
| 47 |
|
| 48 |
**Checkpoint:** [Motius-FlowHMR-Latest](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest),
|
| 49 |
-
the official Latest release after PHC+ GRPO post-training.
|
| 50 |
|
| 51 |
- Official checkpoint SHA256: `b7eb06b119feaf5ad7287bafdb2fff38d42dfc22ea9d256f8cdd2ada26dfc53a`.
|
| 52 |
- Motius inference safetensors SHA256: `f4ae4168a6f576ffe08a3a19b245e0fd65c0d304b8e93bc2c6ab0a46a6f86912`.
|
| 53 |
- 750 frames, 25 seconds, 30 fps; seed 0, 20 Euler steps, CFG 1.
|
| 54 |
- VGGT camera sampling every 100 frames (9 keyframes interpolated to 750).
|
| 55 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
The left panel displays the supplied video with the Motius frontend's tracking
|
| 57 |
bbox. The right panel reconstructs SMPL-H vertices from the saved predicted
|
| 58 |
rotations, shape and translation, using Motius's bundled implementation.
|
|
|
|
| 38 |
|
| 39 |
## Visual Results
|
| 40 |
|
| 41 |
+
### Supplied-video demo — Latest
|
| 42 |
|
| 43 |
<video src="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4" poster="https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh_preview.png" controls playsinline preload="metadata" width="100%"></video>
|
| 44 |
|
| 45 |
[Input video](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_input.mp4) · [Download demo](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.mp4) ·
|
| 46 |
+
[Render provenance](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest/resolve/main/media/demo_latest_mesh.json) ·
|
| 47 |
+
[Other checkpoint on the same video](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Base#visual-results)
|
| 48 |
|
| 49 |
**Checkpoint:** [Motius-FlowHMR-Latest](https://huggingface.co/ZeyuLing/Motius-FlowHMR-Latest),
|
| 50 |
+
the official Latest release after PHC+ GRPO post-training. This video is an actual Latest prediction.
|
| 51 |
|
| 52 |
- Official checkpoint SHA256: `b7eb06b119feaf5ad7287bafdb2fff38d42dfc22ea9d256f8cdd2ada26dfc53a`.
|
| 53 |
- Motius inference safetensors SHA256: `f4ae4168a6f576ffe08a3a19b245e0fd65c0d304b8e93bc2c6ab0a46a6f86912`.
|
| 54 |
- 750 frames, 25 seconds, 30 fps; seed 0, 20 Euler steps, CFG 1.
|
| 55 |
- VGGT camera sampling every 100 frames (9 keyframes interpolated to 750).
|
| 56 |
|
| 57 |
+
Base and Latest use the exact same cached tracking boxes, SAM features and camera
|
| 58 |
+
estimates (shared frontend SHA256: `c26b81670919b5b78b3661a022e3e7db294078cfbb464825fdd8246ea5b8419b`).
|
| 59 |
+
Both use the same seed and sampling settings. A single camera framing fits both
|
| 60 |
+
predicted sequences, so the display scale and view are identical.
|
| 61 |
+
|
| 62 |
The left panel displays the supplied video with the Motius frontend's tracking
|
| 63 |
bbox. The right panel reconstructs SMPL-H vertices from the saved predicted
|
| 64 |
rotations, shape and translation, using Motius's bundled implementation.
|
media/demo_latest_mesh.json
CHANGED
|
@@ -15,18 +15,28 @@
|
|
| 15 |
"height": 585,
|
| 16 |
"frames": 750,
|
| 17 |
"vertex_count": 6890,
|
| 18 |
-
"half_height": 1.
|
| 19 |
"camera_target": [
|
| 20 |
-
|
| 21 |
-
0.
|
| 22 |
-
0.
|
| 23 |
],
|
| 24 |
"camera_position": [
|
| 25 |
-
1.
|
| 26 |
-
1.
|
| 27 |
-
-5.
|
| 28 |
]
|
| 29 |
},
|
| 30 |
"source_sha256": "8f9e9c1193163940eafb512e9a0621a31fe316406e7a69aa3a357f6deceb17f1",
|
| 31 |
-
"video_sha256": "
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
}
|
|
|
|
| 15 |
"height": 585,
|
| 16 |
"frames": 750,
|
| 17 |
"vertex_count": 6890,
|
| 18 |
+
"half_height": 1.1555242160887533,
|
| 19 |
"camera_target": [
|
| 20 |
+
0.01125761379322961,
|
| 21 |
+
0.8669598787713986,
|
| 22 |
+
0.1328583852640172
|
| 23 |
],
|
| 24 |
"camera_position": [
|
| 25 |
+
1.4513036960051875,
|
| 26 |
+
1.7309875280985734,
|
| 27 |
+
-5.6273259435838145
|
| 28 |
]
|
| 29 |
},
|
| 30 |
"source_sha256": "8f9e9c1193163940eafb512e9a0621a31fe316406e7a69aa3a357f6deceb17f1",
|
| 31 |
+
"video_sha256": "76b0c753a950b2b6fd43f9dab38f41371a9aa9eb1d5d33077cf589cc245a0960",
|
| 32 |
+
"inference": {
|
| 33 |
+
"camera_translation": "conditioning only; no metric world alignment",
|
| 34 |
+
"cfg_scale": 1.0,
|
| 35 |
+
"euler_steps": 20,
|
| 36 |
+
"seed": 0,
|
| 37 |
+
"shared_frontend_sha256": "c26b81670919b5b78b3661a022e3e7db294078cfbb464825fdd8246ea5b8419b",
|
| 38 |
+
"source_video_sha256": "8f9e9c1193163940eafb512e9a0621a31fe316406e7a69aa3a357f6deceb17f1",
|
| 39 |
+
"vggt_frame_interval": 100
|
| 40 |
+
},
|
| 41 |
+
"camera_reference_sha256": "29177e7879f9753cf84ce32714b5107f2e3125ea49db8292d3a9f5fdcfab7f1d"
|
| 42 |
}
|
media/demo_latest_mesh.mp4
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:76b0c753a950b2b6fd43f9dab38f41371a9aa9eb1d5d33077cf589cc245a0960
|
| 3 |
+
size 7538359
|
media/demo_latest_mesh_preview.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|