Add model card
#1
by nielsr HF Staff - opened
README.md
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: image-to-3d
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# Point4D: Long-range 4D Motion Reconstruction
|
| 6 |
+
|
| 7 |
+
Point4D is a feed-forward 4D reconstruction model for long-range video sequences. It tracks points through long videos by chaining 3D queries across overlapping chunks, supporting long-horizon 4D motion reconstruction.
|
| 8 |
+
|
| 9 |
+
- Paper: [Point4D: Long-range 4D Motion Reconstruction](https://huggingface.co/papers/2609.09145)
|
| 10 |
+
- Project page: [https://point-4d.github.io](https://point-4d.github.io)
|
| 11 |
+
- Code: [https://github.com/point-4d/Point4D](https://github.com/point-4d/Point4D)
|
| 12 |
+
|
| 13 |
+
## Usage
|
| 14 |
+
|
| 15 |
+
```python
|
| 16 |
+
import numpy as np
|
| 17 |
+
from point4d.loader import load_model
|
| 18 |
+
from point4d.inference import track_long_video, LongTrackConfig
|
| 19 |
+
|
| 20 |
+
model = load_model(device="cuda") # uses configs/ and checkpoints/ by default
|
| 21 |
+
|
| 22 |
+
images = ... # (T, H, W, 3) uint8 RGB
|
| 23 |
+
query_uv = np.array([[260, 147]], dtype=np.float32) # pixels in frame 0
|
| 24 |
+
|
| 25 |
+
traj, conf = track_long_video(model, images, query_uv,
|
| 26 |
+
LongTrackConfig(chunk_size=64, overlap=16))
|
| 27 |
+
# traj: (T, N, 3) in frame 0 camera coordinates, conf: (T, N)
|
| 28 |
+
```
|
| 29 |
+
|
| 30 |
+
See the [GitHub README](https://github.com/point-4d/Point4D) for installation and the full interactive demo instructions.
|