Add pipeline tag to metadata
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,6 +1,8 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
| 3 |
---
|
|
|
|
| 4 |
<div align="center">
|
| 5 |
|
| 6 |
<h1 style="margin-bottom: 0.2em;">
|
|
@@ -52,3 +54,34 @@ Current generative novel view synthesis methods typically rely on restrictive ex
|
|
| 52 |
- **Metric Scale Anchoring via Modified RoPE:** To overcome the scale drifting issue prevalent in fully implicit methods, we allocate an extra subspace for the *z*-axis to anchor the scene scales and it plays with camera pose via PRoPE. This explicitly injects scale cues, anchoring the generation to a consistent 3D metric space.
|
| 53 |
|
| 54 |
Given a single input image and a target camera pose, MetaView synthesizes the corresponding novel view with precise camera controllability, strong geometry consistency, and remarkable cross-domain generalization.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: image-to-3d
|
| 4 |
---
|
| 5 |
+
|
| 6 |
<div align="center">
|
| 7 |
|
| 8 |
<h1 style="margin-bottom: 0.2em;">
|
|
|
|
| 54 |
- **Metric Scale Anchoring via Modified RoPE:** To overcome the scale drifting issue prevalent in fully implicit methods, we allocate an extra subspace for the *z*-axis to anchor the scene scales and it plays with camera pose via PRoPE. This explicitly injects scale cues, anchoring the generation to a consistent 3D metric space.
|
| 55 |
|
| 56 |
Given a single input image and a target camera pose, MetaView synthesizes the corresponding novel view with precise camera controllability, strong geometry consistency, and remarkable cross-domain generalization.
|
| 57 |
+
|
| 58 |
+
## Usage
|
| 59 |
+
|
| 60 |
+
Please refer to the [GitHub Repository](https://github.com/KlingAIResearch/MetaView) for environment setup and instructions on running inference.
|
| 61 |
+
|
| 62 |
+
You can perform inference using the following command:
|
| 63 |
+
|
| 64 |
+
```bash
|
| 65 |
+
python src/inference.py \
|
| 66 |
+
--image_path "./assets/data/0.png" \
|
| 67 |
+
--ckpt_path "models/MetaView/checkpoint-best.safetensors" \
|
| 68 |
+
--da3_giant_path "models/Depth-Anything-3/DA3-GIANT-1.1" \
|
| 69 |
+
--da3_depth_path "models/Depth-Anything-3/DA3NESTED-GIANT-LARGE-1.1" \
|
| 70 |
+
--yaw -30 \
|
| 71 |
+
--pitch 15 \
|
| 72 |
+
--radius 3.5 \
|
| 73 |
+
--output_path "./result/output_novel_view.png"
|
| 74 |
+
```
|
| 75 |
+
|
| 76 |
+
## Citation
|
| 77 |
+
|
| 78 |
+
```bibtex
|
| 79 |
+
@article{metaview,
|
| 80 |
+
title={MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors},
|
| 81 |
+
author={Yufei Cai and Xuesong Niu and Hao Lu and Kun Gai and Kai Wu and Guosheng Lin},
|
| 82 |
+
year={2026},
|
| 83 |
+
eprint={2607.12000},
|
| 84 |
+
archivePrefix={arXiv},
|
| 85 |
+
url={https://arxiv.org/abs/2607.12000},
|
| 86 |
+
}
|
| 87 |
+
```
|