Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,76 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc-by-nc-4.0
|
| 3 |
+
pipeline_tag: depth-estimation
|
| 4 |
+
tags:
|
| 5 |
+
- depth-estimation
|
| 6 |
+
- monocular-depth
|
| 7 |
+
- metric-depth
|
| 8 |
+
- epipolar-attention
|
| 9 |
+
library_name: pytorch
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# EpiDistill
|
| 13 |
+
|
| 14 |
+
**Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth**
|
| 15 |
+
|
| 16 |
+
Jung-Hee Kim, Xiaoming Liu · Michigan State University / UNC Chapel Hill
|
| 17 |
+
|
| 18 |
+
[Paper](https://arxiv.org/abs/2607.15600) · [Project page](https://jungheekim29.github.io/EpiDistill/) · [Code](https://github.com/jungheekim29/EpiDistill)
|
| 19 |
+
|
| 20 |
+
EpiDistill turns a frozen depth foundation model into a single-view metric depth
|
| 21 |
+
model. A multi-view teacher learns correspondence through depth-guided epipolar
|
| 22 |
+
attention; at inference the source views are replaced by learnable Rectified
|
| 23 |
+
Stereo Tokens, so the cross-view pathway survives with one image.
|
| 24 |
+
|
| 25 |
+
## Files
|
| 26 |
+
|
| 27 |
+
| file | backbone | tensors |
|
| 28 |
+
|---|---|---|
|
| 29 |
+
| `epidistill_unidepthv2.pt` | UniDepthV2 (ViT-L/14) | 401 |
|
| 30 |
+
| `epidistill_depthpro.pt` | DepthPro | 455 |
|
| 31 |
+
|
| 32 |
+
Each file is a plain PyTorch `state_dict` (no pickled objects beyond tensors, so
|
| 33 |
+
it loads with `weights_only=True`).
|
| 34 |
+
|
| 35 |
+
## These weights are a correction, not a depth network
|
| 36 |
+
|
| 37 |
+
They hold only EpiDistill's own parameters. The frozen backbone is **not**
|
| 38 |
+
included and must be obtained separately:
|
| 39 |
+
|
| 40 |
+
* **UniDepthV2** downloads automatically from `lpiccinelli/unidepth-v2-vitl14`.
|
| 41 |
+
* **DepthPro** needs `depth_pro.pt` from
|
| 42 |
+
[apple/ml-depth-pro](https://github.com/apple/ml-depth-pro).
|
| 43 |
+
|
| 44 |
+
## Usage
|
| 45 |
+
|
| 46 |
+
```python
|
| 47 |
+
from huggingface_hub import hf_hub_download
|
| 48 |
+
from epidistill import EpiDistillConfig, EpiDistillPredictor
|
| 49 |
+
|
| 50 |
+
path = hf_hub_download("kimjun84/EpiDistill", "epidistill_unidepthv2.pt")
|
| 51 |
+
predictor = EpiDistillPredictor.from_pretrained(
|
| 52 |
+
path, config=EpiDistillConfig(backbone="unidepthv2")
|
| 53 |
+
)
|
| 54 |
+
depth, K = predictor(rgb) # depth: (H, W) float32 metres, K: (3, 3)
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
The model code lives in the
|
| 58 |
+
[EpiDistill repository](https://github.com/jungheekim29/EpiDistill); install it
|
| 59 |
+
first.
|
| 60 |
+
|
| 61 |
+
## License
|
| 62 |
+
|
| 63 |
+
**CC BY-NC 4.0** — non-commercial. The UniDepthV2 backbone these weights correct
|
| 64 |
+
is itself CC BY-NC 4.0; DepthPro carries Apple's licence.
|
| 65 |
+
|
| 66 |
+
## Citation
|
| 67 |
+
|
| 68 |
+
```bibtex
|
| 69 |
+
@inproceedings{kim2026epidistill,
|
| 70 |
+
title = {Geometric Distillation from Rectified Stereo:
|
| 71 |
+
Leveraging Epipolar Cues for Monocular Depth},
|
| 72 |
+
author = {Kim, Jung-Hee and Liu, Xiaoming},
|
| 73 |
+
booktitle = {ECCV},
|
| 74 |
+
year = {2026}
|
| 75 |
+
}
|
| 76 |
+
```
|