Complete model card and gated-access terms
Browse files
README.md
CHANGED
|
@@ -7,24 +7,104 @@ tags:
|
|
| 7 |
- image-matching
|
| 8 |
- image-registration
|
| 9 |
- remote-sensing
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
# LoRetta
|
| 13 |
|
| 14 |
-
Official inference checkpoint for
|
| 15 |
|
|
|
|
| 16 |
- Code: https://github.com/yusiwei77-star/LoRetta
|
|
|
|
|
|
|
| 17 |
- File: `loretta.pth`
|
| 18 |
-
- Format: canonical tensor-only PyTorch state
|
| 19 |
-
- State-
|
|
|
|
| 20 |
- SHA-256: `09a502056b671d4e07819f454f96eb385ebe605a186ee1b059ce2447d8fb602e`
|
| 21 |
|
| 22 |
-
|
| 23 |
|
| 24 |
-
|
| 25 |
|
| 26 |
-
|
| 27 |
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
Copyright 2026 LEVIR Lab, Beihang University.
|
|
|
|
| 7 |
- image-matching
|
| 8 |
- image-registration
|
| 9 |
- remote-sensing
|
| 10 |
+
- geolocalization
|
| 11 |
+
extra_gated_heading: "Acknowledge the DINOv3 License"
|
| 12 |
+
extra_gated_description: "LoRetta's checkpoint incorporates DINOv3 parameters. Access is granted automatically after you sign in and complete the acknowledgments below."
|
| 13 |
+
extra_gated_button_content: "Acknowledge and access"
|
| 14 |
+
extra_gated_prompt: "By requesting access, you confirm that you have read the DINOv3 License and will comply with its restrictions. Hugging Face also shares your username and email address with the model authors."
|
| 15 |
+
extra_gated_fields:
|
| 16 |
+
I have read and agree to the DINOv3 License: checkbox
|
| 17 |
+
I will not use the model for activities prohibited by the DINOv3 License: checkbox
|
| 18 |
---
|
| 19 |
|
| 20 |
# LoRetta
|
| 21 |
|
| 22 |
+
Official inference checkpoint for **LoRetta: A Localization-and-Registration Foundation Model and Extensive Dataset for Global-Scale Dense Image Matching**.
|
| 23 |
|
| 24 |
+
- Project page: https://www.siweiyu.com/work/loretta/
|
| 25 |
- Code: https://github.com/yusiwei77-star/LoRetta
|
| 26 |
+
- Authors: Siwei Yu, Han Guo, Zhenwei Shi, and Zhengxia Zou
|
| 27 |
+
- Institution: LEVIR Lab, Beihang University
|
| 28 |
- File: `loretta.pth`
|
| 29 |
+
- Format: canonical tensor-only PyTorch state dictionary
|
| 30 |
+
- State-dictionary entries: 807
|
| 31 |
+
- File size: 1,294,957,584 bytes
|
| 32 |
- SHA-256: `09a502056b671d4e07819f454f96eb385ebe605a186ee1b059ce2447d8fb602e`
|
| 33 |
|
| 34 |
+
## Model description
|
| 35 |
|
| 36 |
+
LoRetta is an inference model for dense image matching in remote-sensing imagery. It follows a localization-and-registration design: a matchability-aware module estimates the overlapping region and an affine prior, then a guided coarse-to-fine registration module predicts residual dense correspondence in the aligned frame. The released package uses a pinned, locally vendored DINOv3 ViT-L/16 backbone architecture and does not fetch executable model code at runtime.
|
| 37 |
|
| 38 |
+
The public API, installation instructions, input preprocessing, output definitions, and checkpoint-integrity verification are documented in the code repository. The default loader downloads this file from an immutable Hub commit and verifies the complete file against the SHA-256 above.
|
| 39 |
|
| 40 |
+
## Intended use
|
| 41 |
+
|
| 42 |
+
This research release is intended for remote-sensing image registration, cross-view image matching, geometric alignment experiments, and evaluation on imagery for which the user has appropriate rights and a lawful basis to process. It may also be useful as a research component in astronaut-to-satellite and UAV-to-satellite geolocalization pipelines, subject to independent validation.
|
| 43 |
+
|
| 44 |
+
The model is not a decision authority. Any output used in safety-critical, legal, surveillance, property, emergency-response, or other high-impact settings requires qualified human review, application-specific testing, and independent corroboration.
|
| 45 |
+
|
| 46 |
+
## Input and output assumptions
|
| 47 |
+
|
| 48 |
+
- The reference and sensed images are independently resized to 512 × 512; their original aspect ratios are not preserved.
|
| 49 |
+
- The sensed image is expected to have a ground sampling distance no greater than the reference image and a ground footprint no larger than the reference image.
|
| 50 |
+
- Outputs include a dense warp field and a per-pixel matchability estimate. Optional geometry estimation derives a homography from predicted matches using RANSAC.
|
| 51 |
+
- Very large aspect-ratio changes, weak overlap, severe appearance change, clouds, repetitive texture, or violations of the scale/footprint assumptions can degrade results.
|
| 52 |
+
|
| 53 |
+
## Data overview
|
| 54 |
+
|
| 55 |
+
LoRetta was developed with LEVIR-GM, a multi-temporal optical remote-sensing matching benchmark described by the authors as containing 103K aligned pairs and 827K augmented pairs across six continents, five years, and spatial resolutions from 0.5 to 1024 metres. Dataset files, detailed sampling documentation, and training code are not part of this v0.1.0 checkpoint release and remain forthcoming. Users should not infer demographic, geographic, sensor, season, or land-cover coverage beyond the published description.
|
| 56 |
+
|
| 57 |
+
## Evaluation
|
| 58 |
+
|
| 59 |
+
The authors report the following results on LEVIR-GM under their unified evaluation protocol:
|
| 60 |
+
|
| 61 |
+
- AUC: 83.3%.
|
| 62 |
+
- AUC improvement over RoMa v2: 1.6 percentage points.
|
| 63 |
+
- PCK improvement over RoMa v2: 6.5 points at 1 pixel and 8.2 points at 2 pixels.
|
| 64 |
+
- Inference-latency reduction relative to RoMa v2: 47.8%.
|
| 65 |
+
|
| 66 |
+
Here, PCK is the percentage of evaluated keypoints whose correspondence error falls within the stated pixel threshold. AUC summarizes accuracy across the evaluation error thresholds used by the authors. Latency is implementation- and hardware-dependent and should not be treated as a platform-independent guarantee. The paper and evaluation code are not included in v0.1.0, so these results should be treated as author-reported until the complete evaluation artifacts are released.
|
| 67 |
+
|
| 68 |
+
## Limitations and risks
|
| 69 |
+
|
| 70 |
+
- Matchability is a model estimate, not proof that two locations correspond. Repetitive structures, roads, agricultural patterns, shorelines, cloud edges, and texture-poor regions can create plausible but incorrect matches.
|
| 71 |
+
- A wrong match can propagate into an incorrect affine transform, homography, or geolocation. Downstream systems must preserve uncertainty, reject low-confidence cases, and avoid presenting estimated coordinates as verified ground truth.
|
| 72 |
+
- Results may be unreliable outside the stated input assumptions or on sensors, geographies, seasons, atmospheric conditions, and land-cover types underrepresented in development data.
|
| 73 |
+
- Independent resizing to 512 × 512 can distort geometry, especially for extreme aspect ratios.
|
| 74 |
+
- The checkpoint can support dual-use geospatial workflows. Users are responsible for lawful, ethical use, respecting privacy and imagery rights, and assessing downstream harms.
|
| 75 |
+
|
| 76 |
+
## License and prohibited uses
|
| 77 |
+
|
| 78 |
+
This checkpoint incorporates DINOv3 parameters and is distributed under the [DINOv3 License](DINOV3_LICENSE.md). Use and redistribution must comply with that agreement. In particular, the license requires compliance with applicable laws, privacy/data-protection rules, and trade controls, and prohibits covered end uses including military or warfare purposes, nuclear applications, espionage, and the development or use of guns or illegal weapons. This summary is informational only; the license text controls.
|
| 79 |
+
|
| 80 |
+
LoRetta-authored source code is distributed separately under Apache License 2.0. Third-party source components retain their respective licenses. See the code repository's `THIRD_PARTY_NOTICES.md` for provenance and complete notices.
|
| 81 |
+
|
| 82 |
+
If results produced with this checkpoint are submitted for publication, the DINOv3 License requires acknowledgment of the DINO Materials. Please also cite LoRetta as shown below.
|
| 83 |
+
|
| 84 |
+
## Access
|
| 85 |
+
|
| 86 |
+
Access is automatic after signing in to Hugging Face and completing the two license acknowledgments on this page. Command-line downloads also require authentication:
|
| 87 |
+
|
| 88 |
+
```bash
|
| 89 |
+
hf auth login
|
| 90 |
+
```
|
| 91 |
+
|
| 92 |
+
No company, country, or intended-use description is requested. Hugging Face's standard gated-model flow shares the requesting account's username and email address with the model authors.
|
| 93 |
+
|
| 94 |
+
## Citation
|
| 95 |
+
|
| 96 |
+
```bibtex
|
| 97 |
+
@article{yu2026loretta,
|
| 98 |
+
title = {LoRetta: A Localization-and-Registration Foundation Model and
|
| 99 |
+
Extensive Dataset for Global-Scale Dense Image Matching},
|
| 100 |
+
author = {Yu, Siwei and Guo, Han and Shi, Zhenwei and Zou, Zhengxia},
|
| 101 |
+
journal = {arXiv preprint},
|
| 102 |
+
year = {2026}
|
| 103 |
+
}
|
| 104 |
+
```
|
| 105 |
+
|
| 106 |
+
## Security contact
|
| 107 |
+
|
| 108 |
+
Please report suspected vulnerabilities privately to `contact@siweiyu.com`. Do not include access tokens, private imagery, credentials, or other sensitive data in the initial report.
|
| 109 |
|
| 110 |
Copyright 2026 LEVIR Lab, Beihang University.
|