Simplify the standalone encoder card
Browse files
README.md
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: cc-by-4.0
|
|
|
|
|
|
|
| 3 |
tags:
|
| 4 |
- remote-sensing
|
| 5 |
- insar
|
|
@@ -8,30 +10,42 @@ tags:
|
|
| 8 |
- egms
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# EGMS
|
| 12 |
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
scatterer displacement time series.
|
| 16 |
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
## Files
|
| 27 |
|
| 28 |
| file | contents |
|
| 29 |
|---|---|
|
| 30 |
-
| `encoder.pt` |
|
| 31 |
-
| `
|
| 32 |
-
| `
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
-
## Use
|
|
|
|
|
|
|
| 35 |
|
| 36 |
```bash
|
| 37 |
git clone https://github.com/risenyard/egms-qa
|
|
@@ -40,41 +54,32 @@ pip install -e .
|
|
| 40 |
|
| 41 |
hf download risenyard/egms-qa-encoder \
|
| 42 |
--local-dir data/encoder/checkpoint
|
| 43 |
-
hf download risenyard/egms-qa-dataset \
|
| 44 |
-
--repo-type dataset --local-dir release/egms-qa-dataset
|
| 45 |
-
python -m egms_qa.release install \
|
| 46 |
-
--release-dir release/egms-qa-dataset --target-root .
|
| 47 |
-
|
| 48 |
-
python -m egms_encoder.extract_tokens --output-dir outputs/tokens
|
| 49 |
-
# -> outputs/tokens/encoder_tokens_10k.pt
|
| 50 |
```
|
| 51 |
|
| 52 |
-
|
| 53 |
-
`artifacts/representations/` in the dataset repository and skip encoder
|
| 54 |
-
execution entirely.
|
| 55 |
|
| 56 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
-
The
|
| 59 |
-
|
| 60 |
-
|
|
|
|
| 61 |
|
| 62 |
-
|
| 63 |
-
already follow the EGMS-QA NPZ contract and released 304-step source axis. A
|
| 64 |
-
user-prepared training corpus must also provide its own split manifest, data
|
| 65 |
-
config, and train-fitted normalization. This release does not download official
|
| 66 |
-
EGMS data, convert arbitrary EGMS ZIP/CSV products, or automatically select a
|
| 67 |
-
time window and normalization for another reference period. Do not reuse the
|
| 68 |
-
released `[8,302)` window blindly for a different EGMS product version.
|
| 69 |
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
|
|
|
| 73 |
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
|
| 78 |
-
|
| 79 |
-
distributed separately in `risenyard/egms-qa-dataset` under the CLMS data
|
| 80 |
-
policy and attribution conditions documented there.
|
|
|
|
| 1 |
---
|
| 2 |
license: cc-by-4.0
|
| 3 |
+
datasets:
|
| 4 |
+
- risenyard/egms-qa-dataset
|
| 5 |
tags:
|
| 6 |
- remote-sensing
|
| 7 |
- insar
|
|
|
|
| 10 |
- egms
|
| 11 |
---
|
| 12 |
|
| 13 |
+
# EGMS-QA Encoder
|
| 14 |
|
| 15 |
+
A frozen spatio-temporal encoder for persistent-scatterer displacement time
|
| 16 |
+
series from the European Ground Motion Service (EGMS).
|
|
|
|
| 17 |
|
| 18 |
+
For each 7 km tile, the encoder converts a variable number of point histories
|
| 19 |
+
into context-aware 256-dimensional point representations. Deterministic 8脳8
|
| 20 |
+
spatial pooling then produces 65 EGMS tokens: one tile-summary token and 64
|
| 21 |
+
cell tokens.
|
| 22 |
|
| 23 |
+
## Input and output
|
| 24 |
+
|
| 25 |
+
| stage | shape |
|
| 26 |
+
|---|---|
|
| 27 |
+
| processed source tile | coordinates `[N,2]`, displacement series `[N,304]` |
|
| 28 |
+
| encoder input | `[N,294]`, using the fixed slice `[8,302)` |
|
| 29 |
+
| point representations | `[N,256]` |
|
| 30 |
+
| pooled EGMS tokens | `[65,256]` plus a 65-element validity mask |
|
| 31 |
+
|
| 32 |
+
The model was pretrained with synchronized-block masked reconstruction. Its
|
| 33 |
+
weights remain frozen when training the language-model translator.
|
| 34 |
|
| 35 |
## Files
|
| 36 |
|
| 37 |
| file | contents |
|
| 38 |
|---|---|
|
| 39 |
+
| `encoder.pt` | encoder state dictionary and embedded architecture arguments |
|
| 40 |
+
| `args.json` | readable architecture and training configuration |
|
| 41 |
+
| `normalization.json` | input mean, standard deviation, and residual scale |
|
| 42 |
+
|
| 43 |
+
Together these files contain the model-specific information needed to load the
|
| 44 |
+
checkpoint. EGMS measurements are not included in this model repository.
|
| 45 |
|
| 46 |
+
## Use
|
| 47 |
+
|
| 48 |
+
Install the code and download the checkpoint:
|
| 49 |
|
| 50 |
```bash
|
| 51 |
git clone https://github.com/risenyard/egms-qa
|
|
|
|
| 54 |
|
| 55 |
hf download risenyard/egms-qa-encoder \
|
| 56 |
--local-dir data/encoder/checkpoint
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
```
|
| 58 |
|
| 59 |
+
Extract tokens from an already prepared compatible NPZ tile collection:
|
|
|
|
|
|
|
| 60 |
|
| 61 |
+
```bash
|
| 62 |
+
python -m egms_encoder.extract_tokens \
|
| 63 |
+
--checkpoint data/encoder/checkpoint/encoder.pt \
|
| 64 |
+
--manifest path/to/split.parquet \
|
| 65 |
+
--data-config path/to/data_config.json \
|
| 66 |
+
--output-dir outputs/tokens
|
| 67 |
+
```
|
| 68 |
|
| 69 |
+
The manifest and data config describe the user's tiles; they are not properties
|
| 70 |
+
of the checkpoint. The released training data and reference manifest are
|
| 71 |
+
available separately in
|
| 72 |
+
[`risenyard/egms-qa-dataset`](https://huggingface.co/datasets/risenyard/egms-qa-dataset).
|
| 73 |
|
| 74 |
+
## Scope
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 75 |
|
| 76 |
+
The encoder expects data that already follow the EGMS-QA NPZ and time-axis
|
| 77 |
+
contract. It does not download or convert official EGMS products. Its outputs
|
| 78 |
+
describe observed deformation histories; they do not establish cause, forecast
|
| 79 |
+
motion, or certify structural safety.
|
| 80 |
|
| 81 |
+
Code: [`risenyard/egms-qa`](https://github.com/risenyard/egms-qa) 路
|
| 82 |
+
Dataset: [`risenyard/egms-qa-dataset`](https://huggingface.co/datasets/risenyard/egms-qa-dataset) 路
|
| 83 |
+
Translator: [`risenyard/egms-qa-translator`](https://huggingface.co/risenyard/egms-qa-translator)
|
| 84 |
|
| 85 |
+
Released under CC-BY-4.0.
|
|
|
|
|
|