zyfz0um commited on
Commit
908d2a9
·
verified ·
1 Parent(s): 6639464

Add complete SADER model card and usage guide

Browse files
Files changed (1) hide show
  1. README.md +158 -10
README.md CHANGED
@@ -1,16 +1,164 @@
1
  ---
2
  license: other
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
4
- # TGRS-CREDM weights
5
 
6
- Cloud-removal diffusion model weights and configs (TGRS-CREDM project).
7
 
8
- | 目录 | 内容 | 权重大小 |
9
- |---|---|---|
10
- | `tsdesign/` | TS-design 最终模型 final_ckpt | 1.23 GB |
11
- | `newdesign/` | New-design 最终模型 final_ckpt | 0.31 GB |
12
- | `tsmask/` | TS-mask 最终模型 final_ckpt | 0.83 GB |
13
- | `pretrained/` | MAE 预训练骨干(5 组:eurosat rgb/ms/rgbn × mask 比例,含 loss 曲线)| ~0.16 GB |
14
 
15
- 每个目录内含:`final_ckpt/last.ckpt`(或 `checkpoint.pth`)、`configs/*.yaml`(project/lightning 配置)、`testtube/`(hparams 与 metrics.csv)。
16
- 权重为 PyTorch Lightning checkpoint(dict 格式),大于 10 MB 的文件由 HF LFS 自动托管。
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
+ library_name: pytorch-lightning
4
+ pipeline_tag: image-to-image
5
+ tags:
6
+ - remote-sensing
7
+ - cloud-removal
8
+ - image-restoration
9
+ - diffusion
10
+ - multi-temporal
11
+ - sentinel-2
12
+ - pytorch
13
+ - pytorch-lightning
14
+ - geospatial
15
+ - arxiv:2602.00536
16
  ---
 
17
 
18
+ # SADER
19
 
20
+ Official checkpoints for **SADER: Structure-Aware Diffusion Framework with Deterministic Resampling for Multi-Temporal Remote Sensing Cloud Removal**.
 
 
 
 
 
21
 
22
+ SADER combines a multi-temporal conditional denoising network, a cloud-aware training objective, and deterministic resampling for cloud-free reconstruction from temporally aligned Sentinel-2 observations.
23
+
24
+ - **Paper:** [arXiv:2602.00536](https://arxiv.org/abs/2602.00536)
25
+ - **Code and inference instructions:** [github.com/zyfzs0/SADER](https://github.com/zyfzs0/SADER)
26
+ - **Issues:** [github.com/zyfzs0/SADER/issues](https://github.com/zyfzs0/SADER/issues)
27
+
28
+ ## Released checkpoints
29
+
30
+ The two primary SADER checkpoints correspond to the benchmark settings reported in the paper.
31
+
32
+ | Directory | Dataset / setting | Model output | Main checkpoint | MAE checkpoint used by deterministic resampling |
33
+ |---|---|---|---|---|
34
+ | `newdesign/` | Sen2_MTC_New; three temporal RGB+NIR observations | RGB | `newdesign/final_ckpt/last.ckpt` | `pretrained/imputation_mask0.5_MAE_eurosat_rgb_dm192_bs16_lr0.001_Exp_0/checkpoint.pth` |
35
+ | `tsdesign/` | SEN12MS-CR-TS(EA); three temporal Sentinel-2 observations with 13 bands | 13 Sentinel-2 bands | `tsdesign/final_ckpt/last.ckpt` | `pretrained/imputation_mask0.5_MAE_eurosat_ms_dm192_bs16_lr0.001_Exp_0/checkpoint.pth` |
36
+
37
+ The repository also contains:
38
+
39
+ - `tsmask/`: an additional mask-conditioned SEN12MS-CR-TS(EA) experimental checkpoint and its run snapshots.
40
+ - `pretrained/`: five EuroSAT MAE checkpoints used in the final configurations or auxiliary pretraining experiments.
41
+ - `*/configs/`: the original project and PyTorch Lightning configuration snapshots.
42
+ - `*/testtube/`: saved hyperparameters and training metric logs.
43
+
44
+ The configuration snapshots preserve the paths used for the original runs. Replace all dataset paths and checkpoint paths with locations on your system before running the code.
45
+
46
+ ## Download
47
+
48
+ Install the Hugging Face CLI:
49
+
50
+ ```bash
51
+ pip install -U huggingface_hub
52
+ ```
53
+
54
+ Download the complete release (approximately 2.7 GB):
55
+
56
+ ```bash
57
+ hf download zyfz0um/SADER --local-dir ./sader_weights
58
+ ```
59
+
60
+ Download only the Sen2_MTC_New model and its MAE checkpoint:
61
+
62
+ ```bash
63
+ hf download zyfz0um/SADER \
64
+ newdesign/final_ckpt/last.ckpt \
65
+ pretrained/imputation_mask0.5_MAE_eurosat_rgb_dm192_bs16_lr0.001_Exp_0/checkpoint.pth \
66
+ --local-dir ./sader_weights
67
+ ```
68
+
69
+ Download only the SEN12MS-CR-TS(EA) model and its MAE checkpoint:
70
+
71
+ ```bash
72
+ hf download zyfz0um/SADER \
73
+ tsdesign/final_ckpt/last.ckpt \
74
+ pretrained/imputation_mask0.5_MAE_eurosat_ms_dm192_bs16_lr0.001_Exp_0/checkpoint.pth \
75
+ --local-dir ./sader_weights
76
+ ```
77
+
78
+ ## Use with the official code
79
+
80
+ Clone the code and initialize the MAE submodule:
81
+
82
+ ```bash
83
+ git clone --recursive https://github.com/zyfzs0/SADER.git
84
+ cd SADER
85
+ pip install -r requirements.txt
86
+ ```
87
+
88
+ Download the required checkpoint pair into the code repository, then edit the corresponding YAML file:
89
+
90
+ | Dataset | Official YAML file |
91
+ |---|---|
92
+ | Sen2_MTC_New | `configs/example_training/sen2_mtc_new_TemporalAdm_repaint_mae.yaml` |
93
+ | SEN12MS-CR-TS(EA) | `configs/example_training/sentinelts_new_repaint_mae.yaml` |
94
+
95
+ Update the following entries in the YAML file:
96
+
97
+ 1. `model.ckpt_path`: path to the SADER `last.ckpt` file.
98
+ 2. `sampler_config.params.mae_config.params.configs.model_path`: path to the corresponding MAE `checkpoint.pth` file.
99
+ 3. Dataset paths under `data.params`.
100
+
101
+ Run evaluation:
102
+
103
+ ```bash
104
+ python main.py \
105
+ --base configs/example_training/<CONFIG_FILE>.yaml \
106
+ --enable_tf32 \
107
+ -t false
108
+ ```
109
+
110
+ Run prediction and save reconstructed images:
111
+
112
+ ```bash
113
+ python main.py \
114
+ --base configs/example_training/<CONFIG_FILE>.yaml \
115
+ --enable_tf32 \
116
+ -t false \
117
+ --no-test true \
118
+ --predict true
119
+ ```
120
+
121
+ See the [official GitHub README](https://github.com/zyfzs0/SADER#tadausage) for dataset preparation, environment setup, training, testing, and prediction details.
122
+
123
+ ## Input and output settings
124
+
125
+ | Dataset | Temporal input | Auxiliary information | Reconstruction target |
126
+ |---|---|---|---|
127
+ | Sen2_MTC_New | Three aligned observations | NIR is used together with RGB as conditional information | RGB image |
128
+ | SEN12MS-CR-TS(EA) | Three aligned Sentinel-2 observations | No additional auxiliary channel | All 13 Sentinel-2 bands |
129
+
130
+ The released configurations use 256 × 256 image patches and `T = 3` temporal observations.
131
+
132
+ ## Reported results
133
+
134
+ The following results use the evaluation protocol reported in the paper.
135
+
136
+ | Dataset | PSNR ↑ | SSIM ↑ | LPIPS ↓ | SAM (°) ↓ |
137
+ |---|---:|---:|---:|---:|
138
+ | Sen2_MTC_New | 20.941 | 0.729 | 0.228 | — |
139
+ | SEN12MS-CR-TS(EA) | 31.234 | 0.937 | — | 5.885 |
140
+
141
+ ## Intended use and limitations
142
+
143
+ These checkpoints are intended for research and reproducibility in multi-temporal remote sensing cloud removal. Performance may change for sensors, spectral configurations, geographic regions, temporal lengths, or preprocessing pipelines that differ from the two reported benchmarks. The full MTCDN is computationally demanding despite its compact parameter count.
144
+
145
+ The `.ckpt` and `.pth` files use PyTorch serialization, which may rely on pickle. Load checkpoint files only from a source you trust.
146
+
147
+ ## License
148
+
149
+ This repository currently declares the license as `other`; no separate license for the released weights has been specified. Please contact the authors with licensing questions.
150
+
151
+ ## Citation
152
+
153
+ ```bibtex
154
+ @article{zhang2026sader,
155
+ title={SADER: Structure-Aware Diffusion Framework with Deterministic Resampling for Multi-Temporal Remote Sensing Cloud Removal},
156
+ author={Zhang, Yifan and Chen, Qian and Liu, Yi and Li, Wengen and Guan, Jihong},
157
+ journal={arXiv preprint arXiv:2602.00536},
158
+ year={2026}
159
+ }
160
+ ```
161
+
162
+ ## Contact
163
+
164
+ For questions, please open an issue in the [SADER GitHub repository](https://github.com/zyfzs0/SADER/issues) or contact `yifanzhg@umich.edu` / `2250951@tongji.edu.cn`.