Add resource documentation and statistics
Browse files- .gitignore +1 -0
- LICENSE.md +50 -0
- README.md +48 -0
- SHA256SUMS +7 -0
- stats/mean_std_121x240.npz +3 -0
- stats/mean_std_diff_120x240.npz +3 -0
.gitignore
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
.cache/
|
LICENSE.md
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Model Checkpoint License
|
| 2 |
+
|
| 3 |
+
The following SBDA-distributed model checkpoint files are made available under
|
| 4 |
+
the MIT License stated below:
|
| 5 |
+
|
| 6 |
+
- `model_ckpt/sbda_full.pt`
|
| 7 |
+
- `model_ckpt/sbda_wo_oi_train.pt`
|
| 8 |
+
- `model_ckpt/diffda.pt`
|
| 9 |
+
- `aifs_ckpt/aurora-1.5-finetuned.pt`
|
| 10 |
+
|
| 11 |
+
For the SBDA and baseline DiffDA checkpoints:
|
| 12 |
+
|
| 13 |
+
Copyright (c) 2026 SBDA authors
|
| 14 |
+
|
| 15 |
+
For `aurora-1.5-finetuned.pt`, which was fine-tuned from the Microsoft Aurora
|
| 16 |
+
pretrained model:
|
| 17 |
+
|
| 18 |
+
Copyright (c) Microsoft Corporation.
|
| 19 |
+
Copyright (c) 2026 SBDA authors (fine-tuning contributions)
|
| 20 |
+
|
| 21 |
+
## MIT License
|
| 22 |
+
|
| 23 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 24 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 25 |
+
in the Software without restriction, including without limitation the rights
|
| 26 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 27 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 28 |
+
furnished to do so, subject to the following conditions:
|
| 29 |
+
|
| 30 |
+
The above copyright notices and this permission notice shall be included in all
|
| 31 |
+
copies or substantial portions of the Software.
|
| 32 |
+
|
| 33 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 34 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 35 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 36 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 37 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 38 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 39 |
+
SOFTWARE.
|
| 40 |
+
|
| 41 |
+
## Scope
|
| 42 |
+
|
| 43 |
+
This license applies to the checkpoint files listed above. It does not relicense
|
| 44 |
+
the source code needed to run them. In particular, the I2SB-derived source files
|
| 45 |
+
used by the SBDA pipeline remain subject to the NVIDIA Source Code License for
|
| 46 |
+
I2SB and its non-commercial research-or-evaluation limitation. It also does not
|
| 47 |
+
change the terms of ERA5 or any other training, evaluation, or input data.
|
| 48 |
+
|
| 49 |
+
The Microsoft Aurora attribution applicable to the fine-tuned checkpoint is
|
| 50 |
+
included above.
|
README.md
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: pytorch
|
| 4 |
+
tags:
|
| 5 |
+
- weather
|
| 6 |
+
- data-assimilation
|
| 7 |
+
- diffusion-models
|
| 8 |
+
- aurora
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# SBDA Resources
|
| 12 |
+
|
| 13 |
+
This repository contains the model checkpoints, normalization statistics, and
|
| 14 |
+
sparse-observation mask required to reproduce the SBDA experiments.
|
| 15 |
+
|
| 16 |
+
## Files
|
| 17 |
+
|
| 18 |
+
| Path | Purpose |
|
| 19 |
+
| --- | --- |
|
| 20 |
+
| `model_ckpt/sbda_full.pt` | Full SBDA checkpoint |
|
| 21 |
+
| `model_ckpt/sbda_wo_oi_train.pt` | SBDA checkpoint trained without observation refinement |
|
| 22 |
+
| `model_ckpt/diffda.pt` | Baseline DiffDA checkpoint |
|
| 23 |
+
| `aifs_ckpt/aurora-1.5-finetuned.pt` | Fine-tuned Aurora checkpoint for background generation and forecast evaluation |
|
| 24 |
+
| `stats/mean_std_121x240.npz` | ERA5 normalization statistics used by all experiments |
|
| 25 |
+
| `stats/mean_std_diff_120x240.npz` | ERA5–Aurora difference statistics used by baseline DiffDA |
|
| 26 |
+
| `mask/mask_120x240_1pct.pt` | Fixed 1% sparse-observation mask |
|
| 27 |
+
|
| 28 |
+
Download all resources into the `resource/` directory of the code release:
|
| 29 |
+
|
| 30 |
+
```bash
|
| 31 |
+
hf download strayee/SBDA --local-dir resource
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
File integrity can be checked with:
|
| 35 |
+
|
| 36 |
+
```bash
|
| 37 |
+
sha256sum -c SHA256SUMS
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
## License
|
| 41 |
+
|
| 42 |
+
The distributed checkpoints are released under the MIT terms in `LICENSE.md`.
|
| 43 |
+
The fine-tuned Aurora checkpoint retains the Microsoft Aurora MIT notice. The
|
| 44 |
+
license of these files does not relicense the software required to run them or
|
| 45 |
+
the ERA5-derived source data; see `LICENSE.md` for the precise scope.
|
| 46 |
+
|
| 47 |
+
PyTorch `.pt` files may use Python pickle internally. Load checkpoint files only
|
| 48 |
+
from a source you trust.
|
SHA256SUMS
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
43a2f7a284d7ff9be9fb6af4dec64bd51fbbc17a889727dc43c8d83cbb3603b8 aifs_ckpt/aurora-1.5-finetuned.pt
|
| 2 |
+
83a4a37b415e294fff026538f40257dda90a8b97f1f9597443ec42346dcb20d2 mask/mask_120x240_1pct.pt
|
| 3 |
+
435c2a59a9cefef3597f1c0089b298b2a24cd4c8167bd650439f1b0de15f6912 model_ckpt/diffda.pt
|
| 4 |
+
2f3b968944120523d82ec92446ee2d07d6136c95dbdbdcb5539811135f4a4019 model_ckpt/sbda_full.pt
|
| 5 |
+
36b7373623a778f8a2165f0cdefffe8b3bcdf2eb167f353bdbec9a5c217cc0e7 model_ckpt/sbda_wo_oi_train.pt
|
| 6 |
+
59331519ff85f6d0e1e8cee64e44d602534a1e435568eb1b6444242b105eaf9c stats/mean_std_121x240.npz
|
| 7 |
+
6b73aac377aa11b6d143176344215d52ef905c3ac397c21d7abf05f83663fc97 stats/mean_std_diff_120x240.npz
|
stats/mean_std_121x240.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:59331519ff85f6d0e1e8cee64e44d602534a1e435568eb1b6444242b105eaf9c
|
| 3 |
+
size 1052
|
stats/mean_std_diff_120x240.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6b73aac377aa11b6d143176344215d52ef905c3ac397c21d7abf05f83663fc97
|
| 3 |
+
size 1052
|