Fix released weights: publish trained final state (issue #2)
Browse filesThe previous shards contained an EMA state that was never updated during training (initialization weights) due to a key-prefix mismatch in update_ema under torch.compile + DeepSpeed. This upload replaces them with the final 300K-step training weights, verified to load strictly into Flux2 and to denoise (delta_rms > 0). Adds SHA256SUMS.
- README.md +8 -1
- SHA256SUMS +6 -0
- config.json +1 -1
- model-00001-of-00004.safetensors +1 -1
- model-00002-of-00004.safetensors +1 -1
- model-00003-of-00004.safetensors +1 -1
- model-00004-of-00004.safetensors +1 -1
README.md
CHANGED
|
@@ -36,12 +36,19 @@ exclusively on EO data. GeoCore-9B is a Flow Matching Diffusion Transformer that
|
|
| 36 |
generation on text **and** continuous geospatial metadata — ground sample distance (GSD), latitude
|
| 37 |
and longitude.
|
| 38 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
## Model details
|
| 40 |
|
| 41 |
| | |
|
| 42 |
|---|---|
|
| 43 |
| Parameters | 9.24 B |
|
| 44 |
-
| Weights | EMA, bfloat16, sharded safetensors |
|
| 45 |
| Architecture | Flow Matching DiT — 8 double-stream + 24 single-stream blocks, hidden 4096, 32 heads |
|
| 46 |
| Conditioning | CLIP + T5 text embeddings, GSD, latitude, longitude |
|
| 47 |
| Training data | [Git-10M](https://huggingface.co/datasets/lcybuaa/Git-10M) |
|
|
|
|
| 36 |
generation on text **and** continuous geospatial metadata — ground sample distance (GSD), latitude
|
| 37 |
and longitude.
|
| 38 |
|
| 39 |
+
> [!NOTE]
|
| 40 |
+
> **2026-08-04 — corrected weights.** The initial upload accidentally contained an EMA state that
|
| 41 |
+
> was never updated during training (pure initialization weights — see
|
| 42 |
+
> [GitHub issue #2](https://github.com/KAIST-VICLab/GeoCore-9B/issues/2)). The current files are the
|
| 43 |
+
> final 300K-step training weights, verified to load strictly and denoise correctly. If you
|
| 44 |
+
> downloaded the weights before this date, please re-download and check them against `SHA256SUMS`.
|
| 45 |
+
|
| 46 |
## Model details
|
| 47 |
|
| 48 |
| | |
|
| 49 |
|---|---|
|
| 50 |
| Parameters | 9.24 B |
|
| 51 |
+
| Weights | final training weights (non-EMA), bfloat16, sharded safetensors |
|
| 52 |
| Architecture | Flow Matching DiT — 8 double-stream + 24 single-stream blocks, hidden 4096, 32 heads |
|
| 53 |
| Conditioning | CLIP + T5 text embeddings, GSD, latitude, longitude |
|
| 54 |
| Training data | [Git-10M](https://huggingface.co/datasets/lcybuaa/Git-10M) |
|
SHA256SUMS
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
37867b56a02748c67fe64f60118b6b6cd6966653026ba101abd1bf849e4f4b37 model-00001-of-00004.safetensors
|
| 2 |
+
561831477a146da51524beacbd28e4e4db9c3d66318c98388823e641e920a956 model-00002-of-00004.safetensors
|
| 3 |
+
60107ab28114906426b4187bbca9fda59af121318cb39543a90697b7a7ecef9a model-00003-of-00004.safetensors
|
| 4 |
+
7cef9bd84c652cb25d0868d0f06d3cc4279d8a066db219f9c5f3fb4c7ac7288a model-00004-of-00004.safetensors
|
| 5 |
+
6af0afb014d208f28e04804cb0bbe8bdf3b52a8490cf3610e001b85c17fa8b65 model.safetensors.index.json
|
| 6 |
+
5b289da77aa6062d83ddb87c81b450e452e75f488401329cabbc0890ee2805b3 config.json
|
config.json
CHANGED
|
@@ -18,6 +18,6 @@
|
|
| 18 |
"architecture": "Flux2",
|
| 19 |
"model_size": "9b",
|
| 20 |
"torch_dtype": "bf16",
|
| 21 |
-
"weights": "
|
| 22 |
"training_steps": 300000
|
| 23 |
}
|
|
|
|
| 18 |
"architecture": "Flux2",
|
| 19 |
"model_size": "9b",
|
| 20 |
"torch_dtype": "bf16",
|
| 21 |
+
"weights": "model",
|
| 22 |
"training_steps": 300000
|
| 23 |
}
|
model-00001-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4948246312
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37867b56a02748c67fe64f60118b6b6cd6966653026ba101abd1bf849e4f4b37
|
| 3 |
size 4948246312
|
model-00002-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4966067040
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:561831477a146da51524beacbd28e4e4db9c3d66318c98388823e641e920a956
|
| 3 |
size 4966067040
|
model-00003-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4932512840
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:60107ab28114906426b4187bbca9fda59af121318cb39543a90697b7a7ecef9a
|
| 3 |
size 4932512840
|
model-00004-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3624934504
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7cef9bd84c652cb25d0868d0f06d3cc4279d8a066db219f9c5f3fb4c7ac7288a
|
| 3 |
size 3624934504
|