JeonghyeokDo commited on
Commit
b868c30
·
verified ·
1 Parent(s): 2c8b43a

Fix released weights: publish trained final state (issue #2)

Browse files

The previous shards contained an EMA state that was never updated during training (initialization weights) due to a key-prefix mismatch in update_ema under torch.compile + DeepSpeed. This upload replaces them with the final 300K-step training weights, verified to load strictly into Flux2 and to denoise (delta_rms > 0). Adds SHA256SUMS.

README.md CHANGED
@@ -36,12 +36,19 @@ exclusively on EO data. GeoCore-9B is a Flow Matching Diffusion Transformer that
36
  generation on text **and** continuous geospatial metadata — ground sample distance (GSD), latitude
37
  and longitude.
38
 
 
 
 
 
 
 
 
39
  ## Model details
40
 
41
  | | |
42
  |---|---|
43
  | Parameters | 9.24 B |
44
- | Weights | EMA, bfloat16, sharded safetensors |
45
  | Architecture | Flow Matching DiT — 8 double-stream + 24 single-stream blocks, hidden 4096, 32 heads |
46
  | Conditioning | CLIP + T5 text embeddings, GSD, latitude, longitude |
47
  | Training data | [Git-10M](https://huggingface.co/datasets/lcybuaa/Git-10M) |
 
36
  generation on text **and** continuous geospatial metadata — ground sample distance (GSD), latitude
37
  and longitude.
38
 
39
+ > [!NOTE]
40
+ > **2026-08-04 — corrected weights.** The initial upload accidentally contained an EMA state that
41
+ > was never updated during training (pure initialization weights — see
42
+ > [GitHub issue #2](https://github.com/KAIST-VICLab/GeoCore-9B/issues/2)). The current files are the
43
+ > final 300K-step training weights, verified to load strictly and denoise correctly. If you
44
+ > downloaded the weights before this date, please re-download and check them against `SHA256SUMS`.
45
+
46
  ## Model details
47
 
48
  | | |
49
  |---|---|
50
  | Parameters | 9.24 B |
51
+ | Weights | final training weights (non-EMA), bfloat16, sharded safetensors |
52
  | Architecture | Flow Matching DiT — 8 double-stream + 24 single-stream blocks, hidden 4096, 32 heads |
53
  | Conditioning | CLIP + T5 text embeddings, GSD, latitude, longitude |
54
  | Training data | [Git-10M](https://huggingface.co/datasets/lcybuaa/Git-10M) |
SHA256SUMS ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ 37867b56a02748c67fe64f60118b6b6cd6966653026ba101abd1bf849e4f4b37 model-00001-of-00004.safetensors
2
+ 561831477a146da51524beacbd28e4e4db9c3d66318c98388823e641e920a956 model-00002-of-00004.safetensors
3
+ 60107ab28114906426b4187bbca9fda59af121318cb39543a90697b7a7ecef9a model-00003-of-00004.safetensors
4
+ 7cef9bd84c652cb25d0868d0f06d3cc4279d8a066db219f9c5f3fb4c7ac7288a model-00004-of-00004.safetensors
5
+ 6af0afb014d208f28e04804cb0bbe8bdf3b52a8490cf3610e001b85c17fa8b65 model.safetensors.index.json
6
+ 5b289da77aa6062d83ddb87c81b450e452e75f488401329cabbc0890ee2805b3 config.json
config.json CHANGED
@@ -18,6 +18,6 @@
18
  "architecture": "Flux2",
19
  "model_size": "9b",
20
  "torch_dtype": "bf16",
21
- "weights": "ema",
22
  "training_steps": 300000
23
  }
 
18
  "architecture": "Flux2",
19
  "model_size": "9b",
20
  "torch_dtype": "bf16",
21
+ "weights": "model",
22
  "training_steps": 300000
23
  }
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a7057a4d09362556f8ff2f0bf2a15561adb5f24449f124105896055881f9c2a6
3
  size 4948246312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37867b56a02748c67fe64f60118b6b6cd6966653026ba101abd1bf849e4f4b37
3
  size 4948246312
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5d6beb4d01c4773f8b2b3cd333ad3a92dc06eb933ad29963aaaf32e1c5d0868d
3
  size 4966067040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:561831477a146da51524beacbd28e4e4db9c3d66318c98388823e641e920a956
3
  size 4966067040
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d90c65dd8ff6de3baddb7446f5ba6fa9ab721e8f2b12a42d1e462b9eb8530a3e
3
  size 4932512840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60107ab28114906426b4187bbca9fda59af121318cb39543a90697b7a7ecef9a
3
  size 4932512840
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8127a1d0bbc535562920e12debca65a0eb91434fd91026f33ef755ec8e469d56
3
  size 3624934504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cef9bd84c652cb25d0868d0f06d3cc4279d8a066db219f9c5f3fb4c7ac7288a
3
  size 3624934504