reproduction/: the alignment model trained with seven seeds (checkpoints, results, checksums)
Browse files- reproduction/README.md +23 -0
- reproduction/SHA256SUMS.txt +9 -0
- reproduction/meidnet_paper_rerun_seed0.pth +3 -0
- reproduction/meidnet_paper_rerun_seed1.pth +3 -0
- reproduction/meidnet_paper_rerun_seed2.pth +3 -0
- reproduction/meidnet_paper_rerun_seed3.pth +3 -0
- reproduction/meidnet_paper_rerun_seed4.pth +3 -0
- reproduction/meidnet_paper_rerun_seed5.pth +3 -0
- reproduction/meidnet_paper_rerun_seed6.pth +3 -0
- reproduction/results.json +68 -0
reproduction/README.md
ADDED
|
@@ -0,0 +1,23 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# reproduction/ — the alignment model, trained with seven seeds
|
| 2 |
+
|
| 3 |
+
Seven checkpoints of `tri_curri_v1_save.py`, the alignment training script of MEIDNet, trained with seeds 0 to 6 on all
|
| 4 |
+
18,928 Perov-5 materials (2,200 epochs, Python 3.10, torch 2.6.0, one NVIDIA A100, about 7 hours each).
|
| 5 |
+
|
| 6 |
+
`results.json` gives, per seed, the cosine similarity and the L2 distance between the structure latent and the property
|
| 7 |
+
latent of the same material (normalised encoder outputs, before the projection heads) and the structure-matching rate.
|
| 8 |
+
`SHA256SUMS.txt` lists the checksums.
|
| 9 |
+
|
| 10 |
+
| | cosine | L2 | structure matching |
|
| 11 |
+
|---|---|---|---|
|
| 12 |
+
| mean ± s.d. over the seven seeds | 0.954 ± 0.011 | 0.301 ± 0.034 | 86.1 ± 5.0 % |
|
| 13 |
+
|
| 14 |
+
Load a checkpoint with `meidnet.checkpoint.load_checkpoint(path)` (version-1 format, ABX₃ perovskites, properties
|
| 15 |
+
`heat_all` and `dir_gap`), or recompute the numbers on a laptop in about a minute:
|
| 16 |
+
|
| 17 |
+
```bash
|
| 18 |
+
pip install git+https://github.com/ABnano/MEIDNet.git
|
| 19 |
+
meidnet download-data
|
| 20 |
+
python scripts/reproduce_alignment.py --seed 4
|
| 21 |
+
```
|
| 22 |
+
|
| 23 |
+
Results, figures and analysis: https://babu09-meidnet.hf.space/docs/benchmarks/perov5-reproduction.html
|
reproduction/SHA256SUMS.txt
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
9af6307788fcdbd7994c2d18aa085c5ce03c43c2003cef740e8197a891095b08 *meidnet_paper_rerun_seed0.pth
|
| 2 |
+
67f0b0cbc9e58eae24aff693d79d0c15c9df975b22c18f4203ea5e0ce5bdc2ce *meidnet_paper_rerun_seed1.pth
|
| 3 |
+
3e82d459ccb517056f701fd1ab5cd6f215dd7eceefe25fc574b2f561e3115c02 *meidnet_paper_rerun_seed2.pth
|
| 4 |
+
205de8b833900c54841d9dcfe3510a8e4a8a4bb9bbf5516d80cb68a7fc121889 *meidnet_paper_rerun_seed3.pth
|
| 5 |
+
5da9b4dc68b3e98d7c60ff9ba0eef6e062bb54d66d4b1d8cda78857dc50b36ee *meidnet_paper_rerun_seed4.pth
|
| 6 |
+
3f70e752a6f7aeb0e0df05d898a91c54bfd33b246c129cdfda50eba8265f066a *meidnet_paper_rerun_seed5.pth
|
| 7 |
+
399a17f23ec9a1c1be73eeed88c10b5e8b4004f9c77e712cb82b7c45f3c1fe38 *meidnet_paper_rerun_seed6.pth
|
| 8 |
+
95b26aa9660bf641e72089c1d91cbd3ae63ae89f14ce9072adf573629e9f3bf4 *results.json
|
| 9 |
+
51c7a9958c2f285d15c65a3b955e98310f20ac86870a9b9b746c0719de88fd0a *README.md
|
reproduction/meidnet_paper_rerun_seed0.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9af6307788fcdbd7994c2d18aa085c5ce03c43c2003cef740e8197a891095b08
|
| 3 |
+
size 2838994
|
reproduction/meidnet_paper_rerun_seed1.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:67f0b0cbc9e58eae24aff693d79d0c15c9df975b22c18f4203ea5e0ce5bdc2ce
|
| 3 |
+
size 2838994
|
reproduction/meidnet_paper_rerun_seed2.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3e82d459ccb517056f701fd1ab5cd6f215dd7eceefe25fc574b2f561e3115c02
|
| 3 |
+
size 2838994
|
reproduction/meidnet_paper_rerun_seed3.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:205de8b833900c54841d9dcfe3510a8e4a8a4bb9bbf5516d80cb68a7fc121889
|
| 3 |
+
size 2838994
|
reproduction/meidnet_paper_rerun_seed4.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5da9b4dc68b3e98d7c60ff9ba0eef6e062bb54d66d4b1d8cda78857dc50b36ee
|
| 3 |
+
size 2838994
|
reproduction/meidnet_paper_rerun_seed5.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f70e752a6f7aeb0e0df05d898a91c54bfd33b246c129cdfda50eba8265f066a
|
| 3 |
+
size 2838994
|
reproduction/meidnet_paper_rerun_seed6.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:399a17f23ec9a1c1be73eeed88c10b5e8b4004f9c77e712cb82b7c45f3c1fe38
|
| 3 |
+
size 2838538
|
reproduction/results.json
ADDED
|
@@ -0,0 +1,68 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"what": "tri_curri_v1_save.py (the paper's training script, unchanged), retrained 2026-10-04 on all 18,928 Perov-5 materials; cosine and L2 between the normalised encoder outputs (before the projection heads), on the same materials",
|
| 3 |
+
"runs": [
|
| 4 |
+
{
|
| 5 |
+
"file": "meidnet_paper_rerun_seed0.pth",
|
| 6 |
+
"seed": 0,
|
| 7 |
+
"cosine": 0.9563,
|
| 8 |
+
"l2": 0.2934,
|
| 9 |
+
"structure_matching_pct": 90.04,
|
| 10 |
+
"epochs": 2200,
|
| 11 |
+
"script": "tri_curri_v1_save.py"
|
| 12 |
+
},
|
| 13 |
+
{
|
| 14 |
+
"file": "meidnet_paper_rerun_seed1.pth",
|
| 15 |
+
"seed": 1,
|
| 16 |
+
"cosine": 0.9585,
|
| 17 |
+
"l2": 0.2862,
|
| 18 |
+
"structure_matching_pct": 91.41,
|
| 19 |
+
"epochs": 2200,
|
| 20 |
+
"script": "tri_curri_v1_save.py"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"file": "meidnet_paper_rerun_seed2.pth",
|
| 24 |
+
"seed": 2,
|
| 25 |
+
"cosine": 0.9373,
|
| 26 |
+
"l2": 0.3529,
|
| 27 |
+
"structure_matching_pct": 82.91,
|
| 28 |
+
"epochs": 2200,
|
| 29 |
+
"script": "tri_curri_v1_save.py"
|
| 30 |
+
},
|
| 31 |
+
{
|
| 32 |
+
"file": "meidnet_paper_rerun_seed3.pth",
|
| 33 |
+
"seed": 3,
|
| 34 |
+
"cosine": 0.9592,
|
| 35 |
+
"l2": 0.2839,
|
| 36 |
+
"structure_matching_pct": 91.55,
|
| 37 |
+
"epochs": 2200,
|
| 38 |
+
"script": "tri_curri_v1_save.py"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"file": "meidnet_paper_rerun_seed4.pth",
|
| 42 |
+
"seed": 4,
|
| 43 |
+
"cosine": 0.9654,
|
| 44 |
+
"l2": 0.2615,
|
| 45 |
+
"structure_matching_pct": 78.21,
|
| 46 |
+
"epochs": 2200,
|
| 47 |
+
"script": "tri_curri_v1_save.py"
|
| 48 |
+
},
|
| 49 |
+
{
|
| 50 |
+
"file": "meidnet_paper_rerun_seed5.pth",
|
| 51 |
+
"seed": 5,
|
| 52 |
+
"cosine": 0.9586,
|
| 53 |
+
"l2": 0.2863,
|
| 54 |
+
"structure_matching_pct": 85.15,
|
| 55 |
+
"epochs": 2200,
|
| 56 |
+
"script": "tri_curri_v1_save.py"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"file": "meidnet_paper_rerun_seed6.pth",
|
| 60 |
+
"seed": 6,
|
| 61 |
+
"cosine": 0.94,
|
| 62 |
+
"l2": 0.3449,
|
| 63 |
+
"structure_matching_pct": 83.76,
|
| 64 |
+
"epochs": 2200,
|
| 65 |
+
"script": "tri_curri_v1_save.py"
|
| 66 |
+
}
|
| 67 |
+
]
|
| 68 |
+
}
|