Babu09 commited on
Commit
aa1f6a4
·
verified ·
1 Parent(s): 1355870

reproduction/: the alignment model trained with seven seeds (checkpoints, results, checksums)

Browse files
reproduction/README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # reproduction/ — the alignment model, trained with seven seeds
2
+
3
+ Seven checkpoints of `tri_curri_v1_save.py`, the alignment training script of MEIDNet, trained with seeds 0 to 6 on all
4
+ 18,928 Perov-5 materials (2,200 epochs, Python 3.10, torch 2.6.0, one NVIDIA A100, about 7 hours each).
5
+
6
+ `results.json` gives, per seed, the cosine similarity and the L2 distance between the structure latent and the property
7
+ latent of the same material (normalised encoder outputs, before the projection heads) and the structure-matching rate.
8
+ `SHA256SUMS.txt` lists the checksums.
9
+
10
+ | | cosine | L2 | structure matching |
11
+ |---|---|---|---|
12
+ | mean ± s.d. over the seven seeds | 0.954 ± 0.011 | 0.301 ± 0.034 | 86.1 ± 5.0 % |
13
+
14
+ Load a checkpoint with `meidnet.checkpoint.load_checkpoint(path)` (version-1 format, ABX₃ perovskites, properties
15
+ `heat_all` and `dir_gap`), or recompute the numbers on a laptop in about a minute:
16
+
17
+ ```bash
18
+ pip install git+https://github.com/ABnano/MEIDNet.git
19
+ meidnet download-data
20
+ python scripts/reproduce_alignment.py --seed 4
21
+ ```
22
+
23
+ Results, figures and analysis: https://babu09-meidnet.hf.space/docs/benchmarks/perov5-reproduction.html
reproduction/SHA256SUMS.txt ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ 9af6307788fcdbd7994c2d18aa085c5ce03c43c2003cef740e8197a891095b08 *meidnet_paper_rerun_seed0.pth
2
+ 67f0b0cbc9e58eae24aff693d79d0c15c9df975b22c18f4203ea5e0ce5bdc2ce *meidnet_paper_rerun_seed1.pth
3
+ 3e82d459ccb517056f701fd1ab5cd6f215dd7eceefe25fc574b2f561e3115c02 *meidnet_paper_rerun_seed2.pth
4
+ 205de8b833900c54841d9dcfe3510a8e4a8a4bb9bbf5516d80cb68a7fc121889 *meidnet_paper_rerun_seed3.pth
5
+ 5da9b4dc68b3e98d7c60ff9ba0eef6e062bb54d66d4b1d8cda78857dc50b36ee *meidnet_paper_rerun_seed4.pth
6
+ 3f70e752a6f7aeb0e0df05d898a91c54bfd33b246c129cdfda50eba8265f066a *meidnet_paper_rerun_seed5.pth
7
+ 399a17f23ec9a1c1be73eeed88c10b5e8b4004f9c77e712cb82b7c45f3c1fe38 *meidnet_paper_rerun_seed6.pth
8
+ 95b26aa9660bf641e72089c1d91cbd3ae63ae89f14ce9072adf573629e9f3bf4 *results.json
9
+ 51c7a9958c2f285d15c65a3b955e98310f20ac86870a9b9b746c0719de88fd0a *README.md
reproduction/meidnet_paper_rerun_seed0.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9af6307788fcdbd7994c2d18aa085c5ce03c43c2003cef740e8197a891095b08
3
+ size 2838994
reproduction/meidnet_paper_rerun_seed1.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67f0b0cbc9e58eae24aff693d79d0c15c9df975b22c18f4203ea5e0ce5bdc2ce
3
+ size 2838994
reproduction/meidnet_paper_rerun_seed2.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e82d459ccb517056f701fd1ab5cd6f215dd7eceefe25fc574b2f561e3115c02
3
+ size 2838994
reproduction/meidnet_paper_rerun_seed3.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:205de8b833900c54841d9dcfe3510a8e4a8a4bb9bbf5516d80cb68a7fc121889
3
+ size 2838994
reproduction/meidnet_paper_rerun_seed4.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5da9b4dc68b3e98d7c60ff9ba0eef6e062bb54d66d4b1d8cda78857dc50b36ee
3
+ size 2838994
reproduction/meidnet_paper_rerun_seed5.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f70e752a6f7aeb0e0df05d898a91c54bfd33b246c129cdfda50eba8265f066a
3
+ size 2838994
reproduction/meidnet_paper_rerun_seed6.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:399a17f23ec9a1c1be73eeed88c10b5e8b4004f9c77e712cb82b7c45f3c1fe38
3
+ size 2838538
reproduction/results.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "what": "tri_curri_v1_save.py (the paper's training script, unchanged), retrained 2026-10-04 on all 18,928 Perov-5 materials; cosine and L2 between the normalised encoder outputs (before the projection heads), on the same materials",
3
+ "runs": [
4
+ {
5
+ "file": "meidnet_paper_rerun_seed0.pth",
6
+ "seed": 0,
7
+ "cosine": 0.9563,
8
+ "l2": 0.2934,
9
+ "structure_matching_pct": 90.04,
10
+ "epochs": 2200,
11
+ "script": "tri_curri_v1_save.py"
12
+ },
13
+ {
14
+ "file": "meidnet_paper_rerun_seed1.pth",
15
+ "seed": 1,
16
+ "cosine": 0.9585,
17
+ "l2": 0.2862,
18
+ "structure_matching_pct": 91.41,
19
+ "epochs": 2200,
20
+ "script": "tri_curri_v1_save.py"
21
+ },
22
+ {
23
+ "file": "meidnet_paper_rerun_seed2.pth",
24
+ "seed": 2,
25
+ "cosine": 0.9373,
26
+ "l2": 0.3529,
27
+ "structure_matching_pct": 82.91,
28
+ "epochs": 2200,
29
+ "script": "tri_curri_v1_save.py"
30
+ },
31
+ {
32
+ "file": "meidnet_paper_rerun_seed3.pth",
33
+ "seed": 3,
34
+ "cosine": 0.9592,
35
+ "l2": 0.2839,
36
+ "structure_matching_pct": 91.55,
37
+ "epochs": 2200,
38
+ "script": "tri_curri_v1_save.py"
39
+ },
40
+ {
41
+ "file": "meidnet_paper_rerun_seed4.pth",
42
+ "seed": 4,
43
+ "cosine": 0.9654,
44
+ "l2": 0.2615,
45
+ "structure_matching_pct": 78.21,
46
+ "epochs": 2200,
47
+ "script": "tri_curri_v1_save.py"
48
+ },
49
+ {
50
+ "file": "meidnet_paper_rerun_seed5.pth",
51
+ "seed": 5,
52
+ "cosine": 0.9586,
53
+ "l2": 0.2863,
54
+ "structure_matching_pct": 85.15,
55
+ "epochs": 2200,
56
+ "script": "tri_curri_v1_save.py"
57
+ },
58
+ {
59
+ "file": "meidnet_paper_rerun_seed6.pth",
60
+ "seed": 6,
61
+ "cosine": 0.94,
62
+ "l2": 0.3449,
63
+ "structure_matching_pct": 83.76,
64
+ "epochs": 2200,
65
+ "script": "tri_curri_v1_save.py"
66
+ }
67
+ ]
68
+ }