neurips-dataset commited on
Commit
a552579
·
verified ·
1 Parent(s): 915ea18

Add OrbFlow QM9 and MD checkpoints

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +80 -0
  2. md_benzene_k3l3_slim_10k100k/config.yaml +191 -0
  3. md_benzene_k3l3_slim_10k100k/epoch=1730-step=108990.ckpt +3 -0
  4. md_benzene_k3l3_slim_10k100k/metadata.json +1 -0
  5. md_benzene_k3l3_slim_10k100k_seed42/config.yaml +196 -0
  6. md_benzene_k3l3_slim_10k100k_seed42/epoch=1741-step=109683.ckpt +3 -0
  7. md_benzene_k3l3_slim_10k100k_seed42/metadata.json +1 -0
  8. md_benzene_k3l3_slim_10k100k_seed505/config.yaml +196 -0
  9. md_benzene_k3l3_slim_10k100k_seed505/epoch=872-step=109872.ckpt +3 -0
  10. md_benzene_k3l3_slim_10k100k_seed505/metadata.json +1 -0
  11. md_ethane_k3l3_slim_10k100k/config.yaml +191 -0
  12. md_ethane_k3l3_slim_10k100k/epoch=440-step=55000.ckpt +3 -0
  13. md_ethane_k3l3_slim_10k100k/metadata.json +1 -0
  14. md_ethane_k3l3_slim_10k100k_seed42/config.yaml +196 -0
  15. md_ethane_k3l3_slim_10k100k_seed42/epoch=829-step=103625.ckpt +3 -0
  16. md_ethane_k3l3_slim_10k100k_seed42/metadata.json +1 -0
  17. md_ethane_k3l3_slim_10k100k_seed505/config.yaml +196 -0
  18. md_ethane_k3l3_slim_10k100k_seed505/epoch=429-step=107250.ckpt +3 -0
  19. md_ethane_k3l3_slim_10k100k_seed505/metadata.json +1 -0
  20. md_ethanol_k3l3_slim_10k100k/config.yaml +196 -0
  21. md_ethanol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt +3 -0
  22. md_ethanol_k3l3_slim_10k100k/metadata.json +1 -0
  23. md_ethanol_k3l3_slim_10k100k_seed42/config.yaml +196 -0
  24. md_ethanol_k3l3_slim_10k100k_seed42/epoch=1748-step=110000.ckpt +3 -0
  25. md_ethanol_k3l3_slim_10k100k_seed42/metadata.json +1 -0
  26. md_ethanol_k3l3_slim_10k100k_seed505/config.yaml +196 -0
  27. md_ethanol_k3l3_slim_10k100k_seed505/epoch=434-step=54684.ckpt +3 -0
  28. md_ethanol_k3l3_slim_10k100k_seed505/metadata.json +1 -0
  29. md_malonaldehyde_k3l3_slim_10k100k/config.yaml +191 -0
  30. md_malonaldehyde_k3l3_slim_10k100k/epoch=148-step=18500.ckpt +3 -0
  31. md_malonaldehyde_k3l3_slim_10k100k/metadata.json +1 -0
  32. md_malonaldehyde_k3l3_slim_10k100k_seed42/config.yaml +196 -0
  33. md_malonaldehyde_k3l3_slim_10k100k_seed42/epoch=320-step=40000.ckpt +3 -0
  34. md_malonaldehyde_k3l3_slim_10k100k_seed42/metadata.json +1 -0
  35. md_malonaldehyde_k3l3_slim_10k100k_seed505/config.yaml +196 -0
  36. md_malonaldehyde_k3l3_slim_10k100k_seed505/epoch=108-step=27000.ckpt +3 -0
  37. md_malonaldehyde_k3l3_slim_10k100k_seed505/metadata.json +1 -0
  38. md_phenol_k3l3_slim_10k100k/config.yaml +196 -0
  39. md_phenol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt +3 -0
  40. md_phenol_k3l3_slim_10k100k/metadata.json +1 -0
  41. md_phenol_k3l3_slim_10k100k_seed42/config.yaml +196 -0
  42. md_phenol_k3l3_slim_10k100k_seed42/epoch=712-step=44856-v1.ckpt +3 -0
  43. md_phenol_k3l3_slim_10k100k_seed42/metadata.json +1 -0
  44. md_phenol_k3l3_slim_10k100k_seed505/config.yaml +196 -0
  45. md_phenol_k3l3_slim_10k100k_seed505/epoch=477-step=60102.ckpt +3 -0
  46. md_phenol_k3l3_slim_10k100k_seed505/metadata.json +1 -0
  47. md_resorcinol_k3l3_slim_10k100k/config.yaml +191 -0
  48. md_resorcinol_k3l3_slim_10k100k/epoch=698-step=43974.ckpt +3 -0
  49. md_resorcinol_k3l3_slim_10k100k/metadata.json +1 -0
  50. md_resorcinol_k3l3_slim_10k100k_seed42/config.yaml +196 -0
README.md ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - chemistry
5
+ - electron-density
6
+ - flow-matching
7
+ - equivariant-neural-networks
8
+ - qm9
9
+ datasets:
10
+ - divelab/OrbFlow-data
11
+ ---
12
+
13
+ # OrbFlow checkpoints
14
+
15
+ Trained checkpoints for **OrbFlow**, which predicts atomic-orbital expansion coefficients (and the resulting
16
+ electron density) with equivariant flow matching.
17
+
18
+ - Code: https://github.com/TODO/OrbFlow
19
+ - Data: [divelab/OrbFlow-data](https://huggingface.co/datasets/divelab/OrbFlow-data)
20
+ - Paper: TODO
21
+
22
+ ## Contents
23
+
24
+ Each folder is one training run with its **best-validation checkpoint**, `config.yaml` and `metadata.json`.
25
+ Optimizer state has been removed, so these files are for evaluation and inference; they cannot resume training.
26
+
27
+ | Folder | Model | Seeds | Checkpoint size |
28
+ |--------|-------|-------|-----------------|
29
+ | `qm9_qhf_eqv3_gt_2ph_final`, `…_s42`, `…_s123` | QM9: EquiformerV3, 8 layers, ℓmax = 6; 75k endpoint → 450k integrated-density training | 0, 42, 123 | 1.2 GB |
30
+ | `md_<mol>_k3l3_slim_10k100k`, `…_seed42`, `…_seed505` | MD: slim EquiformerV3, 3 layers, ℓmax = 3; 10k → 110k | 0, 42, 505 | 155 MB |
31
+
32
+ MD molecules: benzene, ethane, ethanol, malonaldehyde, phenol, resorcinol.
33
+ The seed-505 phenol and resorcinol runs stopped at ~60k of their 110k training steps (job time limit); their best-validation checkpoints are from step ~60k.
34
+
35
+ ## Usage
36
+
37
+ Download into the root of the OrbFlow code repository, so the folder names match what the evaluation scripts expect:
38
+
39
+ ```bash
40
+ git clone https://github.com/TODO/OrbFlow.git && cd OrbFlow
41
+ # set up the environment and .env as described in the code README, then:
42
+ hf download divelab/OrbFlow --local-dir .
43
+
44
+ # QM9 test set (Euler K = 2 and 3; full test split and last 1600 molecules)
45
+ CKPT_PATH=qm9_qhf_eqv3_gt_2ph_final sbatch vision/test_qhf_eqv3_gt_2ph_final_full.slurm
46
+
47
+ # MD test sets (6 molecules); for other seeds use EXP_SUFFIX=md_%s_k3l3_slim_10k100k_seed42
48
+ sbatch vision/test_flow_md_paper_2phase_beta13_all6.slurm
49
+ ```
50
+
51
+ To download a single run: `hf download divelab/OrbFlow --include "qm9_qhf_eqv3_gt_2ph_final/*" --local-dir .`
52
+
53
+ ## Results
54
+
55
+ Test nMAPE (%) with Euler K = 2, mean ± std over training seeds, computed with the evaluation scripts above.
56
+
57
+ **QM9** (10,000 test molecules, seeds 0 / 42 / 123)
58
+
59
+ | Split | nMAPE (%) |
60
+ |-------|-----------|
61
+ | Full test set | 0.1518 ± 0.0008 |
62
+ | Last 1,600 molecules | 0.1646 ± 0.0008 |
63
+
64
+ **MD** (seeds 0 / 42 / 505)
65
+
66
+ | Molecule | nMAPE (%) |
67
+ |----------|-----------|
68
+ | benzene | 0.4210 ± 0.0017 |
69
+ | ethane | 0.8706 ± 0.0084 |
70
+ | ethanol | 1.0784 ± 0.0229 |
71
+ | malonaldehyde | 1.1771 ± 0.0127 |
72
+ | phenol | 0.5753 ± 0.0083 |
73
+ | resorcinol | 0.6626 ± 0.0136 |
74
+ | **average (6 molecules)** | **0.7975 ± 0.0067** |
75
+
76
+ ## Citation
77
+
78
+ TODO
79
+
80
+ OrbFlow builds on [SCDP](https://github.com/kyonofx/scdp) (Fu et al., NeurIPS 2024).
md_benzene_k3l3_slim_10k100k/config.yaml ADDED
@@ -0,0 +1,191 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/benzene
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ flow_velocity_mlp_hidden: 512
81
+ flow_time_dim: 64
82
+ flow_head: escn
83
+ flow_e3nn_hidden_multiplier: 2
84
+ bridge_mode: cfm
85
+ flow_loss_mode: endpoint
86
+ flow_endpoint_loss: integrated_density
87
+ flow_target_mode: gt
88
+ flow_use_t_scale: false
89
+ flow_t_scale_max: 0.9
90
+ flow_prior_mode: irrep_gaussian
91
+ flow_prior_sigma: 1.8172615989393406
92
+ flow_prior_mu: 0.008670088241267512
93
+ flow_prior_nelectron_normalize: false
94
+ flow_nelectron_mc_max_probes: 0
95
+ flow_val_integrate_steps: 2
96
+ flow_val_integrate_sweep_steps:
97
+ - 1
98
+ - 2
99
+ - 3
100
+ flow_integrate_train_steps: 2
101
+ flow_integrate_min_t: 0.01
102
+ flow_integrate_schedule: uniform
103
+ flow_integrate_t_hi: 0.99
104
+ flow_integrate_power: 4.0
105
+ flow_val_max_n_probe_per_pass: 400000
106
+ flow_val_log_readout: false
107
+ sb_sigma: 0.1
108
+ sb_noise_mode: isotropic
109
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
110
+ sb_per_l_sigma_scales: null
111
+ train:
112
+ seed: 0
113
+ deterministic: true
114
+ run_post_fit_test: false
115
+ trainer:
116
+ fast_dev_run: false
117
+ accelerator: gpu
118
+ strategy: ddp_find_unused_parameters_true
119
+ devices: 4
120
+ precision: 32
121
+ max_epochs: 100000
122
+ max_steps: 110000
123
+ num_sanity_val_steps: 2
124
+ gradient_clip_val: 0.5
125
+ val_check_interval: 1.0
126
+ deterministic: ${train.deterministic}
127
+ optim:
128
+ _target_: torch.optim.Adam
129
+ lr: 0.001
130
+ betas:
131
+ - 0.9
132
+ - 0.999
133
+ eps: 1.0e-08
134
+ weight_decay: 0.0
135
+ lr_scheduler:
136
+ _target_: scdp.model.utils.PowerDecayScheduler
137
+ warmup_steps: 1000
138
+ alpha: 0.96
139
+ beta: 4433
140
+ lr_schedule_freq: 1
141
+ ema:
142
+ decay: 0.995
143
+ restore:
144
+ ckpt_or_run_path: null
145
+ mode: null
146
+ weights_only: false
147
+ monitor:
148
+ metric: nmape/val_flow
149
+ mode: min
150
+ callbacks:
151
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
152
+ patience: 10000
153
+ verbose: false
154
+ monitor: ${train.monitor.metric}
155
+ mode: ${train.monitor.mode}
156
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
157
+ dirpath: ${core.storage_dir}
158
+ save_top_k: 2
159
+ save_last: true
160
+ verbose: false
161
+ monitor: ${train.monitor.metric}
162
+ mode: ${train.monitor.mode}
163
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
164
+ logging_interval: step
165
+ log_momentum: false
166
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
167
+ refresh_rate: 20
168
+ logging:
169
+ upload:
170
+ run_files: false
171
+ source: true
172
+ wandb:
173
+ name: ${core.expname}
174
+ project: ${core.project_name}
175
+ entity: null
176
+ log_model: ${..upload.run_files}
177
+ mode: online
178
+ tags: ${core.tags}
179
+ resume: allow
180
+ wandb_watch:
181
+ log: all
182
+ log_freq: 100
183
+ core:
184
+ expname: md_benzene_k3l3_slim_10k100k
185
+ project_name: orbflow
186
+ storage_dir: ${core.expname}
187
+ version: 0.0.1
188
+ tags: null
189
+ conventions:
190
+ x_key: x
191
+ y_key: 'y'
md_benzene_k3l3_slim_10k100k/epoch=1730-step=108990.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c97567e39c5591b60498012578d1c3c2418bf082d774c8dc60e51318cf7fa72c
3
+ size 154821792
md_benzene_k3l3_slim_10k100k/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.049426741898059845, "target_var": 0.09023545682430267, "avg_num_neighbors": 11, "unique_atom_types": [0, 1, 6]}
md_benzene_k3l3_slim_10k100k_seed42/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/benzene
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 1.8172615989393406
97
+ flow_prior_mu: 0.008670088241267512
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 42
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_benzene_k3l3_slim_10k100k_seed42
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_benzene_k3l3_slim_10k100k_seed42/epoch=1741-step=109683.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e91a9ef42a774f8dff79251293f099fb4cfbc5e329ae564d75bb6a927b6f0163
3
+ size 154821984
md_benzene_k3l3_slim_10k100k_seed42/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.049426741898059845, "target_var": 0.09023545682430267, "avg_num_neighbors": 11, "unique_atom_types": [0, 1, 6]}
md_benzene_k3l3_slim_10k100k_seed505/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/benzene
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 1.8172615989393406
97
+ flow_prior_mu: 0.008670088241267512
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 505
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 2
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_benzene_k3l3_slim_10k100k_seed505
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_benzene_k3l3_slim_10k100k_seed505/epoch=872-step=109872.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ee9b9966635023e8fad9ce3e75cb9ab9c4e1ce1d5007b20c7dd95a2b62901b7
3
+ size 154820962
md_benzene_k3l3_slim_10k100k_seed505/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.049426741898059845, "target_var": 0.09023545682430267, "avg_num_neighbors": 11, "unique_atom_types": [0, 1, 6]}
md_ethane_k3l3_slim_10k100k/config.yaml ADDED
@@ -0,0 +1,191 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethane
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ flow_velocity_mlp_hidden: 512
81
+ flow_time_dim: 64
82
+ flow_head: escn
83
+ flow_e3nn_hidden_multiplier: 2
84
+ bridge_mode: cfm
85
+ flow_loss_mode: endpoint
86
+ flow_endpoint_loss: integrated_density
87
+ flow_target_mode: gt
88
+ flow_use_t_scale: false
89
+ flow_t_scale_max: 0.9
90
+ flow_prior_mode: irrep_gaussian
91
+ flow_prior_sigma: 3.6557021047032014
92
+ flow_prior_mu: 0.008435532788597242
93
+ flow_prior_nelectron_normalize: false
94
+ flow_nelectron_mc_max_probes: 0
95
+ flow_val_integrate_steps: 2
96
+ flow_val_integrate_sweep_steps:
97
+ - 1
98
+ - 2
99
+ - 3
100
+ flow_integrate_train_steps: 2
101
+ flow_integrate_min_t: 0.01
102
+ flow_integrate_schedule: uniform
103
+ flow_integrate_t_hi: 0.99
104
+ flow_integrate_power: 4.0
105
+ flow_val_max_n_probe_per_pass: 400000
106
+ flow_val_log_readout: false
107
+ sb_sigma: 0.1
108
+ sb_noise_mode: isotropic
109
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
110
+ sb_per_l_sigma_scales: null
111
+ train:
112
+ seed: 0
113
+ deterministic: true
114
+ run_post_fit_test: false
115
+ trainer:
116
+ fast_dev_run: false
117
+ accelerator: gpu
118
+ strategy: ddp_find_unused_parameters_true
119
+ devices: 4
120
+ precision: 32
121
+ max_epochs: 100000
122
+ max_steps: 110000
123
+ num_sanity_val_steps: 2
124
+ gradient_clip_val: 0.5
125
+ val_check_interval: 1.0
126
+ deterministic: ${train.deterministic}
127
+ optim:
128
+ _target_: torch.optim.Adam
129
+ lr: 0.001
130
+ betas:
131
+ - 0.9
132
+ - 0.999
133
+ eps: 1.0e-08
134
+ weight_decay: 0.0
135
+ lr_scheduler:
136
+ _target_: scdp.model.utils.PowerDecayScheduler
137
+ warmup_steps: 1000
138
+ alpha: 0.96
139
+ beta: 4433
140
+ lr_schedule_freq: 1
141
+ ema:
142
+ decay: 0.995
143
+ restore:
144
+ ckpt_or_run_path: null
145
+ mode: null
146
+ weights_only: false
147
+ monitor:
148
+ metric: nmape/val_flow
149
+ mode: min
150
+ callbacks:
151
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
152
+ patience: 10000
153
+ verbose: false
154
+ monitor: ${train.monitor.metric}
155
+ mode: ${train.monitor.mode}
156
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
157
+ dirpath: ${core.storage_dir}
158
+ save_top_k: 2
159
+ save_last: true
160
+ verbose: false
161
+ monitor: ${train.monitor.metric}
162
+ mode: ${train.monitor.mode}
163
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
164
+ logging_interval: step
165
+ log_momentum: false
166
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
167
+ refresh_rate: 20
168
+ logging:
169
+ upload:
170
+ run_files: false
171
+ source: true
172
+ wandb:
173
+ name: ${core.expname}
174
+ project: ${core.project_name}
175
+ entity: null
176
+ log_model: ${..upload.run_files}
177
+ mode: online
178
+ tags: ${core.tags}
179
+ resume: allow
180
+ wandb_watch:
181
+ log: all
182
+ log_freq: 100
183
+ core:
184
+ expname: md_ethane_k3l3_slim_10k100k
185
+ project_name: orbflow
186
+ storage_dir: ${core.expname}
187
+ version: 0.0.1
188
+ tags: null
189
+ conventions:
190
+ x_key: x
191
+ y_key: 'y'
md_ethane_k3l3_slim_10k100k/epoch=440-step=55000.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51067711ace62d1214d47c14504b1da7a21e9a3cf91f531895d8419de6712090
3
+ size 154820260
md_ethane_k3l3_slim_10k100k/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.02306615188717842, "target_var": 0.039020102471113205, "avg_num_neighbors": 7, "unique_atom_types": [0, 1, 6]}
md_ethane_k3l3_slim_10k100k_seed42/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethane
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 3.6557021047032014
97
+ flow_prior_mu: 0.008435532788597242
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 42
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_ethane_k3l3_slim_10k100k_seed42
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_ethane_k3l3_slim_10k100k_seed42/epoch=829-step=103625.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d91ce76b904463ced039346bb8f9e07e7bee59bb74e42d539860791c9669507
3
+ size 154820962
md_ethane_k3l3_slim_10k100k_seed42/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.02306615188717842, "target_var": 0.039020102471113205, "avg_num_neighbors": 7, "unique_atom_types": [0, 1, 6]}
md_ethane_k3l3_slim_10k100k_seed505/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethane
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 3.6557021047032014
97
+ flow_prior_mu: 0.008435532788597242
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 505
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 2
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_ethane_k3l3_slim_10k100k_seed505
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_ethane_k3l3_slim_10k100k_seed505/epoch=429-step=107250.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf78c4065d59b7ec8904098082fecc46f38ce35da8755530c115851b5bfc1f2d
3
+ size 154820962
md_ethane_k3l3_slim_10k100k_seed505/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.02306615188717842, "target_var": 0.039020102471113205, "avg_num_neighbors": 7, "unique_atom_types": [0, 1, 6]}
md_ethanol_k3l3_slim_10k100k/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethanol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 3.0378894564782692
97
+ flow_prior_mu: 0.005635817718369937
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 0
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_ethanol_k3l3_slim_10k100k
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_ethanol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c083b8317177438ba0cef691baa499b28124ca88869f11002a2edcb0566ac9b
3
+ size 154837998
md_ethanol_k3l3_slim_10k100k/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.03295100852847099, "target_var": 0.09332586824893951, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
md_ethanol_k3l3_slim_10k100k_seed42/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethanol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 3.0378894564782692
97
+ flow_prior_mu: 0.005635817718369937
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 42
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_ethanol_k3l3_slim_10k100k_seed42
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_ethanol_k3l3_slim_10k100k_seed42/epoch=1748-step=110000.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:423b04f267c2a83d8c67e32108598b61d74ce5e9b6af7f49ed406cae85dd2473
3
+ size 154837998
md_ethanol_k3l3_slim_10k100k_seed42/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.03295100852847099, "target_var": 0.09332586824893951, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
md_ethanol_k3l3_slim_10k100k_seed505/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethanol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 3.0378894564782692
97
+ flow_prior_mu: 0.005635817718369937
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 505
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 2
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_ethanol_k3l3_slim_10k100k_seed505
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_ethanol_k3l3_slim_10k100k_seed505/epoch=434-step=54684.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b60101e69ed3c4360d32402406e3296228345b62b06ee2d39d7d84e75ee717c9
3
+ size 154836454
md_ethanol_k3l3_slim_10k100k_seed505/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.03295100852847099, "target_var": 0.09332586824893951, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
md_malonaldehyde_k3l3_slim_10k100k/config.yaml ADDED
@@ -0,0 +1,191 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/malonaldehyde
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ flow_velocity_mlp_hidden: 512
81
+ flow_time_dim: 64
82
+ flow_head: escn
83
+ flow_e3nn_hidden_multiplier: 2
84
+ bridge_mode: cfm
85
+ flow_loss_mode: endpoint
86
+ flow_endpoint_loss: integrated_density
87
+ flow_target_mode: gt
88
+ flow_use_t_scale: false
89
+ flow_t_scale_max: 0.9
90
+ flow_prior_mode: irrep_gaussian
91
+ flow_prior_sigma: 2.7930136827969125
92
+ flow_prior_mu: 0.017925494043203455
93
+ flow_prior_nelectron_normalize: false
94
+ flow_nelectron_mc_max_probes: 0
95
+ flow_val_integrate_steps: 2
96
+ flow_val_integrate_sweep_steps:
97
+ - 1
98
+ - 2
99
+ - 3
100
+ flow_integrate_train_steps: 2
101
+ flow_integrate_min_t: 0.01
102
+ flow_integrate_schedule: uniform
103
+ flow_integrate_t_hi: 0.99
104
+ flow_integrate_power: 4.0
105
+ flow_val_max_n_probe_per_pass: 400000
106
+ flow_val_log_readout: false
107
+ sb_sigma: 0.1
108
+ sb_noise_mode: isotropic
109
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
110
+ sb_per_l_sigma_scales: null
111
+ train:
112
+ seed: 0
113
+ deterministic: true
114
+ run_post_fit_test: false
115
+ trainer:
116
+ fast_dev_run: false
117
+ accelerator: gpu
118
+ strategy: ddp_find_unused_parameters_true
119
+ devices: 4
120
+ precision: 32
121
+ max_epochs: 100000
122
+ max_steps: 110000
123
+ num_sanity_val_steps: 2
124
+ gradient_clip_val: 0.5
125
+ val_check_interval: 1.0
126
+ deterministic: ${train.deterministic}
127
+ optim:
128
+ _target_: torch.optim.Adam
129
+ lr: 0.001
130
+ betas:
131
+ - 0.9
132
+ - 0.999
133
+ eps: 1.0e-08
134
+ weight_decay: 0.0
135
+ lr_scheduler:
136
+ _target_: scdp.model.utils.PowerDecayScheduler
137
+ warmup_steps: 1000
138
+ alpha: 0.96
139
+ beta: 4433
140
+ lr_schedule_freq: 1
141
+ ema:
142
+ decay: 0.995
143
+ restore:
144
+ ckpt_or_run_path: null
145
+ mode: null
146
+ weights_only: false
147
+ monitor:
148
+ metric: nmape/val_flow
149
+ mode: min
150
+ callbacks:
151
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
152
+ patience: 10000
153
+ verbose: false
154
+ monitor: ${train.monitor.metric}
155
+ mode: ${train.monitor.mode}
156
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
157
+ dirpath: ${core.storage_dir}
158
+ save_top_k: 2
159
+ save_last: true
160
+ verbose: false
161
+ monitor: ${train.monitor.metric}
162
+ mode: ${train.monitor.mode}
163
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
164
+ logging_interval: step
165
+ log_momentum: false
166
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
167
+ refresh_rate: 20
168
+ logging:
169
+ upload:
170
+ run_files: false
171
+ source: true
172
+ wandb:
173
+ name: ${core.expname}
174
+ project: ${core.project_name}
175
+ entity: null
176
+ log_model: ${..upload.run_files}
177
+ mode: online
178
+ tags: ${core.tags}
179
+ resume: allow
180
+ wandb_watch:
181
+ log: all
182
+ log_freq: 100
183
+ core:
184
+ expname: md_malonaldehyde_k3l3_slim_10k100k
185
+ project_name: orbflow
186
+ storage_dir: ${core.expname}
187
+ version: 0.0.1
188
+ tags: null
189
+ conventions:
190
+ x_key: x
191
+ y_key: 'y'
md_malonaldehyde_k3l3_slim_10k100k/epoch=148-step=18500.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c43acd17309b1623fcd3186b9f2b47cb5a52909d43c82647c19df27185cbe1fa
3
+ size 154836262
md_malonaldehyde_k3l3_slim_10k100k/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.04613230377435684, "target_var": 0.15922808647155762, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
md_malonaldehyde_k3l3_slim_10k100k_seed42/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/malonaldehyde
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 2.7930136827969125
97
+ flow_prior_mu: 0.017925494043203455
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 42
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_malonaldehyde_k3l3_slim_10k100k_seed42
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_malonaldehyde_k3l3_slim_10k100k_seed42/epoch=320-step=40000.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8823014baa4602a894e42f5ebc8d98fa388f821b63dfbdf0166c77e1557a1579
3
+ size 154836454
md_malonaldehyde_k3l3_slim_10k100k_seed42/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.04613230377435684, "target_var": 0.15922808647155762, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
md_malonaldehyde_k3l3_slim_10k100k_seed505/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/malonaldehyde
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 2.7930136827969125
97
+ flow_prior_mu: 0.017925494043203455
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 505
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 2
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_malonaldehyde_k3l3_slim_10k100k_seed505
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_malonaldehyde_k3l3_slim_10k100k_seed505/epoch=108-step=27000.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e279e4d237d3ff3d23fa315a615286b10456fbecee8dc67033004f94719dcac
3
+ size 154836454
md_malonaldehyde_k3l3_slim_10k100k_seed505/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.04613230377435684, "target_var": 0.15922808647155762, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
md_phenol_k3l3_slim_10k100k/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/phenol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 1.9846056192284764
97
+ flow_prior_mu: 0.005037187932829464
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 0
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_phenol_k3l3_slim_10k100k
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_phenol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37fa2defb2da0615e627725c16261cde54b7fe837aadca4a3f7201d59c56b5c7
3
+ size 154837934
md_phenol_k3l3_slim_10k100k/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.059311117976903915, "target_var": 0.1463594138622284, "avg_num_neighbors": 12, "unique_atom_types": [8, 1, 6, 0]}
md_phenol_k3l3_slim_10k100k_seed42/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/phenol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 1.9846056192284764
97
+ flow_prior_mu: 0.005037187932829464
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 42
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_phenol_k3l3_slim_10k100k_seed42
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_phenol_k3l3_slim_10k100k_seed42/epoch=712-step=44856-v1.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f06f639fa3ccfcd032f5e245a8fe10aae8219220256d3131ebe14956c40426a
3
+ size 154838514
md_phenol_k3l3_slim_10k100k_seed42/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.059311117976903915, "target_var": 0.1463594138622284, "avg_num_neighbors": 12, "unique_atom_types": [8, 1, 6, 0]}
md_phenol_k3l3_slim_10k100k_seed505/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/phenol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 1.9846056192284764
97
+ flow_prior_mu: 0.005037187932829464
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 505
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 2
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_phenol_k3l3_slim_10k100k_seed505
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'
md_phenol_k3l3_slim_10k100k_seed505/epoch=477-step=60102.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf856c66cb543c94a6f5b37b8105c6bae357487ebc8d3f911e8ed097577d8883
3
+ size 154836454
md_phenol_k3l3_slim_10k100k_seed505/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.059311117976903915, "target_var": 0.1463594138622284, "avg_num_neighbors": 12, "unique_atom_types": [8, 1, 6, 0]}
md_resorcinol_k3l3_slim_10k100k/config.yaml ADDED
@@ -0,0 +1,191 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/resorcinol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ flow_velocity_mlp_hidden: 512
81
+ flow_time_dim: 64
82
+ flow_head: escn
83
+ flow_e3nn_hidden_multiplier: 2
84
+ bridge_mode: cfm
85
+ flow_loss_mode: endpoint
86
+ flow_endpoint_loss: integrated_density
87
+ flow_target_mode: gt
88
+ flow_use_t_scale: false
89
+ flow_t_scale_max: 0.9
90
+ flow_prior_mode: irrep_gaussian
91
+ flow_prior_sigma: 2.0182929296544465
92
+ flow_prior_mu: 0.004724867169487745
93
+ flow_prior_nelectron_normalize: false
94
+ flow_nelectron_mc_max_probes: 0
95
+ flow_val_integrate_steps: 2
96
+ flow_val_integrate_sweep_steps:
97
+ - 1
98
+ - 2
99
+ - 3
100
+ flow_integrate_train_steps: 2
101
+ flow_integrate_min_t: 0.01
102
+ flow_integrate_schedule: uniform
103
+ flow_integrate_t_hi: 0.99
104
+ flow_integrate_power: 4.0
105
+ flow_val_max_n_probe_per_pass: 400000
106
+ flow_val_log_readout: false
107
+ sb_sigma: 0.1
108
+ sb_noise_mode: isotropic
109
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
110
+ sb_per_l_sigma_scales: null
111
+ train:
112
+ seed: 0
113
+ deterministic: true
114
+ run_post_fit_test: false
115
+ trainer:
116
+ fast_dev_run: false
117
+ accelerator: gpu
118
+ strategy: ddp_find_unused_parameters_true
119
+ devices: 4
120
+ precision: 32
121
+ max_epochs: 100000
122
+ max_steps: 110000
123
+ num_sanity_val_steps: 2
124
+ gradient_clip_val: 0.5
125
+ val_check_interval: 1.0
126
+ deterministic: ${train.deterministic}
127
+ optim:
128
+ _target_: torch.optim.Adam
129
+ lr: 0.001
130
+ betas:
131
+ - 0.9
132
+ - 0.999
133
+ eps: 1.0e-08
134
+ weight_decay: 0.0
135
+ lr_scheduler:
136
+ _target_: scdp.model.utils.PowerDecayScheduler
137
+ warmup_steps: 1000
138
+ alpha: 0.96
139
+ beta: 4433
140
+ lr_schedule_freq: 1
141
+ ema:
142
+ decay: 0.995
143
+ restore:
144
+ ckpt_or_run_path: null
145
+ mode: null
146
+ weights_only: false
147
+ monitor:
148
+ metric: nmape/val_flow
149
+ mode: min
150
+ callbacks:
151
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
152
+ patience: 10000
153
+ verbose: false
154
+ monitor: ${train.monitor.metric}
155
+ mode: ${train.monitor.mode}
156
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
157
+ dirpath: ${core.storage_dir}
158
+ save_top_k: 2
159
+ save_last: true
160
+ verbose: false
161
+ monitor: ${train.monitor.metric}
162
+ mode: ${train.monitor.mode}
163
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
164
+ logging_interval: step
165
+ log_momentum: false
166
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
167
+ refresh_rate: 20
168
+ logging:
169
+ upload:
170
+ run_files: false
171
+ source: true
172
+ wandb:
173
+ name: ${core.expname}
174
+ project: ${core.project_name}
175
+ entity: null
176
+ log_model: ${..upload.run_files}
177
+ mode: online
178
+ tags: ${core.tags}
179
+ resume: allow
180
+ wandb_watch:
181
+ log: null
182
+ log_freq: 100
183
+ core:
184
+ expname: md_resorcinol_k3l3_slim_10k100k
185
+ project_name: orbflow
186
+ storage_dir: ${core.expname}
187
+ version: 0.0.1
188
+ tags: null
189
+ conventions:
190
+ x_key: x
191
+ y_key: 'y'
md_resorcinol_k3l3_slim_10k100k/epoch=698-step=43974.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b8c7b823cf4c1390b16482e2d5cf64cf8ffd5d4cc0edfa37fa190c56884f68d
3
+ size 154836262
md_resorcinol_k3l3_slim_10k100k/metadata.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"target_mean": 0.06919773668050766, "target_var": 0.20266202092170715, "avg_num_neighbors": 13, "unique_atom_types": [8, 1, 6, 0]}
md_resorcinol_k3l3_slim_10k100k_seed42/config.yaml ADDED
@@ -0,0 +1,196 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ data:
2
+ _target_: scdp.data.datamodule.ProbeDataModule
3
+ dataset:
4
+ _target_: scdp.data.dataset.LmdbDataset
5
+ path: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol
6
+ gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/resorcinol
7
+ sad_coeffs_path: null
8
+ split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol/datasplits.json
9
+ num_workers:
10
+ train: 8
11
+ val: 8
12
+ test: 8
13
+ batch_size:
14
+ train: 4
15
+ val: 4
16
+ test: 4
17
+ n_probe:
18
+ train: 125000
19
+ val: 125000
20
+ test: 125000
21
+ model:
22
+ model:
23
+ _target_: scdp.model.equiformer_v3.EquiformerV3
24
+ enable_flow_coeff_entangle: true
25
+ flow_bridge_time_dim: ${..flow_time_dim}
26
+ max_num_elements: 100
27
+ num_layers: 3
28
+ lmax_list:
29
+ - 3
30
+ mmax_list:
31
+ - 2
32
+ cutoff: 6.0
33
+ sphere_channels: 96
34
+ hidden_channels: 192
35
+ edge_channels: 96
36
+ num_radial_basis: 300
37
+ distance_resolution: 0.02
38
+ basis_width_scalar: 2.0
39
+ attn_hidden_channels: 64
40
+ num_heads: 8
41
+ attn_alpha_channels: 32
42
+ attn_value_channels: 16
43
+ attn_grid_resolution_list:
44
+ - 20
45
+ - 8
46
+ ffn_grid_resolution_list:
47
+ - 20
48
+ - 20
49
+ norm_type: merge_layer_norm
50
+ use_atom_edge_embedding: true
51
+ use_envelope: true
52
+ use_attn_renorm: true
53
+ use_add_merge: false
54
+ use_grid_mlp: true
55
+ attn_activation: sep-merge_gates2_swiglu
56
+ ffn_activation: sep-merge_gates2_swiglu
57
+ alpha_drop: 0.0
58
+ attn_mask_rate: 0.0
59
+ attn_weights_drop: 0.0
60
+ value_drop: 0.0
61
+ drop_path_rate: 0.0
62
+ proj_drop: 0.0
63
+ ffn_drop: 0.0
64
+ gradient_checkpointing_block_list: null
65
+ _target_: scdp.model.module_flow.ChgFlowMatchingModule
66
+ criterion: mae
67
+ vnode_elem: 8
68
+ pbc: false
69
+ dft_basis_set: def2-qzvppd
70
+ dft_wt_aug: true
71
+ concat_basis: false
72
+ beta: 1.3
73
+ lmax_restriction: true
74
+ lmax_relax: 0
75
+ uncontracted: true
76
+ orb_cutoff: 5.0
77
+ expo_trainable: false
78
+ magnitude_weighting: false
79
+ density_synthesis_mode: linear
80
+ density_eval_mode: realspace
81
+ hybrid_fft_zeta_max: 5.0
82
+ hybrid_fft_phase_sign: -1.0
83
+ hybrid_fft_chunk_G: 65536
84
+ flow_velocity_mlp_hidden: 512
85
+ flow_time_dim: 64
86
+ flow_head: escn
87
+ flow_e3nn_hidden_multiplier: 2
88
+ bridge_mode: cfm
89
+ flow_loss_mode: endpoint
90
+ flow_endpoint_loss: integrated_density
91
+ flow_combined_integrated_weight: 1.0
92
+ flow_target_mode: gt
93
+ flow_use_t_scale: false
94
+ flow_t_scale_max: 0.9
95
+ flow_prior_mode: irrep_gaussian
96
+ flow_prior_sigma: 2.0182929296544465
97
+ flow_prior_mu: 0.004724867169487745
98
+ flow_prior_nelectron_normalize: false
99
+ flow_nelectron_mc_max_probes: 0
100
+ flow_val_integrate_steps: 2
101
+ flow_val_integrate_sweep_steps:
102
+ - 1
103
+ - 2
104
+ - 3
105
+ flow_integrate_train_steps: 2
106
+ flow_integrate_min_t: 0.01
107
+ flow_integrate_schedule: uniform
108
+ flow_integrate_t_hi: 0.99
109
+ flow_integrate_power: 4.0
110
+ flow_val_max_n_probe_per_pass: 400000
111
+ flow_val_log_readout: false
112
+ sb_sigma: 0.1
113
+ sb_noise_mode: isotropic
114
+ sb_per_l_sigma_mode: inv_sqrt_2lp1
115
+ sb_per_l_sigma_scales: null
116
+ train:
117
+ seed: 42
118
+ deterministic: true
119
+ run_post_fit_test: false
120
+ trainer:
121
+ fast_dev_run: false
122
+ accelerator: gpu
123
+ strategy: ddp_find_unused_parameters_true
124
+ devices: 4
125
+ precision: 32
126
+ max_epochs: 100000
127
+ max_steps: 110000
128
+ num_sanity_val_steps: 2
129
+ gradient_clip_val: 0.5
130
+ val_check_interval: 1.0
131
+ deterministic: ${train.deterministic}
132
+ optim:
133
+ _target_: torch.optim.Adam
134
+ lr: 0.001
135
+ betas:
136
+ - 0.9
137
+ - 0.999
138
+ eps: 1.0e-08
139
+ weight_decay: 0.0
140
+ lr_scheduler:
141
+ _target_: scdp.model.utils.PowerDecayScheduler
142
+ warmup_steps: 1000
143
+ alpha: 0.96
144
+ beta: 4433
145
+ lr_schedule_freq: 1
146
+ ema:
147
+ decay: 0.995
148
+ restore:
149
+ ckpt_or_run_path: null
150
+ mode: null
151
+ weights_only: false
152
+ monitor:
153
+ metric: nmape/val_flow
154
+ mode: min
155
+ callbacks:
156
+ - _target_: lightning.pytorch.callbacks.EarlyStopping
157
+ patience: 10000
158
+ verbose: false
159
+ monitor: ${train.monitor.metric}
160
+ mode: ${train.monitor.mode}
161
+ - _target_: lightning.pytorch.callbacks.ModelCheckpoint
162
+ dirpath: ${core.storage_dir}
163
+ save_top_k: 2
164
+ save_last: true
165
+ verbose: false
166
+ monitor: ${train.monitor.metric}
167
+ mode: ${train.monitor.mode}
168
+ - _target_: lightning.pytorch.callbacks.LearningRateMonitor
169
+ logging_interval: step
170
+ log_momentum: false
171
+ - _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
172
+ refresh_rate: 20
173
+ logging:
174
+ upload:
175
+ run_files: false
176
+ source: true
177
+ wandb:
178
+ name: ${core.expname}
179
+ project: ${core.project_name}
180
+ entity: null
181
+ log_model: ${..upload.run_files}
182
+ mode: online
183
+ tags: ${core.tags}
184
+ resume: allow
185
+ wandb_watch:
186
+ log: null
187
+ log_freq: 100
188
+ core:
189
+ expname: md_resorcinol_k3l3_slim_10k100k_seed42
190
+ project_name: orbflow
191
+ storage_dir: ${core.expname}
192
+ version: 0.0.1
193
+ tags: null
194
+ conventions:
195
+ x_key: x
196
+ y_key: 'y'