Add OrbFlow QM9 and MD checkpoints
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- README.md +80 -0
- md_benzene_k3l3_slim_10k100k/config.yaml +191 -0
- md_benzene_k3l3_slim_10k100k/epoch=1730-step=108990.ckpt +3 -0
- md_benzene_k3l3_slim_10k100k/metadata.json +1 -0
- md_benzene_k3l3_slim_10k100k_seed42/config.yaml +196 -0
- md_benzene_k3l3_slim_10k100k_seed42/epoch=1741-step=109683.ckpt +3 -0
- md_benzene_k3l3_slim_10k100k_seed42/metadata.json +1 -0
- md_benzene_k3l3_slim_10k100k_seed505/config.yaml +196 -0
- md_benzene_k3l3_slim_10k100k_seed505/epoch=872-step=109872.ckpt +3 -0
- md_benzene_k3l3_slim_10k100k_seed505/metadata.json +1 -0
- md_ethane_k3l3_slim_10k100k/config.yaml +191 -0
- md_ethane_k3l3_slim_10k100k/epoch=440-step=55000.ckpt +3 -0
- md_ethane_k3l3_slim_10k100k/metadata.json +1 -0
- md_ethane_k3l3_slim_10k100k_seed42/config.yaml +196 -0
- md_ethane_k3l3_slim_10k100k_seed42/epoch=829-step=103625.ckpt +3 -0
- md_ethane_k3l3_slim_10k100k_seed42/metadata.json +1 -0
- md_ethane_k3l3_slim_10k100k_seed505/config.yaml +196 -0
- md_ethane_k3l3_slim_10k100k_seed505/epoch=429-step=107250.ckpt +3 -0
- md_ethane_k3l3_slim_10k100k_seed505/metadata.json +1 -0
- md_ethanol_k3l3_slim_10k100k/config.yaml +196 -0
- md_ethanol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt +3 -0
- md_ethanol_k3l3_slim_10k100k/metadata.json +1 -0
- md_ethanol_k3l3_slim_10k100k_seed42/config.yaml +196 -0
- md_ethanol_k3l3_slim_10k100k_seed42/epoch=1748-step=110000.ckpt +3 -0
- md_ethanol_k3l3_slim_10k100k_seed42/metadata.json +1 -0
- md_ethanol_k3l3_slim_10k100k_seed505/config.yaml +196 -0
- md_ethanol_k3l3_slim_10k100k_seed505/epoch=434-step=54684.ckpt +3 -0
- md_ethanol_k3l3_slim_10k100k_seed505/metadata.json +1 -0
- md_malonaldehyde_k3l3_slim_10k100k/config.yaml +191 -0
- md_malonaldehyde_k3l3_slim_10k100k/epoch=148-step=18500.ckpt +3 -0
- md_malonaldehyde_k3l3_slim_10k100k/metadata.json +1 -0
- md_malonaldehyde_k3l3_slim_10k100k_seed42/config.yaml +196 -0
- md_malonaldehyde_k3l3_slim_10k100k_seed42/epoch=320-step=40000.ckpt +3 -0
- md_malonaldehyde_k3l3_slim_10k100k_seed42/metadata.json +1 -0
- md_malonaldehyde_k3l3_slim_10k100k_seed505/config.yaml +196 -0
- md_malonaldehyde_k3l3_slim_10k100k_seed505/epoch=108-step=27000.ckpt +3 -0
- md_malonaldehyde_k3l3_slim_10k100k_seed505/metadata.json +1 -0
- md_phenol_k3l3_slim_10k100k/config.yaml +196 -0
- md_phenol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt +3 -0
- md_phenol_k3l3_slim_10k100k/metadata.json +1 -0
- md_phenol_k3l3_slim_10k100k_seed42/config.yaml +196 -0
- md_phenol_k3l3_slim_10k100k_seed42/epoch=712-step=44856-v1.ckpt +3 -0
- md_phenol_k3l3_slim_10k100k_seed42/metadata.json +1 -0
- md_phenol_k3l3_slim_10k100k_seed505/config.yaml +196 -0
- md_phenol_k3l3_slim_10k100k_seed505/epoch=477-step=60102.ckpt +3 -0
- md_phenol_k3l3_slim_10k100k_seed505/metadata.json +1 -0
- md_resorcinol_k3l3_slim_10k100k/config.yaml +191 -0
- md_resorcinol_k3l3_slim_10k100k/epoch=698-step=43974.ckpt +3 -0
- md_resorcinol_k3l3_slim_10k100k/metadata.json +1 -0
- md_resorcinol_k3l3_slim_10k100k_seed42/config.yaml +196 -0
README.md
ADDED
|
@@ -0,0 +1,80 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- chemistry
|
| 5 |
+
- electron-density
|
| 6 |
+
- flow-matching
|
| 7 |
+
- equivariant-neural-networks
|
| 8 |
+
- qm9
|
| 9 |
+
datasets:
|
| 10 |
+
- divelab/OrbFlow-data
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# OrbFlow checkpoints
|
| 14 |
+
|
| 15 |
+
Trained checkpoints for **OrbFlow**, which predicts atomic-orbital expansion coefficients (and the resulting
|
| 16 |
+
electron density) with equivariant flow matching.
|
| 17 |
+
|
| 18 |
+
- Code: https://github.com/TODO/OrbFlow
|
| 19 |
+
- Data: [divelab/OrbFlow-data](https://huggingface.co/datasets/divelab/OrbFlow-data)
|
| 20 |
+
- Paper: TODO
|
| 21 |
+
|
| 22 |
+
## Contents
|
| 23 |
+
|
| 24 |
+
Each folder is one training run with its **best-validation checkpoint**, `config.yaml` and `metadata.json`.
|
| 25 |
+
Optimizer state has been removed, so these files are for evaluation and inference; they cannot resume training.
|
| 26 |
+
|
| 27 |
+
| Folder | Model | Seeds | Checkpoint size |
|
| 28 |
+
|--------|-------|-------|-----------------|
|
| 29 |
+
| `qm9_qhf_eqv3_gt_2ph_final`, `…_s42`, `…_s123` | QM9: EquiformerV3, 8 layers, ℓmax = 6; 75k endpoint → 450k integrated-density training | 0, 42, 123 | 1.2 GB |
|
| 30 |
+
| `md_<mol>_k3l3_slim_10k100k`, `…_seed42`, `…_seed505` | MD: slim EquiformerV3, 3 layers, ℓmax = 3; 10k → 110k | 0, 42, 505 | 155 MB |
|
| 31 |
+
|
| 32 |
+
MD molecules: benzene, ethane, ethanol, malonaldehyde, phenol, resorcinol.
|
| 33 |
+
The seed-505 phenol and resorcinol runs stopped at ~60k of their 110k training steps (job time limit); their best-validation checkpoints are from step ~60k.
|
| 34 |
+
|
| 35 |
+
## Usage
|
| 36 |
+
|
| 37 |
+
Download into the root of the OrbFlow code repository, so the folder names match what the evaluation scripts expect:
|
| 38 |
+
|
| 39 |
+
```bash
|
| 40 |
+
git clone https://github.com/TODO/OrbFlow.git && cd OrbFlow
|
| 41 |
+
# set up the environment and .env as described in the code README, then:
|
| 42 |
+
hf download divelab/OrbFlow --local-dir .
|
| 43 |
+
|
| 44 |
+
# QM9 test set (Euler K = 2 and 3; full test split and last 1600 molecules)
|
| 45 |
+
CKPT_PATH=qm9_qhf_eqv3_gt_2ph_final sbatch vision/test_qhf_eqv3_gt_2ph_final_full.slurm
|
| 46 |
+
|
| 47 |
+
# MD test sets (6 molecules); for other seeds use EXP_SUFFIX=md_%s_k3l3_slim_10k100k_seed42
|
| 48 |
+
sbatch vision/test_flow_md_paper_2phase_beta13_all6.slurm
|
| 49 |
+
```
|
| 50 |
+
|
| 51 |
+
To download a single run: `hf download divelab/OrbFlow --include "qm9_qhf_eqv3_gt_2ph_final/*" --local-dir .`
|
| 52 |
+
|
| 53 |
+
## Results
|
| 54 |
+
|
| 55 |
+
Test nMAPE (%) with Euler K = 2, mean ± std over training seeds, computed with the evaluation scripts above.
|
| 56 |
+
|
| 57 |
+
**QM9** (10,000 test molecules, seeds 0 / 42 / 123)
|
| 58 |
+
|
| 59 |
+
| Split | nMAPE (%) |
|
| 60 |
+
|-------|-----------|
|
| 61 |
+
| Full test set | 0.1518 ± 0.0008 |
|
| 62 |
+
| Last 1,600 molecules | 0.1646 ± 0.0008 |
|
| 63 |
+
|
| 64 |
+
**MD** (seeds 0 / 42 / 505)
|
| 65 |
+
|
| 66 |
+
| Molecule | nMAPE (%) |
|
| 67 |
+
|----------|-----------|
|
| 68 |
+
| benzene | 0.4210 ± 0.0017 |
|
| 69 |
+
| ethane | 0.8706 ± 0.0084 |
|
| 70 |
+
| ethanol | 1.0784 ± 0.0229 |
|
| 71 |
+
| malonaldehyde | 1.1771 ± 0.0127 |
|
| 72 |
+
| phenol | 0.5753 ± 0.0083 |
|
| 73 |
+
| resorcinol | 0.6626 ± 0.0136 |
|
| 74 |
+
| **average (6 molecules)** | **0.7975 ± 0.0067** |
|
| 75 |
+
|
| 76 |
+
## Citation
|
| 77 |
+
|
| 78 |
+
TODO
|
| 79 |
+
|
| 80 |
+
OrbFlow builds on [SCDP](https://github.com/kyonofx/scdp) (Fu et al., NeurIPS 2024).
|
md_benzene_k3l3_slim_10k100k/config.yaml
ADDED
|
@@ -0,0 +1,191 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/benzene
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
flow_velocity_mlp_hidden: 512
|
| 81 |
+
flow_time_dim: 64
|
| 82 |
+
flow_head: escn
|
| 83 |
+
flow_e3nn_hidden_multiplier: 2
|
| 84 |
+
bridge_mode: cfm
|
| 85 |
+
flow_loss_mode: endpoint
|
| 86 |
+
flow_endpoint_loss: integrated_density
|
| 87 |
+
flow_target_mode: gt
|
| 88 |
+
flow_use_t_scale: false
|
| 89 |
+
flow_t_scale_max: 0.9
|
| 90 |
+
flow_prior_mode: irrep_gaussian
|
| 91 |
+
flow_prior_sigma: 1.8172615989393406
|
| 92 |
+
flow_prior_mu: 0.008670088241267512
|
| 93 |
+
flow_prior_nelectron_normalize: false
|
| 94 |
+
flow_nelectron_mc_max_probes: 0
|
| 95 |
+
flow_val_integrate_steps: 2
|
| 96 |
+
flow_val_integrate_sweep_steps:
|
| 97 |
+
- 1
|
| 98 |
+
- 2
|
| 99 |
+
- 3
|
| 100 |
+
flow_integrate_train_steps: 2
|
| 101 |
+
flow_integrate_min_t: 0.01
|
| 102 |
+
flow_integrate_schedule: uniform
|
| 103 |
+
flow_integrate_t_hi: 0.99
|
| 104 |
+
flow_integrate_power: 4.0
|
| 105 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 106 |
+
flow_val_log_readout: false
|
| 107 |
+
sb_sigma: 0.1
|
| 108 |
+
sb_noise_mode: isotropic
|
| 109 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 110 |
+
sb_per_l_sigma_scales: null
|
| 111 |
+
train:
|
| 112 |
+
seed: 0
|
| 113 |
+
deterministic: true
|
| 114 |
+
run_post_fit_test: false
|
| 115 |
+
trainer:
|
| 116 |
+
fast_dev_run: false
|
| 117 |
+
accelerator: gpu
|
| 118 |
+
strategy: ddp_find_unused_parameters_true
|
| 119 |
+
devices: 4
|
| 120 |
+
precision: 32
|
| 121 |
+
max_epochs: 100000
|
| 122 |
+
max_steps: 110000
|
| 123 |
+
num_sanity_val_steps: 2
|
| 124 |
+
gradient_clip_val: 0.5
|
| 125 |
+
val_check_interval: 1.0
|
| 126 |
+
deterministic: ${train.deterministic}
|
| 127 |
+
optim:
|
| 128 |
+
_target_: torch.optim.Adam
|
| 129 |
+
lr: 0.001
|
| 130 |
+
betas:
|
| 131 |
+
- 0.9
|
| 132 |
+
- 0.999
|
| 133 |
+
eps: 1.0e-08
|
| 134 |
+
weight_decay: 0.0
|
| 135 |
+
lr_scheduler:
|
| 136 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 137 |
+
warmup_steps: 1000
|
| 138 |
+
alpha: 0.96
|
| 139 |
+
beta: 4433
|
| 140 |
+
lr_schedule_freq: 1
|
| 141 |
+
ema:
|
| 142 |
+
decay: 0.995
|
| 143 |
+
restore:
|
| 144 |
+
ckpt_or_run_path: null
|
| 145 |
+
mode: null
|
| 146 |
+
weights_only: false
|
| 147 |
+
monitor:
|
| 148 |
+
metric: nmape/val_flow
|
| 149 |
+
mode: min
|
| 150 |
+
callbacks:
|
| 151 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 152 |
+
patience: 10000
|
| 153 |
+
verbose: false
|
| 154 |
+
monitor: ${train.monitor.metric}
|
| 155 |
+
mode: ${train.monitor.mode}
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 157 |
+
dirpath: ${core.storage_dir}
|
| 158 |
+
save_top_k: 2
|
| 159 |
+
save_last: true
|
| 160 |
+
verbose: false
|
| 161 |
+
monitor: ${train.monitor.metric}
|
| 162 |
+
mode: ${train.monitor.mode}
|
| 163 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 164 |
+
logging_interval: step
|
| 165 |
+
log_momentum: false
|
| 166 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 167 |
+
refresh_rate: 20
|
| 168 |
+
logging:
|
| 169 |
+
upload:
|
| 170 |
+
run_files: false
|
| 171 |
+
source: true
|
| 172 |
+
wandb:
|
| 173 |
+
name: ${core.expname}
|
| 174 |
+
project: ${core.project_name}
|
| 175 |
+
entity: null
|
| 176 |
+
log_model: ${..upload.run_files}
|
| 177 |
+
mode: online
|
| 178 |
+
tags: ${core.tags}
|
| 179 |
+
resume: allow
|
| 180 |
+
wandb_watch:
|
| 181 |
+
log: all
|
| 182 |
+
log_freq: 100
|
| 183 |
+
core:
|
| 184 |
+
expname: md_benzene_k3l3_slim_10k100k
|
| 185 |
+
project_name: orbflow
|
| 186 |
+
storage_dir: ${core.expname}
|
| 187 |
+
version: 0.0.1
|
| 188 |
+
tags: null
|
| 189 |
+
conventions:
|
| 190 |
+
x_key: x
|
| 191 |
+
y_key: 'y'
|
md_benzene_k3l3_slim_10k100k/epoch=1730-step=108990.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c97567e39c5591b60498012578d1c3c2418bf082d774c8dc60e51318cf7fa72c
|
| 3 |
+
size 154821792
|
md_benzene_k3l3_slim_10k100k/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.049426741898059845, "target_var": 0.09023545682430267, "avg_num_neighbors": 11, "unique_atom_types": [0, 1, 6]}
|
md_benzene_k3l3_slim_10k100k_seed42/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/benzene
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 1.8172615989393406
|
| 97 |
+
flow_prior_mu: 0.008670088241267512
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 42
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_benzene_k3l3_slim_10k100k_seed42
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_benzene_k3l3_slim_10k100k_seed42/epoch=1741-step=109683.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e91a9ef42a774f8dff79251293f099fb4cfbc5e329ae564d75bb6a927b6f0163
|
| 3 |
+
size 154821984
|
md_benzene_k3l3_slim_10k100k_seed42/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.049426741898059845, "target_var": 0.09023545682430267, "avg_num_neighbors": 11, "unique_atom_types": [0, 1, 6]}
|
md_benzene_k3l3_slim_10k100k_seed505/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/benzene
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/benzene/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 1.8172615989393406
|
| 97 |
+
flow_prior_mu: 0.008670088241267512
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 505
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 2
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_benzene_k3l3_slim_10k100k_seed505
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_benzene_k3l3_slim_10k100k_seed505/epoch=872-step=109872.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ee9b9966635023e8fad9ce3e75cb9ab9c4e1ce1d5007b20c7dd95a2b62901b7
|
| 3 |
+
size 154820962
|
md_benzene_k3l3_slim_10k100k_seed505/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.049426741898059845, "target_var": 0.09023545682430267, "avg_num_neighbors": 11, "unique_atom_types": [0, 1, 6]}
|
md_ethane_k3l3_slim_10k100k/config.yaml
ADDED
|
@@ -0,0 +1,191 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethane
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
flow_velocity_mlp_hidden: 512
|
| 81 |
+
flow_time_dim: 64
|
| 82 |
+
flow_head: escn
|
| 83 |
+
flow_e3nn_hidden_multiplier: 2
|
| 84 |
+
bridge_mode: cfm
|
| 85 |
+
flow_loss_mode: endpoint
|
| 86 |
+
flow_endpoint_loss: integrated_density
|
| 87 |
+
flow_target_mode: gt
|
| 88 |
+
flow_use_t_scale: false
|
| 89 |
+
flow_t_scale_max: 0.9
|
| 90 |
+
flow_prior_mode: irrep_gaussian
|
| 91 |
+
flow_prior_sigma: 3.6557021047032014
|
| 92 |
+
flow_prior_mu: 0.008435532788597242
|
| 93 |
+
flow_prior_nelectron_normalize: false
|
| 94 |
+
flow_nelectron_mc_max_probes: 0
|
| 95 |
+
flow_val_integrate_steps: 2
|
| 96 |
+
flow_val_integrate_sweep_steps:
|
| 97 |
+
- 1
|
| 98 |
+
- 2
|
| 99 |
+
- 3
|
| 100 |
+
flow_integrate_train_steps: 2
|
| 101 |
+
flow_integrate_min_t: 0.01
|
| 102 |
+
flow_integrate_schedule: uniform
|
| 103 |
+
flow_integrate_t_hi: 0.99
|
| 104 |
+
flow_integrate_power: 4.0
|
| 105 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 106 |
+
flow_val_log_readout: false
|
| 107 |
+
sb_sigma: 0.1
|
| 108 |
+
sb_noise_mode: isotropic
|
| 109 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 110 |
+
sb_per_l_sigma_scales: null
|
| 111 |
+
train:
|
| 112 |
+
seed: 0
|
| 113 |
+
deterministic: true
|
| 114 |
+
run_post_fit_test: false
|
| 115 |
+
trainer:
|
| 116 |
+
fast_dev_run: false
|
| 117 |
+
accelerator: gpu
|
| 118 |
+
strategy: ddp_find_unused_parameters_true
|
| 119 |
+
devices: 4
|
| 120 |
+
precision: 32
|
| 121 |
+
max_epochs: 100000
|
| 122 |
+
max_steps: 110000
|
| 123 |
+
num_sanity_val_steps: 2
|
| 124 |
+
gradient_clip_val: 0.5
|
| 125 |
+
val_check_interval: 1.0
|
| 126 |
+
deterministic: ${train.deterministic}
|
| 127 |
+
optim:
|
| 128 |
+
_target_: torch.optim.Adam
|
| 129 |
+
lr: 0.001
|
| 130 |
+
betas:
|
| 131 |
+
- 0.9
|
| 132 |
+
- 0.999
|
| 133 |
+
eps: 1.0e-08
|
| 134 |
+
weight_decay: 0.0
|
| 135 |
+
lr_scheduler:
|
| 136 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 137 |
+
warmup_steps: 1000
|
| 138 |
+
alpha: 0.96
|
| 139 |
+
beta: 4433
|
| 140 |
+
lr_schedule_freq: 1
|
| 141 |
+
ema:
|
| 142 |
+
decay: 0.995
|
| 143 |
+
restore:
|
| 144 |
+
ckpt_or_run_path: null
|
| 145 |
+
mode: null
|
| 146 |
+
weights_only: false
|
| 147 |
+
monitor:
|
| 148 |
+
metric: nmape/val_flow
|
| 149 |
+
mode: min
|
| 150 |
+
callbacks:
|
| 151 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 152 |
+
patience: 10000
|
| 153 |
+
verbose: false
|
| 154 |
+
monitor: ${train.monitor.metric}
|
| 155 |
+
mode: ${train.monitor.mode}
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 157 |
+
dirpath: ${core.storage_dir}
|
| 158 |
+
save_top_k: 2
|
| 159 |
+
save_last: true
|
| 160 |
+
verbose: false
|
| 161 |
+
monitor: ${train.monitor.metric}
|
| 162 |
+
mode: ${train.monitor.mode}
|
| 163 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 164 |
+
logging_interval: step
|
| 165 |
+
log_momentum: false
|
| 166 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 167 |
+
refresh_rate: 20
|
| 168 |
+
logging:
|
| 169 |
+
upload:
|
| 170 |
+
run_files: false
|
| 171 |
+
source: true
|
| 172 |
+
wandb:
|
| 173 |
+
name: ${core.expname}
|
| 174 |
+
project: ${core.project_name}
|
| 175 |
+
entity: null
|
| 176 |
+
log_model: ${..upload.run_files}
|
| 177 |
+
mode: online
|
| 178 |
+
tags: ${core.tags}
|
| 179 |
+
resume: allow
|
| 180 |
+
wandb_watch:
|
| 181 |
+
log: all
|
| 182 |
+
log_freq: 100
|
| 183 |
+
core:
|
| 184 |
+
expname: md_ethane_k3l3_slim_10k100k
|
| 185 |
+
project_name: orbflow
|
| 186 |
+
storage_dir: ${core.expname}
|
| 187 |
+
version: 0.0.1
|
| 188 |
+
tags: null
|
| 189 |
+
conventions:
|
| 190 |
+
x_key: x
|
| 191 |
+
y_key: 'y'
|
md_ethane_k3l3_slim_10k100k/epoch=440-step=55000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:51067711ace62d1214d47c14504b1da7a21e9a3cf91f531895d8419de6712090
|
| 3 |
+
size 154820260
|
md_ethane_k3l3_slim_10k100k/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.02306615188717842, "target_var": 0.039020102471113205, "avg_num_neighbors": 7, "unique_atom_types": [0, 1, 6]}
|
md_ethane_k3l3_slim_10k100k_seed42/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethane
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 3.6557021047032014
|
| 97 |
+
flow_prior_mu: 0.008435532788597242
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 42
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_ethane_k3l3_slim_10k100k_seed42
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_ethane_k3l3_slim_10k100k_seed42/epoch=829-step=103625.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5d91ce76b904463ced039346bb8f9e07e7bee59bb74e42d539860791c9669507
|
| 3 |
+
size 154820962
|
md_ethane_k3l3_slim_10k100k_seed42/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.02306615188717842, "target_var": 0.039020102471113205, "avg_num_neighbors": 7, "unique_atom_types": [0, 1, 6]}
|
md_ethane_k3l3_slim_10k100k_seed505/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethane
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethane/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 3.6557021047032014
|
| 97 |
+
flow_prior_mu: 0.008435532788597242
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 505
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 2
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_ethane_k3l3_slim_10k100k_seed505
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_ethane_k3l3_slim_10k100k_seed505/epoch=429-step=107250.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cf78c4065d59b7ec8904098082fecc46f38ce35da8755530c115851b5bfc1f2d
|
| 3 |
+
size 154820962
|
md_ethane_k3l3_slim_10k100k_seed505/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.02306615188717842, "target_var": 0.039020102471113205, "avg_num_neighbors": 7, "unique_atom_types": [0, 1, 6]}
|
md_ethanol_k3l3_slim_10k100k/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethanol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 3.0378894564782692
|
| 97 |
+
flow_prior_mu: 0.005635817718369937
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 0
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_ethanol_k3l3_slim_10k100k
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_ethanol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c083b8317177438ba0cef691baa499b28124ca88869f11002a2edcb0566ac9b
|
| 3 |
+
size 154837998
|
md_ethanol_k3l3_slim_10k100k/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.03295100852847099, "target_var": 0.09332586824893951, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
|
md_ethanol_k3l3_slim_10k100k_seed42/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethanol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 3.0378894564782692
|
| 97 |
+
flow_prior_mu: 0.005635817718369937
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 42
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_ethanol_k3l3_slim_10k100k_seed42
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_ethanol_k3l3_slim_10k100k_seed42/epoch=1748-step=110000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:423b04f267c2a83d8c67e32108598b61d74ce5e9b6af7f49ed406cae85dd2473
|
| 3 |
+
size 154837998
|
md_ethanol_k3l3_slim_10k100k_seed42/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.03295100852847099, "target_var": 0.09332586824893951, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
|
md_ethanol_k3l3_slim_10k100k_seed505/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/ethanol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/ethanol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 3.0378894564782692
|
| 97 |
+
flow_prior_mu: 0.005635817718369937
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 505
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 2
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_ethanol_k3l3_slim_10k100k_seed505
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_ethanol_k3l3_slim_10k100k_seed505/epoch=434-step=54684.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b60101e69ed3c4360d32402406e3296228345b62b06ee2d39d7d84e75ee717c9
|
| 3 |
+
size 154836454
|
md_ethanol_k3l3_slim_10k100k_seed505/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.03295100852847099, "target_var": 0.09332586824893951, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
|
md_malonaldehyde_k3l3_slim_10k100k/config.yaml
ADDED
|
@@ -0,0 +1,191 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/malonaldehyde
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
flow_velocity_mlp_hidden: 512
|
| 81 |
+
flow_time_dim: 64
|
| 82 |
+
flow_head: escn
|
| 83 |
+
flow_e3nn_hidden_multiplier: 2
|
| 84 |
+
bridge_mode: cfm
|
| 85 |
+
flow_loss_mode: endpoint
|
| 86 |
+
flow_endpoint_loss: integrated_density
|
| 87 |
+
flow_target_mode: gt
|
| 88 |
+
flow_use_t_scale: false
|
| 89 |
+
flow_t_scale_max: 0.9
|
| 90 |
+
flow_prior_mode: irrep_gaussian
|
| 91 |
+
flow_prior_sigma: 2.7930136827969125
|
| 92 |
+
flow_prior_mu: 0.017925494043203455
|
| 93 |
+
flow_prior_nelectron_normalize: false
|
| 94 |
+
flow_nelectron_mc_max_probes: 0
|
| 95 |
+
flow_val_integrate_steps: 2
|
| 96 |
+
flow_val_integrate_sweep_steps:
|
| 97 |
+
- 1
|
| 98 |
+
- 2
|
| 99 |
+
- 3
|
| 100 |
+
flow_integrate_train_steps: 2
|
| 101 |
+
flow_integrate_min_t: 0.01
|
| 102 |
+
flow_integrate_schedule: uniform
|
| 103 |
+
flow_integrate_t_hi: 0.99
|
| 104 |
+
flow_integrate_power: 4.0
|
| 105 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 106 |
+
flow_val_log_readout: false
|
| 107 |
+
sb_sigma: 0.1
|
| 108 |
+
sb_noise_mode: isotropic
|
| 109 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 110 |
+
sb_per_l_sigma_scales: null
|
| 111 |
+
train:
|
| 112 |
+
seed: 0
|
| 113 |
+
deterministic: true
|
| 114 |
+
run_post_fit_test: false
|
| 115 |
+
trainer:
|
| 116 |
+
fast_dev_run: false
|
| 117 |
+
accelerator: gpu
|
| 118 |
+
strategy: ddp_find_unused_parameters_true
|
| 119 |
+
devices: 4
|
| 120 |
+
precision: 32
|
| 121 |
+
max_epochs: 100000
|
| 122 |
+
max_steps: 110000
|
| 123 |
+
num_sanity_val_steps: 2
|
| 124 |
+
gradient_clip_val: 0.5
|
| 125 |
+
val_check_interval: 1.0
|
| 126 |
+
deterministic: ${train.deterministic}
|
| 127 |
+
optim:
|
| 128 |
+
_target_: torch.optim.Adam
|
| 129 |
+
lr: 0.001
|
| 130 |
+
betas:
|
| 131 |
+
- 0.9
|
| 132 |
+
- 0.999
|
| 133 |
+
eps: 1.0e-08
|
| 134 |
+
weight_decay: 0.0
|
| 135 |
+
lr_scheduler:
|
| 136 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 137 |
+
warmup_steps: 1000
|
| 138 |
+
alpha: 0.96
|
| 139 |
+
beta: 4433
|
| 140 |
+
lr_schedule_freq: 1
|
| 141 |
+
ema:
|
| 142 |
+
decay: 0.995
|
| 143 |
+
restore:
|
| 144 |
+
ckpt_or_run_path: null
|
| 145 |
+
mode: null
|
| 146 |
+
weights_only: false
|
| 147 |
+
monitor:
|
| 148 |
+
metric: nmape/val_flow
|
| 149 |
+
mode: min
|
| 150 |
+
callbacks:
|
| 151 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 152 |
+
patience: 10000
|
| 153 |
+
verbose: false
|
| 154 |
+
monitor: ${train.monitor.metric}
|
| 155 |
+
mode: ${train.monitor.mode}
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 157 |
+
dirpath: ${core.storage_dir}
|
| 158 |
+
save_top_k: 2
|
| 159 |
+
save_last: true
|
| 160 |
+
verbose: false
|
| 161 |
+
monitor: ${train.monitor.metric}
|
| 162 |
+
mode: ${train.monitor.mode}
|
| 163 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 164 |
+
logging_interval: step
|
| 165 |
+
log_momentum: false
|
| 166 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 167 |
+
refresh_rate: 20
|
| 168 |
+
logging:
|
| 169 |
+
upload:
|
| 170 |
+
run_files: false
|
| 171 |
+
source: true
|
| 172 |
+
wandb:
|
| 173 |
+
name: ${core.expname}
|
| 174 |
+
project: ${core.project_name}
|
| 175 |
+
entity: null
|
| 176 |
+
log_model: ${..upload.run_files}
|
| 177 |
+
mode: online
|
| 178 |
+
tags: ${core.tags}
|
| 179 |
+
resume: allow
|
| 180 |
+
wandb_watch:
|
| 181 |
+
log: all
|
| 182 |
+
log_freq: 100
|
| 183 |
+
core:
|
| 184 |
+
expname: md_malonaldehyde_k3l3_slim_10k100k
|
| 185 |
+
project_name: orbflow
|
| 186 |
+
storage_dir: ${core.expname}
|
| 187 |
+
version: 0.0.1
|
| 188 |
+
tags: null
|
| 189 |
+
conventions:
|
| 190 |
+
x_key: x
|
| 191 |
+
y_key: 'y'
|
md_malonaldehyde_k3l3_slim_10k100k/epoch=148-step=18500.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c43acd17309b1623fcd3186b9f2b47cb5a52909d43c82647c19df27185cbe1fa
|
| 3 |
+
size 154836262
|
md_malonaldehyde_k3l3_slim_10k100k/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.04613230377435684, "target_var": 0.15922808647155762, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
|
md_malonaldehyde_k3l3_slim_10k100k_seed42/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/malonaldehyde
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 2.7930136827969125
|
| 97 |
+
flow_prior_mu: 0.017925494043203455
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 42
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_malonaldehyde_k3l3_slim_10k100k_seed42
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_malonaldehyde_k3l3_slim_10k100k_seed42/epoch=320-step=40000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8823014baa4602a894e42f5ebc8d98fa388f821b63dfbdf0166c77e1557a1579
|
| 3 |
+
size 154836454
|
md_malonaldehyde_k3l3_slim_10k100k_seed42/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.04613230377435684, "target_var": 0.15922808647155762, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
|
md_malonaldehyde_k3l3_slim_10k100k_seed505/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/malonaldehyde
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/malonaldehyde/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 2.7930136827969125
|
| 97 |
+
flow_prior_mu: 0.017925494043203455
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 505
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 2
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_malonaldehyde_k3l3_slim_10k100k_seed505
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_malonaldehyde_k3l3_slim_10k100k_seed505/epoch=108-step=27000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1e279e4d237d3ff3d23fa315a615286b10456fbecee8dc67033004f94719dcac
|
| 3 |
+
size 154836454
|
md_malonaldehyde_k3l3_slim_10k100k_seed505/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.04613230377435684, "target_var": 0.15922808647155762, "avg_num_neighbors": 7, "unique_atom_types": [8, 1, 6, 0]}
|
md_phenol_k3l3_slim_10k100k/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/phenol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 1.9846056192284764
|
| 97 |
+
flow_prior_mu: 0.005037187932829464
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 0
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_phenol_k3l3_slim_10k100k
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_phenol_k3l3_slim_10k100k/epoch=1748-step=110000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37fa2defb2da0615e627725c16261cde54b7fe837aadca4a3f7201d59c56b5c7
|
| 3 |
+
size 154837934
|
md_phenol_k3l3_slim_10k100k/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.059311117976903915, "target_var": 0.1463594138622284, "avg_num_neighbors": 12, "unique_atom_types": [8, 1, 6, 0]}
|
md_phenol_k3l3_slim_10k100k_seed42/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/phenol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 1.9846056192284764
|
| 97 |
+
flow_prior_mu: 0.005037187932829464
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 42
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_phenol_k3l3_slim_10k100k_seed42
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_phenol_k3l3_slim_10k100k_seed42/epoch=712-step=44856-v1.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4f06f639fa3ccfcd032f5e245a8fe10aae8219220256d3131ebe14956c40426a
|
| 3 |
+
size 154838514
|
md_phenol_k3l3_slim_10k100k_seed42/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.059311117976903915, "target_var": 0.1463594138622284, "avg_num_neighbors": 12, "unique_atom_types": [8, 1, 6, 0]}
|
md_phenol_k3l3_slim_10k100k_seed505/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/phenol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/phenol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 1.9846056192284764
|
| 97 |
+
flow_prior_mu: 0.005037187932829464
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 505
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 2
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_phenol_k3l3_slim_10k100k_seed505
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|
md_phenol_k3l3_slim_10k100k_seed505/epoch=477-step=60102.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cf856c66cb543c94a6f5b37b8105c6bae357487ebc8d3f911e8ed097577d8883
|
| 3 |
+
size 154836454
|
md_phenol_k3l3_slim_10k100k_seed505/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.059311117976903915, "target_var": 0.1463594138622284, "avg_num_neighbors": 12, "unique_atom_types": [8, 1, 6, 0]}
|
md_resorcinol_k3l3_slim_10k100k/config.yaml
ADDED
|
@@ -0,0 +1,191 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/resorcinol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
flow_velocity_mlp_hidden: 512
|
| 81 |
+
flow_time_dim: 64
|
| 82 |
+
flow_head: escn
|
| 83 |
+
flow_e3nn_hidden_multiplier: 2
|
| 84 |
+
bridge_mode: cfm
|
| 85 |
+
flow_loss_mode: endpoint
|
| 86 |
+
flow_endpoint_loss: integrated_density
|
| 87 |
+
flow_target_mode: gt
|
| 88 |
+
flow_use_t_scale: false
|
| 89 |
+
flow_t_scale_max: 0.9
|
| 90 |
+
flow_prior_mode: irrep_gaussian
|
| 91 |
+
flow_prior_sigma: 2.0182929296544465
|
| 92 |
+
flow_prior_mu: 0.004724867169487745
|
| 93 |
+
flow_prior_nelectron_normalize: false
|
| 94 |
+
flow_nelectron_mc_max_probes: 0
|
| 95 |
+
flow_val_integrate_steps: 2
|
| 96 |
+
flow_val_integrate_sweep_steps:
|
| 97 |
+
- 1
|
| 98 |
+
- 2
|
| 99 |
+
- 3
|
| 100 |
+
flow_integrate_train_steps: 2
|
| 101 |
+
flow_integrate_min_t: 0.01
|
| 102 |
+
flow_integrate_schedule: uniform
|
| 103 |
+
flow_integrate_t_hi: 0.99
|
| 104 |
+
flow_integrate_power: 4.0
|
| 105 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 106 |
+
flow_val_log_readout: false
|
| 107 |
+
sb_sigma: 0.1
|
| 108 |
+
sb_noise_mode: isotropic
|
| 109 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 110 |
+
sb_per_l_sigma_scales: null
|
| 111 |
+
train:
|
| 112 |
+
seed: 0
|
| 113 |
+
deterministic: true
|
| 114 |
+
run_post_fit_test: false
|
| 115 |
+
trainer:
|
| 116 |
+
fast_dev_run: false
|
| 117 |
+
accelerator: gpu
|
| 118 |
+
strategy: ddp_find_unused_parameters_true
|
| 119 |
+
devices: 4
|
| 120 |
+
precision: 32
|
| 121 |
+
max_epochs: 100000
|
| 122 |
+
max_steps: 110000
|
| 123 |
+
num_sanity_val_steps: 2
|
| 124 |
+
gradient_clip_val: 0.5
|
| 125 |
+
val_check_interval: 1.0
|
| 126 |
+
deterministic: ${train.deterministic}
|
| 127 |
+
optim:
|
| 128 |
+
_target_: torch.optim.Adam
|
| 129 |
+
lr: 0.001
|
| 130 |
+
betas:
|
| 131 |
+
- 0.9
|
| 132 |
+
- 0.999
|
| 133 |
+
eps: 1.0e-08
|
| 134 |
+
weight_decay: 0.0
|
| 135 |
+
lr_scheduler:
|
| 136 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 137 |
+
warmup_steps: 1000
|
| 138 |
+
alpha: 0.96
|
| 139 |
+
beta: 4433
|
| 140 |
+
lr_schedule_freq: 1
|
| 141 |
+
ema:
|
| 142 |
+
decay: 0.995
|
| 143 |
+
restore:
|
| 144 |
+
ckpt_or_run_path: null
|
| 145 |
+
mode: null
|
| 146 |
+
weights_only: false
|
| 147 |
+
monitor:
|
| 148 |
+
metric: nmape/val_flow
|
| 149 |
+
mode: min
|
| 150 |
+
callbacks:
|
| 151 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 152 |
+
patience: 10000
|
| 153 |
+
verbose: false
|
| 154 |
+
monitor: ${train.monitor.metric}
|
| 155 |
+
mode: ${train.monitor.mode}
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 157 |
+
dirpath: ${core.storage_dir}
|
| 158 |
+
save_top_k: 2
|
| 159 |
+
save_last: true
|
| 160 |
+
verbose: false
|
| 161 |
+
monitor: ${train.monitor.metric}
|
| 162 |
+
mode: ${train.monitor.mode}
|
| 163 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 164 |
+
logging_interval: step
|
| 165 |
+
log_momentum: false
|
| 166 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 167 |
+
refresh_rate: 20
|
| 168 |
+
logging:
|
| 169 |
+
upload:
|
| 170 |
+
run_files: false
|
| 171 |
+
source: true
|
| 172 |
+
wandb:
|
| 173 |
+
name: ${core.expname}
|
| 174 |
+
project: ${core.project_name}
|
| 175 |
+
entity: null
|
| 176 |
+
log_model: ${..upload.run_files}
|
| 177 |
+
mode: online
|
| 178 |
+
tags: ${core.tags}
|
| 179 |
+
resume: allow
|
| 180 |
+
wandb_watch:
|
| 181 |
+
log: null
|
| 182 |
+
log_freq: 100
|
| 183 |
+
core:
|
| 184 |
+
expname: md_resorcinol_k3l3_slim_10k100k
|
| 185 |
+
project_name: orbflow
|
| 186 |
+
storage_dir: ${core.expname}
|
| 187 |
+
version: 0.0.1
|
| 188 |
+
tags: null
|
| 189 |
+
conventions:
|
| 190 |
+
x_key: x
|
| 191 |
+
y_key: 'y'
|
md_resorcinol_k3l3_slim_10k100k/epoch=698-step=43974.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1b8c7b823cf4c1390b16482e2d5cf64cf8ffd5d4cc0edfa37fa190c56884f68d
|
| 3 |
+
size 154836262
|
md_resorcinol_k3l3_slim_10k100k/metadata.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"target_mean": 0.06919773668050766, "target_var": 0.20266202092170715, "avg_num_neighbors": 13, "unique_atom_types": [8, 1, 6, 0]}
|
md_resorcinol_k3l3_slim_10k100k_seed42/config.yaml
ADDED
|
@@ -0,0 +1,196 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
data:
|
| 2 |
+
_target_: scdp.data.datamodule.ProbeDataModule
|
| 3 |
+
dataset:
|
| 4 |
+
_target_: scdp.data.dataset.LmdbDataset
|
| 5 |
+
path: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol
|
| 6 |
+
gt_coeffs_path: ${oc.env:DATAPATH}/MD/scdp_lmdb_gt_ridge_beta1.3/resorcinol
|
| 7 |
+
sad_coeffs_path: null
|
| 8 |
+
split_file: ${oc.env:DATAPATH}/MD/scdp_lmdb/resorcinol/datasplits.json
|
| 9 |
+
num_workers:
|
| 10 |
+
train: 8
|
| 11 |
+
val: 8
|
| 12 |
+
test: 8
|
| 13 |
+
batch_size:
|
| 14 |
+
train: 4
|
| 15 |
+
val: 4
|
| 16 |
+
test: 4
|
| 17 |
+
n_probe:
|
| 18 |
+
train: 125000
|
| 19 |
+
val: 125000
|
| 20 |
+
test: 125000
|
| 21 |
+
model:
|
| 22 |
+
model:
|
| 23 |
+
_target_: scdp.model.equiformer_v3.EquiformerV3
|
| 24 |
+
enable_flow_coeff_entangle: true
|
| 25 |
+
flow_bridge_time_dim: ${..flow_time_dim}
|
| 26 |
+
max_num_elements: 100
|
| 27 |
+
num_layers: 3
|
| 28 |
+
lmax_list:
|
| 29 |
+
- 3
|
| 30 |
+
mmax_list:
|
| 31 |
+
- 2
|
| 32 |
+
cutoff: 6.0
|
| 33 |
+
sphere_channels: 96
|
| 34 |
+
hidden_channels: 192
|
| 35 |
+
edge_channels: 96
|
| 36 |
+
num_radial_basis: 300
|
| 37 |
+
distance_resolution: 0.02
|
| 38 |
+
basis_width_scalar: 2.0
|
| 39 |
+
attn_hidden_channels: 64
|
| 40 |
+
num_heads: 8
|
| 41 |
+
attn_alpha_channels: 32
|
| 42 |
+
attn_value_channels: 16
|
| 43 |
+
attn_grid_resolution_list:
|
| 44 |
+
- 20
|
| 45 |
+
- 8
|
| 46 |
+
ffn_grid_resolution_list:
|
| 47 |
+
- 20
|
| 48 |
+
- 20
|
| 49 |
+
norm_type: merge_layer_norm
|
| 50 |
+
use_atom_edge_embedding: true
|
| 51 |
+
use_envelope: true
|
| 52 |
+
use_attn_renorm: true
|
| 53 |
+
use_add_merge: false
|
| 54 |
+
use_grid_mlp: true
|
| 55 |
+
attn_activation: sep-merge_gates2_swiglu
|
| 56 |
+
ffn_activation: sep-merge_gates2_swiglu
|
| 57 |
+
alpha_drop: 0.0
|
| 58 |
+
attn_mask_rate: 0.0
|
| 59 |
+
attn_weights_drop: 0.0
|
| 60 |
+
value_drop: 0.0
|
| 61 |
+
drop_path_rate: 0.0
|
| 62 |
+
proj_drop: 0.0
|
| 63 |
+
ffn_drop: 0.0
|
| 64 |
+
gradient_checkpointing_block_list: null
|
| 65 |
+
_target_: scdp.model.module_flow.ChgFlowMatchingModule
|
| 66 |
+
criterion: mae
|
| 67 |
+
vnode_elem: 8
|
| 68 |
+
pbc: false
|
| 69 |
+
dft_basis_set: def2-qzvppd
|
| 70 |
+
dft_wt_aug: true
|
| 71 |
+
concat_basis: false
|
| 72 |
+
beta: 1.3
|
| 73 |
+
lmax_restriction: true
|
| 74 |
+
lmax_relax: 0
|
| 75 |
+
uncontracted: true
|
| 76 |
+
orb_cutoff: 5.0
|
| 77 |
+
expo_trainable: false
|
| 78 |
+
magnitude_weighting: false
|
| 79 |
+
density_synthesis_mode: linear
|
| 80 |
+
density_eval_mode: realspace
|
| 81 |
+
hybrid_fft_zeta_max: 5.0
|
| 82 |
+
hybrid_fft_phase_sign: -1.0
|
| 83 |
+
hybrid_fft_chunk_G: 65536
|
| 84 |
+
flow_velocity_mlp_hidden: 512
|
| 85 |
+
flow_time_dim: 64
|
| 86 |
+
flow_head: escn
|
| 87 |
+
flow_e3nn_hidden_multiplier: 2
|
| 88 |
+
bridge_mode: cfm
|
| 89 |
+
flow_loss_mode: endpoint
|
| 90 |
+
flow_endpoint_loss: integrated_density
|
| 91 |
+
flow_combined_integrated_weight: 1.0
|
| 92 |
+
flow_target_mode: gt
|
| 93 |
+
flow_use_t_scale: false
|
| 94 |
+
flow_t_scale_max: 0.9
|
| 95 |
+
flow_prior_mode: irrep_gaussian
|
| 96 |
+
flow_prior_sigma: 2.0182929296544465
|
| 97 |
+
flow_prior_mu: 0.004724867169487745
|
| 98 |
+
flow_prior_nelectron_normalize: false
|
| 99 |
+
flow_nelectron_mc_max_probes: 0
|
| 100 |
+
flow_val_integrate_steps: 2
|
| 101 |
+
flow_val_integrate_sweep_steps:
|
| 102 |
+
- 1
|
| 103 |
+
- 2
|
| 104 |
+
- 3
|
| 105 |
+
flow_integrate_train_steps: 2
|
| 106 |
+
flow_integrate_min_t: 0.01
|
| 107 |
+
flow_integrate_schedule: uniform
|
| 108 |
+
flow_integrate_t_hi: 0.99
|
| 109 |
+
flow_integrate_power: 4.0
|
| 110 |
+
flow_val_max_n_probe_per_pass: 400000
|
| 111 |
+
flow_val_log_readout: false
|
| 112 |
+
sb_sigma: 0.1
|
| 113 |
+
sb_noise_mode: isotropic
|
| 114 |
+
sb_per_l_sigma_mode: inv_sqrt_2lp1
|
| 115 |
+
sb_per_l_sigma_scales: null
|
| 116 |
+
train:
|
| 117 |
+
seed: 42
|
| 118 |
+
deterministic: true
|
| 119 |
+
run_post_fit_test: false
|
| 120 |
+
trainer:
|
| 121 |
+
fast_dev_run: false
|
| 122 |
+
accelerator: gpu
|
| 123 |
+
strategy: ddp_find_unused_parameters_true
|
| 124 |
+
devices: 4
|
| 125 |
+
precision: 32
|
| 126 |
+
max_epochs: 100000
|
| 127 |
+
max_steps: 110000
|
| 128 |
+
num_sanity_val_steps: 2
|
| 129 |
+
gradient_clip_val: 0.5
|
| 130 |
+
val_check_interval: 1.0
|
| 131 |
+
deterministic: ${train.deterministic}
|
| 132 |
+
optim:
|
| 133 |
+
_target_: torch.optim.Adam
|
| 134 |
+
lr: 0.001
|
| 135 |
+
betas:
|
| 136 |
+
- 0.9
|
| 137 |
+
- 0.999
|
| 138 |
+
eps: 1.0e-08
|
| 139 |
+
weight_decay: 0.0
|
| 140 |
+
lr_scheduler:
|
| 141 |
+
_target_: scdp.model.utils.PowerDecayScheduler
|
| 142 |
+
warmup_steps: 1000
|
| 143 |
+
alpha: 0.96
|
| 144 |
+
beta: 4433
|
| 145 |
+
lr_schedule_freq: 1
|
| 146 |
+
ema:
|
| 147 |
+
decay: 0.995
|
| 148 |
+
restore:
|
| 149 |
+
ckpt_or_run_path: null
|
| 150 |
+
mode: null
|
| 151 |
+
weights_only: false
|
| 152 |
+
monitor:
|
| 153 |
+
metric: nmape/val_flow
|
| 154 |
+
mode: min
|
| 155 |
+
callbacks:
|
| 156 |
+
- _target_: lightning.pytorch.callbacks.EarlyStopping
|
| 157 |
+
patience: 10000
|
| 158 |
+
verbose: false
|
| 159 |
+
monitor: ${train.monitor.metric}
|
| 160 |
+
mode: ${train.monitor.mode}
|
| 161 |
+
- _target_: lightning.pytorch.callbacks.ModelCheckpoint
|
| 162 |
+
dirpath: ${core.storage_dir}
|
| 163 |
+
save_top_k: 2
|
| 164 |
+
save_last: true
|
| 165 |
+
verbose: false
|
| 166 |
+
monitor: ${train.monitor.metric}
|
| 167 |
+
mode: ${train.monitor.mode}
|
| 168 |
+
- _target_: lightning.pytorch.callbacks.LearningRateMonitor
|
| 169 |
+
logging_interval: step
|
| 170 |
+
log_momentum: false
|
| 171 |
+
- _target_: lightning.pytorch.callbacks.progress.tqdm_progress.TQDMProgressBar
|
| 172 |
+
refresh_rate: 20
|
| 173 |
+
logging:
|
| 174 |
+
upload:
|
| 175 |
+
run_files: false
|
| 176 |
+
source: true
|
| 177 |
+
wandb:
|
| 178 |
+
name: ${core.expname}
|
| 179 |
+
project: ${core.project_name}
|
| 180 |
+
entity: null
|
| 181 |
+
log_model: ${..upload.run_files}
|
| 182 |
+
mode: online
|
| 183 |
+
tags: ${core.tags}
|
| 184 |
+
resume: allow
|
| 185 |
+
wandb_watch:
|
| 186 |
+
log: null
|
| 187 |
+
log_freq: 100
|
| 188 |
+
core:
|
| 189 |
+
expname: md_resorcinol_k3l3_slim_10k100k_seed42
|
| 190 |
+
project_name: orbflow
|
| 191 |
+
storage_dir: ${core.expname}
|
| 192 |
+
version: 0.0.1
|
| 193 |
+
tags: null
|
| 194 |
+
conventions:
|
| 195 |
+
x_key: x
|
| 196 |
+
y_key: 'y'
|