[2024-11-26 22:22:59,693][hydra.utils][INFO] - Instantiating <diffcsp.pl_data.datamodule.CrystDataModule>
[2024-11-26 22:24:10,067][hydra.utils][INFO] - Instantiating <diffcsp.pl_modules.diffusion_w_type.CSPDiffusion>
[2024-11-26 22:24:16,487][hydra.utils][INFO] - Model initialized with parameters: ['decoder.node_embedding.weight', 'decoder.node_embedding.bias', 'decoder.atom_latent_emb.weight', 'decoder.atom_latent_emb.bias', 'decoder.csp_layer_0.edge_mlp.0.weight', 'decoder.csp_layer_0.edge_mlp.0.bias', 'decoder.csp_layer_0.edge_mlp.2.weight', 'decoder.csp_layer_0.edge_mlp.2.bias', 'decoder.csp_layer_0.node_mlp.0.weight', 'decoder.csp_layer_0.node_mlp.0.bias']
[2024-11-26 22:24:16,488][hydra.utils][INFO] - Passing scaler from datamodule to model <StandardScalerTorch(means: 3.604318141937256, stds: 5.234546661376953)>
[2024-11-26 22:24:16,511][hydra.utils][INFO] - Adding callback <LearningRateMonitor>
[2024-11-26 22:24:16,511][hydra.utils][INFO] - Adding callback <EarlyStopping>
[2024-11-26 22:24:16,512][hydra.utils][INFO] - Adding callback <ModelCheckpoint>
[2024-11-26 22:24:16,515][hydra.utils][INFO] - Instantiating <WandbLogger>
[2024-11-26 22:24:16,554][hydra.utils][INFO] - W&B is now watching <{cfg.logging.wandb_watch.log}>!
[2024-11-26 22:24:18,334][hydra.utils][INFO] - Using checkpoint specified in config: /blue/hennig/pawanprakash/diffusion/Diffscp_guide/hydra/singlerun/2024-11-21/alex_20/epoch=656-step=74898.ckpt
[2024-11-26 22:24:18,334][hydra.utils][INFO] - Loading model state dict from checkpoint: /blue/hennig/pawanprakash/diffusion/Diffscp_guide/hydra/singlerun/2024-11-21/alex_20/epoch=656-step=74898.ckpt
[2024-11-26 22:24:21,126][hydra.utils][INFO] - Checkpoint keys: ['decoder.node_embedding.weight', 'decoder.node_embedding.bias', 'decoder.atom_latent_emb.weight', 'decoder.atom_latent_emb.bias', 'decoder.csp_layer_0.edge_mlp.0.weight', 'decoder.csp_layer_0.edge_mlp.0.bias', 'decoder.csp_layer_0.edge_mlp.2.weight', 'decoder.csp_layer_0.edge_mlp.2.bias', 'decoder.csp_layer_0.node_mlp.0.weight', 'decoder.csp_layer_0.node_mlp.0.bias']
[2024-11-26 22:24:21,134][hydra.utils][WARNING] - Missing keys during checkpoint loading: ['decoder.adapters.0.adapter_fc1.weight', 'decoder.adapters.0.adapter_fc1.bias', 'decoder.adapters.0.adapter_fc2.weight', 'decoder.adapters.0.adapter_fc2.bias', 'decoder.adapters.0.mixin.weight', 'decoder.adapters.1.adapter_fc1.weight', 'decoder.adapters.1.adapter_fc1.bias', 'decoder.adapters.1.adapter_fc2.weight', 'decoder.adapters.1.adapter_fc2.bias', 'decoder.adapters.1.mixin.weight', 'decoder.adapters.2.adapter_fc1.weight', 'decoder.adapters.2.adapter_fc1.bias', 'decoder.adapters.2.adapter_fc2.weight', 'decoder.adapters.2.adapter_fc2.bias', 'decoder.adapters.2.mixin.weight', 'decoder.adapters.3.adapter_fc1.weight', 'decoder.adapters.3.adapter_fc1.bias', 'decoder.adapters.3.adapter_fc2.weight', 'decoder.adapters.3.adapter_fc2.bias', 'decoder.adapters.3.mixin.weight', 'decoder.adapters.4.adapter_fc1.weight', 'decoder.adapters.4.adapter_fc1.bias', 'decoder.adapters.4.adapter_fc2.weight', 'decoder.adapters.4.adapter_fc2.bias', 'decoder.adapters.4.mixin.weight', 'decoder.adapters.5.adapter_fc1.weight', 'decoder.adapters.5.adapter_fc1.bias', 'decoder.adapters.5.adapter_fc2.weight', 'decoder.adapters.5.adapter_fc2.bias', 'decoder.adapters.5.mixin.weight']
[2024-11-26 22:24:21,659][hydra.utils][INFO] - Instantiating the Trainer
[2024-11-26 22:24:21,704][hydra.utils][INFO] - Starting training!
[2024-11-26 22:54:46,657][hydra.utils][INFO] - Starting testing!