jpata commited on
Commit
bf7d95a
·
verified ·
1 Parent(s): 5a6d581

Publish FM c6879962 training artifacts (1-200/1676)

Browse files

PF FM 500k campaign: experts, joint training and fine-tunes; latest and best checkpoints, complete histories, TensorBoard, logs, configs, manifests, original-step plots and integrity metadata.

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/checkpoints/best.pth +3 -0
  2. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/checkpoints/checkpoint-50000.pth +3 -0
  3. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_10000.json +1 -0
  4. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_20000.json +1 -0
  5. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_30000.json +1 -0
  6. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_40000.json +1 -0
  7. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_50000.json +1 -0
  8. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/hyperparameters.json +1 -0
  9. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/model_kwargs.pkl +3 -0
  10. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/particleflow_spec.yaml +3198 -0
  11. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.pdf +0 -0
  12. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.png +0 -0
  13. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.pdf +0 -0
  14. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.png +0 -0
  15. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.pdf +0 -0
  16. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.png +0 -0
  17. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res.pdf +0 -0
  18. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res.png +0 -0
  19. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.pdf +0 -0
  20. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.png +0 -0
  21. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/num_elements.pdf +0 -0
  22. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/num_elements.png +0 -0
  23. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/runs/train/events.out.tfevents.1794646693.workergpu159.1868450.0 +3 -0
  24. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/runs/valid/events.out.tfevents.1794646693.workergpu159.1868450.1 +3 -0
  25. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/scenario-manifest.json +1299 -0
  26. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/train-config.yaml +202 -0
  27. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/train.log +0 -0
  28. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/train.log.0 +0 -0
  29. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/checkpoints/best.pth +3 -0
  30. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/checkpoints/checkpoint-50000.pth +3 -0
  31. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_10000.json +1 -0
  32. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_20000.json +1 -0
  33. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_30000.json +1 -0
  34. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_40000.json +1 -0
  35. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_50000.json +1 -0
  36. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/hyperparameters.json +1 -0
  37. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/model_kwargs.pkl +3 -0
  38. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/particleflow_spec.yaml +3198 -0
  39. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.pdf +0 -0
  40. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.png +0 -0
  41. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.pdf +0 -0
  42. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.png +0 -0
  43. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.pdf +0 -0
  44. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.png +0 -0
  45. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res.pdf +0 -0
  46. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res.png +0 -0
  47. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.pdf +0 -0
  48. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.png +0 -0
  49. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/num_elements.pdf +0 -0
  50. fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/num_elements.png +0 -0
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/checkpoints/best.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f516c5ed88f2f000355e32801d8533c56bdda6768fa937442fe2040af9484d14
3
+ size 47063573
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/checkpoints/checkpoint-50000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3916e6116e80e23e4c298a7a018c7a14bb6f98fa4138dd7f4ccaff74c7d09e62
3
+ size 47101757
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_10000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 17.793594306049823, "train": {"Classification_binary": 2.470405340194702, "Classification": 0.01498999260365963, "Regression_pt": 0.2600608170032501, "Regression_eta": 0.006616869010031223, "Regression_sin_phi": 0.004621132742613554, "Regression_cos_phi": 0.004002876579761505, "Regression_energy": 0.2713663876056671, "Total": 6.39364767074585, "Total_unweighted": 3.0320634157396853}, "train_group": {}, "valid": {"Classification_binary": 2.4950942993164062, "Classification": 0.012887252494692802, "Regression_pt": 0.20939947664737701, "Regression_eta": 0.014357101172208786, "Regression_sin_phi": 0.009900463744997978, "Regression_cos_phi": 0.008746917359530926, "Regression_energy": 0.20825736224651337, "Total": 5.769011974334717, "Total_unweighted": 2.958642872981727, "metrics/particle/class_1/efficiency": 0.863043487071991, "metrics/particle/class_1/pid_accuracy": 0.9722921848297119, "metrics/particle/class_2/efficiency": 0.2380952388048172, "metrics/particle/class_2/pid_accuracy": 0.6000000238418579, "metrics/particle/class_3/efficiency": 0.512499988079071, "metrics/particle/class_3/pid_accuracy": 0.9756097793579102, "metrics/particle/class_4/efficiency": 0.8383838534355164, "metrics/particle/class_4/pid_accuracy": 0.9397590160369873, "metrics/particle/class_5/efficiency": 0.9292929172515869, "metrics/particle/class_5/pid_accuracy": 0.989130437374115, "metrics/particle/count/bias_mean": -0.1120000034570694, "metrics/particle/count/mae": 0.6320000290870667, "metrics/particle/count/prediction_mean": 4.52400016784668, "metrics/particle/count/target_mean": 4.636000156402588, "metrics/particle/event/energy_relative_abs_error": 0.08760278671979904, "metrics/particle/event/energy_response_mean": 0.9866527915000916, "metrics/particle/event/met_abs_error": 2.8842148780822754, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08855906873941422, "metrics/particle/event/scalar_pt_response_mean": 0.9902690649032593, "metrics/particle/event/vector_pt_closure": 0.1092691421508789, "metrics/particle/matched/delta_eta_abs_mean": 0.0280148983001709, "metrics/particle/matched/delta_phi_abs_mean": 0.024209514260292053, "metrics/particle/matched/delta_r_mean": 0.0412246435880661, "metrics/particle/matched/energy_relative_abs_mean": 0.10055454820394516, "metrics/particle/matched/pid_accuracy": 0.969623327255249, "metrics/particle/matched/pt_relative_abs_mean": 0.10068883746862411, "metrics/particle/matching/duplicate_fraction": 0.029177719727158546, "metrics/particle/matching/efficiency": 0.7100949287414551, "metrics/particle/matching/f1": 0.7187772989273071, "metrics/particle/matching/purity": 0.7276746034622192, "metrics/particle/matching/target_coverage_dr0p05": 0.48662641644477844, "metrics/particle/matching/target_coverage_dr0p10": 0.7506471276283264, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6617773771286011, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8127696514129639}, "step_train_time": 0.6028058528900146, "step_valid_time": 2.8203783889766783, "step_total_time": 1113.3894712924957, "elapsed_training_loop_seconds": 1113.3894712924957, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.0074353931865176, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.09821468632867425, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 437, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 435, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 404, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 395, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9244851258581236, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9287356321839081, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.926605504587156, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.07126436781609195, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9038901601830663, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9080459770114943, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9059633027522935, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9244851258581236, "step_test_time": 5.576461191056296, "step_plot_time": 4.444414507015608, "step_validation_cycle_time": 13.37055923906155}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_20000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 35.587188612099645, "train": {"Classification_binary": 1.9142053127288818, "Classification": 0.002808774821460247, "Regression_pt": 0.18370336294174194, "Regression_eta": 0.006747966166585684, "Regression_sin_phi": 0.009045658633112907, "Regression_cos_phi": 0.004843755625188351, "Regression_energy": 0.18506161868572235, "Total": 4.634146213531494, "Total_unweighted": 2.3064164496026933}, "train_group": {}, "valid": {"Classification_binary": 2.359476089477539, "Classification": 0.01065006759017706, "Regression_pt": 0.20814518630504608, "Regression_eta": 0.010532179847359657, "Regression_sin_phi": 0.008639832958579063, "Regression_cos_phi": 0.006208475679159164, "Regression_energy": 0.21246372163295746, "Total": 5.560715198516846, "Total_unweighted": 2.8161155534908175, "metrics/particle/class_1/efficiency": 0.897826075553894, "metrics/particle/class_1/pid_accuracy": 0.9782082438468933, "metrics/particle/class_2/efficiency": 0.3333333432674408, "metrics/particle/class_2/pid_accuracy": 0.5714285969734192, "metrics/particle/class_3/efficiency": 0.5770833492279053, "metrics/particle/class_3/pid_accuracy": 0.9747292399406433, "metrics/particle/class_4/efficiency": 0.8383838534355164, "metrics/particle/class_4/pid_accuracy": 0.9156626462936401, "metrics/particle/class_5/efficiency": 0.9797979593276978, "metrics/particle/class_5/pid_accuracy": 0.9896907210350037, "metrics/particle/count/bias_mean": 0.02800000086426735, "metrics/particle/count/mae": 0.5879999995231628, "metrics/particle/count/prediction_mean": 4.664000034332275, "metrics/particle/count/target_mean": 4.636000156402588, "metrics/particle/event/energy_relative_abs_error": 0.08774281293153763, "metrics/particle/event/energy_response_mean": 0.9923677444458008, "metrics/particle/event/met_abs_error": 2.612107753753662, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08549340069293976, "metrics/particle/event/scalar_pt_response_mean": 0.997454047203064, "metrics/particle/event/vector_pt_closure": 0.09128881245851517, "metrics/particle/matched/delta_eta_abs_mean": 0.02574164606630802, "metrics/particle/matched/delta_phi_abs_mean": 0.021925149485468864, "metrics/particle/matched/delta_r_mean": 0.03762231022119522, "metrics/particle/matched/energy_relative_abs_mean": 0.09812948107719421, "metrics/particle/matched/pid_accuracy": 0.9692132472991943, "metrics/particle/matched/pt_relative_abs_mean": 0.0980519950389862, "metrics/particle/matching/duplicate_fraction": 0.03344768285751343, "metrics/particle/matching/efficiency": 0.756686806678772, "metrics/particle/matching/f1": 0.754408597946167, "metrics/particle/matching/purity": 0.7521440982818604, "metrics/particle/matching/target_coverage_dr0p05": 0.5806729793548584, "metrics/particle/matching/target_coverage_dr0p10": 0.8058671355247498, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6833477020263672, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8360655903816223}, "step_train_time": 0.6147933006286621, "step_valid_time": 2.9689863089006394, "step_total_time": 2240.7805354595184, "elapsed_training_loop_seconds": 2240.7805354595184, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9828551354348452, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.08326922599868103, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 437, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 434, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 408, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 403, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9336384439359268, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9400921658986175, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9368541905855339, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.059907834101382486, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9221967963386728, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9285714285714286, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9253731343283582, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9336384439359268, "step_test_time": 4.8475582679966465, "step_plot_time": 3.2590056729968637, "step_validation_cycle_time": 11.620401413994841}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_30000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 53.380782918149464, "train": {"Classification_binary": 2.329976797103882, "Classification": 0.006666332017630339, "Regression_pt": 0.1582590639591217, "Regression_eta": 0.006296627689152956, "Regression_sin_phi": 0.0027599530294537544, "Regression_cos_phi": 0.003585765603929758, "Regression_energy": 0.11865943670272827, "Total": 4.44908332824707, "Total_unweighted": 2.6262039761058986}, "train_group": {}, "valid": {"Classification_binary": 2.6239399909973145, "Classification": 0.012073090299963951, "Regression_pt": 0.22017677128314972, "Regression_eta": 0.009221618995070457, "Regression_sin_phi": 0.008007444441318512, "Regression_cos_phi": 0.006201080046594143, "Regression_energy": 0.2277200073003769, "Total": 6.011784076690674, "Total_unweighted": 3.107340003363788, "metrics/particle/class_1/efficiency": 0.8999999761581421, "metrics/particle/class_1/pid_accuracy": 0.9758453965187073, "metrics/particle/class_2/efficiency": 0.1428571492433548, "metrics/particle/class_2/pid_accuracy": 0.6666666865348816, "metrics/particle/class_3/efficiency": 0.581250011920929, "metrics/particle/class_3/pid_accuracy": 0.9605734944343567, "metrics/particle/class_4/efficiency": 0.8888888955116272, "metrics/particle/class_4/pid_accuracy": 0.8863636255264282, "metrics/particle/class_5/efficiency": 0.9898989796638489, "metrics/particle/class_5/pid_accuracy": 0.9693877696990967, "metrics/particle/count/bias_mean": 0.052000001072883606, "metrics/particle/count/mae": 0.6200000047683716, "metrics/particle/count/prediction_mean": 4.688000202178955, "metrics/particle/count/target_mean": 4.636000156402588, "metrics/particle/event/energy_relative_abs_error": 0.10221365094184875, "metrics/particle/event/energy_response_mean": 1.0306388139724731, "metrics/particle/event/met_abs_error": 3.0977890491485596, "metrics/particle/event/scalar_pt_relative_abs_error": 0.09756720811128616, "metrics/particle/event/scalar_pt_response_mean": 1.0288279056549072, "metrics/particle/event/vector_pt_closure": 0.10402042418718338, "metrics/particle/matched/delta_eta_abs_mean": 0.024498332291841507, "metrics/particle/matched/delta_phi_abs_mean": 0.019895203411579132, "metrics/particle/matched/delta_r_mean": 0.03521939739584923, "metrics/particle/matched/energy_relative_abs_mean": 0.09077376127243042, "metrics/particle/matched/pid_accuracy": 0.9603174328804016, "metrics/particle/matched/pt_relative_abs_mean": 0.08867111057043076, "metrics/particle/matching/duplicate_fraction": 0.03498293459415436, "metrics/particle/matching/efficiency": 0.7610008716583252, "metrics/particle/matching/f1": 0.7567567825317383, "metrics/particle/matching/purity": 0.7525597214698792, "metrics/particle/matching/target_coverage_dr0p05": 0.5953407883644104, "metrics/particle/matching/target_coverage_dr0p10": 0.795513391494751, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7066436409950256, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8386540412902832}, "step_train_time": 0.5930485725402832, "step_valid_time": 2.9109891100088134, "step_total_time": 3369.930011987686, "elapsed_training_loop_seconds": 3369.930011987686, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9987664713387776, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.09312806262645335, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 437, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 436, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 406, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 394, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9290617848970252, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9311926605504587, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9301260022909508, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.06880733944954129, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9016018306636155, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9036697247706422, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9026345933562429, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9290617848970252, "step_test_time": 4.91679990501143, "step_plot_time": 3.2464390649693087, "step_validation_cycle_time": 11.536785959964618}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_40000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 71.17437722419929, "train": {"Classification_binary": 0.500719428062439, "Classification": 0.002525398973375559, "Regression_pt": 0.06104760989546776, "Regression_eta": 0.007465233560651541, "Regression_sin_phi": 0.00578747782856226, "Regression_cos_phi": 0.002875670325011015, "Regression_energy": 0.06672719866037369, "Total": 1.5229731798171997, "Total_unweighted": 0.6471480173058808}, "train_group": {}, "valid": {"Classification_binary": 4.046369552612305, "Classification": 0.015168276615440845, "Regression_pt": 0.2710207402706146, "Regression_eta": 0.009634613990783691, "Regression_sin_phi": 0.007051053922623396, "Regression_cos_phi": 0.006012238096445799, "Regression_energy": 0.2764267325401306, "Total": 8.147441864013672, "Total_unweighted": 4.631683208048344, "metrics/particle/class_1/efficiency": 0.9021739363670349, "metrics/particle/class_1/pid_accuracy": 0.966265082359314, "metrics/particle/class_2/efficiency": 0.2857142984867096, "metrics/particle/class_2/pid_accuracy": 0.6666666865348816, "metrics/particle/class_3/efficiency": 0.5333333611488342, "metrics/particle/class_3/pid_accuracy": 0.95703125, "metrics/particle/class_4/efficiency": 0.8888888955116272, "metrics/particle/class_4/pid_accuracy": 0.9204545617103577, "metrics/particle/class_5/efficiency": 0.9898989796638489, "metrics/particle/class_5/pid_accuracy": 0.9897959232330322, "metrics/particle/count/bias_mean": 0.024000000208616257, "metrics/particle/count/mae": 0.671999990940094, "metrics/particle/count/prediction_mean": 4.659999847412109, "metrics/particle/count/target_mean": 4.636000156402588, "metrics/particle/event/energy_relative_abs_error": 0.10295739769935608, "metrics/particle/event/energy_response_mean": 0.9809581637382507, "metrics/particle/event/met_abs_error": 3.1130566596984863, "metrics/particle/event/scalar_pt_relative_abs_error": 0.10064424574375153, "metrics/particle/event/scalar_pt_response_mean": 0.9849731922149658, "metrics/particle/event/vector_pt_closure": 0.10102332383394241, "metrics/particle/matched/delta_eta_abs_mean": 0.024862930178642273, "metrics/particle/matched/delta_phi_abs_mean": 0.018575577065348625, "metrics/particle/matched/delta_r_mean": 0.03451808542013168, "metrics/particle/matched/energy_relative_abs_mean": 0.0863056629896164, "metrics/particle/matched/pid_accuracy": 0.9594438076019287, "metrics/particle/matched/pt_relative_abs_mean": 0.08467335253953934, "metrics/particle/matching/duplicate_fraction": 0.03261802718043327, "metrics/particle/matching/efficiency": 0.7446074485778809, "metrics/particle/matching/f1": 0.7426850199699402, "metrics/particle/matching/purity": 0.740772545337677, "metrics/particle/matching/target_coverage_dr0p05": 0.5789473652839661, "metrics/particle/matching/target_coverage_dr0p10": 0.7739430665969849, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.693701446056366, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8352027535438538}, "step_train_time": 0.5716068744659424, "step_valid_time": 2.9506208589300513, "step_total_time": 4500.595416307449, "elapsed_training_loop_seconds": 4500.595416307449, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9898951446376003, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.07098580459097559, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 437, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 431, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 406, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 395, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9290617848970252, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9419953596287703, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9354838709677419, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.058004640371229696, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9038901601830663, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9164733178654292, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9101382488479263, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9290617848970252, "step_test_time": 4.93864590395242, "step_plot_time": 3.2144215418957174, "step_validation_cycle_time": 11.535477022989653}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/history/step_50000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 88.96797153024912, "train": {"Classification_binary": 0.669297456741333, "Classification": 0.0003745425201486796, "Regression_pt": 0.0415232814848423, "Regression_eta": 0.0017013844335451722, "Regression_sin_phi": 0.0016055343439802527, "Regression_cos_phi": 0.0015140834730118513, "Regression_energy": 0.038813576102256775, "Total": 1.2645851373672485, "Total_unweighted": 0.754829859099118}, "train_group": {}, "valid": {"Classification_binary": 6.121794700622559, "Classification": 0.023892665281891823, "Regression_pt": 0.2646413743495941, "Regression_eta": 0.009020299650728703, "Regression_sin_phi": 0.0070997984148561954, "Regression_cos_phi": 0.005211640149354935, "Regression_energy": 0.27120810747146606, "Total": 10.243091583251953, "Total_unweighted": 6.70286858594045, "metrics/particle/class_1/efficiency": 0.9108695387840271, "metrics/particle/class_1/pid_accuracy": 0.9809069037437439, "metrics/particle/class_2/efficiency": 0.2380952388048172, "metrics/particle/class_2/pid_accuracy": 0.4000000059604645, "metrics/particle/class_3/efficiency": 0.5062500238418579, "metrics/particle/class_3/pid_accuracy": 0.9794238805770874, "metrics/particle/class_4/efficiency": 0.8888888955116272, "metrics/particle/class_4/pid_accuracy": 0.8977272510528564, "metrics/particle/class_5/efficiency": 0.9898989796638489, "metrics/particle/class_5/pid_accuracy": 0.9897959232330322, "metrics/particle/count/bias_mean": 0.12399999797344208, "metrics/particle/count/mae": 0.6359999775886536, "metrics/particle/count/prediction_mean": 4.760000228881836, "metrics/particle/count/target_mean": 4.636000156402588, "metrics/particle/event/energy_relative_abs_error": 0.08591156452894211, "metrics/particle/event/energy_response_mean": 0.9860177040100098, "metrics/particle/event/met_abs_error": 2.8056294918060303, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08281180262565613, "metrics/particle/event/scalar_pt_response_mean": 0.9875185489654541, "metrics/particle/event/vector_pt_closure": 0.0968654677271843, "metrics/particle/matched/delta_eta_abs_mean": 0.02260054089128971, "metrics/particle/matched/delta_phi_abs_mean": 0.018529651686549187, "metrics/particle/matched/delta_r_mean": 0.03262568265199661, "metrics/particle/matched/energy_relative_abs_mean": 0.0773727297782898, "metrics/particle/matched/pid_accuracy": 0.969519317150116, "metrics/particle/matched/pt_relative_abs_mean": 0.07580088824033737, "metrics/particle/matching/duplicate_fraction": 0.029411764815449715, "metrics/particle/matching/efficiency": 0.7359793186187744, "metrics/particle/matching/f1": 0.7262665033340454, "metrics/particle/matching/purity": 0.7168067097663879, "metrics/particle/matching/target_coverage_dr0p05": 0.596203625202179, "metrics/particle/matching/target_coverage_dr0p10": 0.7704917788505554, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7006039619445801, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8438308835029602}, "step_train_time": 0.5911049842834473, "step_valid_time": 2.9122192590730265, "step_total_time": 5630.75192284584, "elapsed_training_loop_seconds": 5630.75192284584, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9964882214744637, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.05293799171410429, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 437, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 437, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 412, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 405, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9427917620137299, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9427917620137299, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9427917620137299, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.057208237986270026, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9267734553775744, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9267734553775744, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9267734553775744, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9427917620137299, "step_test_time": 4.780989658087492, "step_plot_time": 3.141829597996548, "step_validation_cycle_time": 11.239615236991085}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/hyperparameters.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"num_mlpf_params": 3910930, "dataset": "cld", "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/ecal_1p5mm/tfds", "model": {"type": "attention", "input_encoding": "split", "learned_representation_mode": "last", "pt_mode": "direct-elemtype-split", "eta_mode": "linear", "sin_phi_mode": "linear", "cos_phi_mode": "linear", "energy_mode": "direct-elemtype-split", "trainable": "all", "task_queries": true, "output_mode": "elementwise", "binary_classification_focal_gamma": null, "backbone": {"mode": "shared", "num_convs": 6, "num_tracker_layers": null, "num_calo_layers": null, "num_common_layers": null}, "hit_feature_engineering": {"enabled": true, "geometry": true, "tracker_neighborhood": false, "tracker_momentum": false, "tracker_doublets": false, "calorimeter_neighborhood": true}, "set_decoder": null, "input_normalization": true, "feature_bag": true, "gnnlsh": null, "attention": {"num_convs": 6, "dropout_ff": 0.0, "activation": "elu", "layernorm": true, "num_heads": 16, "head_dim": 16, "attention_type": "flash", "dropout_conv_reg_mha": 0.0, "dropout_conv_reg_ff": 0.0, "dropout_conv_id_mha": 0.0, "dropout_conv_id_ff": 0.0, "use_pre_layernorm": true, "use_jagged_attention": false, "use_flash_attn_varlen": false, "export_onnx_fused": false, "save_attention": false}, "litept": null, "hept": null, "heptv2": null}, "conv_type": "attention", "batch_size": 1, "hyperparameters": {"batch_size": 1, "lr": 0.0005}, "backend": "pytorch", "threads": 16, "gpu_type": "l40", "mem_per_gpu_mb": 40000, "slurm_partition": "gpu", "slurm_runtime": "168h", "input_dim": 19, "num_classes": 6, "elemtypes_nonzero": [1, 2], "seed": 12345, "num_steps": 500000, "patience": 3, "checkpoint_freq": 2000, "val_freq": 10000, "num_workers": 8, "prefetch_factor": 2, "max_open_readers": 64, "gpu_batch_multiplier": 16, "dtype": "bfloat16", "lr": 0.0005, "weight_decay": 0.01, "optimizer": "lamb", "lr_schedule": "onecycle", "lr_schedule_config": {"onecycle": {"pct_start": 0.3}}, "task_loss_weights": {"calibration_steps": 100, "epsilon": 1e-08, "min_weight": 0.01, "max_weight": 1000.0}, "lr_finder": {"start_lr": 1e-07, "end_lr": 0.1, "num_steps": 1000, "smoothing": 0.98, "divergence_factor": 4.0}, "pad_to_multiple_elements": 128, "validation_diagnostics_batches": 0, "validation_linear_probe": false, "validation_linear_probe_max_events": 16, "validation_particle_metrics": true, "train": true, "lr_find": false, "test": true, "compile": false, "make_plots": true, "sort_data": false, "sampler_mode": "interleaved-shards", "load": null, "relaxed_load": false, "load_weights_only": false, "reset_task_loss_weights": false, "sampler_from_scratch": false, "comet": false, "comet_offline": false, "comet_name": "particleflow", "tensorboard_step_freq": 1000, "benchmark": {"enabled": true, "sample_interval_seconds": 1.0, "warmup_steps": 100, "gpu_timing_interval": 0}, "raytune": {"local_dir": null, "sched": "asha", "search_alg": null, "default_metric": "val_loss", "default_mode": "min", "asha": {"max_t": 200, "reduction_factor": 4, "brackets": 1, "grace_period": 10}, "hyperband": {"max_t": 200, "reduction_factor": 4}, "hyperopt": {"n_random_steps": 10}, "nevergrad": {"n_random_steps": 10}}, "train_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_z_tautau_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "valid_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_z_tautau_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "test_dataset": {"cld_edm_z_tautau_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": 1}}, "enabled_test_datasets": ["cld_edm_z_tautau_pf"], "ntrain": null, "nvalid": 256, "ntest": 256, "data_config": null, "gpus": 1}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/model_kwargs.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:173683bc55e375df5711f1dbd76c7723ed41133aff628c51c670079916191d20
3
+ size 4404
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/particleflow_spec.yaml ADDED
@@ -0,0 +1,3198 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ models:
2
+ defaults:
3
+ backend: pytorch
4
+ checkpoint_freq: 10000
5
+ comet: false
6
+ dtype: bfloat16
7
+ gpu_type: l40
8
+ gpus: 1
9
+ load: null
10
+ lr_schedule: cosinedecay
11
+ mem_per_gpu_mb: 40000
12
+ ntest: 100
13
+ ntrain: null
14
+ num_steps: 100000
15
+ num_workers: 2
16
+ nvalid: null
17
+ optimizer: lamb
18
+ patience: 10000
19
+ prefetch_factor: 2
20
+ raytune: &id001
21
+ asha:
22
+ brackets: 1
23
+ grace_period: 10
24
+ max_t: 200
25
+ reduction_factor: 4
26
+ default_metric: val_loss
27
+ default_mode: min
28
+ hyperband:
29
+ max_t: 200
30
+ reduction_factor: 4
31
+ hyperopt:
32
+ n_random_steps: 10
33
+ local_dir: null
34
+ nevergrad:
35
+ n_random_steps: 10
36
+ sched: asha
37
+ search_alg: null
38
+ seed: 12345
39
+ slurm_partition: ${project.gpu_partition}
40
+ slurm_runtime: 168h
41
+ sort_data: false
42
+ task_loss_weights: &id002
43
+ calibration_steps: 100
44
+ epsilon: 1.0e-08
45
+ max_weight: 1.0e3
46
+ min_weight: 0.01
47
+ tensorboard_step_freq: 100
48
+ threads: 16
49
+ val_freq: 10000
50
+ pyg-cld-hits-heptv2-sector-set-v1:
51
+ architecture:
52
+ heptv2:
53
+ block_size: 128
54
+ dropout_ff: 0.0
55
+ embedding_dim: 256
56
+ num_convs: 3
57
+ num_heads: 16
58
+ width: 256
59
+ input_encoding: split
60
+ output_mode: set
61
+ set_decoder:
62
+ attention_mode: sectorized
63
+ local_attention_radius: 0.4
64
+ num_heads: 8
65
+ num_layers: 2
66
+ num_sectors: 32
67
+ num_slots: 256
68
+ proposal_mode: grid-diverse
69
+ query_init: input-conditioned
70
+ sector_neighbors: 1
71
+ use_aggregate_anchors: true
72
+ type: heptv2
73
+ backend: pytorch
74
+ checkpoint_freq: 10000
75
+ comet: false
76
+ dataset: cld_hits
77
+ dtype: bfloat16
78
+ gpu_batch_multiplier: 1
79
+ gpu_type: l40
80
+ gpus: 1
81
+ hyperparameters: &id007
82
+ batch_size: 1
83
+ lr: 0.0001
84
+ load: null
85
+ lr_schedule: cosinedecay
86
+ mem_per_gpu_mb: 40000
87
+ ntest: 100
88
+ ntrain: null
89
+ num_steps: 100000
90
+ num_workers: 2
91
+ nvalid: null
92
+ optimizer: lamb
93
+ pad_to_multiple_elements: 128
94
+ patience: 10000
95
+ prefetch_factor: 2
96
+ raytune: *id001
97
+ seed: 12345
98
+ slurm_partition: ${project.gpu_partition}
99
+ slurm_runtime: 168h
100
+ sort_data: false
101
+ task_loss_weights: *id002
102
+ tensorboard_step_freq: 100
103
+ test_datasets: &id003
104
+ - name: cld_edm_ttbar_hits
105
+ splits:
106
+ - '1'
107
+ - '2'
108
+ - '3'
109
+ - '4'
110
+ - '5'
111
+ - '6'
112
+ - '7'
113
+ - '8'
114
+ - '9'
115
+ - '10'
116
+ version: 3.2.2
117
+ - name: cld_edm_ww_fullhad_hits
118
+ splits:
119
+ - '1'
120
+ - '2'
121
+ - '3'
122
+ - '4'
123
+ - '5'
124
+ - '6'
125
+ - '7'
126
+ - '8'
127
+ - '9'
128
+ - '10'
129
+ version: 3.2.2
130
+ - name: cld_edm_qq_hits
131
+ splits:
132
+ - '1'
133
+ - '2'
134
+ - '3'
135
+ - '4'
136
+ - '5'
137
+ - '6'
138
+ - '7'
139
+ - '8'
140
+ - '9'
141
+ - '10'
142
+ version: 3.2.2
143
+ threads: 16
144
+ train_datasets: &id004
145
+ physical:
146
+ batch_size: 1
147
+ samples:
148
+ - name: cld_edm_ttbar_hits
149
+ splits:
150
+ - '1'
151
+ - '2'
152
+ - '3'
153
+ - '4'
154
+ - '5'
155
+ - '6'
156
+ - '7'
157
+ - '8'
158
+ - '9'
159
+ - '10'
160
+ version: 3.2.2
161
+ - name: cld_edm_ww_fullhad_hits
162
+ splits:
163
+ - '1'
164
+ - '2'
165
+ - '3'
166
+ - '4'
167
+ - '5'
168
+ - '6'
169
+ - '7'
170
+ - '8'
171
+ - '9'
172
+ - '10'
173
+ version: 3.2.2
174
+ - name: cld_edm_qq_hits
175
+ splits:
176
+ - '1'
177
+ - '2'
178
+ - '3'
179
+ - '4'
180
+ - '5'
181
+ - '6'
182
+ - '7'
183
+ - '8'
184
+ - '9'
185
+ - '10'
186
+ version: 3.2.2
187
+ val_freq: 10000
188
+ validation_datasets: &id005
189
+ physical:
190
+ batch_size: 1
191
+ samples:
192
+ - name: cld_edm_ttbar_hits
193
+ splits:
194
+ - '1'
195
+ - '2'
196
+ - '3'
197
+ - '4'
198
+ - '5'
199
+ - '6'
200
+ - '7'
201
+ - '8'
202
+ - '9'
203
+ - '10'
204
+ version: 3.2.2
205
+ - name: cld_edm_ww_fullhad_hits
206
+ splits:
207
+ - '1'
208
+ - '2'
209
+ - '3'
210
+ - '4'
211
+ - '5'
212
+ - '6'
213
+ - '7'
214
+ - '8'
215
+ - '9'
216
+ - '10'
217
+ version: 3.2.2
218
+ - name: cld_edm_qq_hits
219
+ splits:
220
+ - '1'
221
+ - '2'
222
+ - '3'
223
+ - '4'
224
+ - '5'
225
+ - '6'
226
+ - '7'
227
+ - '8'
228
+ - '9'
229
+ - '10'
230
+ version: 3.2.2
231
+ pyg-cld-hits-heptv2-set-v1:
232
+ architecture:
233
+ backbone:
234
+ mode: shared
235
+ num_convs: 6
236
+ binary_classification_focal_gamma: 2.0
237
+ heptv2:
238
+ block_size: 128
239
+ dropout_ff: 0.0
240
+ embedding_dim: 256
241
+ num_convs: 6
242
+ num_heads: 16
243
+ width: 256
244
+ hit_feature_engineering:
245
+ tracker_neighborhood: true
246
+ input_encoding: split
247
+ output_mode: set
248
+ set_decoder:
249
+ aggregate_grid_size: 0.1
250
+ attention_mode: global-flash
251
+ auxiliary_loss_weight: 0.25
252
+ cardinality_loss_weight: 0.05
253
+ event_consistency_loss_weight: 0.0
254
+ hit_grouping: true
255
+ hit_grouping_chunk_size: 1024
256
+ hit_grouping_detector_balanced: false
257
+ hit_grouping_dim: 32
258
+ hit_grouping_loss_weight: 0.1
259
+ local_attention_radius: 0.4
260
+ matcher:
261
+ dr_scale: 0.1
262
+ energy: 0.0
263
+ geometry: 2.0
264
+ log_energy_scale: 0.6931471805599453
265
+ log_pt_scale: 0.6931471805599453
266
+ pid: 1.0
267
+ presence: 1.0
268
+ pt: 1.0
269
+ no_object_weight: 1.0
270
+ num_heads: 8
271
+ num_layers: 4
272
+ num_sectors: 32
273
+ num_slots: 256
274
+ presence_threshold: 0.5
275
+ proposal_grid_size: 0.1
276
+ proposal_mode: grid-diverse
277
+ query_init: input-conditioned
278
+ sector_neighbors: 1
279
+ tracker_fit_correction: false
280
+ tracker_group_magnetic_field: 2.0
281
+ tracker_group_readout: false
282
+ tracker_query_fraction: 0.6
283
+ use_aggregate_anchors: true
284
+ task_queries: false
285
+ type: heptv2
286
+ backend: pytorch
287
+ checkpoint_freq: 10000
288
+ comet: false
289
+ dataset: cld_hits
290
+ dtype: bfloat16
291
+ gpu_batch_multiplier: 1
292
+ gpu_type: l40
293
+ gpus: 1
294
+ hyperparameters:
295
+ batch_size: 1
296
+ lr: 0.001
297
+ load: null
298
+ lr_schedule: cosinedecay
299
+ mem_per_gpu_mb: 40000
300
+ ntest: 100
301
+ ntrain: null
302
+ num_steps: 100000
303
+ num_workers: 2
304
+ nvalid: null
305
+ optimizer: lamb
306
+ pad_to_multiple_elements: 128
307
+ patience: 10000
308
+ prefetch_factor: 2
309
+ raytune: *id001
310
+ seed: 12345
311
+ slurm_partition: ${project.gpu_partition}
312
+ slurm_runtime: 168h
313
+ sort_data: false
314
+ task_loss_weights: *id002
315
+ tensorboard_step_freq: 100
316
+ test_datasets: *id003
317
+ threads: 16
318
+ train_datasets: *id004
319
+ val_freq: 10000
320
+ validation_datasets: *id005
321
+ pyg-cld-hits-set-v1:
322
+ architecture:
323
+ attention: &id006
324
+ head_dim: 16
325
+ num_convs: 3
326
+ num_heads: 16
327
+ use_jagged_attention: true
328
+ binary_classification_focal_gamma: 2.0
329
+ input_encoding: split
330
+ output_mode: set
331
+ set_decoder:
332
+ dropout: 0.0
333
+ ffn_multiplier: 4.0
334
+ num_heads: 8
335
+ num_layers: 2
336
+ num_slots: 256
337
+ type: attention
338
+ backend: pytorch
339
+ checkpoint_freq: 10000
340
+ comet: false
341
+ dataset: cld_hits
342
+ dtype: bfloat16
343
+ gpu_batch_multiplier: 1
344
+ gpu_type: l40
345
+ gpus: 1
346
+ hyperparameters:
347
+ batch_size: 1
348
+ lr: 0.0001
349
+ load: null
350
+ lr_schedule: cosinedecay
351
+ mem_per_gpu_mb: 40000
352
+ ntest: 100
353
+ ntrain: null
354
+ num_steps: 100000
355
+ num_workers: 2
356
+ nvalid: null
357
+ optimizer: lamb
358
+ pad_to_multiple_elements: 128
359
+ patience: 10000
360
+ prefetch_factor: 2
361
+ raytune: *id001
362
+ seed: 12345
363
+ slurm_partition: ${project.gpu_partition}
364
+ slurm_runtime: 168h
365
+ sort_data: false
366
+ task_loss_weights: *id002
367
+ tensorboard_step_freq: 100
368
+ test_datasets: *id003
369
+ threads: 16
370
+ train_datasets: *id004
371
+ val_freq: 10000
372
+ validation_datasets: *id005
373
+ pyg-cld-hits-v1:
374
+ architecture:
375
+ attention: *id006
376
+ binary_classification_focal_gamma: 2.0
377
+ input_encoding: split
378
+ output_mode: elementwise
379
+ type: attention
380
+ backend: pytorch
381
+ checkpoint_freq: 10000
382
+ comet: false
383
+ dataset: cld_hits
384
+ dtype: bfloat16
385
+ gpu_batch_multiplier: 1
386
+ gpu_type: l40
387
+ gpus: 1
388
+ hyperparameters: *id007
389
+ load: null
390
+ lr_schedule: cosinedecay
391
+ mem_per_gpu_mb: 40000
392
+ ntest: 100
393
+ ntrain: null
394
+ num_steps: 100000
395
+ num_workers: 2
396
+ nvalid: null
397
+ optimizer: lamb
398
+ pad_to_multiple_elements: 128
399
+ patience: 10000
400
+ prefetch_factor: 2
401
+ raytune: *id001
402
+ seed: 12345
403
+ slurm_partition: ${project.gpu_partition}
404
+ slurm_runtime: 168h
405
+ sort_data: false
406
+ task_loss_weights: *id002
407
+ tensorboard_step_freq: 100
408
+ test_datasets: *id003
409
+ threads: 16
410
+ train_datasets: *id004
411
+ val_freq: 10000
412
+ validation_datasets: *id005
413
+ pyg-cld-v1:
414
+ architecture:
415
+ attention:
416
+ head_dim: 16
417
+ num_convs: 3
418
+ num_heads: 16
419
+ heptv2:
420
+ cluster_hash_at_centroid: true
421
+ track_hash_at_calo: true
422
+ input_encoding: split
423
+ type: attention
424
+ backend: pytorch
425
+ checkpoint_freq: 10000
426
+ comet: false
427
+ dataset: cld
428
+ dtype: bfloat16
429
+ gpu_batch_multiplier: 1024
430
+ gpu_type: l40
431
+ gpus: 1
432
+ hyperparameters:
433
+ batch_size: 1
434
+ lr: 0.0005
435
+ load: null
436
+ lr_schedule: cosinedecay
437
+ mem_per_gpu_mb: 40000
438
+ ntest: 100
439
+ ntrain: null
440
+ num_steps: 100000
441
+ num_workers: 2
442
+ nvalid: null
443
+ optimizer: lamb
444
+ patience: 10000
445
+ prefetch_factor: 2
446
+ raytune: *id001
447
+ seed: 12345
448
+ slurm_partition: ${project.gpu_partition}
449
+ slurm_runtime: 168h
450
+ sort_data: false
451
+ task_loss_weights: *id002
452
+ tensorboard_step_freq: 100
453
+ test_datasets:
454
+ - name: cld_edm_ttbar_pf
455
+ splits:
456
+ - '1'
457
+ - '2'
458
+ - '3'
459
+ - '4'
460
+ - '5'
461
+ - '6'
462
+ - '7'
463
+ - '8'
464
+ - '9'
465
+ - '10'
466
+ version: 3.3.0
467
+ - name: cld_edm_ww_fullhad_pf
468
+ splits:
469
+ - '1'
470
+ - '2'
471
+ - '3'
472
+ - '4'
473
+ - '5'
474
+ - '6'
475
+ - '7'
476
+ - '8'
477
+ - '9'
478
+ - '10'
479
+ version: 3.3.0
480
+ - name: cld_edm_qq_pf
481
+ splits:
482
+ - '1'
483
+ - '2'
484
+ - '3'
485
+ - '4'
486
+ - '5'
487
+ - '6'
488
+ - '7'
489
+ - '8'
490
+ - '9'
491
+ - '10'
492
+ version: 3.3.0
493
+ threads: 16
494
+ train_datasets:
495
+ physical:
496
+ batch_size: 1
497
+ samples:
498
+ - name: cld_edm_ttbar_pf
499
+ splits:
500
+ - '1'
501
+ - '2'
502
+ - '3'
503
+ - '4'
504
+ - '5'
505
+ - '6'
506
+ - '7'
507
+ - '8'
508
+ - '9'
509
+ - '10'
510
+ version: 3.3.0
511
+ - name: cld_edm_ww_fullhad_pf
512
+ splits:
513
+ - '1'
514
+ - '2'
515
+ - '3'
516
+ - '4'
517
+ - '5'
518
+ - '6'
519
+ - '7'
520
+ - '8'
521
+ - '9'
522
+ - '10'
523
+ version: 3.3.0
524
+ - name: cld_edm_qq_pf
525
+ splits:
526
+ - '1'
527
+ - '2'
528
+ - '3'
529
+ - '4'
530
+ - '5'
531
+ - '6'
532
+ - '7'
533
+ - '8'
534
+ - '9'
535
+ - '10'
536
+ version: 3.3.0
537
+ val_freq: 10000
538
+ validation_datasets:
539
+ physical:
540
+ batch_size: 1
541
+ samples:
542
+ - name: cld_edm_ttbar_pf
543
+ splits:
544
+ - '1'
545
+ - '2'
546
+ - '3'
547
+ - '4'
548
+ - '5'
549
+ - '6'
550
+ - '7'
551
+ - '8'
552
+ - '9'
553
+ - '10'
554
+ version: 3.3.0
555
+ - name: cld_edm_ww_fullhad_pf
556
+ splits:
557
+ - '1'
558
+ - '2'
559
+ - '3'
560
+ - '4'
561
+ - '5'
562
+ - '6'
563
+ - '7'
564
+ - '8'
565
+ - '9'
566
+ - '10'
567
+ version: 3.3.0
568
+ - name: cld_edm_qq_pf
569
+ splits:
570
+ - '1'
571
+ - '2'
572
+ - '3'
573
+ - '4'
574
+ - '5'
575
+ - '6'
576
+ - '7'
577
+ - '8'
578
+ - '9'
579
+ - '10'
580
+ version: 3.3.0
581
+ pyg-cldcliccolliderml-v1:
582
+ architecture:
583
+ attention:
584
+ head_dim: 16
585
+ num_convs: 3
586
+ num_heads: 16
587
+ input_encoding: split
588
+ type: attention
589
+ backend: pytorch
590
+ checkpoint_freq: 10000
591
+ comet: false
592
+ dataset: cld
593
+ dtype: bfloat16
594
+ gpu_batch_multiplier: 1024
595
+ gpu_type: l40
596
+ gpus: 1
597
+ hyperparameters:
598
+ batch_size: 1
599
+ lr: 0.0005
600
+ load: null
601
+ lr_schedule: cosinedecay
602
+ mem_per_gpu_mb: 40000
603
+ ntest: 100
604
+ ntrain: null
605
+ num_steps: 100000
606
+ num_workers: 2
607
+ nvalid: null
608
+ optimizer: lamb
609
+ patience: 10000
610
+ prefetch_factor: 2
611
+ raytune: *id001
612
+ seed: 12345
613
+ slurm_partition: ${project.gpu_partition}
614
+ slurm_runtime: 168h
615
+ sort_data: false
616
+ task_loss_weights: *id002
617
+ tensorboard_step_freq: 100
618
+ test_datasets:
619
+ - name: cld_edm_ttbar_pf
620
+ splits:
621
+ - '1'
622
+ - '2'
623
+ - '3'
624
+ - '4'
625
+ - '5'
626
+ - '6'
627
+ - '7'
628
+ - '8'
629
+ - '9'
630
+ - '10'
631
+ version: 3.3.0
632
+ - name: cld_edm_ww_fullhad_pf
633
+ splits:
634
+ - '1'
635
+ - '2'
636
+ - '3'
637
+ - '4'
638
+ - '5'
639
+ - '6'
640
+ - '7'
641
+ - '8'
642
+ - '9'
643
+ - '10'
644
+ version: 3.3.0
645
+ - name: cld_edm_qq_pf
646
+ splits:
647
+ - '1'
648
+ - '2'
649
+ - '3'
650
+ - '4'
651
+ - '5'
652
+ - '6'
653
+ - '7'
654
+ - '8'
655
+ - '9'
656
+ - '10'
657
+ version: 3.3.0
658
+ - name: clic_edm_ttbar_pf
659
+ splits:
660
+ - '1'
661
+ - '2'
662
+ - '3'
663
+ - '4'
664
+ - '5'
665
+ - '6'
666
+ - '7'
667
+ - '8'
668
+ - '9'
669
+ - '10'
670
+ version: 3.3.0
671
+ - name: clic_edm_ww_fullhad_pf
672
+ splits:
673
+ - '1'
674
+ - '2'
675
+ - '3'
676
+ - '4'
677
+ - '5'
678
+ - '6'
679
+ - '7'
680
+ - '8'
681
+ - '9'
682
+ - '10'
683
+ version: 3.3.0
684
+ - name: clic_edm_qq_pf
685
+ splits:
686
+ - '1'
687
+ - '2'
688
+ - '3'
689
+ - '4'
690
+ - '5'
691
+ - '6'
692
+ - '7'
693
+ - '8'
694
+ - '9'
695
+ - '10'
696
+ version: 3.3.0
697
+ - name: colliderml_ttbar_nopu_pf
698
+ splits:
699
+ - '1'
700
+ - '2'
701
+ - '3'
702
+ - '4'
703
+ - '5'
704
+ - '6'
705
+ - '7'
706
+ - '8'
707
+ - '9'
708
+ - '10'
709
+ version: 1.5.0
710
+ threads: 16
711
+ train_datasets:
712
+ cld:
713
+ batch_size: 1
714
+ samples:
715
+ - name: cld_edm_ttbar_pf
716
+ splits:
717
+ - '1'
718
+ - '2'
719
+ - '3'
720
+ - '4'
721
+ - '5'
722
+ - '6'
723
+ - '7'
724
+ - '8'
725
+ - '9'
726
+ - '10'
727
+ version: 3.3.0
728
+ - name: cld_edm_ww_fullhad_pf
729
+ splits:
730
+ - '1'
731
+ - '2'
732
+ - '3'
733
+ - '4'
734
+ - '5'
735
+ - '6'
736
+ - '7'
737
+ - '8'
738
+ - '9'
739
+ - '10'
740
+ version: 3.3.0
741
+ - name: cld_edm_qq_pf
742
+ splits:
743
+ - '1'
744
+ - '2'
745
+ - '3'
746
+ - '4'
747
+ - '5'
748
+ - '6'
749
+ - '7'
750
+ - '8'
751
+ - '9'
752
+ - '10'
753
+ version: 3.3.0
754
+ weight: 1.0
755
+ clic:
756
+ batch_size: 1
757
+ samples:
758
+ - name: clic_edm_ttbar_pf
759
+ splits:
760
+ - '1'
761
+ - '2'
762
+ - '3'
763
+ - '4'
764
+ - '5'
765
+ - '6'
766
+ - '7'
767
+ - '8'
768
+ - '9'
769
+ - '10'
770
+ version: 3.3.0
771
+ - name: clic_edm_ww_fullhad_pf
772
+ splits:
773
+ - '1'
774
+ - '2'
775
+ - '3'
776
+ - '4'
777
+ - '5'
778
+ - '6'
779
+ - '7'
780
+ - '8'
781
+ - '9'
782
+ - '10'
783
+ version: 3.3.0
784
+ - name: clic_edm_qq_pf
785
+ splits:
786
+ - '1'
787
+ - '2'
788
+ - '3'
789
+ - '4'
790
+ - '5'
791
+ - '6'
792
+ - '7'
793
+ - '8'
794
+ - '9'
795
+ - '10'
796
+ version: 3.3.0
797
+ weight: 1.0
798
+ colliderml:
799
+ batch_size: 1
800
+ samples:
801
+ - name: colliderml_ttbar_nopu_pf
802
+ splits:
803
+ - '1'
804
+ - '2'
805
+ - '3'
806
+ - '4'
807
+ - '5'
808
+ - '6'
809
+ - '7'
810
+ - '8'
811
+ - '9'
812
+ - '10'
813
+ version: 1.5.0
814
+ weight: 1.0
815
+ val_freq: 10000
816
+ validation_datasets:
817
+ cld:
818
+ batch_size: 1
819
+ samples:
820
+ - name: cld_edm_ttbar_pf
821
+ splits:
822
+ - '1'
823
+ - '2'
824
+ - '3'
825
+ - '4'
826
+ - '5'
827
+ - '6'
828
+ - '7'
829
+ - '8'
830
+ - '9'
831
+ - '10'
832
+ version: 3.3.0
833
+ - name: cld_edm_ww_fullhad_pf
834
+ splits:
835
+ - '1'
836
+ - '2'
837
+ - '3'
838
+ - '4'
839
+ - '5'
840
+ - '6'
841
+ - '7'
842
+ - '8'
843
+ - '9'
844
+ - '10'
845
+ version: 3.3.0
846
+ - name: cld_edm_qq_pf
847
+ splits:
848
+ - '1'
849
+ - '2'
850
+ - '3'
851
+ - '4'
852
+ - '5'
853
+ - '6'
854
+ - '7'
855
+ - '8'
856
+ - '9'
857
+ - '10'
858
+ version: 3.3.0
859
+ clic:
860
+ batch_size: 1
861
+ samples:
862
+ - name: clic_edm_ttbar_pf
863
+ splits:
864
+ - '1'
865
+ - '2'
866
+ - '3'
867
+ - '4'
868
+ - '5'
869
+ - '6'
870
+ - '7'
871
+ - '8'
872
+ - '9'
873
+ - '10'
874
+ version: 3.3.0
875
+ - name: clic_edm_ww_fullhad_pf
876
+ splits:
877
+ - '1'
878
+ - '2'
879
+ - '3'
880
+ - '4'
881
+ - '5'
882
+ - '6'
883
+ - '7'
884
+ - '8'
885
+ - '9'
886
+ - '10'
887
+ version: 3.3.0
888
+ - name: clic_edm_qq_pf
889
+ splits:
890
+ - '1'
891
+ - '2'
892
+ - '3'
893
+ - '4'
894
+ - '5'
895
+ - '6'
896
+ - '7'
897
+ - '8'
898
+ - '9'
899
+ - '10'
900
+ version: 3.3.0
901
+ colliderml:
902
+ batch_size: 1
903
+ samples:
904
+ - name: colliderml_ttbar_nopu_pf
905
+ splits:
906
+ - '1'
907
+ - '2'
908
+ - '3'
909
+ - '4'
910
+ - '5'
911
+ - '6'
912
+ - '7'
913
+ - '8'
914
+ - '9'
915
+ - '10'
916
+ version: 1.5.0
917
+ pyg-clic-hits-set-v1:
918
+ architecture:
919
+ attention: &id008
920
+ head_dim: 16
921
+ num_convs: 3
922
+ num_heads: 16
923
+ binary_classification_focal_gamma: 2.0
924
+ input_encoding: split
925
+ output_mode: set
926
+ set_decoder:
927
+ dropout: 0.0
928
+ ffn_multiplier: 4.0
929
+ num_heads: 8
930
+ num_layers: 2
931
+ num_slots: 256
932
+ type: attention
933
+ backend: pytorch
934
+ checkpoint_freq: 10000
935
+ comet: false
936
+ dataset: clic_hits
937
+ dtype: bfloat16
938
+ gpu_batch_multiplier: 16
939
+ gpu_type: l40
940
+ gpus: 1
941
+ hyperparameters:
942
+ batch_size: 1
943
+ lr: 0.0001
944
+ load: null
945
+ lr_schedule: cosinedecay
946
+ mem_per_gpu_mb: 40000
947
+ ntest: 100
948
+ ntrain: null
949
+ num_steps: 100000
950
+ num_workers: 2
951
+ nvalid: null
952
+ optimizer: lamb
953
+ patience: 10000
954
+ prefetch_factor: 2
955
+ raytune: *id001
956
+ seed: 12345
957
+ slurm_partition: ${project.gpu_partition}
958
+ slurm_runtime: 168h
959
+ sort_data: false
960
+ task_loss_weights: *id002
961
+ tensorboard_step_freq: 100
962
+ test_datasets: &id009
963
+ - name: clic_edm_ttbar_hits
964
+ splits:
965
+ - '1'
966
+ - '2'
967
+ - '3'
968
+ - '4'
969
+ - '5'
970
+ - '6'
971
+ - '7'
972
+ - '8'
973
+ - '9'
974
+ - '10'
975
+ version: 3.2.2
976
+ - name: clic_edm_ww_fullhad_hits
977
+ splits:
978
+ - '1'
979
+ - '2'
980
+ - '3'
981
+ - '4'
982
+ - '5'
983
+ - '6'
984
+ - '7'
985
+ - '8'
986
+ - '9'
987
+ - '10'
988
+ version: 3.2.2
989
+ - name: clic_edm_qq_hits
990
+ splits:
991
+ - '1'
992
+ - '2'
993
+ - '3'
994
+ - '4'
995
+ - '5'
996
+ - '6'
997
+ - '7'
998
+ - '8'
999
+ - '9'
1000
+ - '10'
1001
+ version: 3.2.2
1002
+ threads: 16
1003
+ train_datasets: &id010
1004
+ physical:
1005
+ batch_size: 1
1006
+ samples:
1007
+ - name: clic_edm_ttbar_hits
1008
+ splits:
1009
+ - '1'
1010
+ - '2'
1011
+ - '3'
1012
+ - '4'
1013
+ - '5'
1014
+ - '6'
1015
+ - '7'
1016
+ - '8'
1017
+ - '9'
1018
+ - '10'
1019
+ version: 3.2.2
1020
+ - name: clic_edm_ww_fullhad_hits
1021
+ splits:
1022
+ - '1'
1023
+ - '2'
1024
+ - '3'
1025
+ - '4'
1026
+ - '5'
1027
+ - '6'
1028
+ - '7'
1029
+ - '8'
1030
+ - '9'
1031
+ - '10'
1032
+ version: 3.2.2
1033
+ - name: clic_edm_qq_hits
1034
+ splits:
1035
+ - '1'
1036
+ - '2'
1037
+ - '3'
1038
+ - '4'
1039
+ - '5'
1040
+ - '6'
1041
+ - '7'
1042
+ - '8'
1043
+ - '9'
1044
+ - '10'
1045
+ version: 3.2.2
1046
+ val_freq: 10000
1047
+ validation_datasets: &id011
1048
+ physical:
1049
+ batch_size: 1
1050
+ samples:
1051
+ - name: clic_edm_ttbar_hits
1052
+ splits:
1053
+ - '1'
1054
+ - '2'
1055
+ - '3'
1056
+ - '4'
1057
+ - '5'
1058
+ - '6'
1059
+ - '7'
1060
+ - '8'
1061
+ - '9'
1062
+ - '10'
1063
+ version: 3.2.2
1064
+ - name: clic_edm_ww_fullhad_hits
1065
+ splits:
1066
+ - '1'
1067
+ - '2'
1068
+ - '3'
1069
+ - '4'
1070
+ - '5'
1071
+ - '6'
1072
+ - '7'
1073
+ - '8'
1074
+ - '9'
1075
+ - '10'
1076
+ version: 3.2.2
1077
+ - name: clic_edm_qq_hits
1078
+ splits:
1079
+ - '1'
1080
+ - '2'
1081
+ - '3'
1082
+ - '4'
1083
+ - '5'
1084
+ - '6'
1085
+ - '7'
1086
+ - '8'
1087
+ - '9'
1088
+ - '10'
1089
+ version: 3.2.2
1090
+ pyg-clic-hits-v1:
1091
+ architecture:
1092
+ attention: *id008
1093
+ binary_classification_focal_gamma: 2.0
1094
+ input_encoding: split
1095
+ output_mode: elementwise
1096
+ type: attention
1097
+ backend: pytorch
1098
+ checkpoint_freq: 10000
1099
+ comet: false
1100
+ dataset: clic_hits
1101
+ dtype: bfloat16
1102
+ gpu_batch_multiplier: 16
1103
+ gpu_type: l40
1104
+ gpus: 1
1105
+ hyperparameters:
1106
+ batch_size: 1
1107
+ lr: 0.0001
1108
+ load: null
1109
+ lr_schedule: cosinedecay
1110
+ mem_per_gpu_mb: 40000
1111
+ ntest: 100
1112
+ ntrain: null
1113
+ num_steps: 100000
1114
+ num_workers: 2
1115
+ nvalid: null
1116
+ optimizer: lamb
1117
+ patience: 10000
1118
+ prefetch_factor: 2
1119
+ raytune: *id001
1120
+ seed: 12345
1121
+ slurm_partition: ${project.gpu_partition}
1122
+ slurm_runtime: 168h
1123
+ sort_data: false
1124
+ task_loss_weights: *id002
1125
+ tensorboard_step_freq: 100
1126
+ test_datasets: *id009
1127
+ threads: 16
1128
+ train_datasets: *id010
1129
+ val_freq: 10000
1130
+ validation_datasets: *id011
1131
+ pyg-clic-v1:
1132
+ architecture:
1133
+ attention:
1134
+ head_dim: 16
1135
+ num_convs: 3
1136
+ num_heads: 16
1137
+ heptv2:
1138
+ cluster_hash_at_centroid: true
1139
+ track_hash_at_calo: true
1140
+ input_encoding: split
1141
+ type: attention
1142
+ backend: pytorch
1143
+ checkpoint_freq: 10000
1144
+ comet: false
1145
+ dataset: clic
1146
+ dtype: bfloat16
1147
+ gpu_batch_multiplier: 1024
1148
+ gpu_type: l40
1149
+ gpus: 1
1150
+ hyperparameters:
1151
+ batch_size: 1
1152
+ lr: 0.0005
1153
+ load: null
1154
+ lr_schedule: cosinedecay
1155
+ mem_per_gpu_mb: 40000
1156
+ ntest: 100
1157
+ ntrain: null
1158
+ num_steps: 100000
1159
+ num_workers: 2
1160
+ nvalid: null
1161
+ optimizer: lamb
1162
+ patience: 10000
1163
+ prefetch_factor: 2
1164
+ raytune: *id001
1165
+ seed: 12345
1166
+ slurm_partition: ${project.gpu_partition}
1167
+ slurm_runtime: 168h
1168
+ sort_data: false
1169
+ task_loss_weights: *id002
1170
+ tensorboard_step_freq: 100
1171
+ test_datasets:
1172
+ - name: clic_edm_ttbar_pf
1173
+ splits:
1174
+ - '1'
1175
+ - '2'
1176
+ - '3'
1177
+ - '4'
1178
+ - '5'
1179
+ - '6'
1180
+ - '7'
1181
+ - '8'
1182
+ - '9'
1183
+ - '10'
1184
+ version: 3.3.0
1185
+ - name: clic_edm_ww_fullhad_pf
1186
+ splits:
1187
+ - '1'
1188
+ - '2'
1189
+ - '3'
1190
+ - '4'
1191
+ - '5'
1192
+ - '6'
1193
+ - '7'
1194
+ - '8'
1195
+ - '9'
1196
+ - '10'
1197
+ version: 3.3.0
1198
+ - name: clic_edm_qq_pf
1199
+ splits:
1200
+ - '1'
1201
+ - '2'
1202
+ - '3'
1203
+ - '4'
1204
+ - '5'
1205
+ - '6'
1206
+ - '7'
1207
+ - '8'
1208
+ - '9'
1209
+ - '10'
1210
+ version: 3.3.0
1211
+ threads: 16
1212
+ train_datasets:
1213
+ physical:
1214
+ batch_size: 1
1215
+ samples:
1216
+ - name: clic_edm_ttbar_pf
1217
+ splits:
1218
+ - '1'
1219
+ - '2'
1220
+ - '3'
1221
+ - '4'
1222
+ - '5'
1223
+ - '6'
1224
+ - '7'
1225
+ - '8'
1226
+ - '9'
1227
+ - '10'
1228
+ version: 3.3.0
1229
+ - name: clic_edm_ww_fullhad_pf
1230
+ splits:
1231
+ - '1'
1232
+ - '2'
1233
+ - '3'
1234
+ - '4'
1235
+ - '5'
1236
+ - '6'
1237
+ - '7'
1238
+ - '8'
1239
+ - '9'
1240
+ - '10'
1241
+ version: 3.3.0
1242
+ - name: clic_edm_qq_pf
1243
+ splits:
1244
+ - '1'
1245
+ - '2'
1246
+ - '3'
1247
+ - '4'
1248
+ - '5'
1249
+ - '6'
1250
+ - '7'
1251
+ - '8'
1252
+ - '9'
1253
+ - '10'
1254
+ version: 3.3.0
1255
+ val_freq: 10000
1256
+ validation_datasets:
1257
+ physical:
1258
+ batch_size: 1
1259
+ samples:
1260
+ - name: clic_edm_ttbar_pf
1261
+ splits:
1262
+ - '1'
1263
+ - '2'
1264
+ - '3'
1265
+ - '4'
1266
+ - '5'
1267
+ - '6'
1268
+ - '7'
1269
+ - '8'
1270
+ - '9'
1271
+ - '10'
1272
+ version: 3.3.0
1273
+ - name: clic_edm_ww_fullhad_pf
1274
+ splits:
1275
+ - '1'
1276
+ - '2'
1277
+ - '3'
1278
+ - '4'
1279
+ - '5'
1280
+ - '6'
1281
+ - '7'
1282
+ - '8'
1283
+ - '9'
1284
+ - '10'
1285
+ version: 3.3.0
1286
+ - name: clic_edm_qq_pf
1287
+ splits:
1288
+ - '1'
1289
+ - '2'
1290
+ - '3'
1291
+ - '4'
1292
+ - '5'
1293
+ - '6'
1294
+ - '7'
1295
+ - '8'
1296
+ - '9'
1297
+ - '10'
1298
+ version: 3.3.0
1299
+ pyg-cms-v1:
1300
+ architecture:
1301
+ attention:
1302
+ head_dim: 32
1303
+ num_convs: 3
1304
+ num_heads: 16
1305
+ heptv2:
1306
+ track_hash_at_calo: true
1307
+ input_encoding: split
1308
+ type: attention
1309
+ backend: pytorch
1310
+ checkpoint_freq: 10000
1311
+ comet: false
1312
+ dataset: cms
1313
+ dtype: bfloat16
1314
+ gpu_batch_multiplier: 4
1315
+ gpu_type: l40
1316
+ gpus: 1
1317
+ hyperparameters:
1318
+ batch_size: 1
1319
+ lr: 0.0004
1320
+ load: null
1321
+ lr_schedule: cosinedecay
1322
+ mem_per_gpu_mb: 40000
1323
+ ntest: 100
1324
+ ntrain: null
1325
+ num_steps: 100000
1326
+ num_workers: 2
1327
+ nvalid: null
1328
+ optimizer: lamb
1329
+ patience: 10000
1330
+ prefetch_factor: 2
1331
+ raytune: *id001
1332
+ seed: 12345
1333
+ slurm_partition: ${project.gpu_partition}
1334
+ slurm_runtime: 168h
1335
+ sort_data: false
1336
+ task_loss_weights: *id002
1337
+ tensorboard_step_freq: 100
1338
+ test_datasets:
1339
+ - name: cms_pf_ttbar
1340
+ splits:
1341
+ - '1'
1342
+ - '2'
1343
+ - '3'
1344
+ - '4'
1345
+ - '5'
1346
+ - '6'
1347
+ - '7'
1348
+ - '8'
1349
+ - '9'
1350
+ - '10'
1351
+ version: 3.2.0
1352
+ - name: cms_pf_qcd
1353
+ splits:
1354
+ - '1'
1355
+ - '2'
1356
+ - '3'
1357
+ - '4'
1358
+ - '5'
1359
+ - '6'
1360
+ - '7'
1361
+ - '8'
1362
+ - '9'
1363
+ - '10'
1364
+ version: 3.2.0
1365
+ - name: cms_pf_ztt
1366
+ splits:
1367
+ - '1'
1368
+ - '2'
1369
+ - '3'
1370
+ - '4'
1371
+ - '5'
1372
+ - '6'
1373
+ - '7'
1374
+ - '8'
1375
+ - '9'
1376
+ - '10'
1377
+ version: 3.2.0
1378
+ threads: 16
1379
+ train_datasets:
1380
+ physical_nopu:
1381
+ batch_size: 16
1382
+ samples:
1383
+ - name: cms_pf_ttbar_nopu
1384
+ splits:
1385
+ - '1'
1386
+ - '2'
1387
+ - '3'
1388
+ - '4'
1389
+ - '5'
1390
+ - '6'
1391
+ - '7'
1392
+ - '8'
1393
+ - '9'
1394
+ - '10'
1395
+ version: 3.2.0
1396
+ - name: cms_pf_qcd_nopu
1397
+ splits:
1398
+ - '1'
1399
+ - '2'
1400
+ - '3'
1401
+ - '4'
1402
+ - '5'
1403
+ - '6'
1404
+ - '7'
1405
+ - '8'
1406
+ - '9'
1407
+ - '10'
1408
+ version: 3.2.0
1409
+ - name: cms_pf_ztt_nopu
1410
+ splits:
1411
+ - '1'
1412
+ - '2'
1413
+ - '3'
1414
+ - '4'
1415
+ - '5'
1416
+ - '6'
1417
+ - '7'
1418
+ - '8'
1419
+ - '9'
1420
+ - '10'
1421
+ version: 3.2.0
1422
+ physical_pu:
1423
+ batch_size: 1
1424
+ samples:
1425
+ - name: cms_pf_ttbar
1426
+ splits:
1427
+ - '1'
1428
+ - '2'
1429
+ - '3'
1430
+ - '4'
1431
+ - '5'
1432
+ - '6'
1433
+ - '7'
1434
+ - '8'
1435
+ - '9'
1436
+ - '10'
1437
+ version: 3.2.0
1438
+ - name: cms_pf_qcd
1439
+ splits:
1440
+ - '1'
1441
+ - '2'
1442
+ - '3'
1443
+ - '4'
1444
+ - '5'
1445
+ - '6'
1446
+ - '7'
1447
+ - '8'
1448
+ - '9'
1449
+ - '10'
1450
+ version: 3.2.0
1451
+ - name: cms_pf_ztt
1452
+ splits:
1453
+ - '1'
1454
+ - '2'
1455
+ - '3'
1456
+ - '4'
1457
+ - '5'
1458
+ - '6'
1459
+ - '7'
1460
+ - '8'
1461
+ - '9'
1462
+ - '10'
1463
+ version: 3.2.0
1464
+ val_freq: 10000
1465
+ validation_datasets:
1466
+ physical_nopu:
1467
+ batch_size: 16
1468
+ samples:
1469
+ - name: cms_pf_ttbar_nopu
1470
+ splits:
1471
+ - '1'
1472
+ - '2'
1473
+ - '3'
1474
+ - '4'
1475
+ - '5'
1476
+ - '6'
1477
+ - '7'
1478
+ - '8'
1479
+ - '9'
1480
+ - '10'
1481
+ version: 3.2.0
1482
+ - name: cms_pf_qcd_nopu
1483
+ splits:
1484
+ - '1'
1485
+ - '2'
1486
+ - '3'
1487
+ - '4'
1488
+ - '5'
1489
+ - '6'
1490
+ - '7'
1491
+ - '8'
1492
+ - '9'
1493
+ - '10'
1494
+ version: 3.2.0
1495
+ - name: cms_pf_ztt_nopu
1496
+ splits:
1497
+ - '1'
1498
+ - '2'
1499
+ - '3'
1500
+ - '4'
1501
+ - '5'
1502
+ - '6'
1503
+ - '7'
1504
+ - '8'
1505
+ - '9'
1506
+ - '10'
1507
+ version: 3.2.0
1508
+ physical_pu:
1509
+ batch_size: 1
1510
+ samples:
1511
+ - name: cms_pf_ttbar
1512
+ splits:
1513
+ - '1'
1514
+ - '2'
1515
+ - '3'
1516
+ - '4'
1517
+ - '5'
1518
+ - '6'
1519
+ - '7'
1520
+ - '8'
1521
+ - '9'
1522
+ - '10'
1523
+ version: 3.2.0
1524
+ - name: cms_pf_qcd
1525
+ splits:
1526
+ - '1'
1527
+ - '2'
1528
+ - '3'
1529
+ - '4'
1530
+ - '5'
1531
+ - '6'
1532
+ - '7'
1533
+ - '8'
1534
+ - '9'
1535
+ - '10'
1536
+ version: 3.2.0
1537
+ - name: cms_pf_ztt
1538
+ splits:
1539
+ - '1'
1540
+ - '2'
1541
+ - '3'
1542
+ - '4'
1543
+ - '5'
1544
+ - '6'
1545
+ - '7'
1546
+ - '8'
1547
+ - '9'
1548
+ - '10'
1549
+ version: 3.2.0
1550
+ pyg-colliderml-hits-set-v1:
1551
+ architecture:
1552
+ attention: &id012
1553
+ attention_type: flash
1554
+ head_dim: 16
1555
+ num_convs: 3
1556
+ num_heads: 16
1557
+ input_encoding: split
1558
+ output_mode: set
1559
+ set_decoder:
1560
+ dropout: 0.0
1561
+ ffn_multiplier: 4.0
1562
+ num_heads: 8
1563
+ num_layers: 2
1564
+ num_slots: 512
1565
+ type: attention
1566
+ backend: pytorch
1567
+ checkpoint_freq: 10000
1568
+ comet: false
1569
+ dataset: colliderml_hits
1570
+ dtype: bfloat16
1571
+ gpu_batch_multiplier: 1
1572
+ gpu_type: l40
1573
+ gpus: 1
1574
+ hyperparameters: &id013
1575
+ batch_size: 1
1576
+ lr: 0.0001
1577
+ load: null
1578
+ lr_schedule: cosinedecay
1579
+ mem_per_gpu_mb: 40000
1580
+ ntest: 100
1581
+ ntrain: null
1582
+ num_steps: 100000
1583
+ num_workers: 2
1584
+ nvalid: null
1585
+ optimizer: lamb
1586
+ pad_to_multiple_elements: 128
1587
+ patience: 10000
1588
+ prefetch_factor: 2
1589
+ raytune: *id001
1590
+ seed: 12345
1591
+ slurm_partition: ${project.gpu_partition}
1592
+ slurm_runtime: 168h
1593
+ sort_data: false
1594
+ task_loss_weights: *id002
1595
+ tensorboard_step_freq: 100
1596
+ test_datasets: &id014
1597
+ - name: colliderml_ttbar_hits
1598
+ splits:
1599
+ - '1'
1600
+ - '2'
1601
+ - '3'
1602
+ - '4'
1603
+ - '5'
1604
+ - '6'
1605
+ - '7'
1606
+ - '8'
1607
+ - '9'
1608
+ - '10'
1609
+ version: 1.3.0
1610
+ threads: 16
1611
+ train_datasets: &id015
1612
+ physical:
1613
+ batch_size: 1
1614
+ samples:
1615
+ - name: colliderml_ttbar_hits
1616
+ splits:
1617
+ - '1'
1618
+ - '2'
1619
+ - '3'
1620
+ - '4'
1621
+ - '5'
1622
+ - '6'
1623
+ - '7'
1624
+ - '8'
1625
+ - '9'
1626
+ - '10'
1627
+ version: 1.3.0
1628
+ val_freq: 10000
1629
+ validation_datasets: &id016
1630
+ physical:
1631
+ batch_size: 1
1632
+ samples:
1633
+ - name: colliderml_ttbar_hits
1634
+ splits:
1635
+ - '1'
1636
+ - '2'
1637
+ - '3'
1638
+ - '4'
1639
+ - '5'
1640
+ - '6'
1641
+ - '7'
1642
+ - '8'
1643
+ - '9'
1644
+ - '10'
1645
+ version: 1.3.0
1646
+ pyg-colliderml-hits-v1:
1647
+ architecture:
1648
+ attention: *id012
1649
+ input_encoding: split
1650
+ type: attention
1651
+ backend: pytorch
1652
+ checkpoint_freq: 10000
1653
+ comet: false
1654
+ dataset: colliderml_hits
1655
+ dtype: bfloat16
1656
+ gpu_batch_multiplier: 8
1657
+ gpu_type: l40
1658
+ gpus: 1
1659
+ hyperparameters: *id013
1660
+ load: null
1661
+ lr_schedule: cosinedecay
1662
+ mem_per_gpu_mb: 40000
1663
+ ntest: 100
1664
+ ntrain: null
1665
+ num_steps: 100000
1666
+ num_workers: 2
1667
+ nvalid: null
1668
+ optimizer: lamb
1669
+ patience: 10000
1670
+ prefetch_factor: 2
1671
+ raytune: *id001
1672
+ seed: 12345
1673
+ slurm_partition: ${project.gpu_partition}
1674
+ slurm_runtime: 168h
1675
+ sort_data: false
1676
+ task_loss_weights: *id002
1677
+ tensorboard_step_freq: 100
1678
+ test_datasets: *id014
1679
+ threads: 16
1680
+ train_datasets: *id015
1681
+ val_freq: 10000
1682
+ validation_datasets: *id016
1683
+ pyg-colliderml-pu0pu200-groups-v1:
1684
+ architecture: &id017
1685
+ attention:
1686
+ attention_type: flash
1687
+ head_dim: 16
1688
+ num_convs: 3
1689
+ num_heads: 16
1690
+ heptv2:
1691
+ track_hash_at_calo: true
1692
+ input_encoding: split
1693
+ type: attention
1694
+ backend: pytorch
1695
+ checkpoint_freq: 10000
1696
+ comet: false
1697
+ dataset: colliderml
1698
+ dtype: bfloat16
1699
+ gpu_batch_multiplier: 1
1700
+ gpu_type: l40
1701
+ gpus: 1
1702
+ hyperparameters: &id018
1703
+ batch_size: 1
1704
+ lr: 0.0001
1705
+ load: null
1706
+ lr_schedule: cosinedecay
1707
+ mem_per_gpu_mb: 40000
1708
+ ntest: 100
1709
+ ntrain: null
1710
+ num_steps: 100000
1711
+ num_workers: 2
1712
+ nvalid: null
1713
+ optimizer: lamb
1714
+ patience: 10000
1715
+ prefetch_factor: 2
1716
+ raytune: *id001
1717
+ seed: 12345
1718
+ slurm_partition: ${project.gpu_partition}
1719
+ slurm_runtime: 168h
1720
+ sort_data: false
1721
+ task_loss_weights: *id002
1722
+ tensorboard_step_freq: 100
1723
+ test_datasets:
1724
+ - name: colliderml_ttbar_nopu_pf
1725
+ splits:
1726
+ - '1'
1727
+ - '2'
1728
+ - '3'
1729
+ - '4'
1730
+ - '5'
1731
+ - '6'
1732
+ - '7'
1733
+ - '8'
1734
+ - '9'
1735
+ - '10'
1736
+ version: 1.5.0
1737
+ - name: colliderml_ttbar_pu200_pf
1738
+ splits:
1739
+ - '1'
1740
+ - '2'
1741
+ - '3'
1742
+ - '4'
1743
+ - '5'
1744
+ - '6'
1745
+ - '7'
1746
+ - '8'
1747
+ - '9'
1748
+ - '10'
1749
+ version: 1.5.0
1750
+ threads: 16
1751
+ train_datasets:
1752
+ pu0:
1753
+ batch_size: 12
1754
+ samples:
1755
+ - name: colliderml_ttbar_nopu_pf
1756
+ splits:
1757
+ - '1'
1758
+ - '2'
1759
+ - '3'
1760
+ - '4'
1761
+ - '5'
1762
+ - '6'
1763
+ - '7'
1764
+ - '8'
1765
+ - '9'
1766
+ - '10'
1767
+ version: 1.5.0
1768
+ pu200:
1769
+ batch_size: 1
1770
+ samples:
1771
+ - name: colliderml_ttbar_pu200_pf
1772
+ splits:
1773
+ - '1'
1774
+ - '2'
1775
+ - '3'
1776
+ - '4'
1777
+ - '5'
1778
+ - '6'
1779
+ - '7'
1780
+ - '8'
1781
+ - '9'
1782
+ - '10'
1783
+ version: 1.5.0
1784
+ val_freq: 10000
1785
+ validation_datasets:
1786
+ pu0:
1787
+ batch_size: 12
1788
+ samples:
1789
+ - name: colliderml_ttbar_nopu_pf
1790
+ splits:
1791
+ - '1'
1792
+ - '2'
1793
+ - '3'
1794
+ - '4'
1795
+ - '5'
1796
+ - '6'
1797
+ - '7'
1798
+ - '8'
1799
+ - '9'
1800
+ - '10'
1801
+ version: 1.5.0
1802
+ pu200:
1803
+ batch_size: 1
1804
+ samples:
1805
+ - name: colliderml_ttbar_pu200_pf
1806
+ splits:
1807
+ - '1'
1808
+ - '2'
1809
+ - '3'
1810
+ - '4'
1811
+ - '5'
1812
+ - '6'
1813
+ - '7'
1814
+ - '8'
1815
+ - '9'
1816
+ - '10'
1817
+ version: 1.5.0
1818
+ pyg-colliderml-pu200-v1:
1819
+ architecture:
1820
+ attention:
1821
+ attention_type: flash
1822
+ head_dim: 16
1823
+ num_convs: 3
1824
+ num_heads: 16
1825
+ heptv2:
1826
+ track_hash_at_calo: true
1827
+ input_encoding: split
1828
+ type: attention
1829
+ backend: pytorch
1830
+ checkpoint_freq: 10000
1831
+ comet: false
1832
+ dataset: colliderml
1833
+ dtype: bfloat16
1834
+ gpu_batch_multiplier: 8
1835
+ gpu_type: l40
1836
+ gpus: 1
1837
+ hyperparameters:
1838
+ batch_size: 1
1839
+ lr: 0.0001
1840
+ load: null
1841
+ lr_schedule: cosinedecay
1842
+ mem_per_gpu_mb: 40000
1843
+ ntest: 100
1844
+ ntrain: null
1845
+ num_steps: 100000
1846
+ num_workers: 2
1847
+ nvalid: null
1848
+ optimizer: lamb
1849
+ patience: 10000
1850
+ prefetch_factor: 2
1851
+ raytune: *id001
1852
+ seed: 12345
1853
+ slurm_partition: ${project.gpu_partition}
1854
+ slurm_runtime: 168h
1855
+ sort_data: false
1856
+ task_loss_weights: *id002
1857
+ tensorboard_step_freq: 100
1858
+ test_datasets:
1859
+ - name: colliderml_ttbar_pu200_pf
1860
+ splits:
1861
+ - '1'
1862
+ - '2'
1863
+ - '3'
1864
+ - '4'
1865
+ - '5'
1866
+ - '6'
1867
+ - '7'
1868
+ - '8'
1869
+ - '9'
1870
+ - '10'
1871
+ version: 1.5.0
1872
+ threads: 16
1873
+ train_datasets:
1874
+ physical:
1875
+ batch_size: 1
1876
+ samples:
1877
+ - name: colliderml_ttbar_pu200_pf
1878
+ splits:
1879
+ - '1'
1880
+ - '2'
1881
+ - '3'
1882
+ - '4'
1883
+ - '5'
1884
+ - '6'
1885
+ - '7'
1886
+ - '8'
1887
+ - '9'
1888
+ - '10'
1889
+ version: 1.5.0
1890
+ val_freq: 10000
1891
+ validation_datasets:
1892
+ physical:
1893
+ batch_size: 1
1894
+ samples:
1895
+ - name: colliderml_ttbar_pu200_pf
1896
+ splits:
1897
+ - '1'
1898
+ - '2'
1899
+ - '3'
1900
+ - '4'
1901
+ - '5'
1902
+ - '6'
1903
+ - '7'
1904
+ - '8'
1905
+ - '9'
1906
+ - '10'
1907
+ version: 1.5.0
1908
+ pyg-colliderml-v1:
1909
+ architecture: *id017
1910
+ backend: pytorch
1911
+ checkpoint_freq: 10000
1912
+ comet: false
1913
+ dataset: colliderml
1914
+ dtype: bfloat16
1915
+ gpu_batch_multiplier: 8
1916
+ gpu_type: l40
1917
+ gpus: 1
1918
+ hyperparameters: *id018
1919
+ load: null
1920
+ lr_schedule: cosinedecay
1921
+ mem_per_gpu_mb: 40000
1922
+ ntest: 100
1923
+ ntrain: null
1924
+ num_steps: 100000
1925
+ num_workers: 2
1926
+ nvalid: null
1927
+ optimizer: lamb
1928
+ patience: 10000
1929
+ prefetch_factor: 2
1930
+ raytune: *id001
1931
+ seed: 12345
1932
+ slurm_partition: ${project.gpu_partition}
1933
+ slurm_runtime: 168h
1934
+ sort_data: false
1935
+ task_loss_weights: *id002
1936
+ tensorboard_step_freq: 100
1937
+ test_datasets:
1938
+ - name: colliderml_ttbar_nopu_pf
1939
+ splits:
1940
+ - '1'
1941
+ - '2'
1942
+ - '3'
1943
+ - '4'
1944
+ - '5'
1945
+ - '6'
1946
+ - '7'
1947
+ - '8'
1948
+ - '9'
1949
+ - '10'
1950
+ version: 1.5.0
1951
+ threads: 16
1952
+ train_datasets:
1953
+ physical:
1954
+ batch_size: 1
1955
+ samples:
1956
+ - name: colliderml_ttbar_nopu_pf
1957
+ splits:
1958
+ - '1'
1959
+ - '2'
1960
+ - '3'
1961
+ - '4'
1962
+ - '5'
1963
+ - '6'
1964
+ - '7'
1965
+ - '8'
1966
+ - '9'
1967
+ - '10'
1968
+ version: 1.5.0
1969
+ val_freq: 10000
1970
+ validation_datasets:
1971
+ physical:
1972
+ batch_size: 1
1973
+ samples:
1974
+ - name: colliderml_ttbar_nopu_pf
1975
+ splits:
1976
+ - '1'
1977
+ - '2'
1978
+ - '3'
1979
+ - '4'
1980
+ - '5'
1981
+ - '6'
1982
+ - '7'
1983
+ - '8'
1984
+ - '9'
1985
+ - '10'
1986
+ version: 1.5.0
1987
+ pyg-idea-pipeline-v1:
1988
+ architecture:
1989
+ heptv2:
1990
+ block_size: 100
1991
+ dropout_ff: 0.0
1992
+ embedding_dim: 256
1993
+ num_convs: 3
1994
+ num_heads: 16
1995
+ track_hash_at_calo: true
1996
+ width: 256
1997
+ input_encoding: split
1998
+ type: heptv2
1999
+ backend: pytorch
2000
+ checkpoint_freq: 10000
2001
+ comet: false
2002
+ dataset: idea
2003
+ dtype: bfloat16
2004
+ gpu_batch_multiplier: 16
2005
+ gpu_type: l40
2006
+ gpus: 1
2007
+ hyperparameters:
2008
+ batch_size: 1
2009
+ lr: 0.0005
2010
+ load: null
2011
+ lr_schedule: cosinedecay
2012
+ mem_per_gpu_mb: 40000
2013
+ ntest: 100
2014
+ ntrain: null
2015
+ num_steps: 100000
2016
+ num_workers: 2
2017
+ nvalid: null
2018
+ optimizer: lamb
2019
+ pad_to_multiple_elements: 100
2020
+ patience: 10000
2021
+ prefetch_factor: 2
2022
+ raytune: *id001
2023
+ seed: 12345
2024
+ slurm_partition: ${project.gpu_partition}
2025
+ slurm_runtime: 168h
2026
+ sort_data: false
2027
+ task_loss_weights: *id002
2028
+ tensorboard_step_freq: 100
2029
+ test_datasets:
2030
+ - name: idea_edm_qq_pf
2031
+ splits:
2032
+ - '1'
2033
+ version: 0.2.1
2034
+ - name: idea_edm_ttbar_pf
2035
+ splits:
2036
+ - '1'
2037
+ version: 0.2.1
2038
+ - name: idea_edm_ww_fullhad_pf
2039
+ splits:
2040
+ - '1'
2041
+ version: 0.2.1
2042
+ threads: 16
2043
+ train_datasets:
2044
+ physical:
2045
+ batch_size: 1
2046
+ samples:
2047
+ - name: idea_edm_qq_pf
2048
+ splits:
2049
+ - '1'
2050
+ version: 0.2.1
2051
+ - name: idea_edm_ttbar_pf
2052
+ splits:
2053
+ - '1'
2054
+ version: 0.2.1
2055
+ - name: idea_edm_ww_fullhad_pf
2056
+ splits:
2057
+ - '1'
2058
+ version: 0.2.1
2059
+ val_freq: 10000
2060
+ validation_datasets:
2061
+ physical:
2062
+ batch_size: 1
2063
+ samples:
2064
+ - name: idea_edm_qq_pf
2065
+ splits:
2066
+ - '1'
2067
+ version: 0.2.1
2068
+ - name: idea_edm_ttbar_pf
2069
+ splits:
2070
+ - '1'
2071
+ version: 0.2.1
2072
+ - name: idea_edm_ww_fullhad_pf
2073
+ splits:
2074
+ - '1'
2075
+ version: 0.2.1
2076
+ pyg-maia-v1:
2077
+ architecture:
2078
+ attention:
2079
+ head_dim: 16
2080
+ num_convs: 3
2081
+ num_heads: 16
2082
+ input_encoding: split
2083
+ type: attention
2084
+ backend: pytorch
2085
+ checkpoint_freq: 10000
2086
+ comet: false
2087
+ dataset: maia
2088
+ dtype: bfloat16
2089
+ gpu_batch_multiplier: 1
2090
+ gpu_type: l40
2091
+ gpus: 1
2092
+ hyperparameters:
2093
+ batch_size: 1
2094
+ lr: 0.0001
2095
+ load: null
2096
+ lr_schedule: cosinedecay
2097
+ mem_per_gpu_mb: 40000
2098
+ ntest: 100
2099
+ ntrain: null
2100
+ num_steps: 100000
2101
+ num_workers: 2
2102
+ nvalid: null
2103
+ optimizer: lamb
2104
+ patience: 10000
2105
+ prefetch_factor: 2
2106
+ raytune: *id001
2107
+ seed: 12345
2108
+ slurm_partition: ${project.gpu_partition}
2109
+ slurm_runtime: 168h
2110
+ sort_data: false
2111
+ task_loss_weights: *id002
2112
+ tensorboard_step_freq: 100
2113
+ test_datasets:
2114
+ - name: maia_edm_ttbar_pf
2115
+ splits:
2116
+ - '10'
2117
+ version: 1.1.0
2118
+ threads: 16
2119
+ train_datasets:
2120
+ physical:
2121
+ batch_size: 1
2122
+ samples:
2123
+ - name: maia_edm_ttbar_pf
2124
+ splits:
2125
+ - '10'
2126
+ version: 1.1.0
2127
+ val_freq: 10000
2128
+ validation_datasets:
2129
+ physical:
2130
+ batch_size: 1
2131
+ samples:
2132
+ - name: maia_edm_ttbar_pf
2133
+ splits:
2134
+ - '10'
2135
+ version: 1.1.0
2136
+ productions:
2137
+ cld:
2138
+ comment: CLD production with Key4Hep
2139
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2140
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2141
+ memory:
2142
+ gen: 4000
2143
+ post: 2000
2144
+ tfds: 16000
2145
+ model: pyg-cld-v1
2146
+ postprocessing:
2147
+ args: {}
2148
+ script: mlpf/data/key4hep/postprocessing.py
2149
+ samples:
2150
+ gun_e_10gev:
2151
+ events_per_job: 100
2152
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2153
+ process_name: gun_e_10gev
2154
+ seed_range:
2155
+ - 424242
2156
+ - 424342
2157
+ gun_mu_10gev:
2158
+ events_per_job: 100
2159
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2160
+ process_name: gun_mu_10gev
2161
+ seed_range:
2162
+ - 600000
2163
+ - 600100
2164
+ gun_pi_10gev:
2165
+ events_per_job: 100
2166
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2167
+ process_name: gun_pi_10gev
2168
+ seed_range:
2169
+ - 700000
2170
+ - 700100
2171
+ qq:
2172
+ events_per_job: 100
2173
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2174
+ process_name: p8_ee_qq_ecm365
2175
+ seed_range:
2176
+ - 500000
2177
+ - 510010
2178
+ ttbar:
2179
+ events_per_job: 100
2180
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2181
+ process_name: p8_ee_ttbar_ecm365
2182
+ seed_range:
2183
+ - 300000
2184
+ - 310010
2185
+ ww_fullhad:
2186
+ events_per_job: 100
2187
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2188
+ process_name: p8_ee_WW_fullhad_ecm365
2189
+ seed_range:
2190
+ - 400000
2191
+ - 410010
2192
+ z_qq:
2193
+ events_per_job: 100
2194
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2195
+ process_name: p8_ee_Z_qq_ecm91
2196
+ seed_range:
2197
+ - 600000
2198
+ - 610010
2199
+ z_tautau:
2200
+ events_per_job: 100
2201
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2202
+ process_name: p8_ee_Z_tautau_ecm91
2203
+ seed_range:
2204
+ - 700000
2205
+ - 710010
2206
+ zh_tautau_240:
2207
+ events_per_job: 100
2208
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2209
+ process_name: p8_ee_ZH_Htautau_ecm240
2210
+ seed_range:
2211
+ - 200000
2212
+ - 200110
2213
+ zh_tautau_365:
2214
+ events_per_job: 100
2215
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2216
+ process_name: p8_ee_ZH_Htautau_ecm365
2217
+ seed_range:
2218
+ - 200000
2219
+ - 200110
2220
+ zz:
2221
+ events_per_job: 100
2222
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2223
+ process_name: p8_ee_ZZ_ecm365
2224
+ seed_range:
2225
+ - 100000
2226
+ - 105010
2227
+ zz_tautau_240:
2228
+ events_per_job: 100
2229
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2230
+ process_name: p8_ee_ZZ_tautau_ecm240
2231
+ seed_range:
2232
+ - 100000
2233
+ - 100110
2234
+ zz_tautau_365:
2235
+ events_per_job: 100
2236
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2237
+ process_name: p8_ee_ZZ_tautau_ecm365
2238
+ seed_range:
2239
+ - 100000
2240
+ - 110010
2241
+ slurm_partition: main
2242
+ slurm_runtime: 48h
2243
+ tfds_hit_mapping:
2244
+ qq:
2245
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/qq
2246
+ config_ids:
2247
+ - 1
2248
+ - 2
2249
+ - 3
2250
+ - 4
2251
+ - 5
2252
+ - 6
2253
+ - 7
2254
+ - 8
2255
+ - 9
2256
+ - 10
2257
+ version: 3.2.2
2258
+ ttbar:
2259
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2260
+ config_ids:
2261
+ - 1
2262
+ - 2
2263
+ - 3
2264
+ - 4
2265
+ - 5
2266
+ - 6
2267
+ - 7
2268
+ - 8
2269
+ - 9
2270
+ - 10
2271
+ version: 3.2.2
2272
+ ww_fullhad:
2273
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ww_fullhad
2274
+ config_ids:
2275
+ - 1
2276
+ - 2
2277
+ - 3
2278
+ - 4
2279
+ - 5
2280
+ - 6
2281
+ - 7
2282
+ - 8
2283
+ - 9
2284
+ - 10
2285
+ version: 3.2.2
2286
+ zz:
2287
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/zz
2288
+ config_ids:
2289
+ - 1
2290
+ - 2
2291
+ - 3
2292
+ - 4
2293
+ - 5
2294
+ - 6
2295
+ - 7
2296
+ - 8
2297
+ - 9
2298
+ - 10
2299
+ version: 3.2.2
2300
+ tfds_mapping:
2301
+ qq:
2302
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/qq
2303
+ config_ids:
2304
+ - 1
2305
+ - 2
2306
+ - 3
2307
+ - 4
2308
+ - 5
2309
+ - 6
2310
+ - 7
2311
+ - 8
2312
+ - 9
2313
+ - 10
2314
+ version: 3.3.0
2315
+ ttbar:
2316
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2317
+ config_ids:
2318
+ - 1
2319
+ - 2
2320
+ - 3
2321
+ - 4
2322
+ - 5
2323
+ - 6
2324
+ - 7
2325
+ - 8
2326
+ - 9
2327
+ - 10
2328
+ version: 3.3.0
2329
+ ww_fullhad:
2330
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ww_fullhad
2331
+ config_ids:
2332
+ - 1
2333
+ - 2
2334
+ - 3
2335
+ - 4
2336
+ - 5
2337
+ - 6
2338
+ - 7
2339
+ - 8
2340
+ - 9
2341
+ - 10
2342
+ version: 3.3.0
2343
+ zz:
2344
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/zz
2345
+ config_ids:
2346
+ - 1
2347
+ - 2
2348
+ - 3
2349
+ - 4
2350
+ - 5
2351
+ - 6
2352
+ - 7
2353
+ - 8
2354
+ - 9
2355
+ - 10
2356
+ version: 3.3.0
2357
+ type: key4hep
2358
+ workspace_dir: ${project.paths.storage_root}/cld/v1.2.5_key4hep_2025-05-29
2359
+ cld_clic_colliderml:
2360
+ comment: Joint CLD+CLIC+ColliderML pu0 tracks/clusters
2361
+ model: pyg-cldcliccolliderml-v1
2362
+ source_productions:
2363
+ cld: cld
2364
+ clic: clic
2365
+ colliderml: colliderml
2366
+ type: key4hep
2367
+ cld_ecal_pitch_1p5:
2368
+ cms_energy: 91
2369
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 1.5 mm
2370
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_1p5mm/CLD_o2_v07.xml
2371
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2372
+ dataset_only: true
2373
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2374
+ memory: &id019
2375
+ gen: 8000
2376
+ post: 8000
2377
+ tfds: 8000
2378
+ model: pyg-cld-v1
2379
+ postprocessing: &id020
2380
+ args: {}
2381
+ script: mlpf/data/key4hep/postprocessing.py
2382
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2383
+ samples: &id021
2384
+ z_tautau:
2385
+ events_per_job: 100
2386
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2387
+ process_name: p8_ee_Z_tautau_ecm91
2388
+ seed_range:
2389
+ - 700000
2390
+ - 700100
2391
+ slurm_partition: main
2392
+ slurm_runtime: 48h
2393
+ tfds_hit_mapping: &id022
2394
+ z_tautau:
2395
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/z_tautau
2396
+ config_ids:
2397
+ - 1
2398
+ - 2
2399
+ - 3
2400
+ - 4
2401
+ - 5
2402
+ - 6
2403
+ - 7
2404
+ - 8
2405
+ - 9
2406
+ - 10
2407
+ version: 3.2.2
2408
+ tfds_mapping: &id023
2409
+ z_tautau:
2410
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/z_tautau
2411
+ config_ids:
2412
+ - 1
2413
+ - 2
2414
+ - 3
2415
+ - 4
2416
+ - 5
2417
+ - 6
2418
+ - 7
2419
+ - 8
2420
+ - 9
2421
+ - 10
2422
+ version: 3.3.0
2423
+ type: key4hep
2424
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_1p5mm
2425
+ cld_ecal_pitch_2:
2426
+ cms_energy: 91
2427
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2 mm
2428
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2mm/CLD_o2_v07.xml
2429
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2430
+ dataset_only: true
2431
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2432
+ memory: *id019
2433
+ model: pyg-cld-v1
2434
+ postprocessing: *id020
2435
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2436
+ samples: *id021
2437
+ slurm_partition: main
2438
+ slurm_runtime: 48h
2439
+ tfds_hit_mapping: *id022
2440
+ tfds_mapping: *id023
2441
+ type: key4hep
2442
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2mm
2443
+ cld_ecal_pitch_2p5:
2444
+ cms_energy: 91
2445
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2.5 mm
2446
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2p5mm/CLD_o2_v07.xml
2447
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2448
+ dataset_only: true
2449
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2450
+ memory: *id019
2451
+ model: pyg-cld-v1
2452
+ postprocessing: *id020
2453
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2454
+ samples: *id021
2455
+ slurm_partition: main
2456
+ slurm_runtime: 48h
2457
+ tfds_hit_mapping: *id022
2458
+ tfds_mapping: *id023
2459
+ type: key4hep
2460
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2p5mm
2461
+ cld_ecal_pitch_3:
2462
+ cms_energy: 91
2463
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 3 mm
2464
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_3mm/CLD_o2_v07.xml
2465
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2466
+ dataset_only: true
2467
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2468
+ memory: *id019
2469
+ model: pyg-cld-v1
2470
+ postprocessing: *id020
2471
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2472
+ samples: *id021
2473
+ slurm_partition: main
2474
+ slurm_runtime: 48h
2475
+ tfds_hit_mapping: *id022
2476
+ tfds_mapping: *id023
2477
+ type: key4hep
2478
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_3mm
2479
+ cld_ecal_pitch_4:
2480
+ cms_energy: 91
2481
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 4 mm
2482
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_4mm/CLD_o2_v07.xml
2483
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2484
+ dataset_only: true
2485
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2486
+ memory: *id019
2487
+ model: pyg-cld-v1
2488
+ postprocessing: *id020
2489
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2490
+ samples: *id021
2491
+ slurm_partition: main
2492
+ slurm_runtime: 48h
2493
+ tfds_hit_mapping: *id022
2494
+ tfds_mapping: *id023
2495
+ type: key4hep
2496
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_4mm
2497
+ cld_ecal_pitch_5p1:
2498
+ cms_energy: 91
2499
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 5.1 mm
2500
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_5p1mm/CLD_o2_v07.xml
2501
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2502
+ dataset_only: true
2503
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2504
+ memory: *id019
2505
+ model: pyg-cld-v1
2506
+ postprocessing: *id020
2507
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2508
+ samples: *id021
2509
+ slurm_partition: main
2510
+ slurm_runtime: 48h
2511
+ tfds_hit_mapping: *id022
2512
+ tfds_mapping: *id023
2513
+ type: key4hep
2514
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_5p1mm
2515
+ cld_hcal_pitch_10:
2516
+ cms_energy: 365
2517
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 10 mm
2518
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_10mm/CLD_o2_v07.xml
2519
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2520
+ dataset_only: true
2521
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2522
+ memory: &id024
2523
+ gen: 12000
2524
+ post: 16000
2525
+ tfds: 16000
2526
+ model: pyg-cld-v1
2527
+ postprocessing: &id025
2528
+ args: {}
2529
+ script: mlpf/data/key4hep/postprocessing.py
2530
+ samples: &id026
2531
+ ttbar:
2532
+ events_per_job: 100
2533
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2534
+ process_name: p8_ee_ttbar_ecm365
2535
+ seed_range:
2536
+ - 300000
2537
+ - 300100
2538
+ slurm_partition: main
2539
+ slurm_runtime: 48h
2540
+ tfds_hit_mapping: &id027
2541
+ ttbar:
2542
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2543
+ config_ids:
2544
+ - 1
2545
+ - 2
2546
+ - 3
2547
+ - 4
2548
+ - 5
2549
+ - 6
2550
+ - 7
2551
+ - 8
2552
+ - 9
2553
+ - 10
2554
+ version: 3.2.2
2555
+ tfds_mapping: &id028
2556
+ ttbar:
2557
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2558
+ config_ids:
2559
+ - 1
2560
+ - 2
2561
+ - 3
2562
+ - 4
2563
+ - 5
2564
+ - 6
2565
+ - 7
2566
+ - 8
2567
+ - 9
2568
+ - 10
2569
+ version: 3.3.0
2570
+ type: key4hep
2571
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_10mm
2572
+ cld_hcal_pitch_12:
2573
+ cms_energy: 365
2574
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 12 mm
2575
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_12mm/CLD_o2_v07.xml
2576
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2577
+ dataset_only: true
2578
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2579
+ memory: *id024
2580
+ model: pyg-cld-v1
2581
+ postprocessing: *id025
2582
+ samples: *id026
2583
+ slurm_partition: main
2584
+ slurm_runtime: 48h
2585
+ tfds_hit_mapping: *id027
2586
+ tfds_mapping: *id028
2587
+ type: key4hep
2588
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_12mm
2589
+ cld_hcal_pitch_15:
2590
+ cms_energy: 365
2591
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 15 mm
2592
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_15mm/CLD_o2_v07.xml
2593
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2594
+ dataset_only: true
2595
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2596
+ memory: *id024
2597
+ model: pyg-cld-v1
2598
+ postprocessing: *id025
2599
+ samples: *id026
2600
+ slurm_partition: main
2601
+ slurm_runtime: 48h
2602
+ tfds_hit_mapping: *id027
2603
+ tfds_mapping: *id028
2604
+ type: key4hep
2605
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_15mm
2606
+ cld_hcal_pitch_20:
2607
+ cms_energy: 365
2608
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 20 mm
2609
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_20mm/CLD_o2_v07.xml
2610
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2611
+ dataset_only: true
2612
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2613
+ memory: *id024
2614
+ model: pyg-cld-v1
2615
+ postprocessing: *id025
2616
+ samples: *id026
2617
+ slurm_partition: main
2618
+ slurm_runtime: 48h
2619
+ tfds_hit_mapping: *id027
2620
+ tfds_mapping: *id028
2621
+ type: key4hep
2622
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_20mm
2623
+ cld_hcal_pitch_25:
2624
+ cms_energy: 365
2625
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 25 mm
2626
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_25mm/CLD_o2_v07.xml
2627
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2628
+ dataset_only: true
2629
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2630
+ memory: *id024
2631
+ model: pyg-cld-v1
2632
+ postprocessing: *id025
2633
+ samples: *id026
2634
+ slurm_partition: main
2635
+ slurm_runtime: 48h
2636
+ tfds_hit_mapping: *id027
2637
+ tfds_mapping: *id028
2638
+ type: key4hep
2639
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_25mm
2640
+ cld_hcal_pitch_30:
2641
+ cms_energy: 365
2642
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 30 mm
2643
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_30mm/CLD_o2_v07.xml
2644
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2645
+ dataset_only: true
2646
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2647
+ memory: *id024
2648
+ model: pyg-cld-v1
2649
+ postprocessing: *id025
2650
+ samples: *id026
2651
+ slurm_partition: main
2652
+ slurm_runtime: 48h
2653
+ tfds_hit_mapping: *id027
2654
+ tfds_mapping: *id028
2655
+ type: key4hep
2656
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_30mm
2657
+ clic:
2658
+ comment: CLIC production with Key4Hep
2659
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/clic
2660
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2661
+ memory:
2662
+ gen: 4000
2663
+ post: 2000
2664
+ tfds: 16000
2665
+ model: pyg-clic-v1
2666
+ postprocessing:
2667
+ args: {}
2668
+ script: mlpf/data/key4hep/postprocessing.py
2669
+ samples:
2670
+ qq:
2671
+ events_per_job: 100
2672
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2673
+ process_name: p8_ee_qq_ecm380
2674
+ seed_range:
2675
+ - 500000
2676
+ - 510010
2677
+ ttbar:
2678
+ events_per_job: 100
2679
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2680
+ process_name: p8_ee_ttbar_ecm380
2681
+ seed_range:
2682
+ - 300000
2683
+ - 310010
2684
+ ww_fullhad:
2685
+ events_per_job: 100
2686
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2687
+ process_name: p8_ee_WW_fullhad_ecm380
2688
+ seed_range:
2689
+ - 400000
2690
+ - 410010
2691
+ slurm_partition: main
2692
+ slurm_runtime: 48h
2693
+ tfds_hit_mapping:
2694
+ qq:
2695
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/qq
2696
+ config_ids:
2697
+ - 1
2698
+ - 2
2699
+ - 3
2700
+ - 4
2701
+ - 5
2702
+ - 6
2703
+ - 7
2704
+ - 8
2705
+ - 9
2706
+ - 10
2707
+ version: 3.2.2
2708
+ ttbar:
2709
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ttbar
2710
+ config_ids:
2711
+ - 1
2712
+ - 2
2713
+ - 3
2714
+ - 4
2715
+ - 5
2716
+ - 6
2717
+ - 7
2718
+ - 8
2719
+ - 9
2720
+ - 10
2721
+ version: 3.2.2
2722
+ ww_fullhad:
2723
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ww_fullhad
2724
+ config_ids:
2725
+ - 1
2726
+ - 2
2727
+ - 3
2728
+ - 4
2729
+ - 5
2730
+ - 6
2731
+ - 7
2732
+ - 8
2733
+ - 9
2734
+ - 10
2735
+ version: 3.2.2
2736
+ tfds_mapping:
2737
+ qq:
2738
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/qq
2739
+ config_ids:
2740
+ - 1
2741
+ - 2
2742
+ - 3
2743
+ - 4
2744
+ - 5
2745
+ - 6
2746
+ - 7
2747
+ - 8
2748
+ - 9
2749
+ - 10
2750
+ version: 3.3.0
2751
+ ttbar:
2752
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ttbar
2753
+ config_ids:
2754
+ - 1
2755
+ - 2
2756
+ - 3
2757
+ - 4
2758
+ - 5
2759
+ - 6
2760
+ - 7
2761
+ - 8
2762
+ - 9
2763
+ - 10
2764
+ version: 3.3.0
2765
+ ww_fullhad:
2766
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ww_fullhad
2767
+ config_ids:
2768
+ - 1
2769
+ - 2
2770
+ - 3
2771
+ - 4
2772
+ - 5
2773
+ - 6
2774
+ - 7
2775
+ - 8
2776
+ - 9
2777
+ - 10
2778
+ version: 3.3.0
2779
+ type: key4hep
2780
+ workspace_dir: ${project.paths.storage_root}/clic/v1.2.5_key4hep_2025-05-29
2781
+ cms_run3:
2782
+ comment: Main production with CMSSW_15_0_5
2783
+ config_dir: ${project.paths.project_root}
2784
+ environment:
2785
+ cmssw_dir: ${project.cmssw_dir}
2786
+ cmssw_release: CMSSW_15_0_5
2787
+ scram_arch: el8_amd64_gcc12
2788
+ gen_container: /cvmfs/singularity.opensciencegrid.org/cmssw/cms:rhel8-x86_64
2789
+ memory:
2790
+ gen: 6000
2791
+ post: 4000
2792
+ tfds: 16000
2793
+ train: 16000
2794
+ val: 8000
2795
+ model: pyg-cms-v1
2796
+ postprocessing:
2797
+ args:
2798
+ num_events: -1
2799
+ save_full_graph: false
2800
+ script: mlpf/data/cms/postprocessing2.py
2801
+ samples:
2802
+ qcd_nopu:
2803
+ events_per_job: 100
2804
+ gen_script: mlpf/data/cms/genjob_pu.sh
2805
+ output_subdir: nopu
2806
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2807
+ pu_type: nopu
2808
+ seed_range:
2809
+ - 1000000
2810
+ - 1010010
2811
+ qcd_pu:
2812
+ events_per_job: 100
2813
+ gen_script: mlpf/data/cms/genjob_pu.sh
2814
+ output_subdir: pu55to75
2815
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2816
+ pu_type: pu55to75
2817
+ seed_range:
2818
+ - 300000
2819
+ - 310010
2820
+ qcd_val:
2821
+ copy_step2: true
2822
+ events_per_job: 100
2823
+ gen_script: mlpf/data/cms/genjob_pu.sh
2824
+ output_subdir: pu55to75_val
2825
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2826
+ pu_type: pu55to75
2827
+ seed_range:
2828
+ - 400000
2829
+ - 401010
2830
+ ttbar_nopu:
2831
+ events_per_job: 100
2832
+ gen_script: mlpf/data/cms/genjob_pu.sh
2833
+ output_subdir: nopu
2834
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2835
+ pu_type: nopu
2836
+ seed_range:
2837
+ - 800000
2838
+ - 810010
2839
+ ttbar_pu:
2840
+ events_per_job: 50
2841
+ gen_script: mlpf/data/cms/genjob_pu.sh
2842
+ output_subdir: pu55to75
2843
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2844
+ pu_type: pu55to75
2845
+ seed_range:
2846
+ - 100000
2847
+ - 110010
2848
+ ztt_nopu:
2849
+ events_per_job: 100
2850
+ gen_script: mlpf/data/cms/genjob_pu.sh
2851
+ output_subdir: nopu
2852
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2853
+ pu_type: nopu
2854
+ seed_range:
2855
+ - 1100000
2856
+ - 1110010
2857
+ ztt_pu:
2858
+ events_per_job: 100
2859
+ gen_script: mlpf/data/cms/genjob_pu.sh
2860
+ output_subdir: pu55to75
2861
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2862
+ pu_type: pu55to75
2863
+ seed_range:
2864
+ - 200000
2865
+ - 210010
2866
+ slurm_partition: ${project.cpu_partition}
2867
+ slurm_runtime: 48h
2868
+ tfds_mapping:
2869
+ qcd_nopu:
2870
+ builder_path: mlpf/heptfds/cms_pf/qcd_nopu
2871
+ config_ids:
2872
+ - 1
2873
+ - 2
2874
+ - 3
2875
+ - 4
2876
+ - 5
2877
+ - 6
2878
+ - 7
2879
+ - 8
2880
+ - 9
2881
+ - 10
2882
+ version: 3.2.0
2883
+ qcd_pu:
2884
+ builder_path: mlpf/heptfds/cms_pf/qcd
2885
+ config_ids:
2886
+ - 1
2887
+ - 2
2888
+ - 3
2889
+ - 4
2890
+ - 5
2891
+ - 6
2892
+ - 7
2893
+ - 8
2894
+ - 9
2895
+ - 10
2896
+ version: 3.2.0
2897
+ ttbar_nopu:
2898
+ builder_path: mlpf/heptfds/cms_pf/ttbar_nopu
2899
+ config_ids:
2900
+ - 1
2901
+ - 2
2902
+ - 3
2903
+ - 4
2904
+ - 5
2905
+ - 6
2906
+ - 7
2907
+ - 8
2908
+ - 9
2909
+ - 10
2910
+ version: 3.2.0
2911
+ ttbar_pu:
2912
+ builder_path: mlpf/heptfds/cms_pf/ttbar
2913
+ config_ids:
2914
+ - 1
2915
+ - 2
2916
+ - 3
2917
+ - 4
2918
+ - 5
2919
+ - 6
2920
+ - 7
2921
+ - 8
2922
+ - 9
2923
+ - 10
2924
+ version: 3.2.0
2925
+ ztt_nopu:
2926
+ builder_path: mlpf/heptfds/cms_pf/ztt_nopu
2927
+ config_ids:
2928
+ - 1
2929
+ - 2
2930
+ - 3
2931
+ - 4
2932
+ - 5
2933
+ - 6
2934
+ - 7
2935
+ - 8
2936
+ - 9
2937
+ - 10
2938
+ version: 3.2.0
2939
+ ztt_pu:
2940
+ builder_path: mlpf/heptfds/cms_pf/ztt
2941
+ config_ids:
2942
+ - 1
2943
+ - 2
2944
+ - 3
2945
+ - 4
2946
+ - 5
2947
+ - 6
2948
+ - 7
2949
+ - 8
2950
+ - 9
2951
+ - 10
2952
+ version: 3.2.0
2953
+ type: cms
2954
+ validation:
2955
+ job_types:
2956
+ - pf
2957
+ - mlpf
2958
+ threads: 8
2959
+ use_cuda: false
2960
+ validation_data:
2961
+ job_types:
2962
+ - pf
2963
+ - mlpf
2964
+ samples:
2965
+ jetmet0:
2966
+ input_filelist: data/cms/run3/${project.site_name}/jetmet0.txt
2967
+ output_subdir: Run2024C
2968
+ seed_range:
2969
+ - 1
2970
+ - 100
2971
+ threads: 8
2972
+ use_cuda: false
2973
+ workspace_dir: ${project.paths.storage_root}/cms/20260204_cmssw_15_0_5_117d32
2974
+ colliderml:
2975
+ comment: ColliderML Release 1 ttbar (no pileup), clustered view (tracks + our
2976
+ spatial clusters)
2977
+ download_root: /mnt/ceph/users/ewulff/data/colliderml/CERN__ColliderML-Release-1
2978
+ memory:
2979
+ post: 32000
2980
+ tfds: 32000
2981
+ postprocessing:
2982
+ args: {}
2983
+ script: mlpf/data/colliderml/postprocessing.py
2984
+ samples:
2985
+ ttbar_pu0:
2986
+ source_dir: ${productions.colliderml.download_root}
2987
+ ttbar_pu200:
2988
+ source_dir: ${productions.colliderml.download_root}
2989
+ source_revision: 64c3d2f112df3d5d20979d22da7cfdff13e10c4b
2990
+ tfds_hit_mapping:
2991
+ ttbar_pu0:
2992
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar
2993
+ config_ids:
2994
+ - 1
2995
+ - 2
2996
+ - 3
2997
+ - 4
2998
+ - 5
2999
+ - 6
3000
+ - 7
3001
+ - 8
3002
+ - 9
3003
+ - 10
3004
+ version: 1.3.0
3005
+ ttbar_pu200:
3006
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar_pu200
3007
+ config_ids:
3008
+ - 1
3009
+ - 2
3010
+ - 3
3011
+ - 4
3012
+ - 5
3013
+ - 6
3014
+ - 7
3015
+ - 8
3016
+ - 9
3017
+ - 10
3018
+ version: 1.3.0
3019
+ tfds_mapping:
3020
+ ttbar_pu0:
3021
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar
3022
+ config_ids:
3023
+ - 1
3024
+ - 2
3025
+ - 3
3026
+ - 4
3027
+ - 5
3028
+ - 6
3029
+ - 7
3030
+ - 8
3031
+ - 9
3032
+ - 10
3033
+ version: 1.5.0
3034
+ ttbar_pu200:
3035
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar_pu200
3036
+ config_ids:
3037
+ - 1
3038
+ - 2
3039
+ - 3
3040
+ - 4
3041
+ - 5
3042
+ - 6
3043
+ - 7
3044
+ - 8
3045
+ - 9
3046
+ - 10
3047
+ version: 1.5.0
3048
+ type: colliderml
3049
+ workspace_dir: ${productions.colliderml.workspace_root}/v1_release1_64c3d2f1
3050
+ workspace_root: /mnt/ceph/users/ewulff/mlpf/colliderml
3051
+ idea:
3052
+ comment: IDEA_o1_v03 pipeline validation with truth-seeded proxy tracks
3053
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/idea
3054
+ environment:
3055
+ progress_interval: 60
3056
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
3057
+ memory:
3058
+ gen: 16000
3059
+ post: 4000
3060
+ tfds: 8000
3061
+ model: pyg-idea-pipeline-v1
3062
+ postprocessing:
3063
+ args: {}
3064
+ script: mlpf/data/key4hep/postprocessing.py
3065
+ samples:
3066
+ gun_e_10gev:
3067
+ events_per_job: 100
3068
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3069
+ process_name: gun_e_10gev
3070
+ seed_range:
3071
+ - 424242
3072
+ - 424342
3073
+ gun_mu_10gev:
3074
+ events_per_job: 100
3075
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3076
+ process_name: gun_mu_10gev
3077
+ seed_range:
3078
+ - 600000
3079
+ - 600100
3080
+ gun_pi_10gev:
3081
+ events_per_job: 100
3082
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3083
+ process_name: gun_pi_10gev
3084
+ seed_range:
3085
+ - 700000
3086
+ - 700100
3087
+ qq:
3088
+ events_per_job: 100
3089
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3090
+ process_name: p8_ee_qq_ecm365
3091
+ seed_range:
3092
+ - 500000
3093
+ - 500100
3094
+ ttbar:
3095
+ events_per_job: 100
3096
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3097
+ process_name: p8_ee_ttbar_ecm365
3098
+ seed_range:
3099
+ - 300000
3100
+ - 300100
3101
+ ww_fullhad:
3102
+ events_per_job: 100
3103
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3104
+ process_name: p8_ee_WW_fullhad_ecm365
3105
+ seed_range:
3106
+ - 400000
3107
+ - 400100
3108
+ slurm_partition: main
3109
+ slurm_runtime: 48h
3110
+ tfds_mapping:
3111
+ qq:
3112
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/qq
3113
+ config_ids:
3114
+ - 1
3115
+ version: 0.2.1
3116
+ ttbar:
3117
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ttbar
3118
+ config_ids:
3119
+ - 1
3120
+ version: 0.2.1
3121
+ ww_fullhad:
3122
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ww_fullhad
3123
+ config_ids:
3124
+ - 1
3125
+ version: 0.2.1
3126
+ type: key4hep
3127
+ workspace_dir: ${project.paths.storage_root}/idea/IDEA_o1_v03_fccconfig_a05a3a9
3128
+ maia:
3129
+ comment: Local MAIA ttbar EDM4hep validation sample
3130
+ config_dir: ${project.paths.project_root}
3131
+ model: pyg-maia-v1
3132
+ type: maia
3133
+ workspace_dir: ${project.paths.project_root}/local_test_data/maia_smoke
3134
+ project:
3135
+ bind_mounts: &id029
3136
+ - /local
3137
+ - /cvmfs
3138
+ - /scratch/local
3139
+ - /scratch/persistent
3140
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3141
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3142
+ cpu_partition: main
3143
+ description: Machine Learning for Particle Flow Reconstruction
3144
+ executor: slurm
3145
+ gpu_partition: gpu
3146
+ name: particleflow
3147
+ paths: &id030
3148
+ project_root: /home/joosep/particleflow
3149
+ scratch_root: /scratch/local/joosep
3150
+ storage_root: /local/joosep/mlpf
3151
+ tmpdir: /scratch/local/joosep/tmp
3152
+ site_name: tallinn
3153
+ sites:
3154
+ local:
3155
+ bind_mounts:
3156
+ - /tmp
3157
+ - /mnt/work
3158
+ cmssw_dir: /home/joosep/particleflow/CMSSW_15_0_5
3159
+ container: https://jpata.web.cern.ch/jpata/particleflow-29042026-de861d.sif
3160
+ cpu_partition: local
3161
+ executor: local
3162
+ gpu_partition: local
3163
+ paths:
3164
+ project_root: /home/joosep/particleflow
3165
+ scratch_root: /tmp/particleflow
3166
+ storage_root: /mnt/work/mlpf/
3167
+ tmpdir: /tmp/particleflow/tmp
3168
+ site_name: local
3169
+ lxplus:
3170
+ bind_mounts:
3171
+ - /afs
3172
+ - /cvmfs
3173
+ - /eos/user/j/jpata
3174
+ - /etc/pki/ca-trust
3175
+ - /etc/tnsnames.ora
3176
+ - /run
3177
+ cmssw_dir: /cvmfs/cms.cern.ch
3178
+ container: /eos/user/j/jpata/www/particleflow-20260330-cd2f54.sif
3179
+ cpu_partition: tomorrow
3180
+ executor: condor
3181
+ gpu_partition: tomorrow
3182
+ paths:
3183
+ project_root: /afs/cern.ch/work/j/jpata/particleflow
3184
+ scratch_root: /tmp
3185
+ storage_root: /eos/user/j/jpata/mlpf
3186
+ tmpdir: /tmp
3187
+ site_name: lxplus
3188
+ tallinn:
3189
+ bind_mounts: *id029
3190
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3191
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3192
+ cpu_partition: main
3193
+ executor: slurm
3194
+ gpu_partition: gpu
3195
+ paths: *id030
3196
+ site_name: tallinn
3197
+ slurm_account: hepusers
3198
+ slurm_account: hepusers
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.pdf ADDED
Binary file (21.5 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.pdf ADDED
Binary file (21.1 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.pdf ADDED
Binary file (20.9 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res.pdf ADDED
Binary file (23.7 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.pdf ADDED
Binary file (23.3 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/num_elements.pdf ADDED
Binary file (10.3 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/plots_step_50000/cld_edm_z_tautau_pf/num_elements.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/runs/train/events.out.tfevents.1794646693.workergpu159.1868450.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2674e8100f6fbaa4af50ba5cd30d3a5a7f63d3f13bd919989e2c6ddd7749cab
3
+ size 1843423
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/runs/valid/events.out.tfevents.1794646693.workergpu159.1868450.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dff2016ceae770bb92a2110961039ca7e02f4d32e35caa5af662eea1d90f4283
3
+ size 2325288
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/scenario-manifest.json ADDED
@@ -0,0 +1,1299 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "scenario": {
3
+ "name": "pf_fm_experts",
4
+ "spec_file": "particleflow_spec.yaml",
5
+ "production_name": "cld",
6
+ "variants": {
7
+ "cld": {
8
+ "model_name": "pyg-cld-v1",
9
+ "production_name": null,
10
+ "gpus": null,
11
+ "data_root": null,
12
+ "data_subdir": null,
13
+ "overrides": {}
14
+ },
15
+ "clic": {
16
+ "model_name": "pyg-clic-v1",
17
+ "production_name": "clic",
18
+ "gpus": null,
19
+ "data_root": null,
20
+ "data_subdir": null,
21
+ "overrides": {}
22
+ },
23
+ "idea": {
24
+ "model_name": "pyg-idea-pipeline-v1",
25
+ "production_name": "idea",
26
+ "gpus": null,
27
+ "data_root": null,
28
+ "data_subdir": null,
29
+ "overrides": {}
30
+ },
31
+ "colliderml": {
32
+ "model_name": "pyg-colliderml-v1",
33
+ "production_name": "colliderml",
34
+ "gpus": null,
35
+ "data_root": null,
36
+ "data_subdir": null,
37
+ "overrides": {}
38
+ },
39
+ "cld_ecal_1p5mm": {
40
+ "model_name": "pyg-cld-v1",
41
+ "production_name": "cld",
42
+ "gpus": null,
43
+ "data_root": "cld_granularity",
44
+ "data_subdir": "ecal_1p5mm/tfds",
45
+ "overrides": {
46
+ "model.feature_bag": true,
47
+ "train_dataset.cld.physical.samples": {
48
+ "cld_edm_z_tautau_pf": {
49
+ "version": "3.3.0",
50
+ "splits": [
51
+ "1",
52
+ "2",
53
+ "3",
54
+ "4",
55
+ "5",
56
+ "6",
57
+ "7",
58
+ "8",
59
+ "9",
60
+ "10"
61
+ ]
62
+ }
63
+ },
64
+ "valid_dataset.cld.physical.samples": {
65
+ "cld_edm_z_tautau_pf": {
66
+ "version": "3.3.0",
67
+ "splits": [
68
+ "1",
69
+ "2",
70
+ "3",
71
+ "4",
72
+ "5",
73
+ "6",
74
+ "7",
75
+ "8",
76
+ "9",
77
+ "10"
78
+ ]
79
+ }
80
+ },
81
+ "test_dataset": {
82
+ "cld_edm_z_tautau_pf": {
83
+ "version": "3.3.0",
84
+ "splits": [
85
+ "1",
86
+ "2",
87
+ "3",
88
+ "4",
89
+ "5",
90
+ "6",
91
+ "7",
92
+ "8",
93
+ "9",
94
+ "10"
95
+ ]
96
+ }
97
+ }
98
+ }
99
+ },
100
+ "cld_ecal_2mm": {
101
+ "model_name": "pyg-cld-v1",
102
+ "production_name": "cld",
103
+ "gpus": null,
104
+ "data_root": "cld_granularity",
105
+ "data_subdir": "ecal_2mm/tfds",
106
+ "overrides": {
107
+ "model.feature_bag": true,
108
+ "train_dataset.cld.physical.samples": {
109
+ "cld_edm_z_tautau_pf": {
110
+ "version": "3.3.0",
111
+ "splits": [
112
+ "1",
113
+ "2",
114
+ "3",
115
+ "4",
116
+ "5",
117
+ "6",
118
+ "7",
119
+ "8",
120
+ "9",
121
+ "10"
122
+ ]
123
+ }
124
+ },
125
+ "valid_dataset.cld.physical.samples": {
126
+ "cld_edm_z_tautau_pf": {
127
+ "version": "3.3.0",
128
+ "splits": [
129
+ "1",
130
+ "2",
131
+ "3",
132
+ "4",
133
+ "5",
134
+ "6",
135
+ "7",
136
+ "8",
137
+ "9",
138
+ "10"
139
+ ]
140
+ }
141
+ },
142
+ "test_dataset": {
143
+ "cld_edm_z_tautau_pf": {
144
+ "version": "3.3.0",
145
+ "splits": [
146
+ "1",
147
+ "2",
148
+ "3",
149
+ "4",
150
+ "5",
151
+ "6",
152
+ "7",
153
+ "8",
154
+ "9",
155
+ "10"
156
+ ]
157
+ }
158
+ }
159
+ }
160
+ },
161
+ "cld_ecal_2p5mm": {
162
+ "model_name": "pyg-cld-v1",
163
+ "production_name": "cld",
164
+ "gpus": null,
165
+ "data_root": "cld_granularity",
166
+ "data_subdir": "ecal_2p5mm/tfds",
167
+ "overrides": {
168
+ "model.feature_bag": true,
169
+ "train_dataset.cld.physical.samples": {
170
+ "cld_edm_z_tautau_pf": {
171
+ "version": "3.3.0",
172
+ "splits": [
173
+ "1",
174
+ "2",
175
+ "3",
176
+ "4",
177
+ "5",
178
+ "6",
179
+ "7",
180
+ "8",
181
+ "9",
182
+ "10"
183
+ ]
184
+ }
185
+ },
186
+ "valid_dataset.cld.physical.samples": {
187
+ "cld_edm_z_tautau_pf": {
188
+ "version": "3.3.0",
189
+ "splits": [
190
+ "1",
191
+ "2",
192
+ "3",
193
+ "4",
194
+ "5",
195
+ "6",
196
+ "7",
197
+ "8",
198
+ "9",
199
+ "10"
200
+ ]
201
+ }
202
+ },
203
+ "test_dataset": {
204
+ "cld_edm_z_tautau_pf": {
205
+ "version": "3.3.0",
206
+ "splits": [
207
+ "1",
208
+ "2",
209
+ "3",
210
+ "4",
211
+ "5",
212
+ "6",
213
+ "7",
214
+ "8",
215
+ "9",
216
+ "10"
217
+ ]
218
+ }
219
+ }
220
+ }
221
+ },
222
+ "cld_ecal_3mm": {
223
+ "model_name": "pyg-cld-v1",
224
+ "production_name": "cld",
225
+ "gpus": null,
226
+ "data_root": "cld_granularity",
227
+ "data_subdir": "ecal_3mm/tfds",
228
+ "overrides": {
229
+ "model.feature_bag": true,
230
+ "train_dataset.cld.physical.samples": {
231
+ "cld_edm_z_tautau_pf": {
232
+ "version": "3.3.0",
233
+ "splits": [
234
+ "1",
235
+ "2",
236
+ "3",
237
+ "4",
238
+ "5",
239
+ "6",
240
+ "7",
241
+ "8",
242
+ "9",
243
+ "10"
244
+ ]
245
+ }
246
+ },
247
+ "valid_dataset.cld.physical.samples": {
248
+ "cld_edm_z_tautau_pf": {
249
+ "version": "3.3.0",
250
+ "splits": [
251
+ "1",
252
+ "2",
253
+ "3",
254
+ "4",
255
+ "5",
256
+ "6",
257
+ "7",
258
+ "8",
259
+ "9",
260
+ "10"
261
+ ]
262
+ }
263
+ },
264
+ "test_dataset": {
265
+ "cld_edm_z_tautau_pf": {
266
+ "version": "3.3.0",
267
+ "splits": [
268
+ "1",
269
+ "2",
270
+ "3",
271
+ "4",
272
+ "5",
273
+ "6",
274
+ "7",
275
+ "8",
276
+ "9",
277
+ "10"
278
+ ]
279
+ }
280
+ }
281
+ }
282
+ },
283
+ "cld_ecal_4mm": {
284
+ "model_name": "pyg-cld-v1",
285
+ "production_name": "cld",
286
+ "gpus": null,
287
+ "data_root": "cld_granularity",
288
+ "data_subdir": "ecal_4mm/tfds",
289
+ "overrides": {
290
+ "model.feature_bag": true,
291
+ "train_dataset.cld.physical.samples": {
292
+ "cld_edm_z_tautau_pf": {
293
+ "version": "3.3.0",
294
+ "splits": [
295
+ "1",
296
+ "2",
297
+ "3",
298
+ "4",
299
+ "5",
300
+ "6",
301
+ "7",
302
+ "8",
303
+ "9",
304
+ "10"
305
+ ]
306
+ }
307
+ },
308
+ "valid_dataset.cld.physical.samples": {
309
+ "cld_edm_z_tautau_pf": {
310
+ "version": "3.3.0",
311
+ "splits": [
312
+ "1",
313
+ "2",
314
+ "3",
315
+ "4",
316
+ "5",
317
+ "6",
318
+ "7",
319
+ "8",
320
+ "9",
321
+ "10"
322
+ ]
323
+ }
324
+ },
325
+ "test_dataset": {
326
+ "cld_edm_z_tautau_pf": {
327
+ "version": "3.3.0",
328
+ "splits": [
329
+ "1",
330
+ "2",
331
+ "3",
332
+ "4",
333
+ "5",
334
+ "6",
335
+ "7",
336
+ "8",
337
+ "9",
338
+ "10"
339
+ ]
340
+ }
341
+ }
342
+ }
343
+ },
344
+ "cld_ecal_5p1mm": {
345
+ "model_name": "pyg-cld-v1",
346
+ "production_name": "cld",
347
+ "gpus": null,
348
+ "data_root": "cld_granularity",
349
+ "data_subdir": "ecal_5p1mm/tfds",
350
+ "overrides": {
351
+ "model.feature_bag": true,
352
+ "train_dataset.cld.physical.samples": {
353
+ "cld_edm_z_tautau_pf": {
354
+ "version": "3.3.0",
355
+ "splits": [
356
+ "1",
357
+ "2",
358
+ "3",
359
+ "4",
360
+ "5",
361
+ "6",
362
+ "7",
363
+ "8",
364
+ "9",
365
+ "10"
366
+ ]
367
+ }
368
+ },
369
+ "valid_dataset.cld.physical.samples": {
370
+ "cld_edm_z_tautau_pf": {
371
+ "version": "3.3.0",
372
+ "splits": [
373
+ "1",
374
+ "2",
375
+ "3",
376
+ "4",
377
+ "5",
378
+ "6",
379
+ "7",
380
+ "8",
381
+ "9",
382
+ "10"
383
+ ]
384
+ }
385
+ },
386
+ "test_dataset": {
387
+ "cld_edm_z_tautau_pf": {
388
+ "version": "3.3.0",
389
+ "splits": [
390
+ "1",
391
+ "2",
392
+ "3",
393
+ "4",
394
+ "5",
395
+ "6",
396
+ "7",
397
+ "8",
398
+ "9",
399
+ "10"
400
+ ]
401
+ }
402
+ }
403
+ }
404
+ },
405
+ "cld_hcal_10mm": {
406
+ "model_name": "pyg-cld-v1",
407
+ "production_name": "cld",
408
+ "gpus": null,
409
+ "data_root": "cld_granularity",
410
+ "data_subdir": "hcal_10mm/tfds",
411
+ "overrides": {
412
+ "model.feature_bag": true,
413
+ "train_dataset.cld.physical.samples": {
414
+ "cld_edm_ttbar_pf": {
415
+ "version": "3.3.0",
416
+ "splits": [
417
+ "1",
418
+ "2",
419
+ "3",
420
+ "4",
421
+ "5",
422
+ "6",
423
+ "7",
424
+ "8",
425
+ "9",
426
+ "10"
427
+ ]
428
+ }
429
+ },
430
+ "valid_dataset.cld.physical.samples": {
431
+ "cld_edm_ttbar_pf": {
432
+ "version": "3.3.0",
433
+ "splits": [
434
+ "1",
435
+ "2",
436
+ "3",
437
+ "4",
438
+ "5",
439
+ "6",
440
+ "7",
441
+ "8",
442
+ "9",
443
+ "10"
444
+ ]
445
+ }
446
+ },
447
+ "test_dataset": {
448
+ "cld_edm_ttbar_pf": {
449
+ "version": "3.3.0",
450
+ "splits": [
451
+ "1",
452
+ "2",
453
+ "3",
454
+ "4",
455
+ "5",
456
+ "6",
457
+ "7",
458
+ "8",
459
+ "9",
460
+ "10"
461
+ ]
462
+ }
463
+ }
464
+ }
465
+ },
466
+ "cld_hcal_12mm": {
467
+ "model_name": "pyg-cld-v1",
468
+ "production_name": "cld",
469
+ "gpus": null,
470
+ "data_root": "cld_granularity",
471
+ "data_subdir": "hcal_12mm/tfds",
472
+ "overrides": {
473
+ "model.feature_bag": true,
474
+ "train_dataset.cld.physical.samples": {
475
+ "cld_edm_ttbar_pf": {
476
+ "version": "3.3.0",
477
+ "splits": [
478
+ "1",
479
+ "2",
480
+ "3",
481
+ "4",
482
+ "5",
483
+ "6",
484
+ "7",
485
+ "8",
486
+ "9",
487
+ "10"
488
+ ]
489
+ }
490
+ },
491
+ "valid_dataset.cld.physical.samples": {
492
+ "cld_edm_ttbar_pf": {
493
+ "version": "3.3.0",
494
+ "splits": [
495
+ "1",
496
+ "2",
497
+ "3",
498
+ "4",
499
+ "5",
500
+ "6",
501
+ "7",
502
+ "8",
503
+ "9",
504
+ "10"
505
+ ]
506
+ }
507
+ },
508
+ "test_dataset": {
509
+ "cld_edm_ttbar_pf": {
510
+ "version": "3.3.0",
511
+ "splits": [
512
+ "1",
513
+ "2",
514
+ "3",
515
+ "4",
516
+ "5",
517
+ "6",
518
+ "7",
519
+ "8",
520
+ "9",
521
+ "10"
522
+ ]
523
+ }
524
+ }
525
+ }
526
+ },
527
+ "cld_hcal_15mm": {
528
+ "model_name": "pyg-cld-v1",
529
+ "production_name": "cld",
530
+ "gpus": null,
531
+ "data_root": "cld_granularity",
532
+ "data_subdir": "hcal_15mm/tfds",
533
+ "overrides": {
534
+ "model.feature_bag": true,
535
+ "train_dataset.cld.physical.samples": {
536
+ "cld_edm_ttbar_pf": {
537
+ "version": "3.3.0",
538
+ "splits": [
539
+ "1",
540
+ "2",
541
+ "3",
542
+ "4",
543
+ "5",
544
+ "6",
545
+ "7",
546
+ "8",
547
+ "9",
548
+ "10"
549
+ ]
550
+ }
551
+ },
552
+ "valid_dataset.cld.physical.samples": {
553
+ "cld_edm_ttbar_pf": {
554
+ "version": "3.3.0",
555
+ "splits": [
556
+ "1",
557
+ "2",
558
+ "3",
559
+ "4",
560
+ "5",
561
+ "6",
562
+ "7",
563
+ "8",
564
+ "9",
565
+ "10"
566
+ ]
567
+ }
568
+ },
569
+ "test_dataset": {
570
+ "cld_edm_ttbar_pf": {
571
+ "version": "3.3.0",
572
+ "splits": [
573
+ "1",
574
+ "2",
575
+ "3",
576
+ "4",
577
+ "5",
578
+ "6",
579
+ "7",
580
+ "8",
581
+ "9",
582
+ "10"
583
+ ]
584
+ }
585
+ }
586
+ }
587
+ },
588
+ "cld_hcal_20mm": {
589
+ "model_name": "pyg-cld-v1",
590
+ "production_name": "cld",
591
+ "gpus": null,
592
+ "data_root": "cld_granularity",
593
+ "data_subdir": "hcal_20mm/tfds",
594
+ "overrides": {
595
+ "model.feature_bag": true,
596
+ "train_dataset.cld.physical.samples": {
597
+ "cld_edm_ttbar_pf": {
598
+ "version": "3.3.0",
599
+ "splits": [
600
+ "1",
601
+ "2",
602
+ "3",
603
+ "4",
604
+ "5",
605
+ "6",
606
+ "7",
607
+ "8",
608
+ "9",
609
+ "10"
610
+ ]
611
+ }
612
+ },
613
+ "valid_dataset.cld.physical.samples": {
614
+ "cld_edm_ttbar_pf": {
615
+ "version": "3.3.0",
616
+ "splits": [
617
+ "1",
618
+ "2",
619
+ "3",
620
+ "4",
621
+ "5",
622
+ "6",
623
+ "7",
624
+ "8",
625
+ "9",
626
+ "10"
627
+ ]
628
+ }
629
+ },
630
+ "test_dataset": {
631
+ "cld_edm_ttbar_pf": {
632
+ "version": "3.3.0",
633
+ "splits": [
634
+ "1",
635
+ "2",
636
+ "3",
637
+ "4",
638
+ "5",
639
+ "6",
640
+ "7",
641
+ "8",
642
+ "9",
643
+ "10"
644
+ ]
645
+ }
646
+ }
647
+ }
648
+ },
649
+ "cld_hcal_25mm": {
650
+ "model_name": "pyg-cld-v1",
651
+ "production_name": "cld",
652
+ "gpus": null,
653
+ "data_root": "cld_granularity",
654
+ "data_subdir": "hcal_25mm/tfds",
655
+ "overrides": {
656
+ "model.feature_bag": true,
657
+ "train_dataset.cld.physical.samples": {
658
+ "cld_edm_ttbar_pf": {
659
+ "version": "3.3.0",
660
+ "splits": [
661
+ "1",
662
+ "2",
663
+ "3",
664
+ "4",
665
+ "5",
666
+ "6",
667
+ "7",
668
+ "8",
669
+ "9",
670
+ "10"
671
+ ]
672
+ }
673
+ },
674
+ "valid_dataset.cld.physical.samples": {
675
+ "cld_edm_ttbar_pf": {
676
+ "version": "3.3.0",
677
+ "splits": [
678
+ "1",
679
+ "2",
680
+ "3",
681
+ "4",
682
+ "5",
683
+ "6",
684
+ "7",
685
+ "8",
686
+ "9",
687
+ "10"
688
+ ]
689
+ }
690
+ },
691
+ "test_dataset": {
692
+ "cld_edm_ttbar_pf": {
693
+ "version": "3.3.0",
694
+ "splits": [
695
+ "1",
696
+ "2",
697
+ "3",
698
+ "4",
699
+ "5",
700
+ "6",
701
+ "7",
702
+ "8",
703
+ "9",
704
+ "10"
705
+ ]
706
+ }
707
+ }
708
+ }
709
+ },
710
+ "cld_hcal_30mm": {
711
+ "model_name": "pyg-cld-v1",
712
+ "production_name": "cld",
713
+ "gpus": null,
714
+ "data_root": "cld_granularity",
715
+ "data_subdir": "hcal_30mm/tfds",
716
+ "overrides": {
717
+ "model.feature_bag": true,
718
+ "train_dataset.cld.physical.samples": {
719
+ "cld_edm_ttbar_pf": {
720
+ "version": "3.3.0",
721
+ "splits": [
722
+ "1",
723
+ "2",
724
+ "3",
725
+ "4",
726
+ "5",
727
+ "6",
728
+ "7",
729
+ "8",
730
+ "9",
731
+ "10"
732
+ ]
733
+ }
734
+ },
735
+ "valid_dataset.cld.physical.samples": {
736
+ "cld_edm_ttbar_pf": {
737
+ "version": "3.3.0",
738
+ "splits": [
739
+ "1",
740
+ "2",
741
+ "3",
742
+ "4",
743
+ "5",
744
+ "6",
745
+ "7",
746
+ "8",
747
+ "9",
748
+ "10"
749
+ ]
750
+ }
751
+ },
752
+ "test_dataset": {
753
+ "cld_edm_ttbar_pf": {
754
+ "version": "3.3.0",
755
+ "splits": [
756
+ "1",
757
+ "2",
758
+ "3",
759
+ "4",
760
+ "5",
761
+ "6",
762
+ "7",
763
+ "8",
764
+ "9",
765
+ "10"
766
+ ]
767
+ }
768
+ }
769
+ }
770
+ }
771
+ },
772
+ "seeds": [
773
+ 12345
774
+ ],
775
+ "training": {
776
+ "global_batch_size": 16,
777
+ "parameters": {
778
+ "optimizer": "lamb",
779
+ "lr": 0.0005,
780
+ "lr_schedule": "onecycle",
781
+ "lr_schedule_config.onecycle.pct_start": 0.3,
782
+ "num_steps": 500000,
783
+ "tensorboard_step_freq": 1000,
784
+ "benchmark.enabled": true,
785
+ "benchmark.sample_interval_seconds": 1.0,
786
+ "benchmark.warmup_steps": 100,
787
+ "benchmark.gpu_timing_interval": 0,
788
+ "val_freq": 10000,
789
+ "checkpoint_freq": 2000,
790
+ "patience": 3,
791
+ "nvalid": 256,
792
+ "ntest": 256,
793
+ "sampler_mode": "interleaved-shards",
794
+ "pad_to_multiple_elements": 128,
795
+ "validation_particle_metrics": true,
796
+ "make_plots": true
797
+ }
798
+ },
799
+ "common_overrides": {
800
+ "model.type": "attention",
801
+ "model.heptv2": null,
802
+ "model.attention": {
803
+ "num_convs": 6,
804
+ "num_heads": 16,
805
+ "head_dim": 16,
806
+ "attention_type": "flash",
807
+ "dropout_ff": 0.0
808
+ },
809
+ "model.input_encoding": "split",
810
+ "model.input_normalization": true,
811
+ "model.backbone.mode": "shared",
812
+ "model.backbone.num_convs": 6
813
+ },
814
+ "allowed_variant_differences": [
815
+ "model.feature_bag",
816
+ "data_dir",
817
+ "dataset",
818
+ "hyperparameters.lr",
819
+ "input_dim",
820
+ "train_dataset",
821
+ "valid_dataset",
822
+ "test_dataset",
823
+ "enabled_test_datasets"
824
+ ]
825
+ },
826
+ "platform": {
827
+ "name": "flatiron_h100_single",
828
+ "gpus": 1,
829
+ "python_command": [
830
+ "uv",
831
+ "run",
832
+ "python3"
833
+ ],
834
+ "data_dir": {
835
+ "cld": "/mnt/ceph/users/jpata/mlpf/cld/v1.2.5_key4hep_2025-05-29/tfds",
836
+ "clic": "/mnt/ceph/users/jpata/mlpf/clic/v1.2.5_key4hep_2025-05-29/tfds",
837
+ "idea": "/mnt/ceph/users/jpata/mlpf/idea/IDEA_o1_v03_fccconfig_a05a3a9/tfds",
838
+ "colliderml": "/mnt/ceph/users/ewulff/tensorflow_datasets/colliderml/",
839
+ "cld_granularity": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29"
840
+ },
841
+ "experiments_dir": "/mnt/home/jpata/particleflow/experiments",
842
+ "environment": {},
843
+ "runtime_overrides": {
844
+ "dtype": "bfloat16",
845
+ "num_workers": 8,
846
+ "prefetch_factor": 2,
847
+ "model.attention.use_flash_attn_varlen": false
848
+ },
849
+ "slurm": {
850
+ "partition": "gpu",
851
+ "constraint": "h100",
852
+ "account": null,
853
+ "qos": null,
854
+ "reservation": null,
855
+ "time": "48:00:00",
856
+ "nodes": 1,
857
+ "tasks_per_node": 1,
858
+ "cpus_per_task": 64,
859
+ "cpus_per_gpu": 24,
860
+ "gpu_request": "gpus-per-task",
861
+ "gpu_type": null,
862
+ "memory": "128G",
863
+ "memory_per_gpu": null,
864
+ "no_requeue": false
865
+ }
866
+ },
867
+ "job": {
868
+ "scenario_name": "pf_fm_experts",
869
+ "platform_name": "flatiron_h100_single",
870
+ "variant_name": "cld_ecal_1p5mm",
871
+ "model_name": "pyg-cld-v1",
872
+ "production_name": "cld",
873
+ "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/ecal_1p5mm/tfds",
874
+ "seed": 12345,
875
+ "global_batch_size": 16,
876
+ "per_gpu_batch_size": 16,
877
+ "gpu_batch_multiplier": 16,
878
+ "settings": {
879
+ "optimizer": "lamb",
880
+ "lr": 0.0005,
881
+ "lr_schedule": "onecycle",
882
+ "lr_schedule_config.onecycle.pct_start": 0.3,
883
+ "num_steps": 500000,
884
+ "tensorboard_step_freq": 1000,
885
+ "benchmark.enabled": true,
886
+ "benchmark.sample_interval_seconds": 1.0,
887
+ "benchmark.warmup_steps": 100,
888
+ "benchmark.gpu_timing_interval": 0,
889
+ "val_freq": 10000,
890
+ "checkpoint_freq": 2000,
891
+ "patience": 3,
892
+ "nvalid": 256,
893
+ "ntest": 256,
894
+ "sampler_mode": "interleaved-shards",
895
+ "pad_to_multiple_elements": 128,
896
+ "validation_particle_metrics": true,
897
+ "make_plots": true,
898
+ "model.type": "attention",
899
+ "model.heptv2": null,
900
+ "model.attention": {
901
+ "num_convs": 6,
902
+ "num_heads": 16,
903
+ "head_dim": 16,
904
+ "attention_type": "flash",
905
+ "dropout_ff": 0.0
906
+ },
907
+ "model.input_encoding": "split",
908
+ "model.input_normalization": true,
909
+ "model.backbone.mode": "shared",
910
+ "model.backbone.num_convs": 6,
911
+ "dtype": "bfloat16",
912
+ "num_workers": 8,
913
+ "prefetch_factor": 2,
914
+ "model.attention.use_flash_attn_varlen": false,
915
+ "model.feature_bag": true,
916
+ "train_dataset.cld.physical.samples": {
917
+ "cld_edm_z_tautau_pf": {
918
+ "version": "3.3.0",
919
+ "splits": [
920
+ "1",
921
+ "2",
922
+ "3",
923
+ "4",
924
+ "5",
925
+ "6",
926
+ "7",
927
+ "8",
928
+ "9",
929
+ "10"
930
+ ]
931
+ }
932
+ },
933
+ "valid_dataset.cld.physical.samples": {
934
+ "cld_edm_z_tautau_pf": {
935
+ "version": "3.3.0",
936
+ "splits": [
937
+ "1",
938
+ "2",
939
+ "3",
940
+ "4",
941
+ "5",
942
+ "6",
943
+ "7",
944
+ "8",
945
+ "9",
946
+ "10"
947
+ ]
948
+ }
949
+ },
950
+ "test_dataset": {
951
+ "cld_edm_z_tautau_pf": {
952
+ "version": "3.3.0",
953
+ "splits": [
954
+ "1",
955
+ "2",
956
+ "3",
957
+ "4",
958
+ "5",
959
+ "6",
960
+ "7",
961
+ "8",
962
+ "9",
963
+ "10"
964
+ ]
965
+ }
966
+ },
967
+ "seed": 12345,
968
+ "gpu_batch_multiplier": 16
969
+ }
970
+ },
971
+ "resolved_config": {
972
+ "dataset": "cld",
973
+ "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/ecal_1p5mm/tfds",
974
+ "model": {
975
+ "type": "attention",
976
+ "input_encoding": "split",
977
+ "learned_representation_mode": "last",
978
+ "pt_mode": "direct-elemtype-split",
979
+ "eta_mode": "linear",
980
+ "sin_phi_mode": "linear",
981
+ "cos_phi_mode": "linear",
982
+ "energy_mode": "direct-elemtype-split",
983
+ "trainable": "all",
984
+ "task_queries": true,
985
+ "output_mode": "elementwise",
986
+ "binary_classification_focal_gamma": null,
987
+ "backbone": {
988
+ "mode": "shared",
989
+ "num_convs": 6,
990
+ "num_tracker_layers": null,
991
+ "num_calo_layers": null,
992
+ "num_common_layers": null
993
+ },
994
+ "hit_feature_engineering": {
995
+ "enabled": true,
996
+ "geometry": true,
997
+ "tracker_neighborhood": false,
998
+ "tracker_momentum": false,
999
+ "tracker_doublets": false,
1000
+ "calorimeter_neighborhood": true
1001
+ },
1002
+ "set_decoder": null,
1003
+ "input_normalization": true,
1004
+ "feature_bag": true,
1005
+ "gnnlsh": null,
1006
+ "attention": {
1007
+ "num_convs": 6,
1008
+ "dropout_ff": 0.0,
1009
+ "activation": "elu",
1010
+ "layernorm": true,
1011
+ "num_heads": 16,
1012
+ "head_dim": 16,
1013
+ "attention_type": "flash",
1014
+ "dropout_conv_reg_mha": 0.0,
1015
+ "dropout_conv_reg_ff": 0.0,
1016
+ "dropout_conv_id_mha": 0.0,
1017
+ "dropout_conv_id_ff": 0.0,
1018
+ "use_pre_layernorm": true,
1019
+ "use_jagged_attention": false,
1020
+ "use_flash_attn_varlen": false,
1021
+ "export_onnx_fused": false,
1022
+ "save_attention": false
1023
+ },
1024
+ "litept": null,
1025
+ "hept": null,
1026
+ "heptv2": null
1027
+ },
1028
+ "conv_type": "attention",
1029
+ "batch_size": 1,
1030
+ "hyperparameters": {
1031
+ "batch_size": 1,
1032
+ "lr": 0.0005
1033
+ },
1034
+ "backend": "pytorch",
1035
+ "threads": 16,
1036
+ "gpu_type": "l40",
1037
+ "mem_per_gpu_mb": 40000,
1038
+ "slurm_partition": "gpu",
1039
+ "slurm_runtime": "168h",
1040
+ "input_dim": 19,
1041
+ "num_classes": 6,
1042
+ "elemtypes_nonzero": [
1043
+ 1,
1044
+ 2
1045
+ ],
1046
+ "seed": 12345,
1047
+ "num_steps": 500000,
1048
+ "patience": 3,
1049
+ "checkpoint_freq": 2000,
1050
+ "val_freq": 10000,
1051
+ "num_workers": 8,
1052
+ "prefetch_factor": 2,
1053
+ "max_open_readers": 64,
1054
+ "gpu_batch_multiplier": 16,
1055
+ "dtype": "bfloat16",
1056
+ "lr": 0.0005,
1057
+ "weight_decay": 0.01,
1058
+ "optimizer": "lamb",
1059
+ "lr_schedule": "onecycle",
1060
+ "lr_schedule_config": {
1061
+ "onecycle": {
1062
+ "pct_start": 0.3
1063
+ }
1064
+ },
1065
+ "task_loss_weights": {
1066
+ "calibration_steps": 100,
1067
+ "epsilon": 1e-08,
1068
+ "min_weight": 0.01,
1069
+ "max_weight": 1000.0
1070
+ },
1071
+ "lr_finder": {
1072
+ "start_lr": 1e-07,
1073
+ "end_lr": 0.1,
1074
+ "num_steps": 1000,
1075
+ "smoothing": 0.98,
1076
+ "divergence_factor": 4.0
1077
+ },
1078
+ "pad_to_multiple_elements": 128,
1079
+ "validation_diagnostics_batches": 0,
1080
+ "validation_linear_probe": false,
1081
+ "validation_linear_probe_max_events": 16,
1082
+ "validation_particle_metrics": true,
1083
+ "train": true,
1084
+ "lr_find": false,
1085
+ "test": true,
1086
+ "compile": false,
1087
+ "make_plots": true,
1088
+ "sort_data": false,
1089
+ "sampler_mode": "interleaved-shards",
1090
+ "load": null,
1091
+ "relaxed_load": false,
1092
+ "load_weights_only": false,
1093
+ "reset_task_loss_weights": false,
1094
+ "sampler_from_scratch": false,
1095
+ "comet": false,
1096
+ "comet_offline": false,
1097
+ "comet_name": "particleflow",
1098
+ "tensorboard_step_freq": 1000,
1099
+ "benchmark": {
1100
+ "enabled": true,
1101
+ "sample_interval_seconds": 1.0,
1102
+ "warmup_steps": 100,
1103
+ "gpu_timing_interval": 0
1104
+ },
1105
+ "raytune": {
1106
+ "local_dir": null,
1107
+ "sched": "asha",
1108
+ "search_alg": null,
1109
+ "default_metric": "val_loss",
1110
+ "default_mode": "min",
1111
+ "asha": {
1112
+ "max_t": 200,
1113
+ "reduction_factor": 4,
1114
+ "brackets": 1,
1115
+ "grace_period": 10
1116
+ },
1117
+ "hyperband": {
1118
+ "max_t": 200,
1119
+ "reduction_factor": 4
1120
+ },
1121
+ "hyperopt": {
1122
+ "n_random_steps": 10
1123
+ },
1124
+ "nevergrad": {
1125
+ "n_random_steps": 10
1126
+ }
1127
+ },
1128
+ "train_dataset": {
1129
+ "cld": {
1130
+ "physical": {
1131
+ "batch_size": 1,
1132
+ "weight": null,
1133
+ "samples": {
1134
+ "cld_edm_z_tautau_pf": {
1135
+ "version": "3.3.0",
1136
+ "splits": [
1137
+ "1",
1138
+ "2",
1139
+ "3",
1140
+ "4",
1141
+ "5",
1142
+ "6",
1143
+ "7",
1144
+ "8",
1145
+ "9",
1146
+ "10"
1147
+ ],
1148
+ "batch_size": null
1149
+ }
1150
+ }
1151
+ }
1152
+ }
1153
+ },
1154
+ "valid_dataset": {
1155
+ "cld": {
1156
+ "physical": {
1157
+ "batch_size": 1,
1158
+ "weight": null,
1159
+ "samples": {
1160
+ "cld_edm_z_tautau_pf": {
1161
+ "version": "3.3.0",
1162
+ "splits": [
1163
+ "1",
1164
+ "2",
1165
+ "3",
1166
+ "4",
1167
+ "5",
1168
+ "6",
1169
+ "7",
1170
+ "8",
1171
+ "9",
1172
+ "10"
1173
+ ],
1174
+ "batch_size": null
1175
+ }
1176
+ }
1177
+ }
1178
+ }
1179
+ },
1180
+ "test_dataset": {
1181
+ "cld_edm_z_tautau_pf": {
1182
+ "version": "3.3.0",
1183
+ "splits": [
1184
+ "1",
1185
+ "2",
1186
+ "3",
1187
+ "4",
1188
+ "5",
1189
+ "6",
1190
+ "7",
1191
+ "8",
1192
+ "9",
1193
+ "10"
1194
+ ],
1195
+ "batch_size": 1
1196
+ }
1197
+ },
1198
+ "enabled_test_datasets": [
1199
+ "cld_edm_z_tautau_pf"
1200
+ ],
1201
+ "ntrain": null,
1202
+ "nvalid": 256,
1203
+ "ntest": 256,
1204
+ "data_config": null,
1205
+ "gpus": 1
1206
+ },
1207
+ "command": [
1208
+ "uv",
1209
+ "run",
1210
+ "python3",
1211
+ "-u",
1212
+ "mlpf/pipeline.py",
1213
+ "--spec-file",
1214
+ "particleflow_spec.yaml",
1215
+ "--model-name",
1216
+ "pyg-cld-v1",
1217
+ "--production-name",
1218
+ "cld",
1219
+ "--data-dir",
1220
+ "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/ecal_1p5mm/tfds",
1221
+ "--experiment-dir",
1222
+ "/mnt/home/jpata/particleflow/experiments/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077",
1223
+ "train",
1224
+ "--gpus",
1225
+ "1",
1226
+ "--dtype",
1227
+ "bfloat16",
1228
+ "--make-plots",
1229
+ "--optimizer",
1230
+ "lamb",
1231
+ "--lr",
1232
+ "0.0005",
1233
+ "--lr_schedule",
1234
+ "onecycle",
1235
+ "--lr_schedule_config.onecycle.pct_start",
1236
+ "0.3",
1237
+ "--num_steps",
1238
+ "500000",
1239
+ "--tensorboard_step_freq",
1240
+ "1000",
1241
+ "--benchmark.enabled",
1242
+ "true",
1243
+ "--benchmark.sample_interval_seconds",
1244
+ "1.0",
1245
+ "--benchmark.warmup_steps",
1246
+ "100",
1247
+ "--benchmark.gpu_timing_interval",
1248
+ "0",
1249
+ "--val_freq",
1250
+ "10000",
1251
+ "--checkpoint_freq",
1252
+ "2000",
1253
+ "--patience",
1254
+ "3",
1255
+ "--nvalid",
1256
+ "256",
1257
+ "--ntest",
1258
+ "256",
1259
+ "--sampler_mode",
1260
+ "interleaved-shards",
1261
+ "--pad_to_multiple_elements",
1262
+ "128",
1263
+ "--validation_particle_metrics",
1264
+ "true",
1265
+ "--model.type",
1266
+ "attention",
1267
+ "--model.heptv2",
1268
+ "null",
1269
+ "--model.attention",
1270
+ "{\"num_convs\": 6, \"num_heads\": 16, \"head_dim\": 16, \"attention_type\": \"flash\", \"dropout_ff\": 0.0}",
1271
+ "--model.input_encoding",
1272
+ "split",
1273
+ "--model.input_normalization",
1274
+ "true",
1275
+ "--model.backbone.mode",
1276
+ "shared",
1277
+ "--model.backbone.num_convs",
1278
+ "6",
1279
+ "--num_workers",
1280
+ "8",
1281
+ "--prefetch_factor",
1282
+ "2",
1283
+ "--model.attention.use_flash_attn_varlen",
1284
+ "false",
1285
+ "--model.feature_bag",
1286
+ "true",
1287
+ "--train_dataset.cld.physical.samples",
1288
+ "{\"cld_edm_z_tautau_pf\": {\"version\": \"3.3.0\", \"splits\": [\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"8\", \"9\", \"10\"]}}",
1289
+ "--valid_dataset.cld.physical.samples",
1290
+ "{\"cld_edm_z_tautau_pf\": {\"version\": \"3.3.0\", \"splits\": [\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"8\", \"9\", \"10\"]}}",
1291
+ "--test_dataset",
1292
+ "{\"cld_edm_z_tautau_pf\": {\"version\": \"3.3.0\", \"splits\": [\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"8\", \"9\", \"10\"]}}",
1293
+ "--seed",
1294
+ "12345",
1295
+ "--gpu_batch_multiplier",
1296
+ "16"
1297
+ ],
1298
+ "git_revision": "c68799620d27ceec2dc167db69d47fa42d3e84f7"
1299
+ }
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/train-config.yaml ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ backend: pytorch
2
+ batch_size: 1
3
+ benchmark:
4
+ enabled: true
5
+ gpu_timing_interval: 0
6
+ sample_interval_seconds: 1.0
7
+ warmup_steps: 100
8
+ checkpoint_freq: 2000
9
+ comet: false
10
+ comet_name: particleflow
11
+ comet_offline: false
12
+ compile: false
13
+ conv_type: attention
14
+ data_config: null
15
+ data_dir: /mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/ecal_1p5mm/tfds
16
+ dataset: cld
17
+ dtype: bfloat16
18
+ elemtypes_nonzero:
19
+ - 1
20
+ - 2
21
+ enabled_test_datasets:
22
+ - cld_edm_z_tautau_pf
23
+ gpu_batch_multiplier: 16
24
+ gpu_type: l40
25
+ gpus: 1
26
+ hyperparameters:
27
+ batch_size: 1
28
+ lr: 0.0005
29
+ input_dim: 19
30
+ load: null
31
+ load_weights_only: false
32
+ lr: 0.0005
33
+ lr_find: false
34
+ lr_finder:
35
+ divergence_factor: 4.0
36
+ end_lr: 0.1
37
+ num_steps: 1000
38
+ smoothing: 0.98
39
+ start_lr: 1.0e-07
40
+ lr_schedule: onecycle
41
+ lr_schedule_config:
42
+ onecycle:
43
+ pct_start: 0.3
44
+ make_plots: true
45
+ max_open_readers: 64
46
+ mem_per_gpu_mb: 40000
47
+ model:
48
+ attention:
49
+ activation: elu
50
+ attention_type: flash
51
+ dropout_conv_id_ff: 0.0
52
+ dropout_conv_id_mha: 0.0
53
+ dropout_conv_reg_ff: 0.0
54
+ dropout_conv_reg_mha: 0.0
55
+ dropout_ff: 0.0
56
+ export_onnx_fused: false
57
+ head_dim: 16
58
+ layernorm: true
59
+ num_convs: 6
60
+ num_heads: 16
61
+ save_attention: false
62
+ use_flash_attn_varlen: false
63
+ use_jagged_attention: false
64
+ use_pre_layernorm: true
65
+ backbone:
66
+ mode: shared
67
+ num_calo_layers: null
68
+ num_common_layers: null
69
+ num_convs: 6
70
+ num_tracker_layers: null
71
+ binary_classification_focal_gamma: null
72
+ cos_phi_mode: linear
73
+ energy_mode: direct-elemtype-split
74
+ eta_mode: linear
75
+ feature_bag: true
76
+ gnnlsh: null
77
+ hept: null
78
+ heptv2: null
79
+ hit_feature_engineering:
80
+ calorimeter_neighborhood: true
81
+ enabled: true
82
+ geometry: true
83
+ tracker_doublets: false
84
+ tracker_momentum: false
85
+ tracker_neighborhood: false
86
+ input_encoding: split
87
+ input_normalization: true
88
+ learned_representation_mode: last
89
+ litept: null
90
+ output_mode: elementwise
91
+ pt_mode: direct-elemtype-split
92
+ set_decoder: null
93
+ sin_phi_mode: linear
94
+ task_queries: true
95
+ trainable: all
96
+ type: attention
97
+ ntest: 256
98
+ ntrain: null
99
+ num_classes: 6
100
+ num_steps: 500000
101
+ num_workers: 8
102
+ nvalid: 256
103
+ optimizer: lamb
104
+ pad_to_multiple_elements: 128
105
+ patience: 3
106
+ prefetch_factor: 2
107
+ raytune:
108
+ asha:
109
+ brackets: 1
110
+ grace_period: 10
111
+ max_t: 200
112
+ reduction_factor: 4
113
+ default_metric: val_loss
114
+ default_mode: min
115
+ hyperband:
116
+ max_t: 200
117
+ reduction_factor: 4
118
+ hyperopt:
119
+ n_random_steps: 10
120
+ local_dir: null
121
+ nevergrad:
122
+ n_random_steps: 10
123
+ sched: asha
124
+ search_alg: null
125
+ relaxed_load: false
126
+ reset_task_loss_weights: false
127
+ sampler_from_scratch: false
128
+ sampler_mode: interleaved-shards
129
+ seed: 12345
130
+ slurm_partition: gpu
131
+ slurm_runtime: 168h
132
+ sort_data: false
133
+ task_loss_weights:
134
+ calibration_steps: 100
135
+ epsilon: 1.0e-08
136
+ max_weight: 1000.0
137
+ min_weight: 0.01
138
+ tensorboard_step_freq: 1000
139
+ test: true
140
+ test_dataset:
141
+ cld_edm_z_tautau_pf:
142
+ batch_size: 1
143
+ splits:
144
+ - '1'
145
+ - '2'
146
+ - '3'
147
+ - '4'
148
+ - '5'
149
+ - '6'
150
+ - '7'
151
+ - '8'
152
+ - '9'
153
+ - '10'
154
+ version: 3.3.0
155
+ threads: 16
156
+ train: true
157
+ train_dataset:
158
+ cld:
159
+ physical:
160
+ batch_size: 1
161
+ samples:
162
+ cld_edm_z_tautau_pf:
163
+ batch_size: null
164
+ splits:
165
+ - '1'
166
+ - '2'
167
+ - '3'
168
+ - '4'
169
+ - '5'
170
+ - '6'
171
+ - '7'
172
+ - '8'
173
+ - '9'
174
+ - '10'
175
+ version: 3.3.0
176
+ weight: null
177
+ val_freq: 10000
178
+ valid_dataset:
179
+ cld:
180
+ physical:
181
+ batch_size: 1
182
+ samples:
183
+ cld_edm_z_tautau_pf:
184
+ batch_size: null
185
+ splits:
186
+ - '1'
187
+ - '2'
188
+ - '3'
189
+ - '4'
190
+ - '5'
191
+ - '6'
192
+ - '7'
193
+ - '8'
194
+ - '9'
195
+ - '10'
196
+ version: 3.3.0
197
+ weight: null
198
+ validation_diagnostics_batches: 0
199
+ validation_linear_probe: false
200
+ validation_linear_probe_max_events: 16
201
+ validation_particle_metrics: true
202
+ weight_decay: 0.01
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/train.log ADDED
The diff for this file is too large to render. See raw diff
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_1p5mm_seed12345_20261114_035700_604077/train.log.0 ADDED
The diff for this file is too large to render. See raw diff
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/checkpoints/best.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfaed50f9b6be6ac251234f6cdd2a882fc11844ea8b7669b72f606ee00864105
3
+ size 47063573
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/checkpoints/checkpoint-50000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b24ee0ab293094fca8f9b7823ea7aab6e00c328dc45e68cc8a6bcbf01b6e921
3
+ size 47101757
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_10000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 17.793594306049823, "train": {"Classification_binary": 2.0719246864318848, "Classification": 0.006858853157609701, "Regression_pt": 0.08618886768817902, "Regression_eta": 0.012449911795556545, "Regression_sin_phi": 0.09924516081809998, "Regression_cos_phi": 0.11105702072381973, "Regression_energy": 0.07378891110420227, "Total": 5.275087356567383, "Total_unweighted": 2.461513411719352}, "train_group": {}, "valid": {"Classification_binary": 2.686521530151367, "Classification": 0.021385284140706062, "Regression_pt": 0.21083134412765503, "Regression_eta": 0.01582890935242176, "Regression_sin_phi": 0.01167185977101326, "Regression_cos_phi": 0.018491923809051514, "Regression_energy": 0.21606501936912537, "Total": 6.309292793273926, "Total_unweighted": 3.18079587072134, "metrics/particle/class_1/efficiency": 0.8522953987121582, "metrics/particle/class_1/pid_accuracy": 0.9414519667625427, "metrics/particle/class_2/efficiency": 0.09090909361839294, "metrics/particle/class_2/pid_accuracy": 0.0, "metrics/particle/class_3/efficiency": 0.554973840713501, "metrics/particle/class_3/pid_accuracy": 0.9591194987297058, "metrics/particle/class_4/efficiency": 0.821052610874176, "metrics/particle/class_4/pid_accuracy": 0.8589743375778198, "metrics/particle/class_5/efficiency": 0.9277108311653137, "metrics/particle/class_5/pid_accuracy": 0.9610389471054077, "metrics/particle/count/bias_mean": 0.00800000037997961, "metrics/particle/count/mae": 0.671999990940094, "metrics/particle/count/prediction_mean": 5.104000091552734, "metrics/particle/count/target_mean": 5.0960001945495605, "metrics/particle/event/energy_relative_abs_error": 0.09184730798006058, "metrics/particle/event/energy_response_mean": 1.010958194732666, "metrics/particle/event/met_abs_error": 3.0697665214538574, "metrics/particle/event/scalar_pt_relative_abs_error": 0.09020112454891205, "metrics/particle/event/scalar_pt_response_mean": 1.0160568952560425, "metrics/particle/event/vector_pt_closure": 0.10612638294696808, "metrics/particle/matched/delta_eta_abs_mean": 0.02715766243636608, "metrics/particle/matched/delta_phi_abs_mean": 0.021657753735780716, "metrics/particle/matched/delta_r_mean": 0.03856511414051056, "metrics/particle/matched/energy_relative_abs_mean": 0.09160294383764267, "metrics/particle/matched/pid_accuracy": 0.9401330351829529, "metrics/particle/matched/pt_relative_abs_mean": 0.0909905806183815, "metrics/particle/matching/duplicate_fraction": 0.03369905799627304, "metrics/particle/matching/efficiency": 0.7080062627792358, "metrics/particle/matching/f1": 0.7074509859085083, "metrics/particle/matching/purity": 0.7068965435028076, "metrics/particle/matching/target_coverage_dr0p05": 0.5180533528327942, "metrics/particle/matching/target_coverage_dr0p10": 0.7401883602142334, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6758241653442383, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8163265585899353}, "step_train_time": 0.5353190898895264, "step_valid_time": 2.7521878289990127, "step_total_time": 1119.2234790325165, "elapsed_training_loop_seconds": 1119.2234790325165, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.0085043472962556, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.09354433034229781, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 427, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 427, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 388, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 382, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9086651053864169, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9086651053864169, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9086651053864169, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.09133489461358314, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8946135831381733, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8946135831381733, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8946135831381733, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9086651053864169, "step_test_time": 4.913209314050619, "step_plot_time": 3.7223417469649576, "step_validation_cycle_time": 11.89633384597255}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_20000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 35.587188612099645, "train": {"Classification_binary": 1.4348115921020508, "Classification": 0.008471202105283737, "Regression_pt": 0.09407742321491241, "Regression_eta": 0.004091836977750063, "Regression_sin_phi": 0.003910078667104244, "Regression_cos_phi": 0.0037213547620922327, "Regression_energy": 0.08778736740350723, "Total": 2.9174692630767822, "Total_unweighted": 1.6368708552327007}, "train_group": {}, "valid": {"Classification_binary": 2.4926018714904785, "Classification": 0.017619574442505836, "Regression_pt": 0.19637814164161682, "Regression_eta": 0.011677371338009834, "Regression_sin_phi": 0.010613786056637764, "Regression_cos_phi": 0.016363093629479408, "Regression_energy": 0.20268724858760834, "Total": 5.816726207733154, "Total_unweighted": 2.9479410871863365, "metrics/particle/class_1/efficiency": 0.910179615020752, "metrics/particle/class_1/pid_accuracy": 0.9473684430122375, "metrics/particle/class_2/efficiency": 0.13636364042758942, "metrics/particle/class_2/pid_accuracy": 0.3333333432674408, "metrics/particle/class_3/efficiency": 0.5811518430709839, "metrics/particle/class_3/pid_accuracy": 0.9759759902954102, "metrics/particle/class_4/efficiency": 0.821052610874176, "metrics/particle/class_4/pid_accuracy": 0.9230769276618958, "metrics/particle/class_5/efficiency": 0.9879518151283264, "metrics/particle/class_5/pid_accuracy": 0.9878048896789551, "metrics/particle/count/bias_mean": -0.2919999957084656, "metrics/particle/count/mae": 0.6039999723434448, "metrics/particle/count/prediction_mean": 4.803999900817871, "metrics/particle/count/target_mean": 5.0960001945495605, "metrics/particle/event/energy_relative_abs_error": 0.08109983801841736, "metrics/particle/event/energy_response_mean": 0.9847778081893921, "metrics/particle/event/met_abs_error": 2.538388967514038, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08028209209442139, "metrics/particle/event/scalar_pt_response_mean": 0.9856570363044739, "metrics/particle/event/vector_pt_closure": 0.09397654980421066, "metrics/particle/matched/delta_eta_abs_mean": 0.024612655863165855, "metrics/particle/matched/delta_phi_abs_mean": 0.019493846222758293, "metrics/particle/matched/delta_r_mean": 0.03485165163874626, "metrics/particle/matched/energy_relative_abs_mean": 0.08925310522317886, "metrics/particle/matched/pid_accuracy": 0.956932783126831, "metrics/particle/matched/pt_relative_abs_mean": 0.08827477693557739, "metrics/particle/matching/duplicate_fraction": 0.01665278896689415, "metrics/particle/matching/efficiency": 0.7472527623176575, "metrics/particle/matching/f1": 0.769292950630188, "metrics/particle/matching/purity": 0.7926727533340454, "metrics/particle/matching/target_coverage_dr0p05": 0.5855572819709778, "metrics/particle/matching/target_coverage_dr0p10": 0.7715855836868286, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6899529099464417, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8304552435874939}, "step_train_time": 0.5214474201202393, "step_valid_time": 2.9077981989830732, "step_total_time": 2246.449330329895, "elapsed_training_loop_seconds": 2246.449330329895, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.0092964747531605, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.07823858814918239, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 427, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 426, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 401, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 395, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9391100702576113, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9413145539906104, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.94021101992966, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.05868544600938967, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9250585480093677, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9272300469483568, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9261430246189918, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9391100702576113, "step_test_time": 4.646595601981971, "step_plot_time": 3.176696587994229, "step_validation_cycle_time": 11.25192904699361}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_30000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 53.380782918149464, "train": {"Classification_binary": 1.8763298988342285, "Classification": 0.009554348886013031, "Regression_pt": 0.07301955670118332, "Regression_eta": 0.006397808436304331, "Regression_sin_phi": 0.004290834069252014, "Regression_cos_phi": 0.00591751653701067, "Regression_energy": 0.07593051344156265, "Total": 3.1678123474121094, "Total_unweighted": 2.0514404769055545}, "train_group": {}, "valid": {"Classification_binary": 2.7286434173583984, "Classification": 0.019377749413251877, "Regression_pt": 0.23874136805534363, "Regression_eta": 0.01192166842520237, "Regression_sin_phi": 0.01135250274091959, "Regression_cos_phi": 0.013505646958947182, "Regression_energy": 0.24252334237098694, "Total": 6.6356329917907715, "Total_unweighted": 3.26606569532305, "metrics/particle/class_1/efficiency": 0.916167676448822, "metrics/particle/class_1/pid_accuracy": 0.943355143070221, "metrics/particle/class_2/efficiency": 0.13636364042758942, "metrics/particle/class_2/pid_accuracy": 0.3333333432674408, "metrics/particle/class_3/efficiency": 0.5881326198577881, "metrics/particle/class_3/pid_accuracy": 0.9584569931030273, "metrics/particle/class_4/efficiency": 0.8631578683853149, "metrics/particle/class_4/pid_accuracy": 0.9268292784690857, "metrics/particle/class_5/efficiency": 0.9879518151283264, "metrics/particle/class_5/pid_accuracy": 0.9878048896789551, "metrics/particle/count/bias_mean": -0.06400000303983688, "metrics/particle/count/mae": 0.5680000185966492, "metrics/particle/count/prediction_mean": 5.0320000648498535, "metrics/particle/count/target_mean": 5.0960001945495605, "metrics/particle/event/energy_relative_abs_error": 0.08190050721168518, "metrics/particle/event/energy_response_mean": 1.0022300481796265, "metrics/particle/event/met_abs_error": 2.7011783123016357, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08281683176755905, "metrics/particle/event/scalar_pt_response_mean": 1.00493586063385, "metrics/particle/event/vector_pt_closure": 0.10037313401699066, "metrics/particle/matched/delta_eta_abs_mean": 0.024778185412287712, "metrics/particle/matched/delta_phi_abs_mean": 0.020547199994325638, "metrics/particle/matched/delta_r_mean": 0.03552239015698433, "metrics/particle/matched/energy_relative_abs_mean": 0.08953256905078888, "metrics/particle/matched/pid_accuracy": 0.9491173624992371, "metrics/particle/matched/pt_relative_abs_mean": 0.08815541118383408, "metrics/particle/matching/duplicate_fraction": 0.023052463307976723, "metrics/particle/matching/efficiency": 0.755886971950531, "metrics/particle/matching/f1": 0.7606635093688965, "metrics/particle/matching/purity": 0.7655007839202881, "metrics/particle/matching/target_coverage_dr0p05": 0.5894819498062134, "metrics/particle/matching/target_coverage_dr0p10": 0.7896389365196228, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7025117874145508, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8383045792579651}, "step_train_time": 0.5173015594482422, "step_valid_time": 2.8862563319853507, "step_total_time": 3372.7198433876038, "elapsed_training_loop_seconds": 3372.7198433876038, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9994616878226401, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.0830584844332295, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 427, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 426, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 402, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 393, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9414519906323185, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9436619718309859, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9425556858147714, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.056338028169014086, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9203747072599532, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9225352112676056, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9214536928487691, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9414519906323185, "step_test_time": 4.654789781954605, "step_plot_time": 3.1255021169781685, "step_validation_cycle_time": 11.116008513025008}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_40000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 71.17437722419929, "train": {"Classification_binary": 0.25035592913627625, "Classification": 0.00026504829293116927, "Regression_pt": 0.06056802719831467, "Regression_eta": 0.0202044527977705, "Regression_sin_phi": 0.003965836483985186, "Regression_cos_phi": 0.19168363511562347, "Regression_energy": 0.05783575773239136, "Total": 3.0005176067352295, "Total_unweighted": 0.5848786867572926}, "train_group": {}, "valid": {"Classification_binary": 4.693091869354248, "Classification": 0.03539912775158882, "Regression_pt": 0.25628405809402466, "Regression_eta": 0.012033405713737011, "Regression_sin_phi": 0.011573029682040215, "Regression_cos_phi": 0.011829989962279797, "Regression_energy": 0.256602942943573, "Total": 9.015144348144531, "Total_unweighted": 5.2768144235014915, "metrics/particle/class_1/efficiency": 0.9041916131973267, "metrics/particle/class_1/pid_accuracy": 0.940397322177887, "metrics/particle/class_2/efficiency": 0.13636364042758942, "metrics/particle/class_2/pid_accuracy": 0.6666666865348816, "metrics/particle/class_3/efficiency": 0.6055846214294434, "metrics/particle/class_3/pid_accuracy": 0.9596541523933411, "metrics/particle/class_4/efficiency": 0.8526315689086914, "metrics/particle/class_4/pid_accuracy": 0.9135802388191223, "metrics/particle/class_5/efficiency": 0.9759036302566528, "metrics/particle/class_5/pid_accuracy": 0.9629629850387573, "metrics/particle/count/bias_mean": 0.15600000321865082, "metrics/particle/count/mae": 0.6759999990463257, "metrics/particle/count/prediction_mean": 5.251999855041504, "metrics/particle/count/target_mean": 5.0960001945495605, "metrics/particle/event/energy_relative_abs_error": 0.10026486217975616, "metrics/particle/event/energy_response_mean": 1.0268350839614868, "metrics/particle/event/met_abs_error": 2.752887487411499, "metrics/particle/event/scalar_pt_relative_abs_error": 0.09881633520126343, "metrics/particle/event/scalar_pt_response_mean": 1.0309008359909058, "metrics/particle/event/vector_pt_closure": 0.10692144930362701, "metrics/particle/matched/delta_eta_abs_mean": 0.02540541999042034, "metrics/particle/matched/delta_phi_abs_mean": 0.020604919642210007, "metrics/particle/matched/delta_r_mean": 0.03628775477409363, "metrics/particle/matched/energy_relative_abs_mean": 0.09215104579925537, "metrics/particle/matched/pid_accuracy": 0.9461140036582947, "metrics/particle/matched/pt_relative_abs_mean": 0.09306861460208893, "metrics/particle/matching/duplicate_fraction": 0.02817974053323269, "metrics/particle/matching/efficiency": 0.7574568390846252, "metrics/particle/matching/f1": 0.7460379004478455, "metrics/particle/matching/purity": 0.7349581122398376, "metrics/particle/matching/target_coverage_dr0p05": 0.5879120826721191, "metrics/particle/matching/target_coverage_dr0p10": 0.7864992022514343, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7001569867134094, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8437990546226501}, "step_train_time": 0.5229721069335938, "step_valid_time": 2.9613347810227424, "step_total_time": 4503.0636875629425, "elapsed_training_loop_seconds": 4503.0636875629425, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.0290366538076436, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.0731983895760362, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 427, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 430, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 404, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 398, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9461358313817331, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9395348837209302, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9428238039673279, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.06046511627906977, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9320843091334895, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9255813953488372, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9288214702450408, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9461358313817331, "step_test_time": 4.683143892965745, "step_plot_time": 3.194976851984393, "step_validation_cycle_time": 11.323585562990047}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/history/step_50000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 88.96797153024912, "train": {"Classification_binary": 0.5680248737335205, "Classification": 0.0014090090990066528, "Regression_pt": 0.06491699814796448, "Regression_eta": 0.005144355818629265, "Regression_sin_phi": 0.0039162891916930676, "Regression_cos_phi": 0.0026869382709264755, "Regression_energy": 0.06929463893175125, "Total": 1.6110718250274658, "Total_unweighted": 0.7153931031934917}, "train_group": {}, "valid": {"Classification_binary": 5.547128677368164, "Classification": 0.048895105719566345, "Regression_pt": 0.27639055252075195, "Regression_eta": 0.012601262889802456, "Regression_sin_phi": 0.0099935969337821, "Regression_cos_phi": 0.01193607784807682, "Regression_energy": 0.28006547689437866, "Total": 10.329926490783691, "Total_unweighted": 6.187010750174522, "metrics/particle/class_1/efficiency": 0.910179615020752, "metrics/particle/class_1/pid_accuracy": 0.9517543911933899, "metrics/particle/class_2/efficiency": 0.09090909361839294, "metrics/particle/class_2/pid_accuracy": 0.5, "metrics/particle/class_3/efficiency": 0.5916230082511902, "metrics/particle/class_3/pid_accuracy": 0.9587020874023438, "metrics/particle/class_4/efficiency": 0.8526315689086914, "metrics/particle/class_4/pid_accuracy": 0.9259259104728699, "metrics/particle/class_5/efficiency": 0.9879518151283264, "metrics/particle/class_5/pid_accuracy": 0.9390243887901306, "metrics/particle/count/bias_mean": 0.08399999886751175, "metrics/particle/count/mae": 0.628000020980835, "metrics/particle/count/prediction_mean": 5.179999828338623, "metrics/particle/count/target_mean": 5.0960001945495605, "metrics/particle/event/energy_relative_abs_error": 0.08712522685527802, "metrics/particle/event/energy_response_mean": 0.9965773224830627, "metrics/particle/event/met_abs_error": 2.4294087886810303, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08539421856403351, "metrics/particle/event/scalar_pt_response_mean": 0.9943791627883911, "metrics/particle/event/vector_pt_closure": 0.09651248157024384, "metrics/particle/matched/delta_eta_abs_mean": 0.024091660976409912, "metrics/particle/matched/delta_phi_abs_mean": 0.020453354343771935, "metrics/particle/matched/delta_r_mean": 0.034953150898218155, "metrics/particle/matched/energy_relative_abs_mean": 0.07815088331699371, "metrics/particle/matched/pid_accuracy": 0.949999988079071, "metrics/particle/matched/pt_relative_abs_mean": 0.07644808292388916, "metrics/particle/matching/duplicate_fraction": 0.016988417133688927, "metrics/particle/matching/efficiency": 0.7535321712493896, "metrics/particle/matching/f1": 0.7473725080490112, "metrics/particle/matching/purity": 0.7413127422332764, "metrics/particle/matching/target_coverage_dr0p05": 0.5894819498062134, "metrics/particle/matching/target_coverage_dr0p10": 0.779434859752655, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7307692170143127, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8414442539215088}, "step_train_time": 0.5262422561645508, "step_valid_time": 2.910034954024013, "step_total_time": 5638.497114419937, "elapsed_training_loop_seconds": 5638.497114419937, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9928266340230274, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.052418352968584436, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 427, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 425, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 402, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 393, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9414519906323185, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9458823529411765, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9436619718309859, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.05411764705882353, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.9203747072599532, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.9247058823529412, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.9225352112676056, "step/cld_edm_z_tautau_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9414519906323185, "step_test_time": 4.672498514992185, "step_plot_time": 3.165850337012671, "step_validation_cycle_time": 11.18819552497007}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/hyperparameters.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"num_mlpf_params": 3910930, "dataset": "cld", "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/ecal_2mm/tfds", "model": {"type": "attention", "input_encoding": "split", "learned_representation_mode": "last", "pt_mode": "direct-elemtype-split", "eta_mode": "linear", "sin_phi_mode": "linear", "cos_phi_mode": "linear", "energy_mode": "direct-elemtype-split", "trainable": "all", "task_queries": true, "output_mode": "elementwise", "binary_classification_focal_gamma": null, "backbone": {"mode": "shared", "num_convs": 6, "num_tracker_layers": null, "num_calo_layers": null, "num_common_layers": null}, "hit_feature_engineering": {"enabled": true, "geometry": true, "tracker_neighborhood": false, "tracker_momentum": false, "tracker_doublets": false, "calorimeter_neighborhood": true}, "set_decoder": null, "input_normalization": true, "feature_bag": true, "gnnlsh": null, "attention": {"num_convs": 6, "dropout_ff": 0.0, "activation": "elu", "layernorm": true, "num_heads": 16, "head_dim": 16, "attention_type": "flash", "dropout_conv_reg_mha": 0.0, "dropout_conv_reg_ff": 0.0, "dropout_conv_id_mha": 0.0, "dropout_conv_id_ff": 0.0, "use_pre_layernorm": true, "use_jagged_attention": false, "use_flash_attn_varlen": false, "export_onnx_fused": false, "save_attention": false}, "litept": null, "hept": null, "heptv2": null}, "conv_type": "attention", "batch_size": 1, "hyperparameters": {"batch_size": 1, "lr": 0.0005}, "backend": "pytorch", "threads": 16, "gpu_type": "l40", "mem_per_gpu_mb": 40000, "slurm_partition": "gpu", "slurm_runtime": "168h", "input_dim": 19, "num_classes": 6, "elemtypes_nonzero": [1, 2], "seed": 12345, "num_steps": 500000, "patience": 3, "checkpoint_freq": 2000, "val_freq": 10000, "num_workers": 8, "prefetch_factor": 2, "max_open_readers": 64, "gpu_batch_multiplier": 16, "dtype": "bfloat16", "lr": 0.0005, "weight_decay": 0.01, "optimizer": "lamb", "lr_schedule": "onecycle", "lr_schedule_config": {"onecycle": {"pct_start": 0.3}}, "task_loss_weights": {"calibration_steps": 100, "epsilon": 1e-08, "min_weight": 0.01, "max_weight": 1000.0}, "lr_finder": {"start_lr": 1e-07, "end_lr": 0.1, "num_steps": 1000, "smoothing": 0.98, "divergence_factor": 4.0}, "pad_to_multiple_elements": 128, "validation_diagnostics_batches": 0, "validation_linear_probe": false, "validation_linear_probe_max_events": 16, "validation_particle_metrics": true, "train": true, "lr_find": false, "test": true, "compile": false, "make_plots": true, "sort_data": false, "sampler_mode": "interleaved-shards", "load": null, "relaxed_load": false, "load_weights_only": false, "reset_task_loss_weights": false, "sampler_from_scratch": false, "comet": false, "comet_offline": false, "comet_name": "particleflow", "tensorboard_step_freq": 1000, "benchmark": {"enabled": true, "sample_interval_seconds": 1.0, "warmup_steps": 100, "gpu_timing_interval": 0}, "raytune": {"local_dir": null, "sched": "asha", "search_alg": null, "default_metric": "val_loss", "default_mode": "min", "asha": {"max_t": 200, "reduction_factor": 4, "brackets": 1, "grace_period": 10}, "hyperband": {"max_t": 200, "reduction_factor": 4}, "hyperopt": {"n_random_steps": 10}, "nevergrad": {"n_random_steps": 10}}, "train_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_z_tautau_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "valid_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_z_tautau_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "test_dataset": {"cld_edm_z_tautau_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": 1}}, "enabled_test_datasets": ["cld_edm_z_tautau_pf"], "ntrain": null, "nvalid": 256, "ntest": 256, "data_config": null, "gpus": 1}
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/model_kwargs.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b6bf49fa3864c3ae2d0894d25d45db76119450071bebdc352cfb24301592b93
3
+ size 4402
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/particleflow_spec.yaml ADDED
@@ -0,0 +1,3198 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ models:
2
+ defaults:
3
+ backend: pytorch
4
+ checkpoint_freq: 10000
5
+ comet: false
6
+ dtype: bfloat16
7
+ gpu_type: l40
8
+ gpus: 1
9
+ load: null
10
+ lr_schedule: cosinedecay
11
+ mem_per_gpu_mb: 40000
12
+ ntest: 100
13
+ ntrain: null
14
+ num_steps: 100000
15
+ num_workers: 2
16
+ nvalid: null
17
+ optimizer: lamb
18
+ patience: 10000
19
+ prefetch_factor: 2
20
+ raytune: &id001
21
+ asha:
22
+ brackets: 1
23
+ grace_period: 10
24
+ max_t: 200
25
+ reduction_factor: 4
26
+ default_metric: val_loss
27
+ default_mode: min
28
+ hyperband:
29
+ max_t: 200
30
+ reduction_factor: 4
31
+ hyperopt:
32
+ n_random_steps: 10
33
+ local_dir: null
34
+ nevergrad:
35
+ n_random_steps: 10
36
+ sched: asha
37
+ search_alg: null
38
+ seed: 12345
39
+ slurm_partition: ${project.gpu_partition}
40
+ slurm_runtime: 168h
41
+ sort_data: false
42
+ task_loss_weights: &id002
43
+ calibration_steps: 100
44
+ epsilon: 1.0e-08
45
+ max_weight: 1.0e3
46
+ min_weight: 0.01
47
+ tensorboard_step_freq: 100
48
+ threads: 16
49
+ val_freq: 10000
50
+ pyg-cld-hits-heptv2-sector-set-v1:
51
+ architecture:
52
+ heptv2:
53
+ block_size: 128
54
+ dropout_ff: 0.0
55
+ embedding_dim: 256
56
+ num_convs: 3
57
+ num_heads: 16
58
+ width: 256
59
+ input_encoding: split
60
+ output_mode: set
61
+ set_decoder:
62
+ attention_mode: sectorized
63
+ local_attention_radius: 0.4
64
+ num_heads: 8
65
+ num_layers: 2
66
+ num_sectors: 32
67
+ num_slots: 256
68
+ proposal_mode: grid-diverse
69
+ query_init: input-conditioned
70
+ sector_neighbors: 1
71
+ use_aggregate_anchors: true
72
+ type: heptv2
73
+ backend: pytorch
74
+ checkpoint_freq: 10000
75
+ comet: false
76
+ dataset: cld_hits
77
+ dtype: bfloat16
78
+ gpu_batch_multiplier: 1
79
+ gpu_type: l40
80
+ gpus: 1
81
+ hyperparameters: &id007
82
+ batch_size: 1
83
+ lr: 0.0001
84
+ load: null
85
+ lr_schedule: cosinedecay
86
+ mem_per_gpu_mb: 40000
87
+ ntest: 100
88
+ ntrain: null
89
+ num_steps: 100000
90
+ num_workers: 2
91
+ nvalid: null
92
+ optimizer: lamb
93
+ pad_to_multiple_elements: 128
94
+ patience: 10000
95
+ prefetch_factor: 2
96
+ raytune: *id001
97
+ seed: 12345
98
+ slurm_partition: ${project.gpu_partition}
99
+ slurm_runtime: 168h
100
+ sort_data: false
101
+ task_loss_weights: *id002
102
+ tensorboard_step_freq: 100
103
+ test_datasets: &id003
104
+ - name: cld_edm_ttbar_hits
105
+ splits:
106
+ - '1'
107
+ - '2'
108
+ - '3'
109
+ - '4'
110
+ - '5'
111
+ - '6'
112
+ - '7'
113
+ - '8'
114
+ - '9'
115
+ - '10'
116
+ version: 3.2.2
117
+ - name: cld_edm_ww_fullhad_hits
118
+ splits:
119
+ - '1'
120
+ - '2'
121
+ - '3'
122
+ - '4'
123
+ - '5'
124
+ - '6'
125
+ - '7'
126
+ - '8'
127
+ - '9'
128
+ - '10'
129
+ version: 3.2.2
130
+ - name: cld_edm_qq_hits
131
+ splits:
132
+ - '1'
133
+ - '2'
134
+ - '3'
135
+ - '4'
136
+ - '5'
137
+ - '6'
138
+ - '7'
139
+ - '8'
140
+ - '9'
141
+ - '10'
142
+ version: 3.2.2
143
+ threads: 16
144
+ train_datasets: &id004
145
+ physical:
146
+ batch_size: 1
147
+ samples:
148
+ - name: cld_edm_ttbar_hits
149
+ splits:
150
+ - '1'
151
+ - '2'
152
+ - '3'
153
+ - '4'
154
+ - '5'
155
+ - '6'
156
+ - '7'
157
+ - '8'
158
+ - '9'
159
+ - '10'
160
+ version: 3.2.2
161
+ - name: cld_edm_ww_fullhad_hits
162
+ splits:
163
+ - '1'
164
+ - '2'
165
+ - '3'
166
+ - '4'
167
+ - '5'
168
+ - '6'
169
+ - '7'
170
+ - '8'
171
+ - '9'
172
+ - '10'
173
+ version: 3.2.2
174
+ - name: cld_edm_qq_hits
175
+ splits:
176
+ - '1'
177
+ - '2'
178
+ - '3'
179
+ - '4'
180
+ - '5'
181
+ - '6'
182
+ - '7'
183
+ - '8'
184
+ - '9'
185
+ - '10'
186
+ version: 3.2.2
187
+ val_freq: 10000
188
+ validation_datasets: &id005
189
+ physical:
190
+ batch_size: 1
191
+ samples:
192
+ - name: cld_edm_ttbar_hits
193
+ splits:
194
+ - '1'
195
+ - '2'
196
+ - '3'
197
+ - '4'
198
+ - '5'
199
+ - '6'
200
+ - '7'
201
+ - '8'
202
+ - '9'
203
+ - '10'
204
+ version: 3.2.2
205
+ - name: cld_edm_ww_fullhad_hits
206
+ splits:
207
+ - '1'
208
+ - '2'
209
+ - '3'
210
+ - '4'
211
+ - '5'
212
+ - '6'
213
+ - '7'
214
+ - '8'
215
+ - '9'
216
+ - '10'
217
+ version: 3.2.2
218
+ - name: cld_edm_qq_hits
219
+ splits:
220
+ - '1'
221
+ - '2'
222
+ - '3'
223
+ - '4'
224
+ - '5'
225
+ - '6'
226
+ - '7'
227
+ - '8'
228
+ - '9'
229
+ - '10'
230
+ version: 3.2.2
231
+ pyg-cld-hits-heptv2-set-v1:
232
+ architecture:
233
+ backbone:
234
+ mode: shared
235
+ num_convs: 6
236
+ binary_classification_focal_gamma: 2.0
237
+ heptv2:
238
+ block_size: 128
239
+ dropout_ff: 0.0
240
+ embedding_dim: 256
241
+ num_convs: 6
242
+ num_heads: 16
243
+ width: 256
244
+ hit_feature_engineering:
245
+ tracker_neighborhood: true
246
+ input_encoding: split
247
+ output_mode: set
248
+ set_decoder:
249
+ aggregate_grid_size: 0.1
250
+ attention_mode: global-flash
251
+ auxiliary_loss_weight: 0.25
252
+ cardinality_loss_weight: 0.05
253
+ event_consistency_loss_weight: 0.0
254
+ hit_grouping: true
255
+ hit_grouping_chunk_size: 1024
256
+ hit_grouping_detector_balanced: false
257
+ hit_grouping_dim: 32
258
+ hit_grouping_loss_weight: 0.1
259
+ local_attention_radius: 0.4
260
+ matcher:
261
+ dr_scale: 0.1
262
+ energy: 0.0
263
+ geometry: 2.0
264
+ log_energy_scale: 0.6931471805599453
265
+ log_pt_scale: 0.6931471805599453
266
+ pid: 1.0
267
+ presence: 1.0
268
+ pt: 1.0
269
+ no_object_weight: 1.0
270
+ num_heads: 8
271
+ num_layers: 4
272
+ num_sectors: 32
273
+ num_slots: 256
274
+ presence_threshold: 0.5
275
+ proposal_grid_size: 0.1
276
+ proposal_mode: grid-diverse
277
+ query_init: input-conditioned
278
+ sector_neighbors: 1
279
+ tracker_fit_correction: false
280
+ tracker_group_magnetic_field: 2.0
281
+ tracker_group_readout: false
282
+ tracker_query_fraction: 0.6
283
+ use_aggregate_anchors: true
284
+ task_queries: false
285
+ type: heptv2
286
+ backend: pytorch
287
+ checkpoint_freq: 10000
288
+ comet: false
289
+ dataset: cld_hits
290
+ dtype: bfloat16
291
+ gpu_batch_multiplier: 1
292
+ gpu_type: l40
293
+ gpus: 1
294
+ hyperparameters:
295
+ batch_size: 1
296
+ lr: 0.001
297
+ load: null
298
+ lr_schedule: cosinedecay
299
+ mem_per_gpu_mb: 40000
300
+ ntest: 100
301
+ ntrain: null
302
+ num_steps: 100000
303
+ num_workers: 2
304
+ nvalid: null
305
+ optimizer: lamb
306
+ pad_to_multiple_elements: 128
307
+ patience: 10000
308
+ prefetch_factor: 2
309
+ raytune: *id001
310
+ seed: 12345
311
+ slurm_partition: ${project.gpu_partition}
312
+ slurm_runtime: 168h
313
+ sort_data: false
314
+ task_loss_weights: *id002
315
+ tensorboard_step_freq: 100
316
+ test_datasets: *id003
317
+ threads: 16
318
+ train_datasets: *id004
319
+ val_freq: 10000
320
+ validation_datasets: *id005
321
+ pyg-cld-hits-set-v1:
322
+ architecture:
323
+ attention: &id006
324
+ head_dim: 16
325
+ num_convs: 3
326
+ num_heads: 16
327
+ use_jagged_attention: true
328
+ binary_classification_focal_gamma: 2.0
329
+ input_encoding: split
330
+ output_mode: set
331
+ set_decoder:
332
+ dropout: 0.0
333
+ ffn_multiplier: 4.0
334
+ num_heads: 8
335
+ num_layers: 2
336
+ num_slots: 256
337
+ type: attention
338
+ backend: pytorch
339
+ checkpoint_freq: 10000
340
+ comet: false
341
+ dataset: cld_hits
342
+ dtype: bfloat16
343
+ gpu_batch_multiplier: 1
344
+ gpu_type: l40
345
+ gpus: 1
346
+ hyperparameters:
347
+ batch_size: 1
348
+ lr: 0.0001
349
+ load: null
350
+ lr_schedule: cosinedecay
351
+ mem_per_gpu_mb: 40000
352
+ ntest: 100
353
+ ntrain: null
354
+ num_steps: 100000
355
+ num_workers: 2
356
+ nvalid: null
357
+ optimizer: lamb
358
+ pad_to_multiple_elements: 128
359
+ patience: 10000
360
+ prefetch_factor: 2
361
+ raytune: *id001
362
+ seed: 12345
363
+ slurm_partition: ${project.gpu_partition}
364
+ slurm_runtime: 168h
365
+ sort_data: false
366
+ task_loss_weights: *id002
367
+ tensorboard_step_freq: 100
368
+ test_datasets: *id003
369
+ threads: 16
370
+ train_datasets: *id004
371
+ val_freq: 10000
372
+ validation_datasets: *id005
373
+ pyg-cld-hits-v1:
374
+ architecture:
375
+ attention: *id006
376
+ binary_classification_focal_gamma: 2.0
377
+ input_encoding: split
378
+ output_mode: elementwise
379
+ type: attention
380
+ backend: pytorch
381
+ checkpoint_freq: 10000
382
+ comet: false
383
+ dataset: cld_hits
384
+ dtype: bfloat16
385
+ gpu_batch_multiplier: 1
386
+ gpu_type: l40
387
+ gpus: 1
388
+ hyperparameters: *id007
389
+ load: null
390
+ lr_schedule: cosinedecay
391
+ mem_per_gpu_mb: 40000
392
+ ntest: 100
393
+ ntrain: null
394
+ num_steps: 100000
395
+ num_workers: 2
396
+ nvalid: null
397
+ optimizer: lamb
398
+ pad_to_multiple_elements: 128
399
+ patience: 10000
400
+ prefetch_factor: 2
401
+ raytune: *id001
402
+ seed: 12345
403
+ slurm_partition: ${project.gpu_partition}
404
+ slurm_runtime: 168h
405
+ sort_data: false
406
+ task_loss_weights: *id002
407
+ tensorboard_step_freq: 100
408
+ test_datasets: *id003
409
+ threads: 16
410
+ train_datasets: *id004
411
+ val_freq: 10000
412
+ validation_datasets: *id005
413
+ pyg-cld-v1:
414
+ architecture:
415
+ attention:
416
+ head_dim: 16
417
+ num_convs: 3
418
+ num_heads: 16
419
+ heptv2:
420
+ cluster_hash_at_centroid: true
421
+ track_hash_at_calo: true
422
+ input_encoding: split
423
+ type: attention
424
+ backend: pytorch
425
+ checkpoint_freq: 10000
426
+ comet: false
427
+ dataset: cld
428
+ dtype: bfloat16
429
+ gpu_batch_multiplier: 1024
430
+ gpu_type: l40
431
+ gpus: 1
432
+ hyperparameters:
433
+ batch_size: 1
434
+ lr: 0.0005
435
+ load: null
436
+ lr_schedule: cosinedecay
437
+ mem_per_gpu_mb: 40000
438
+ ntest: 100
439
+ ntrain: null
440
+ num_steps: 100000
441
+ num_workers: 2
442
+ nvalid: null
443
+ optimizer: lamb
444
+ patience: 10000
445
+ prefetch_factor: 2
446
+ raytune: *id001
447
+ seed: 12345
448
+ slurm_partition: ${project.gpu_partition}
449
+ slurm_runtime: 168h
450
+ sort_data: false
451
+ task_loss_weights: *id002
452
+ tensorboard_step_freq: 100
453
+ test_datasets:
454
+ - name: cld_edm_ttbar_pf
455
+ splits:
456
+ - '1'
457
+ - '2'
458
+ - '3'
459
+ - '4'
460
+ - '5'
461
+ - '6'
462
+ - '7'
463
+ - '8'
464
+ - '9'
465
+ - '10'
466
+ version: 3.3.0
467
+ - name: cld_edm_ww_fullhad_pf
468
+ splits:
469
+ - '1'
470
+ - '2'
471
+ - '3'
472
+ - '4'
473
+ - '5'
474
+ - '6'
475
+ - '7'
476
+ - '8'
477
+ - '9'
478
+ - '10'
479
+ version: 3.3.0
480
+ - name: cld_edm_qq_pf
481
+ splits:
482
+ - '1'
483
+ - '2'
484
+ - '3'
485
+ - '4'
486
+ - '5'
487
+ - '6'
488
+ - '7'
489
+ - '8'
490
+ - '9'
491
+ - '10'
492
+ version: 3.3.0
493
+ threads: 16
494
+ train_datasets:
495
+ physical:
496
+ batch_size: 1
497
+ samples:
498
+ - name: cld_edm_ttbar_pf
499
+ splits:
500
+ - '1'
501
+ - '2'
502
+ - '3'
503
+ - '4'
504
+ - '5'
505
+ - '6'
506
+ - '7'
507
+ - '8'
508
+ - '9'
509
+ - '10'
510
+ version: 3.3.0
511
+ - name: cld_edm_ww_fullhad_pf
512
+ splits:
513
+ - '1'
514
+ - '2'
515
+ - '3'
516
+ - '4'
517
+ - '5'
518
+ - '6'
519
+ - '7'
520
+ - '8'
521
+ - '9'
522
+ - '10'
523
+ version: 3.3.0
524
+ - name: cld_edm_qq_pf
525
+ splits:
526
+ - '1'
527
+ - '2'
528
+ - '3'
529
+ - '4'
530
+ - '5'
531
+ - '6'
532
+ - '7'
533
+ - '8'
534
+ - '9'
535
+ - '10'
536
+ version: 3.3.0
537
+ val_freq: 10000
538
+ validation_datasets:
539
+ physical:
540
+ batch_size: 1
541
+ samples:
542
+ - name: cld_edm_ttbar_pf
543
+ splits:
544
+ - '1'
545
+ - '2'
546
+ - '3'
547
+ - '4'
548
+ - '5'
549
+ - '6'
550
+ - '7'
551
+ - '8'
552
+ - '9'
553
+ - '10'
554
+ version: 3.3.0
555
+ - name: cld_edm_ww_fullhad_pf
556
+ splits:
557
+ - '1'
558
+ - '2'
559
+ - '3'
560
+ - '4'
561
+ - '5'
562
+ - '6'
563
+ - '7'
564
+ - '8'
565
+ - '9'
566
+ - '10'
567
+ version: 3.3.0
568
+ - name: cld_edm_qq_pf
569
+ splits:
570
+ - '1'
571
+ - '2'
572
+ - '3'
573
+ - '4'
574
+ - '5'
575
+ - '6'
576
+ - '7'
577
+ - '8'
578
+ - '9'
579
+ - '10'
580
+ version: 3.3.0
581
+ pyg-cldcliccolliderml-v1:
582
+ architecture:
583
+ attention:
584
+ head_dim: 16
585
+ num_convs: 3
586
+ num_heads: 16
587
+ input_encoding: split
588
+ type: attention
589
+ backend: pytorch
590
+ checkpoint_freq: 10000
591
+ comet: false
592
+ dataset: cld
593
+ dtype: bfloat16
594
+ gpu_batch_multiplier: 1024
595
+ gpu_type: l40
596
+ gpus: 1
597
+ hyperparameters:
598
+ batch_size: 1
599
+ lr: 0.0005
600
+ load: null
601
+ lr_schedule: cosinedecay
602
+ mem_per_gpu_mb: 40000
603
+ ntest: 100
604
+ ntrain: null
605
+ num_steps: 100000
606
+ num_workers: 2
607
+ nvalid: null
608
+ optimizer: lamb
609
+ patience: 10000
610
+ prefetch_factor: 2
611
+ raytune: *id001
612
+ seed: 12345
613
+ slurm_partition: ${project.gpu_partition}
614
+ slurm_runtime: 168h
615
+ sort_data: false
616
+ task_loss_weights: *id002
617
+ tensorboard_step_freq: 100
618
+ test_datasets:
619
+ - name: cld_edm_ttbar_pf
620
+ splits:
621
+ - '1'
622
+ - '2'
623
+ - '3'
624
+ - '4'
625
+ - '5'
626
+ - '6'
627
+ - '7'
628
+ - '8'
629
+ - '9'
630
+ - '10'
631
+ version: 3.3.0
632
+ - name: cld_edm_ww_fullhad_pf
633
+ splits:
634
+ - '1'
635
+ - '2'
636
+ - '3'
637
+ - '4'
638
+ - '5'
639
+ - '6'
640
+ - '7'
641
+ - '8'
642
+ - '9'
643
+ - '10'
644
+ version: 3.3.0
645
+ - name: cld_edm_qq_pf
646
+ splits:
647
+ - '1'
648
+ - '2'
649
+ - '3'
650
+ - '4'
651
+ - '5'
652
+ - '6'
653
+ - '7'
654
+ - '8'
655
+ - '9'
656
+ - '10'
657
+ version: 3.3.0
658
+ - name: clic_edm_ttbar_pf
659
+ splits:
660
+ - '1'
661
+ - '2'
662
+ - '3'
663
+ - '4'
664
+ - '5'
665
+ - '6'
666
+ - '7'
667
+ - '8'
668
+ - '9'
669
+ - '10'
670
+ version: 3.3.0
671
+ - name: clic_edm_ww_fullhad_pf
672
+ splits:
673
+ - '1'
674
+ - '2'
675
+ - '3'
676
+ - '4'
677
+ - '5'
678
+ - '6'
679
+ - '7'
680
+ - '8'
681
+ - '9'
682
+ - '10'
683
+ version: 3.3.0
684
+ - name: clic_edm_qq_pf
685
+ splits:
686
+ - '1'
687
+ - '2'
688
+ - '3'
689
+ - '4'
690
+ - '5'
691
+ - '6'
692
+ - '7'
693
+ - '8'
694
+ - '9'
695
+ - '10'
696
+ version: 3.3.0
697
+ - name: colliderml_ttbar_nopu_pf
698
+ splits:
699
+ - '1'
700
+ - '2'
701
+ - '3'
702
+ - '4'
703
+ - '5'
704
+ - '6'
705
+ - '7'
706
+ - '8'
707
+ - '9'
708
+ - '10'
709
+ version: 1.5.0
710
+ threads: 16
711
+ train_datasets:
712
+ cld:
713
+ batch_size: 1
714
+ samples:
715
+ - name: cld_edm_ttbar_pf
716
+ splits:
717
+ - '1'
718
+ - '2'
719
+ - '3'
720
+ - '4'
721
+ - '5'
722
+ - '6'
723
+ - '7'
724
+ - '8'
725
+ - '9'
726
+ - '10'
727
+ version: 3.3.0
728
+ - name: cld_edm_ww_fullhad_pf
729
+ splits:
730
+ - '1'
731
+ - '2'
732
+ - '3'
733
+ - '4'
734
+ - '5'
735
+ - '6'
736
+ - '7'
737
+ - '8'
738
+ - '9'
739
+ - '10'
740
+ version: 3.3.0
741
+ - name: cld_edm_qq_pf
742
+ splits:
743
+ - '1'
744
+ - '2'
745
+ - '3'
746
+ - '4'
747
+ - '5'
748
+ - '6'
749
+ - '7'
750
+ - '8'
751
+ - '9'
752
+ - '10'
753
+ version: 3.3.0
754
+ weight: 1.0
755
+ clic:
756
+ batch_size: 1
757
+ samples:
758
+ - name: clic_edm_ttbar_pf
759
+ splits:
760
+ - '1'
761
+ - '2'
762
+ - '3'
763
+ - '4'
764
+ - '5'
765
+ - '6'
766
+ - '7'
767
+ - '8'
768
+ - '9'
769
+ - '10'
770
+ version: 3.3.0
771
+ - name: clic_edm_ww_fullhad_pf
772
+ splits:
773
+ - '1'
774
+ - '2'
775
+ - '3'
776
+ - '4'
777
+ - '5'
778
+ - '6'
779
+ - '7'
780
+ - '8'
781
+ - '9'
782
+ - '10'
783
+ version: 3.3.0
784
+ - name: clic_edm_qq_pf
785
+ splits:
786
+ - '1'
787
+ - '2'
788
+ - '3'
789
+ - '4'
790
+ - '5'
791
+ - '6'
792
+ - '7'
793
+ - '8'
794
+ - '9'
795
+ - '10'
796
+ version: 3.3.0
797
+ weight: 1.0
798
+ colliderml:
799
+ batch_size: 1
800
+ samples:
801
+ - name: colliderml_ttbar_nopu_pf
802
+ splits:
803
+ - '1'
804
+ - '2'
805
+ - '3'
806
+ - '4'
807
+ - '5'
808
+ - '6'
809
+ - '7'
810
+ - '8'
811
+ - '9'
812
+ - '10'
813
+ version: 1.5.0
814
+ weight: 1.0
815
+ val_freq: 10000
816
+ validation_datasets:
817
+ cld:
818
+ batch_size: 1
819
+ samples:
820
+ - name: cld_edm_ttbar_pf
821
+ splits:
822
+ - '1'
823
+ - '2'
824
+ - '3'
825
+ - '4'
826
+ - '5'
827
+ - '6'
828
+ - '7'
829
+ - '8'
830
+ - '9'
831
+ - '10'
832
+ version: 3.3.0
833
+ - name: cld_edm_ww_fullhad_pf
834
+ splits:
835
+ - '1'
836
+ - '2'
837
+ - '3'
838
+ - '4'
839
+ - '5'
840
+ - '6'
841
+ - '7'
842
+ - '8'
843
+ - '9'
844
+ - '10'
845
+ version: 3.3.0
846
+ - name: cld_edm_qq_pf
847
+ splits:
848
+ - '1'
849
+ - '2'
850
+ - '3'
851
+ - '4'
852
+ - '5'
853
+ - '6'
854
+ - '7'
855
+ - '8'
856
+ - '9'
857
+ - '10'
858
+ version: 3.3.0
859
+ clic:
860
+ batch_size: 1
861
+ samples:
862
+ - name: clic_edm_ttbar_pf
863
+ splits:
864
+ - '1'
865
+ - '2'
866
+ - '3'
867
+ - '4'
868
+ - '5'
869
+ - '6'
870
+ - '7'
871
+ - '8'
872
+ - '9'
873
+ - '10'
874
+ version: 3.3.0
875
+ - name: clic_edm_ww_fullhad_pf
876
+ splits:
877
+ - '1'
878
+ - '2'
879
+ - '3'
880
+ - '4'
881
+ - '5'
882
+ - '6'
883
+ - '7'
884
+ - '8'
885
+ - '9'
886
+ - '10'
887
+ version: 3.3.0
888
+ - name: clic_edm_qq_pf
889
+ splits:
890
+ - '1'
891
+ - '2'
892
+ - '3'
893
+ - '4'
894
+ - '5'
895
+ - '6'
896
+ - '7'
897
+ - '8'
898
+ - '9'
899
+ - '10'
900
+ version: 3.3.0
901
+ colliderml:
902
+ batch_size: 1
903
+ samples:
904
+ - name: colliderml_ttbar_nopu_pf
905
+ splits:
906
+ - '1'
907
+ - '2'
908
+ - '3'
909
+ - '4'
910
+ - '5'
911
+ - '6'
912
+ - '7'
913
+ - '8'
914
+ - '9'
915
+ - '10'
916
+ version: 1.5.0
917
+ pyg-clic-hits-set-v1:
918
+ architecture:
919
+ attention: &id008
920
+ head_dim: 16
921
+ num_convs: 3
922
+ num_heads: 16
923
+ binary_classification_focal_gamma: 2.0
924
+ input_encoding: split
925
+ output_mode: set
926
+ set_decoder:
927
+ dropout: 0.0
928
+ ffn_multiplier: 4.0
929
+ num_heads: 8
930
+ num_layers: 2
931
+ num_slots: 256
932
+ type: attention
933
+ backend: pytorch
934
+ checkpoint_freq: 10000
935
+ comet: false
936
+ dataset: clic_hits
937
+ dtype: bfloat16
938
+ gpu_batch_multiplier: 16
939
+ gpu_type: l40
940
+ gpus: 1
941
+ hyperparameters:
942
+ batch_size: 1
943
+ lr: 0.0001
944
+ load: null
945
+ lr_schedule: cosinedecay
946
+ mem_per_gpu_mb: 40000
947
+ ntest: 100
948
+ ntrain: null
949
+ num_steps: 100000
950
+ num_workers: 2
951
+ nvalid: null
952
+ optimizer: lamb
953
+ patience: 10000
954
+ prefetch_factor: 2
955
+ raytune: *id001
956
+ seed: 12345
957
+ slurm_partition: ${project.gpu_partition}
958
+ slurm_runtime: 168h
959
+ sort_data: false
960
+ task_loss_weights: *id002
961
+ tensorboard_step_freq: 100
962
+ test_datasets: &id009
963
+ - name: clic_edm_ttbar_hits
964
+ splits:
965
+ - '1'
966
+ - '2'
967
+ - '3'
968
+ - '4'
969
+ - '5'
970
+ - '6'
971
+ - '7'
972
+ - '8'
973
+ - '9'
974
+ - '10'
975
+ version: 3.2.2
976
+ - name: clic_edm_ww_fullhad_hits
977
+ splits:
978
+ - '1'
979
+ - '2'
980
+ - '3'
981
+ - '4'
982
+ - '5'
983
+ - '6'
984
+ - '7'
985
+ - '8'
986
+ - '9'
987
+ - '10'
988
+ version: 3.2.2
989
+ - name: clic_edm_qq_hits
990
+ splits:
991
+ - '1'
992
+ - '2'
993
+ - '3'
994
+ - '4'
995
+ - '5'
996
+ - '6'
997
+ - '7'
998
+ - '8'
999
+ - '9'
1000
+ - '10'
1001
+ version: 3.2.2
1002
+ threads: 16
1003
+ train_datasets: &id010
1004
+ physical:
1005
+ batch_size: 1
1006
+ samples:
1007
+ - name: clic_edm_ttbar_hits
1008
+ splits:
1009
+ - '1'
1010
+ - '2'
1011
+ - '3'
1012
+ - '4'
1013
+ - '5'
1014
+ - '6'
1015
+ - '7'
1016
+ - '8'
1017
+ - '9'
1018
+ - '10'
1019
+ version: 3.2.2
1020
+ - name: clic_edm_ww_fullhad_hits
1021
+ splits:
1022
+ - '1'
1023
+ - '2'
1024
+ - '3'
1025
+ - '4'
1026
+ - '5'
1027
+ - '6'
1028
+ - '7'
1029
+ - '8'
1030
+ - '9'
1031
+ - '10'
1032
+ version: 3.2.2
1033
+ - name: clic_edm_qq_hits
1034
+ splits:
1035
+ - '1'
1036
+ - '2'
1037
+ - '3'
1038
+ - '4'
1039
+ - '5'
1040
+ - '6'
1041
+ - '7'
1042
+ - '8'
1043
+ - '9'
1044
+ - '10'
1045
+ version: 3.2.2
1046
+ val_freq: 10000
1047
+ validation_datasets: &id011
1048
+ physical:
1049
+ batch_size: 1
1050
+ samples:
1051
+ - name: clic_edm_ttbar_hits
1052
+ splits:
1053
+ - '1'
1054
+ - '2'
1055
+ - '3'
1056
+ - '4'
1057
+ - '5'
1058
+ - '6'
1059
+ - '7'
1060
+ - '8'
1061
+ - '9'
1062
+ - '10'
1063
+ version: 3.2.2
1064
+ - name: clic_edm_ww_fullhad_hits
1065
+ splits:
1066
+ - '1'
1067
+ - '2'
1068
+ - '3'
1069
+ - '4'
1070
+ - '5'
1071
+ - '6'
1072
+ - '7'
1073
+ - '8'
1074
+ - '9'
1075
+ - '10'
1076
+ version: 3.2.2
1077
+ - name: clic_edm_qq_hits
1078
+ splits:
1079
+ - '1'
1080
+ - '2'
1081
+ - '3'
1082
+ - '4'
1083
+ - '5'
1084
+ - '6'
1085
+ - '7'
1086
+ - '8'
1087
+ - '9'
1088
+ - '10'
1089
+ version: 3.2.2
1090
+ pyg-clic-hits-v1:
1091
+ architecture:
1092
+ attention: *id008
1093
+ binary_classification_focal_gamma: 2.0
1094
+ input_encoding: split
1095
+ output_mode: elementwise
1096
+ type: attention
1097
+ backend: pytorch
1098
+ checkpoint_freq: 10000
1099
+ comet: false
1100
+ dataset: clic_hits
1101
+ dtype: bfloat16
1102
+ gpu_batch_multiplier: 16
1103
+ gpu_type: l40
1104
+ gpus: 1
1105
+ hyperparameters:
1106
+ batch_size: 1
1107
+ lr: 0.0001
1108
+ load: null
1109
+ lr_schedule: cosinedecay
1110
+ mem_per_gpu_mb: 40000
1111
+ ntest: 100
1112
+ ntrain: null
1113
+ num_steps: 100000
1114
+ num_workers: 2
1115
+ nvalid: null
1116
+ optimizer: lamb
1117
+ patience: 10000
1118
+ prefetch_factor: 2
1119
+ raytune: *id001
1120
+ seed: 12345
1121
+ slurm_partition: ${project.gpu_partition}
1122
+ slurm_runtime: 168h
1123
+ sort_data: false
1124
+ task_loss_weights: *id002
1125
+ tensorboard_step_freq: 100
1126
+ test_datasets: *id009
1127
+ threads: 16
1128
+ train_datasets: *id010
1129
+ val_freq: 10000
1130
+ validation_datasets: *id011
1131
+ pyg-clic-v1:
1132
+ architecture:
1133
+ attention:
1134
+ head_dim: 16
1135
+ num_convs: 3
1136
+ num_heads: 16
1137
+ heptv2:
1138
+ cluster_hash_at_centroid: true
1139
+ track_hash_at_calo: true
1140
+ input_encoding: split
1141
+ type: attention
1142
+ backend: pytorch
1143
+ checkpoint_freq: 10000
1144
+ comet: false
1145
+ dataset: clic
1146
+ dtype: bfloat16
1147
+ gpu_batch_multiplier: 1024
1148
+ gpu_type: l40
1149
+ gpus: 1
1150
+ hyperparameters:
1151
+ batch_size: 1
1152
+ lr: 0.0005
1153
+ load: null
1154
+ lr_schedule: cosinedecay
1155
+ mem_per_gpu_mb: 40000
1156
+ ntest: 100
1157
+ ntrain: null
1158
+ num_steps: 100000
1159
+ num_workers: 2
1160
+ nvalid: null
1161
+ optimizer: lamb
1162
+ patience: 10000
1163
+ prefetch_factor: 2
1164
+ raytune: *id001
1165
+ seed: 12345
1166
+ slurm_partition: ${project.gpu_partition}
1167
+ slurm_runtime: 168h
1168
+ sort_data: false
1169
+ task_loss_weights: *id002
1170
+ tensorboard_step_freq: 100
1171
+ test_datasets:
1172
+ - name: clic_edm_ttbar_pf
1173
+ splits:
1174
+ - '1'
1175
+ - '2'
1176
+ - '3'
1177
+ - '4'
1178
+ - '5'
1179
+ - '6'
1180
+ - '7'
1181
+ - '8'
1182
+ - '9'
1183
+ - '10'
1184
+ version: 3.3.0
1185
+ - name: clic_edm_ww_fullhad_pf
1186
+ splits:
1187
+ - '1'
1188
+ - '2'
1189
+ - '3'
1190
+ - '4'
1191
+ - '5'
1192
+ - '6'
1193
+ - '7'
1194
+ - '8'
1195
+ - '9'
1196
+ - '10'
1197
+ version: 3.3.0
1198
+ - name: clic_edm_qq_pf
1199
+ splits:
1200
+ - '1'
1201
+ - '2'
1202
+ - '3'
1203
+ - '4'
1204
+ - '5'
1205
+ - '6'
1206
+ - '7'
1207
+ - '8'
1208
+ - '9'
1209
+ - '10'
1210
+ version: 3.3.0
1211
+ threads: 16
1212
+ train_datasets:
1213
+ physical:
1214
+ batch_size: 1
1215
+ samples:
1216
+ - name: clic_edm_ttbar_pf
1217
+ splits:
1218
+ - '1'
1219
+ - '2'
1220
+ - '3'
1221
+ - '4'
1222
+ - '5'
1223
+ - '6'
1224
+ - '7'
1225
+ - '8'
1226
+ - '9'
1227
+ - '10'
1228
+ version: 3.3.0
1229
+ - name: clic_edm_ww_fullhad_pf
1230
+ splits:
1231
+ - '1'
1232
+ - '2'
1233
+ - '3'
1234
+ - '4'
1235
+ - '5'
1236
+ - '6'
1237
+ - '7'
1238
+ - '8'
1239
+ - '9'
1240
+ - '10'
1241
+ version: 3.3.0
1242
+ - name: clic_edm_qq_pf
1243
+ splits:
1244
+ - '1'
1245
+ - '2'
1246
+ - '3'
1247
+ - '4'
1248
+ - '5'
1249
+ - '6'
1250
+ - '7'
1251
+ - '8'
1252
+ - '9'
1253
+ - '10'
1254
+ version: 3.3.0
1255
+ val_freq: 10000
1256
+ validation_datasets:
1257
+ physical:
1258
+ batch_size: 1
1259
+ samples:
1260
+ - name: clic_edm_ttbar_pf
1261
+ splits:
1262
+ - '1'
1263
+ - '2'
1264
+ - '3'
1265
+ - '4'
1266
+ - '5'
1267
+ - '6'
1268
+ - '7'
1269
+ - '8'
1270
+ - '9'
1271
+ - '10'
1272
+ version: 3.3.0
1273
+ - name: clic_edm_ww_fullhad_pf
1274
+ splits:
1275
+ - '1'
1276
+ - '2'
1277
+ - '3'
1278
+ - '4'
1279
+ - '5'
1280
+ - '6'
1281
+ - '7'
1282
+ - '8'
1283
+ - '9'
1284
+ - '10'
1285
+ version: 3.3.0
1286
+ - name: clic_edm_qq_pf
1287
+ splits:
1288
+ - '1'
1289
+ - '2'
1290
+ - '3'
1291
+ - '4'
1292
+ - '5'
1293
+ - '6'
1294
+ - '7'
1295
+ - '8'
1296
+ - '9'
1297
+ - '10'
1298
+ version: 3.3.0
1299
+ pyg-cms-v1:
1300
+ architecture:
1301
+ attention:
1302
+ head_dim: 32
1303
+ num_convs: 3
1304
+ num_heads: 16
1305
+ heptv2:
1306
+ track_hash_at_calo: true
1307
+ input_encoding: split
1308
+ type: attention
1309
+ backend: pytorch
1310
+ checkpoint_freq: 10000
1311
+ comet: false
1312
+ dataset: cms
1313
+ dtype: bfloat16
1314
+ gpu_batch_multiplier: 4
1315
+ gpu_type: l40
1316
+ gpus: 1
1317
+ hyperparameters:
1318
+ batch_size: 1
1319
+ lr: 0.0004
1320
+ load: null
1321
+ lr_schedule: cosinedecay
1322
+ mem_per_gpu_mb: 40000
1323
+ ntest: 100
1324
+ ntrain: null
1325
+ num_steps: 100000
1326
+ num_workers: 2
1327
+ nvalid: null
1328
+ optimizer: lamb
1329
+ patience: 10000
1330
+ prefetch_factor: 2
1331
+ raytune: *id001
1332
+ seed: 12345
1333
+ slurm_partition: ${project.gpu_partition}
1334
+ slurm_runtime: 168h
1335
+ sort_data: false
1336
+ task_loss_weights: *id002
1337
+ tensorboard_step_freq: 100
1338
+ test_datasets:
1339
+ - name: cms_pf_ttbar
1340
+ splits:
1341
+ - '1'
1342
+ - '2'
1343
+ - '3'
1344
+ - '4'
1345
+ - '5'
1346
+ - '6'
1347
+ - '7'
1348
+ - '8'
1349
+ - '9'
1350
+ - '10'
1351
+ version: 3.2.0
1352
+ - name: cms_pf_qcd
1353
+ splits:
1354
+ - '1'
1355
+ - '2'
1356
+ - '3'
1357
+ - '4'
1358
+ - '5'
1359
+ - '6'
1360
+ - '7'
1361
+ - '8'
1362
+ - '9'
1363
+ - '10'
1364
+ version: 3.2.0
1365
+ - name: cms_pf_ztt
1366
+ splits:
1367
+ - '1'
1368
+ - '2'
1369
+ - '3'
1370
+ - '4'
1371
+ - '5'
1372
+ - '6'
1373
+ - '7'
1374
+ - '8'
1375
+ - '9'
1376
+ - '10'
1377
+ version: 3.2.0
1378
+ threads: 16
1379
+ train_datasets:
1380
+ physical_nopu:
1381
+ batch_size: 16
1382
+ samples:
1383
+ - name: cms_pf_ttbar_nopu
1384
+ splits:
1385
+ - '1'
1386
+ - '2'
1387
+ - '3'
1388
+ - '4'
1389
+ - '5'
1390
+ - '6'
1391
+ - '7'
1392
+ - '8'
1393
+ - '9'
1394
+ - '10'
1395
+ version: 3.2.0
1396
+ - name: cms_pf_qcd_nopu
1397
+ splits:
1398
+ - '1'
1399
+ - '2'
1400
+ - '3'
1401
+ - '4'
1402
+ - '5'
1403
+ - '6'
1404
+ - '7'
1405
+ - '8'
1406
+ - '9'
1407
+ - '10'
1408
+ version: 3.2.0
1409
+ - name: cms_pf_ztt_nopu
1410
+ splits:
1411
+ - '1'
1412
+ - '2'
1413
+ - '3'
1414
+ - '4'
1415
+ - '5'
1416
+ - '6'
1417
+ - '7'
1418
+ - '8'
1419
+ - '9'
1420
+ - '10'
1421
+ version: 3.2.0
1422
+ physical_pu:
1423
+ batch_size: 1
1424
+ samples:
1425
+ - name: cms_pf_ttbar
1426
+ splits:
1427
+ - '1'
1428
+ - '2'
1429
+ - '3'
1430
+ - '4'
1431
+ - '5'
1432
+ - '6'
1433
+ - '7'
1434
+ - '8'
1435
+ - '9'
1436
+ - '10'
1437
+ version: 3.2.0
1438
+ - name: cms_pf_qcd
1439
+ splits:
1440
+ - '1'
1441
+ - '2'
1442
+ - '3'
1443
+ - '4'
1444
+ - '5'
1445
+ - '6'
1446
+ - '7'
1447
+ - '8'
1448
+ - '9'
1449
+ - '10'
1450
+ version: 3.2.0
1451
+ - name: cms_pf_ztt
1452
+ splits:
1453
+ - '1'
1454
+ - '2'
1455
+ - '3'
1456
+ - '4'
1457
+ - '5'
1458
+ - '6'
1459
+ - '7'
1460
+ - '8'
1461
+ - '9'
1462
+ - '10'
1463
+ version: 3.2.0
1464
+ val_freq: 10000
1465
+ validation_datasets:
1466
+ physical_nopu:
1467
+ batch_size: 16
1468
+ samples:
1469
+ - name: cms_pf_ttbar_nopu
1470
+ splits:
1471
+ - '1'
1472
+ - '2'
1473
+ - '3'
1474
+ - '4'
1475
+ - '5'
1476
+ - '6'
1477
+ - '7'
1478
+ - '8'
1479
+ - '9'
1480
+ - '10'
1481
+ version: 3.2.0
1482
+ - name: cms_pf_qcd_nopu
1483
+ splits:
1484
+ - '1'
1485
+ - '2'
1486
+ - '3'
1487
+ - '4'
1488
+ - '5'
1489
+ - '6'
1490
+ - '7'
1491
+ - '8'
1492
+ - '9'
1493
+ - '10'
1494
+ version: 3.2.0
1495
+ - name: cms_pf_ztt_nopu
1496
+ splits:
1497
+ - '1'
1498
+ - '2'
1499
+ - '3'
1500
+ - '4'
1501
+ - '5'
1502
+ - '6'
1503
+ - '7'
1504
+ - '8'
1505
+ - '9'
1506
+ - '10'
1507
+ version: 3.2.0
1508
+ physical_pu:
1509
+ batch_size: 1
1510
+ samples:
1511
+ - name: cms_pf_ttbar
1512
+ splits:
1513
+ - '1'
1514
+ - '2'
1515
+ - '3'
1516
+ - '4'
1517
+ - '5'
1518
+ - '6'
1519
+ - '7'
1520
+ - '8'
1521
+ - '9'
1522
+ - '10'
1523
+ version: 3.2.0
1524
+ - name: cms_pf_qcd
1525
+ splits:
1526
+ - '1'
1527
+ - '2'
1528
+ - '3'
1529
+ - '4'
1530
+ - '5'
1531
+ - '6'
1532
+ - '7'
1533
+ - '8'
1534
+ - '9'
1535
+ - '10'
1536
+ version: 3.2.0
1537
+ - name: cms_pf_ztt
1538
+ splits:
1539
+ - '1'
1540
+ - '2'
1541
+ - '3'
1542
+ - '4'
1543
+ - '5'
1544
+ - '6'
1545
+ - '7'
1546
+ - '8'
1547
+ - '9'
1548
+ - '10'
1549
+ version: 3.2.0
1550
+ pyg-colliderml-hits-set-v1:
1551
+ architecture:
1552
+ attention: &id012
1553
+ attention_type: flash
1554
+ head_dim: 16
1555
+ num_convs: 3
1556
+ num_heads: 16
1557
+ input_encoding: split
1558
+ output_mode: set
1559
+ set_decoder:
1560
+ dropout: 0.0
1561
+ ffn_multiplier: 4.0
1562
+ num_heads: 8
1563
+ num_layers: 2
1564
+ num_slots: 512
1565
+ type: attention
1566
+ backend: pytorch
1567
+ checkpoint_freq: 10000
1568
+ comet: false
1569
+ dataset: colliderml_hits
1570
+ dtype: bfloat16
1571
+ gpu_batch_multiplier: 1
1572
+ gpu_type: l40
1573
+ gpus: 1
1574
+ hyperparameters: &id013
1575
+ batch_size: 1
1576
+ lr: 0.0001
1577
+ load: null
1578
+ lr_schedule: cosinedecay
1579
+ mem_per_gpu_mb: 40000
1580
+ ntest: 100
1581
+ ntrain: null
1582
+ num_steps: 100000
1583
+ num_workers: 2
1584
+ nvalid: null
1585
+ optimizer: lamb
1586
+ pad_to_multiple_elements: 128
1587
+ patience: 10000
1588
+ prefetch_factor: 2
1589
+ raytune: *id001
1590
+ seed: 12345
1591
+ slurm_partition: ${project.gpu_partition}
1592
+ slurm_runtime: 168h
1593
+ sort_data: false
1594
+ task_loss_weights: *id002
1595
+ tensorboard_step_freq: 100
1596
+ test_datasets: &id014
1597
+ - name: colliderml_ttbar_hits
1598
+ splits:
1599
+ - '1'
1600
+ - '2'
1601
+ - '3'
1602
+ - '4'
1603
+ - '5'
1604
+ - '6'
1605
+ - '7'
1606
+ - '8'
1607
+ - '9'
1608
+ - '10'
1609
+ version: 1.3.0
1610
+ threads: 16
1611
+ train_datasets: &id015
1612
+ physical:
1613
+ batch_size: 1
1614
+ samples:
1615
+ - name: colliderml_ttbar_hits
1616
+ splits:
1617
+ - '1'
1618
+ - '2'
1619
+ - '3'
1620
+ - '4'
1621
+ - '5'
1622
+ - '6'
1623
+ - '7'
1624
+ - '8'
1625
+ - '9'
1626
+ - '10'
1627
+ version: 1.3.0
1628
+ val_freq: 10000
1629
+ validation_datasets: &id016
1630
+ physical:
1631
+ batch_size: 1
1632
+ samples:
1633
+ - name: colliderml_ttbar_hits
1634
+ splits:
1635
+ - '1'
1636
+ - '2'
1637
+ - '3'
1638
+ - '4'
1639
+ - '5'
1640
+ - '6'
1641
+ - '7'
1642
+ - '8'
1643
+ - '9'
1644
+ - '10'
1645
+ version: 1.3.0
1646
+ pyg-colliderml-hits-v1:
1647
+ architecture:
1648
+ attention: *id012
1649
+ input_encoding: split
1650
+ type: attention
1651
+ backend: pytorch
1652
+ checkpoint_freq: 10000
1653
+ comet: false
1654
+ dataset: colliderml_hits
1655
+ dtype: bfloat16
1656
+ gpu_batch_multiplier: 8
1657
+ gpu_type: l40
1658
+ gpus: 1
1659
+ hyperparameters: *id013
1660
+ load: null
1661
+ lr_schedule: cosinedecay
1662
+ mem_per_gpu_mb: 40000
1663
+ ntest: 100
1664
+ ntrain: null
1665
+ num_steps: 100000
1666
+ num_workers: 2
1667
+ nvalid: null
1668
+ optimizer: lamb
1669
+ patience: 10000
1670
+ prefetch_factor: 2
1671
+ raytune: *id001
1672
+ seed: 12345
1673
+ slurm_partition: ${project.gpu_partition}
1674
+ slurm_runtime: 168h
1675
+ sort_data: false
1676
+ task_loss_weights: *id002
1677
+ tensorboard_step_freq: 100
1678
+ test_datasets: *id014
1679
+ threads: 16
1680
+ train_datasets: *id015
1681
+ val_freq: 10000
1682
+ validation_datasets: *id016
1683
+ pyg-colliderml-pu0pu200-groups-v1:
1684
+ architecture: &id017
1685
+ attention:
1686
+ attention_type: flash
1687
+ head_dim: 16
1688
+ num_convs: 3
1689
+ num_heads: 16
1690
+ heptv2:
1691
+ track_hash_at_calo: true
1692
+ input_encoding: split
1693
+ type: attention
1694
+ backend: pytorch
1695
+ checkpoint_freq: 10000
1696
+ comet: false
1697
+ dataset: colliderml
1698
+ dtype: bfloat16
1699
+ gpu_batch_multiplier: 1
1700
+ gpu_type: l40
1701
+ gpus: 1
1702
+ hyperparameters: &id018
1703
+ batch_size: 1
1704
+ lr: 0.0001
1705
+ load: null
1706
+ lr_schedule: cosinedecay
1707
+ mem_per_gpu_mb: 40000
1708
+ ntest: 100
1709
+ ntrain: null
1710
+ num_steps: 100000
1711
+ num_workers: 2
1712
+ nvalid: null
1713
+ optimizer: lamb
1714
+ patience: 10000
1715
+ prefetch_factor: 2
1716
+ raytune: *id001
1717
+ seed: 12345
1718
+ slurm_partition: ${project.gpu_partition}
1719
+ slurm_runtime: 168h
1720
+ sort_data: false
1721
+ task_loss_weights: *id002
1722
+ tensorboard_step_freq: 100
1723
+ test_datasets:
1724
+ - name: colliderml_ttbar_nopu_pf
1725
+ splits:
1726
+ - '1'
1727
+ - '2'
1728
+ - '3'
1729
+ - '4'
1730
+ - '5'
1731
+ - '6'
1732
+ - '7'
1733
+ - '8'
1734
+ - '9'
1735
+ - '10'
1736
+ version: 1.5.0
1737
+ - name: colliderml_ttbar_pu200_pf
1738
+ splits:
1739
+ - '1'
1740
+ - '2'
1741
+ - '3'
1742
+ - '4'
1743
+ - '5'
1744
+ - '6'
1745
+ - '7'
1746
+ - '8'
1747
+ - '9'
1748
+ - '10'
1749
+ version: 1.5.0
1750
+ threads: 16
1751
+ train_datasets:
1752
+ pu0:
1753
+ batch_size: 12
1754
+ samples:
1755
+ - name: colliderml_ttbar_nopu_pf
1756
+ splits:
1757
+ - '1'
1758
+ - '2'
1759
+ - '3'
1760
+ - '4'
1761
+ - '5'
1762
+ - '6'
1763
+ - '7'
1764
+ - '8'
1765
+ - '9'
1766
+ - '10'
1767
+ version: 1.5.0
1768
+ pu200:
1769
+ batch_size: 1
1770
+ samples:
1771
+ - name: colliderml_ttbar_pu200_pf
1772
+ splits:
1773
+ - '1'
1774
+ - '2'
1775
+ - '3'
1776
+ - '4'
1777
+ - '5'
1778
+ - '6'
1779
+ - '7'
1780
+ - '8'
1781
+ - '9'
1782
+ - '10'
1783
+ version: 1.5.0
1784
+ val_freq: 10000
1785
+ validation_datasets:
1786
+ pu0:
1787
+ batch_size: 12
1788
+ samples:
1789
+ - name: colliderml_ttbar_nopu_pf
1790
+ splits:
1791
+ - '1'
1792
+ - '2'
1793
+ - '3'
1794
+ - '4'
1795
+ - '5'
1796
+ - '6'
1797
+ - '7'
1798
+ - '8'
1799
+ - '9'
1800
+ - '10'
1801
+ version: 1.5.0
1802
+ pu200:
1803
+ batch_size: 1
1804
+ samples:
1805
+ - name: colliderml_ttbar_pu200_pf
1806
+ splits:
1807
+ - '1'
1808
+ - '2'
1809
+ - '3'
1810
+ - '4'
1811
+ - '5'
1812
+ - '6'
1813
+ - '7'
1814
+ - '8'
1815
+ - '9'
1816
+ - '10'
1817
+ version: 1.5.0
1818
+ pyg-colliderml-pu200-v1:
1819
+ architecture:
1820
+ attention:
1821
+ attention_type: flash
1822
+ head_dim: 16
1823
+ num_convs: 3
1824
+ num_heads: 16
1825
+ heptv2:
1826
+ track_hash_at_calo: true
1827
+ input_encoding: split
1828
+ type: attention
1829
+ backend: pytorch
1830
+ checkpoint_freq: 10000
1831
+ comet: false
1832
+ dataset: colliderml
1833
+ dtype: bfloat16
1834
+ gpu_batch_multiplier: 8
1835
+ gpu_type: l40
1836
+ gpus: 1
1837
+ hyperparameters:
1838
+ batch_size: 1
1839
+ lr: 0.0001
1840
+ load: null
1841
+ lr_schedule: cosinedecay
1842
+ mem_per_gpu_mb: 40000
1843
+ ntest: 100
1844
+ ntrain: null
1845
+ num_steps: 100000
1846
+ num_workers: 2
1847
+ nvalid: null
1848
+ optimizer: lamb
1849
+ patience: 10000
1850
+ prefetch_factor: 2
1851
+ raytune: *id001
1852
+ seed: 12345
1853
+ slurm_partition: ${project.gpu_partition}
1854
+ slurm_runtime: 168h
1855
+ sort_data: false
1856
+ task_loss_weights: *id002
1857
+ tensorboard_step_freq: 100
1858
+ test_datasets:
1859
+ - name: colliderml_ttbar_pu200_pf
1860
+ splits:
1861
+ - '1'
1862
+ - '2'
1863
+ - '3'
1864
+ - '4'
1865
+ - '5'
1866
+ - '6'
1867
+ - '7'
1868
+ - '8'
1869
+ - '9'
1870
+ - '10'
1871
+ version: 1.5.0
1872
+ threads: 16
1873
+ train_datasets:
1874
+ physical:
1875
+ batch_size: 1
1876
+ samples:
1877
+ - name: colliderml_ttbar_pu200_pf
1878
+ splits:
1879
+ - '1'
1880
+ - '2'
1881
+ - '3'
1882
+ - '4'
1883
+ - '5'
1884
+ - '6'
1885
+ - '7'
1886
+ - '8'
1887
+ - '9'
1888
+ - '10'
1889
+ version: 1.5.0
1890
+ val_freq: 10000
1891
+ validation_datasets:
1892
+ physical:
1893
+ batch_size: 1
1894
+ samples:
1895
+ - name: colliderml_ttbar_pu200_pf
1896
+ splits:
1897
+ - '1'
1898
+ - '2'
1899
+ - '3'
1900
+ - '4'
1901
+ - '5'
1902
+ - '6'
1903
+ - '7'
1904
+ - '8'
1905
+ - '9'
1906
+ - '10'
1907
+ version: 1.5.0
1908
+ pyg-colliderml-v1:
1909
+ architecture: *id017
1910
+ backend: pytorch
1911
+ checkpoint_freq: 10000
1912
+ comet: false
1913
+ dataset: colliderml
1914
+ dtype: bfloat16
1915
+ gpu_batch_multiplier: 8
1916
+ gpu_type: l40
1917
+ gpus: 1
1918
+ hyperparameters: *id018
1919
+ load: null
1920
+ lr_schedule: cosinedecay
1921
+ mem_per_gpu_mb: 40000
1922
+ ntest: 100
1923
+ ntrain: null
1924
+ num_steps: 100000
1925
+ num_workers: 2
1926
+ nvalid: null
1927
+ optimizer: lamb
1928
+ patience: 10000
1929
+ prefetch_factor: 2
1930
+ raytune: *id001
1931
+ seed: 12345
1932
+ slurm_partition: ${project.gpu_partition}
1933
+ slurm_runtime: 168h
1934
+ sort_data: false
1935
+ task_loss_weights: *id002
1936
+ tensorboard_step_freq: 100
1937
+ test_datasets:
1938
+ - name: colliderml_ttbar_nopu_pf
1939
+ splits:
1940
+ - '1'
1941
+ - '2'
1942
+ - '3'
1943
+ - '4'
1944
+ - '5'
1945
+ - '6'
1946
+ - '7'
1947
+ - '8'
1948
+ - '9'
1949
+ - '10'
1950
+ version: 1.5.0
1951
+ threads: 16
1952
+ train_datasets:
1953
+ physical:
1954
+ batch_size: 1
1955
+ samples:
1956
+ - name: colliderml_ttbar_nopu_pf
1957
+ splits:
1958
+ - '1'
1959
+ - '2'
1960
+ - '3'
1961
+ - '4'
1962
+ - '5'
1963
+ - '6'
1964
+ - '7'
1965
+ - '8'
1966
+ - '9'
1967
+ - '10'
1968
+ version: 1.5.0
1969
+ val_freq: 10000
1970
+ validation_datasets:
1971
+ physical:
1972
+ batch_size: 1
1973
+ samples:
1974
+ - name: colliderml_ttbar_nopu_pf
1975
+ splits:
1976
+ - '1'
1977
+ - '2'
1978
+ - '3'
1979
+ - '4'
1980
+ - '5'
1981
+ - '6'
1982
+ - '7'
1983
+ - '8'
1984
+ - '9'
1985
+ - '10'
1986
+ version: 1.5.0
1987
+ pyg-idea-pipeline-v1:
1988
+ architecture:
1989
+ heptv2:
1990
+ block_size: 100
1991
+ dropout_ff: 0.0
1992
+ embedding_dim: 256
1993
+ num_convs: 3
1994
+ num_heads: 16
1995
+ track_hash_at_calo: true
1996
+ width: 256
1997
+ input_encoding: split
1998
+ type: heptv2
1999
+ backend: pytorch
2000
+ checkpoint_freq: 10000
2001
+ comet: false
2002
+ dataset: idea
2003
+ dtype: bfloat16
2004
+ gpu_batch_multiplier: 16
2005
+ gpu_type: l40
2006
+ gpus: 1
2007
+ hyperparameters:
2008
+ batch_size: 1
2009
+ lr: 0.0005
2010
+ load: null
2011
+ lr_schedule: cosinedecay
2012
+ mem_per_gpu_mb: 40000
2013
+ ntest: 100
2014
+ ntrain: null
2015
+ num_steps: 100000
2016
+ num_workers: 2
2017
+ nvalid: null
2018
+ optimizer: lamb
2019
+ pad_to_multiple_elements: 100
2020
+ patience: 10000
2021
+ prefetch_factor: 2
2022
+ raytune: *id001
2023
+ seed: 12345
2024
+ slurm_partition: ${project.gpu_partition}
2025
+ slurm_runtime: 168h
2026
+ sort_data: false
2027
+ task_loss_weights: *id002
2028
+ tensorboard_step_freq: 100
2029
+ test_datasets:
2030
+ - name: idea_edm_qq_pf
2031
+ splits:
2032
+ - '1'
2033
+ version: 0.2.1
2034
+ - name: idea_edm_ttbar_pf
2035
+ splits:
2036
+ - '1'
2037
+ version: 0.2.1
2038
+ - name: idea_edm_ww_fullhad_pf
2039
+ splits:
2040
+ - '1'
2041
+ version: 0.2.1
2042
+ threads: 16
2043
+ train_datasets:
2044
+ physical:
2045
+ batch_size: 1
2046
+ samples:
2047
+ - name: idea_edm_qq_pf
2048
+ splits:
2049
+ - '1'
2050
+ version: 0.2.1
2051
+ - name: idea_edm_ttbar_pf
2052
+ splits:
2053
+ - '1'
2054
+ version: 0.2.1
2055
+ - name: idea_edm_ww_fullhad_pf
2056
+ splits:
2057
+ - '1'
2058
+ version: 0.2.1
2059
+ val_freq: 10000
2060
+ validation_datasets:
2061
+ physical:
2062
+ batch_size: 1
2063
+ samples:
2064
+ - name: idea_edm_qq_pf
2065
+ splits:
2066
+ - '1'
2067
+ version: 0.2.1
2068
+ - name: idea_edm_ttbar_pf
2069
+ splits:
2070
+ - '1'
2071
+ version: 0.2.1
2072
+ - name: idea_edm_ww_fullhad_pf
2073
+ splits:
2074
+ - '1'
2075
+ version: 0.2.1
2076
+ pyg-maia-v1:
2077
+ architecture:
2078
+ attention:
2079
+ head_dim: 16
2080
+ num_convs: 3
2081
+ num_heads: 16
2082
+ input_encoding: split
2083
+ type: attention
2084
+ backend: pytorch
2085
+ checkpoint_freq: 10000
2086
+ comet: false
2087
+ dataset: maia
2088
+ dtype: bfloat16
2089
+ gpu_batch_multiplier: 1
2090
+ gpu_type: l40
2091
+ gpus: 1
2092
+ hyperparameters:
2093
+ batch_size: 1
2094
+ lr: 0.0001
2095
+ load: null
2096
+ lr_schedule: cosinedecay
2097
+ mem_per_gpu_mb: 40000
2098
+ ntest: 100
2099
+ ntrain: null
2100
+ num_steps: 100000
2101
+ num_workers: 2
2102
+ nvalid: null
2103
+ optimizer: lamb
2104
+ patience: 10000
2105
+ prefetch_factor: 2
2106
+ raytune: *id001
2107
+ seed: 12345
2108
+ slurm_partition: ${project.gpu_partition}
2109
+ slurm_runtime: 168h
2110
+ sort_data: false
2111
+ task_loss_weights: *id002
2112
+ tensorboard_step_freq: 100
2113
+ test_datasets:
2114
+ - name: maia_edm_ttbar_pf
2115
+ splits:
2116
+ - '10'
2117
+ version: 1.1.0
2118
+ threads: 16
2119
+ train_datasets:
2120
+ physical:
2121
+ batch_size: 1
2122
+ samples:
2123
+ - name: maia_edm_ttbar_pf
2124
+ splits:
2125
+ - '10'
2126
+ version: 1.1.0
2127
+ val_freq: 10000
2128
+ validation_datasets:
2129
+ physical:
2130
+ batch_size: 1
2131
+ samples:
2132
+ - name: maia_edm_ttbar_pf
2133
+ splits:
2134
+ - '10'
2135
+ version: 1.1.0
2136
+ productions:
2137
+ cld:
2138
+ comment: CLD production with Key4Hep
2139
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2140
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2141
+ memory:
2142
+ gen: 4000
2143
+ post: 2000
2144
+ tfds: 16000
2145
+ model: pyg-cld-v1
2146
+ postprocessing:
2147
+ args: {}
2148
+ script: mlpf/data/key4hep/postprocessing.py
2149
+ samples:
2150
+ gun_e_10gev:
2151
+ events_per_job: 100
2152
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2153
+ process_name: gun_e_10gev
2154
+ seed_range:
2155
+ - 424242
2156
+ - 424342
2157
+ gun_mu_10gev:
2158
+ events_per_job: 100
2159
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2160
+ process_name: gun_mu_10gev
2161
+ seed_range:
2162
+ - 600000
2163
+ - 600100
2164
+ gun_pi_10gev:
2165
+ events_per_job: 100
2166
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2167
+ process_name: gun_pi_10gev
2168
+ seed_range:
2169
+ - 700000
2170
+ - 700100
2171
+ qq:
2172
+ events_per_job: 100
2173
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2174
+ process_name: p8_ee_qq_ecm365
2175
+ seed_range:
2176
+ - 500000
2177
+ - 510010
2178
+ ttbar:
2179
+ events_per_job: 100
2180
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2181
+ process_name: p8_ee_ttbar_ecm365
2182
+ seed_range:
2183
+ - 300000
2184
+ - 310010
2185
+ ww_fullhad:
2186
+ events_per_job: 100
2187
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2188
+ process_name: p8_ee_WW_fullhad_ecm365
2189
+ seed_range:
2190
+ - 400000
2191
+ - 410010
2192
+ z_qq:
2193
+ events_per_job: 100
2194
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2195
+ process_name: p8_ee_Z_qq_ecm91
2196
+ seed_range:
2197
+ - 600000
2198
+ - 610010
2199
+ z_tautau:
2200
+ events_per_job: 100
2201
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2202
+ process_name: p8_ee_Z_tautau_ecm91
2203
+ seed_range:
2204
+ - 700000
2205
+ - 710010
2206
+ zh_tautau_240:
2207
+ events_per_job: 100
2208
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2209
+ process_name: p8_ee_ZH_Htautau_ecm240
2210
+ seed_range:
2211
+ - 200000
2212
+ - 200110
2213
+ zh_tautau_365:
2214
+ events_per_job: 100
2215
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2216
+ process_name: p8_ee_ZH_Htautau_ecm365
2217
+ seed_range:
2218
+ - 200000
2219
+ - 200110
2220
+ zz:
2221
+ events_per_job: 100
2222
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2223
+ process_name: p8_ee_ZZ_ecm365
2224
+ seed_range:
2225
+ - 100000
2226
+ - 105010
2227
+ zz_tautau_240:
2228
+ events_per_job: 100
2229
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2230
+ process_name: p8_ee_ZZ_tautau_ecm240
2231
+ seed_range:
2232
+ - 100000
2233
+ - 100110
2234
+ zz_tautau_365:
2235
+ events_per_job: 100
2236
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2237
+ process_name: p8_ee_ZZ_tautau_ecm365
2238
+ seed_range:
2239
+ - 100000
2240
+ - 110010
2241
+ slurm_partition: main
2242
+ slurm_runtime: 48h
2243
+ tfds_hit_mapping:
2244
+ qq:
2245
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/qq
2246
+ config_ids:
2247
+ - 1
2248
+ - 2
2249
+ - 3
2250
+ - 4
2251
+ - 5
2252
+ - 6
2253
+ - 7
2254
+ - 8
2255
+ - 9
2256
+ - 10
2257
+ version: 3.2.2
2258
+ ttbar:
2259
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2260
+ config_ids:
2261
+ - 1
2262
+ - 2
2263
+ - 3
2264
+ - 4
2265
+ - 5
2266
+ - 6
2267
+ - 7
2268
+ - 8
2269
+ - 9
2270
+ - 10
2271
+ version: 3.2.2
2272
+ ww_fullhad:
2273
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ww_fullhad
2274
+ config_ids:
2275
+ - 1
2276
+ - 2
2277
+ - 3
2278
+ - 4
2279
+ - 5
2280
+ - 6
2281
+ - 7
2282
+ - 8
2283
+ - 9
2284
+ - 10
2285
+ version: 3.2.2
2286
+ zz:
2287
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/zz
2288
+ config_ids:
2289
+ - 1
2290
+ - 2
2291
+ - 3
2292
+ - 4
2293
+ - 5
2294
+ - 6
2295
+ - 7
2296
+ - 8
2297
+ - 9
2298
+ - 10
2299
+ version: 3.2.2
2300
+ tfds_mapping:
2301
+ qq:
2302
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/qq
2303
+ config_ids:
2304
+ - 1
2305
+ - 2
2306
+ - 3
2307
+ - 4
2308
+ - 5
2309
+ - 6
2310
+ - 7
2311
+ - 8
2312
+ - 9
2313
+ - 10
2314
+ version: 3.3.0
2315
+ ttbar:
2316
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2317
+ config_ids:
2318
+ - 1
2319
+ - 2
2320
+ - 3
2321
+ - 4
2322
+ - 5
2323
+ - 6
2324
+ - 7
2325
+ - 8
2326
+ - 9
2327
+ - 10
2328
+ version: 3.3.0
2329
+ ww_fullhad:
2330
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ww_fullhad
2331
+ config_ids:
2332
+ - 1
2333
+ - 2
2334
+ - 3
2335
+ - 4
2336
+ - 5
2337
+ - 6
2338
+ - 7
2339
+ - 8
2340
+ - 9
2341
+ - 10
2342
+ version: 3.3.0
2343
+ zz:
2344
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/zz
2345
+ config_ids:
2346
+ - 1
2347
+ - 2
2348
+ - 3
2349
+ - 4
2350
+ - 5
2351
+ - 6
2352
+ - 7
2353
+ - 8
2354
+ - 9
2355
+ - 10
2356
+ version: 3.3.0
2357
+ type: key4hep
2358
+ workspace_dir: ${project.paths.storage_root}/cld/v1.2.5_key4hep_2025-05-29
2359
+ cld_clic_colliderml:
2360
+ comment: Joint CLD+CLIC+ColliderML pu0 tracks/clusters
2361
+ model: pyg-cldcliccolliderml-v1
2362
+ source_productions:
2363
+ cld: cld
2364
+ clic: clic
2365
+ colliderml: colliderml
2366
+ type: key4hep
2367
+ cld_ecal_pitch_1p5:
2368
+ cms_energy: 91
2369
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 1.5 mm
2370
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_1p5mm/CLD_o2_v07.xml
2371
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2372
+ dataset_only: true
2373
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2374
+ memory: &id019
2375
+ gen: 8000
2376
+ post: 8000
2377
+ tfds: 8000
2378
+ model: pyg-cld-v1
2379
+ postprocessing: &id020
2380
+ args: {}
2381
+ script: mlpf/data/key4hep/postprocessing.py
2382
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2383
+ samples: &id021
2384
+ z_tautau:
2385
+ events_per_job: 100
2386
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2387
+ process_name: p8_ee_Z_tautau_ecm91
2388
+ seed_range:
2389
+ - 700000
2390
+ - 700100
2391
+ slurm_partition: main
2392
+ slurm_runtime: 48h
2393
+ tfds_hit_mapping: &id022
2394
+ z_tautau:
2395
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/z_tautau
2396
+ config_ids:
2397
+ - 1
2398
+ - 2
2399
+ - 3
2400
+ - 4
2401
+ - 5
2402
+ - 6
2403
+ - 7
2404
+ - 8
2405
+ - 9
2406
+ - 10
2407
+ version: 3.2.2
2408
+ tfds_mapping: &id023
2409
+ z_tautau:
2410
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/z_tautau
2411
+ config_ids:
2412
+ - 1
2413
+ - 2
2414
+ - 3
2415
+ - 4
2416
+ - 5
2417
+ - 6
2418
+ - 7
2419
+ - 8
2420
+ - 9
2421
+ - 10
2422
+ version: 3.3.0
2423
+ type: key4hep
2424
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_1p5mm
2425
+ cld_ecal_pitch_2:
2426
+ cms_energy: 91
2427
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2 mm
2428
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2mm/CLD_o2_v07.xml
2429
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2430
+ dataset_only: true
2431
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2432
+ memory: *id019
2433
+ model: pyg-cld-v1
2434
+ postprocessing: *id020
2435
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2436
+ samples: *id021
2437
+ slurm_partition: main
2438
+ slurm_runtime: 48h
2439
+ tfds_hit_mapping: *id022
2440
+ tfds_mapping: *id023
2441
+ type: key4hep
2442
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2mm
2443
+ cld_ecal_pitch_2p5:
2444
+ cms_energy: 91
2445
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2.5 mm
2446
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2p5mm/CLD_o2_v07.xml
2447
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2448
+ dataset_only: true
2449
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2450
+ memory: *id019
2451
+ model: pyg-cld-v1
2452
+ postprocessing: *id020
2453
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2454
+ samples: *id021
2455
+ slurm_partition: main
2456
+ slurm_runtime: 48h
2457
+ tfds_hit_mapping: *id022
2458
+ tfds_mapping: *id023
2459
+ type: key4hep
2460
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2p5mm
2461
+ cld_ecal_pitch_3:
2462
+ cms_energy: 91
2463
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 3 mm
2464
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_3mm/CLD_o2_v07.xml
2465
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2466
+ dataset_only: true
2467
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2468
+ memory: *id019
2469
+ model: pyg-cld-v1
2470
+ postprocessing: *id020
2471
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2472
+ samples: *id021
2473
+ slurm_partition: main
2474
+ slurm_runtime: 48h
2475
+ tfds_hit_mapping: *id022
2476
+ tfds_mapping: *id023
2477
+ type: key4hep
2478
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_3mm
2479
+ cld_ecal_pitch_4:
2480
+ cms_energy: 91
2481
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 4 mm
2482
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_4mm/CLD_o2_v07.xml
2483
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2484
+ dataset_only: true
2485
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2486
+ memory: *id019
2487
+ model: pyg-cld-v1
2488
+ postprocessing: *id020
2489
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2490
+ samples: *id021
2491
+ slurm_partition: main
2492
+ slurm_runtime: 48h
2493
+ tfds_hit_mapping: *id022
2494
+ tfds_mapping: *id023
2495
+ type: key4hep
2496
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_4mm
2497
+ cld_ecal_pitch_5p1:
2498
+ cms_energy: 91
2499
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 5.1 mm
2500
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_5p1mm/CLD_o2_v07.xml
2501
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2502
+ dataset_only: true
2503
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2504
+ memory: *id019
2505
+ model: pyg-cld-v1
2506
+ postprocessing: *id020
2507
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2508
+ samples: *id021
2509
+ slurm_partition: main
2510
+ slurm_runtime: 48h
2511
+ tfds_hit_mapping: *id022
2512
+ tfds_mapping: *id023
2513
+ type: key4hep
2514
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_5p1mm
2515
+ cld_hcal_pitch_10:
2516
+ cms_energy: 365
2517
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 10 mm
2518
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_10mm/CLD_o2_v07.xml
2519
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2520
+ dataset_only: true
2521
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2522
+ memory: &id024
2523
+ gen: 12000
2524
+ post: 16000
2525
+ tfds: 16000
2526
+ model: pyg-cld-v1
2527
+ postprocessing: &id025
2528
+ args: {}
2529
+ script: mlpf/data/key4hep/postprocessing.py
2530
+ samples: &id026
2531
+ ttbar:
2532
+ events_per_job: 100
2533
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2534
+ process_name: p8_ee_ttbar_ecm365
2535
+ seed_range:
2536
+ - 300000
2537
+ - 300100
2538
+ slurm_partition: main
2539
+ slurm_runtime: 48h
2540
+ tfds_hit_mapping: &id027
2541
+ ttbar:
2542
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2543
+ config_ids:
2544
+ - 1
2545
+ - 2
2546
+ - 3
2547
+ - 4
2548
+ - 5
2549
+ - 6
2550
+ - 7
2551
+ - 8
2552
+ - 9
2553
+ - 10
2554
+ version: 3.2.2
2555
+ tfds_mapping: &id028
2556
+ ttbar:
2557
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2558
+ config_ids:
2559
+ - 1
2560
+ - 2
2561
+ - 3
2562
+ - 4
2563
+ - 5
2564
+ - 6
2565
+ - 7
2566
+ - 8
2567
+ - 9
2568
+ - 10
2569
+ version: 3.3.0
2570
+ type: key4hep
2571
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_10mm
2572
+ cld_hcal_pitch_12:
2573
+ cms_energy: 365
2574
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 12 mm
2575
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_12mm/CLD_o2_v07.xml
2576
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2577
+ dataset_only: true
2578
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2579
+ memory: *id024
2580
+ model: pyg-cld-v1
2581
+ postprocessing: *id025
2582
+ samples: *id026
2583
+ slurm_partition: main
2584
+ slurm_runtime: 48h
2585
+ tfds_hit_mapping: *id027
2586
+ tfds_mapping: *id028
2587
+ type: key4hep
2588
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_12mm
2589
+ cld_hcal_pitch_15:
2590
+ cms_energy: 365
2591
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 15 mm
2592
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_15mm/CLD_o2_v07.xml
2593
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2594
+ dataset_only: true
2595
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2596
+ memory: *id024
2597
+ model: pyg-cld-v1
2598
+ postprocessing: *id025
2599
+ samples: *id026
2600
+ slurm_partition: main
2601
+ slurm_runtime: 48h
2602
+ tfds_hit_mapping: *id027
2603
+ tfds_mapping: *id028
2604
+ type: key4hep
2605
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_15mm
2606
+ cld_hcal_pitch_20:
2607
+ cms_energy: 365
2608
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 20 mm
2609
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_20mm/CLD_o2_v07.xml
2610
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2611
+ dataset_only: true
2612
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2613
+ memory: *id024
2614
+ model: pyg-cld-v1
2615
+ postprocessing: *id025
2616
+ samples: *id026
2617
+ slurm_partition: main
2618
+ slurm_runtime: 48h
2619
+ tfds_hit_mapping: *id027
2620
+ tfds_mapping: *id028
2621
+ type: key4hep
2622
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_20mm
2623
+ cld_hcal_pitch_25:
2624
+ cms_energy: 365
2625
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 25 mm
2626
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_25mm/CLD_o2_v07.xml
2627
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2628
+ dataset_only: true
2629
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2630
+ memory: *id024
2631
+ model: pyg-cld-v1
2632
+ postprocessing: *id025
2633
+ samples: *id026
2634
+ slurm_partition: main
2635
+ slurm_runtime: 48h
2636
+ tfds_hit_mapping: *id027
2637
+ tfds_mapping: *id028
2638
+ type: key4hep
2639
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_25mm
2640
+ cld_hcal_pitch_30:
2641
+ cms_energy: 365
2642
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 30 mm
2643
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_30mm/CLD_o2_v07.xml
2644
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2645
+ dataset_only: true
2646
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2647
+ memory: *id024
2648
+ model: pyg-cld-v1
2649
+ postprocessing: *id025
2650
+ samples: *id026
2651
+ slurm_partition: main
2652
+ slurm_runtime: 48h
2653
+ tfds_hit_mapping: *id027
2654
+ tfds_mapping: *id028
2655
+ type: key4hep
2656
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_30mm
2657
+ clic:
2658
+ comment: CLIC production with Key4Hep
2659
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/clic
2660
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2661
+ memory:
2662
+ gen: 4000
2663
+ post: 2000
2664
+ tfds: 16000
2665
+ model: pyg-clic-v1
2666
+ postprocessing:
2667
+ args: {}
2668
+ script: mlpf/data/key4hep/postprocessing.py
2669
+ samples:
2670
+ qq:
2671
+ events_per_job: 100
2672
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2673
+ process_name: p8_ee_qq_ecm380
2674
+ seed_range:
2675
+ - 500000
2676
+ - 510010
2677
+ ttbar:
2678
+ events_per_job: 100
2679
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2680
+ process_name: p8_ee_ttbar_ecm380
2681
+ seed_range:
2682
+ - 300000
2683
+ - 310010
2684
+ ww_fullhad:
2685
+ events_per_job: 100
2686
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2687
+ process_name: p8_ee_WW_fullhad_ecm380
2688
+ seed_range:
2689
+ - 400000
2690
+ - 410010
2691
+ slurm_partition: main
2692
+ slurm_runtime: 48h
2693
+ tfds_hit_mapping:
2694
+ qq:
2695
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/qq
2696
+ config_ids:
2697
+ - 1
2698
+ - 2
2699
+ - 3
2700
+ - 4
2701
+ - 5
2702
+ - 6
2703
+ - 7
2704
+ - 8
2705
+ - 9
2706
+ - 10
2707
+ version: 3.2.2
2708
+ ttbar:
2709
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ttbar
2710
+ config_ids:
2711
+ - 1
2712
+ - 2
2713
+ - 3
2714
+ - 4
2715
+ - 5
2716
+ - 6
2717
+ - 7
2718
+ - 8
2719
+ - 9
2720
+ - 10
2721
+ version: 3.2.2
2722
+ ww_fullhad:
2723
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ww_fullhad
2724
+ config_ids:
2725
+ - 1
2726
+ - 2
2727
+ - 3
2728
+ - 4
2729
+ - 5
2730
+ - 6
2731
+ - 7
2732
+ - 8
2733
+ - 9
2734
+ - 10
2735
+ version: 3.2.2
2736
+ tfds_mapping:
2737
+ qq:
2738
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/qq
2739
+ config_ids:
2740
+ - 1
2741
+ - 2
2742
+ - 3
2743
+ - 4
2744
+ - 5
2745
+ - 6
2746
+ - 7
2747
+ - 8
2748
+ - 9
2749
+ - 10
2750
+ version: 3.3.0
2751
+ ttbar:
2752
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ttbar
2753
+ config_ids:
2754
+ - 1
2755
+ - 2
2756
+ - 3
2757
+ - 4
2758
+ - 5
2759
+ - 6
2760
+ - 7
2761
+ - 8
2762
+ - 9
2763
+ - 10
2764
+ version: 3.3.0
2765
+ ww_fullhad:
2766
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ww_fullhad
2767
+ config_ids:
2768
+ - 1
2769
+ - 2
2770
+ - 3
2771
+ - 4
2772
+ - 5
2773
+ - 6
2774
+ - 7
2775
+ - 8
2776
+ - 9
2777
+ - 10
2778
+ version: 3.3.0
2779
+ type: key4hep
2780
+ workspace_dir: ${project.paths.storage_root}/clic/v1.2.5_key4hep_2025-05-29
2781
+ cms_run3:
2782
+ comment: Main production with CMSSW_15_0_5
2783
+ config_dir: ${project.paths.project_root}
2784
+ environment:
2785
+ cmssw_dir: ${project.cmssw_dir}
2786
+ cmssw_release: CMSSW_15_0_5
2787
+ scram_arch: el8_amd64_gcc12
2788
+ gen_container: /cvmfs/singularity.opensciencegrid.org/cmssw/cms:rhel8-x86_64
2789
+ memory:
2790
+ gen: 6000
2791
+ post: 4000
2792
+ tfds: 16000
2793
+ train: 16000
2794
+ val: 8000
2795
+ model: pyg-cms-v1
2796
+ postprocessing:
2797
+ args:
2798
+ num_events: -1
2799
+ save_full_graph: false
2800
+ script: mlpf/data/cms/postprocessing2.py
2801
+ samples:
2802
+ qcd_nopu:
2803
+ events_per_job: 100
2804
+ gen_script: mlpf/data/cms/genjob_pu.sh
2805
+ output_subdir: nopu
2806
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2807
+ pu_type: nopu
2808
+ seed_range:
2809
+ - 1000000
2810
+ - 1010010
2811
+ qcd_pu:
2812
+ events_per_job: 100
2813
+ gen_script: mlpf/data/cms/genjob_pu.sh
2814
+ output_subdir: pu55to75
2815
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2816
+ pu_type: pu55to75
2817
+ seed_range:
2818
+ - 300000
2819
+ - 310010
2820
+ qcd_val:
2821
+ copy_step2: true
2822
+ events_per_job: 100
2823
+ gen_script: mlpf/data/cms/genjob_pu.sh
2824
+ output_subdir: pu55to75_val
2825
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2826
+ pu_type: pu55to75
2827
+ seed_range:
2828
+ - 400000
2829
+ - 401010
2830
+ ttbar_nopu:
2831
+ events_per_job: 100
2832
+ gen_script: mlpf/data/cms/genjob_pu.sh
2833
+ output_subdir: nopu
2834
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2835
+ pu_type: nopu
2836
+ seed_range:
2837
+ - 800000
2838
+ - 810010
2839
+ ttbar_pu:
2840
+ events_per_job: 50
2841
+ gen_script: mlpf/data/cms/genjob_pu.sh
2842
+ output_subdir: pu55to75
2843
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2844
+ pu_type: pu55to75
2845
+ seed_range:
2846
+ - 100000
2847
+ - 110010
2848
+ ztt_nopu:
2849
+ events_per_job: 100
2850
+ gen_script: mlpf/data/cms/genjob_pu.sh
2851
+ output_subdir: nopu
2852
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2853
+ pu_type: nopu
2854
+ seed_range:
2855
+ - 1100000
2856
+ - 1110010
2857
+ ztt_pu:
2858
+ events_per_job: 100
2859
+ gen_script: mlpf/data/cms/genjob_pu.sh
2860
+ output_subdir: pu55to75
2861
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2862
+ pu_type: pu55to75
2863
+ seed_range:
2864
+ - 200000
2865
+ - 210010
2866
+ slurm_partition: ${project.cpu_partition}
2867
+ slurm_runtime: 48h
2868
+ tfds_mapping:
2869
+ qcd_nopu:
2870
+ builder_path: mlpf/heptfds/cms_pf/qcd_nopu
2871
+ config_ids:
2872
+ - 1
2873
+ - 2
2874
+ - 3
2875
+ - 4
2876
+ - 5
2877
+ - 6
2878
+ - 7
2879
+ - 8
2880
+ - 9
2881
+ - 10
2882
+ version: 3.2.0
2883
+ qcd_pu:
2884
+ builder_path: mlpf/heptfds/cms_pf/qcd
2885
+ config_ids:
2886
+ - 1
2887
+ - 2
2888
+ - 3
2889
+ - 4
2890
+ - 5
2891
+ - 6
2892
+ - 7
2893
+ - 8
2894
+ - 9
2895
+ - 10
2896
+ version: 3.2.0
2897
+ ttbar_nopu:
2898
+ builder_path: mlpf/heptfds/cms_pf/ttbar_nopu
2899
+ config_ids:
2900
+ - 1
2901
+ - 2
2902
+ - 3
2903
+ - 4
2904
+ - 5
2905
+ - 6
2906
+ - 7
2907
+ - 8
2908
+ - 9
2909
+ - 10
2910
+ version: 3.2.0
2911
+ ttbar_pu:
2912
+ builder_path: mlpf/heptfds/cms_pf/ttbar
2913
+ config_ids:
2914
+ - 1
2915
+ - 2
2916
+ - 3
2917
+ - 4
2918
+ - 5
2919
+ - 6
2920
+ - 7
2921
+ - 8
2922
+ - 9
2923
+ - 10
2924
+ version: 3.2.0
2925
+ ztt_nopu:
2926
+ builder_path: mlpf/heptfds/cms_pf/ztt_nopu
2927
+ config_ids:
2928
+ - 1
2929
+ - 2
2930
+ - 3
2931
+ - 4
2932
+ - 5
2933
+ - 6
2934
+ - 7
2935
+ - 8
2936
+ - 9
2937
+ - 10
2938
+ version: 3.2.0
2939
+ ztt_pu:
2940
+ builder_path: mlpf/heptfds/cms_pf/ztt
2941
+ config_ids:
2942
+ - 1
2943
+ - 2
2944
+ - 3
2945
+ - 4
2946
+ - 5
2947
+ - 6
2948
+ - 7
2949
+ - 8
2950
+ - 9
2951
+ - 10
2952
+ version: 3.2.0
2953
+ type: cms
2954
+ validation:
2955
+ job_types:
2956
+ - pf
2957
+ - mlpf
2958
+ threads: 8
2959
+ use_cuda: false
2960
+ validation_data:
2961
+ job_types:
2962
+ - pf
2963
+ - mlpf
2964
+ samples:
2965
+ jetmet0:
2966
+ input_filelist: data/cms/run3/${project.site_name}/jetmet0.txt
2967
+ output_subdir: Run2024C
2968
+ seed_range:
2969
+ - 1
2970
+ - 100
2971
+ threads: 8
2972
+ use_cuda: false
2973
+ workspace_dir: ${project.paths.storage_root}/cms/20260204_cmssw_15_0_5_117d32
2974
+ colliderml:
2975
+ comment: ColliderML Release 1 ttbar (no pileup), clustered view (tracks + our
2976
+ spatial clusters)
2977
+ download_root: /mnt/ceph/users/ewulff/data/colliderml/CERN__ColliderML-Release-1
2978
+ memory:
2979
+ post: 32000
2980
+ tfds: 32000
2981
+ postprocessing:
2982
+ args: {}
2983
+ script: mlpf/data/colliderml/postprocessing.py
2984
+ samples:
2985
+ ttbar_pu0:
2986
+ source_dir: ${productions.colliderml.download_root}
2987
+ ttbar_pu200:
2988
+ source_dir: ${productions.colliderml.download_root}
2989
+ source_revision: 64c3d2f112df3d5d20979d22da7cfdff13e10c4b
2990
+ tfds_hit_mapping:
2991
+ ttbar_pu0:
2992
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar
2993
+ config_ids:
2994
+ - 1
2995
+ - 2
2996
+ - 3
2997
+ - 4
2998
+ - 5
2999
+ - 6
3000
+ - 7
3001
+ - 8
3002
+ - 9
3003
+ - 10
3004
+ version: 1.3.0
3005
+ ttbar_pu200:
3006
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar_pu200
3007
+ config_ids:
3008
+ - 1
3009
+ - 2
3010
+ - 3
3011
+ - 4
3012
+ - 5
3013
+ - 6
3014
+ - 7
3015
+ - 8
3016
+ - 9
3017
+ - 10
3018
+ version: 1.3.0
3019
+ tfds_mapping:
3020
+ ttbar_pu0:
3021
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar
3022
+ config_ids:
3023
+ - 1
3024
+ - 2
3025
+ - 3
3026
+ - 4
3027
+ - 5
3028
+ - 6
3029
+ - 7
3030
+ - 8
3031
+ - 9
3032
+ - 10
3033
+ version: 1.5.0
3034
+ ttbar_pu200:
3035
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar_pu200
3036
+ config_ids:
3037
+ - 1
3038
+ - 2
3039
+ - 3
3040
+ - 4
3041
+ - 5
3042
+ - 6
3043
+ - 7
3044
+ - 8
3045
+ - 9
3046
+ - 10
3047
+ version: 1.5.0
3048
+ type: colliderml
3049
+ workspace_dir: ${productions.colliderml.workspace_root}/v1_release1_64c3d2f1
3050
+ workspace_root: /mnt/ceph/users/ewulff/mlpf/colliderml
3051
+ idea:
3052
+ comment: IDEA_o1_v03 pipeline validation with truth-seeded proxy tracks
3053
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/idea
3054
+ environment:
3055
+ progress_interval: 60
3056
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
3057
+ memory:
3058
+ gen: 16000
3059
+ post: 4000
3060
+ tfds: 8000
3061
+ model: pyg-idea-pipeline-v1
3062
+ postprocessing:
3063
+ args: {}
3064
+ script: mlpf/data/key4hep/postprocessing.py
3065
+ samples:
3066
+ gun_e_10gev:
3067
+ events_per_job: 100
3068
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3069
+ process_name: gun_e_10gev
3070
+ seed_range:
3071
+ - 424242
3072
+ - 424342
3073
+ gun_mu_10gev:
3074
+ events_per_job: 100
3075
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3076
+ process_name: gun_mu_10gev
3077
+ seed_range:
3078
+ - 600000
3079
+ - 600100
3080
+ gun_pi_10gev:
3081
+ events_per_job: 100
3082
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3083
+ process_name: gun_pi_10gev
3084
+ seed_range:
3085
+ - 700000
3086
+ - 700100
3087
+ qq:
3088
+ events_per_job: 100
3089
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3090
+ process_name: p8_ee_qq_ecm365
3091
+ seed_range:
3092
+ - 500000
3093
+ - 500100
3094
+ ttbar:
3095
+ events_per_job: 100
3096
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3097
+ process_name: p8_ee_ttbar_ecm365
3098
+ seed_range:
3099
+ - 300000
3100
+ - 300100
3101
+ ww_fullhad:
3102
+ events_per_job: 100
3103
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3104
+ process_name: p8_ee_WW_fullhad_ecm365
3105
+ seed_range:
3106
+ - 400000
3107
+ - 400100
3108
+ slurm_partition: main
3109
+ slurm_runtime: 48h
3110
+ tfds_mapping:
3111
+ qq:
3112
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/qq
3113
+ config_ids:
3114
+ - 1
3115
+ version: 0.2.1
3116
+ ttbar:
3117
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ttbar
3118
+ config_ids:
3119
+ - 1
3120
+ version: 0.2.1
3121
+ ww_fullhad:
3122
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ww_fullhad
3123
+ config_ids:
3124
+ - 1
3125
+ version: 0.2.1
3126
+ type: key4hep
3127
+ workspace_dir: ${project.paths.storage_root}/idea/IDEA_o1_v03_fccconfig_a05a3a9
3128
+ maia:
3129
+ comment: Local MAIA ttbar EDM4hep validation sample
3130
+ config_dir: ${project.paths.project_root}
3131
+ model: pyg-maia-v1
3132
+ type: maia
3133
+ workspace_dir: ${project.paths.project_root}/local_test_data/maia_smoke
3134
+ project:
3135
+ bind_mounts: &id029
3136
+ - /local
3137
+ - /cvmfs
3138
+ - /scratch/local
3139
+ - /scratch/persistent
3140
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3141
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3142
+ cpu_partition: main
3143
+ description: Machine Learning for Particle Flow Reconstruction
3144
+ executor: slurm
3145
+ gpu_partition: gpu
3146
+ name: particleflow
3147
+ paths: &id030
3148
+ project_root: /home/joosep/particleflow
3149
+ scratch_root: /scratch/local/joosep
3150
+ storage_root: /local/joosep/mlpf
3151
+ tmpdir: /scratch/local/joosep/tmp
3152
+ site_name: tallinn
3153
+ sites:
3154
+ local:
3155
+ bind_mounts:
3156
+ - /tmp
3157
+ - /mnt/work
3158
+ cmssw_dir: /home/joosep/particleflow/CMSSW_15_0_5
3159
+ container: https://jpata.web.cern.ch/jpata/particleflow-29042026-de861d.sif
3160
+ cpu_partition: local
3161
+ executor: local
3162
+ gpu_partition: local
3163
+ paths:
3164
+ project_root: /home/joosep/particleflow
3165
+ scratch_root: /tmp/particleflow
3166
+ storage_root: /mnt/work/mlpf/
3167
+ tmpdir: /tmp/particleflow/tmp
3168
+ site_name: local
3169
+ lxplus:
3170
+ bind_mounts:
3171
+ - /afs
3172
+ - /cvmfs
3173
+ - /eos/user/j/jpata
3174
+ - /etc/pki/ca-trust
3175
+ - /etc/tnsnames.ora
3176
+ - /run
3177
+ cmssw_dir: /cvmfs/cms.cern.ch
3178
+ container: /eos/user/j/jpata/www/particleflow-20260330-cd2f54.sif
3179
+ cpu_partition: tomorrow
3180
+ executor: condor
3181
+ gpu_partition: tomorrow
3182
+ paths:
3183
+ project_root: /afs/cern.ch/work/j/jpata/particleflow
3184
+ scratch_root: /tmp
3185
+ storage_root: /eos/user/j/jpata/mlpf
3186
+ tmpdir: /tmp
3187
+ site_name: lxplus
3188
+ tallinn:
3189
+ bind_mounts: *id029
3190
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3191
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3192
+ cpu_partition: main
3193
+ executor: slurm
3194
+ gpu_partition: gpu
3195
+ paths: *id030
3196
+ site_name: tallinn
3197
+ slurm_account: hepusers
3198
+ slurm_account: hepusers
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.pdf ADDED
Binary file (21.6 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_eta.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.pdf ADDED
Binary file (21.1 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.pdf ADDED
Binary file (21 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_pt_log.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res.pdf ADDED
Binary file (24 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.pdf ADDED
Binary file (23.6 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/jet_res_vstarget.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/num_elements.pdf ADDED
Binary file (10.1 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_ecal_2mm_seed12345_20261114_035750_900597/plots_step_50000/cld_edm_z_tautau_pf/num_elements.png ADDED