zmgong commited on
Commit
89cf0f9
·
verified ·
1 Parent(s): f9840e6

Add40epoch DNA-only SSEL weights, inference settings and validation summary

Browse files
README.md CHANGED
@@ -11,7 +11,7 @@ tags:
11
 
12
  # Model Card for SSEL
13
 
14
- Checkpoints and extracted DNA embeddings for **Hierarchical Embedding of DNA Barcode Taxonomy with Hyperbolic Entailment Cones**. This repository contains the nine 768D experiments presented in the iBOL poster; eight also appear in the UniReps submission.
15
 
16
  ## Model Details
17
 
@@ -34,18 +34,19 @@ The DNA branch starts from [BarcodeBERT](https://huggingface.co/bioscan-ml/clibd
34
  | EL | [el](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
35
  | SEL | [sel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
36
  | Positive EL + CL | [positive-el-cl](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/config.yaml) | No |
37
- | SSEL | [ssel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/config.yaml) | Yes |
 
38
  | No direct placement | [no-direct-placement](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/config.yaml) | Yes |
39
  | Frozen labels | [frozen-labels](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
40
  | SEL + nesting | [sel-nesting](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
41
  | SEL + separation | [sel-separation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
42
  | SEL + allocation | [sel-allocation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
43
 
44
- Each selected checkpoint is the exact **last.pth** used for its reported result. All nine runs use 768 dimensions, 15 epochs and seed 42. EL and SEL omit minimum distance; the other listed variants include it. Positive EL + CL is our DNA–taxonomy adaptation, not an exact reproduction of image–text MERU.
45
 
46
  ## Files and Usage
47
 
48
- All versioned artifacts are under **Ver_1_0/**. The layout follows CLIBD's `ckpt/` and `extracted_embedding/` structure, with the version directory placed at the outside:
49
 
50
  ```text
51
  Ver_1_0/
 
11
 
12
  # Model Card for SSEL
13
 
14
+ Checkpoints and extracted DNA embeddings for **Hierarchical Embedding of DNA Barcode Taxonomy with Hyperbolic Entailment Cones**. This repository contains the nine 768D experiments presented in the iBOL poster (eight also appear in the UniReps submission), plus an additional 40-epoch DNA-only SSEL checkpoint.
15
 
16
  ## Model Details
17
 
 
34
  | EL | [el](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
35
  | SEL | [sel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
36
  | Positive EL + CL | [positive-el-cl](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/config.yaml) | No |
37
+ | SSEL (40 epochs) | [ssel-40epochs](Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/last.pth) | — | [Inference config](Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/inference_config.json) | No (additional checkpoint) |
38
+ | SSEL (15 epochs, UniReps) | [ssel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/config.yaml) | Yes |
39
  | No direct placement | [no-direct-placement](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/config.yaml) | Yes |
40
  | Frozen labels | [frozen-labels](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
41
  | SEL + nesting | [sel-nesting](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
42
  | SEL + separation | [sel-separation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
43
  | SEL + allocation | [sel-allocation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
44
 
45
+ Each selected checkpoint is the exact **last.pth** used for its reported result. The nine original `Ver_1_0` runs use 768 dimensions, 15 epochs and seed 42. The additional `ssel-40epochs` checkpoint uses 768 dimensions, 40 epochs and seed 42; its [full validation summary](Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/validation_summary.json) reports 99.56% seen Species nearest-label accuracy, 82.78% unseen-species detection and 2.52% seen false rejection on 14,757 seen and 8,819 unseen validation queries. It is separate from the original 15-epoch UniReps checkpoint. EL and SEL omit minimum distance; the other listed variants include it. Positive EL + CL is our DNA–taxonomy adaptation, not an exact reproduction of image–text MERU.
46
 
47
  ## Files and Usage
48
 
49
+ The original poster artifacts are under **Ver_1_0/**. The added 40-epoch checkpoint and its inference-only configuration are under **Ver_1_1/**; no test embeddings are published for this checkpoint. The layout follows CLIBD's `ckpt/` and `extracted_embedding/` structure, with the version directory placed at the outside:
50
 
51
  ```text
52
  Ver_1_0/
Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/inference_config.json ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "source_config_sha256": "87376a228c7048a9d763f5116f2908eb278de2ec07a0f30080cb7826c42d7825",
3
+ "config": {
4
+ "model_config": {
5
+ "model_output_name": "SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42",
6
+ "dna_output_pipeline": "transformed_hidden_state_mean",
7
+ "output_dim": 768,
8
+ "for_bio_clip": false,
9
+ "dna": {
10
+ "model": "barcode_bert",
11
+ "input_type": "sequence"
12
+ },
13
+ "hyperbolic_space": {
14
+ "curv_init": 1.0,
15
+ "min_radius": 0.1,
16
+ "sel_clamp_feature_alpha_max": true,
17
+ "entailment_geometry": "hyperbolic",
18
+ "nearest_neighbor_metric_cross_modality": "angle",
19
+ "inference_project_to_hyperbolic_space": true,
20
+ "stacked_entailment": {
21
+ "embedding_dim": 768,
22
+ "label_table": {
23
+ "enabled": true,
24
+ "add_dna_bin_level": false
25
+ },
26
+ "dna_projection": {
27
+ "enabled": true,
28
+ "type": "mlp",
29
+ "activation": "gelu",
30
+ "dropout": 0.0,
31
+ "input_dim": 768,
32
+ "hidden_dim": 1536,
33
+ "output_dim": 768,
34
+ "residual": false,
35
+ "normalize": false
36
+ }
37
+ }
38
+ }
39
+ },
40
+ "barcodebert_setting": {
41
+ "old_model_setting": {
42
+ "k": 5,
43
+ "max_len": 660
44
+ }
45
+ }
46
+ }
47
+ }
Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/last.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25680fbc63925526707d1ff523fa6aa39ae445c1310c30de61aa9db10d87c9bd
3
+ size 452784372
Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/validation_summary.json ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "ssel-40epochs",
3
+ "model_output_name": "SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42",
4
+ "epochs": 40,
5
+ "modality": "DNA-only",
6
+ "dimension": 768,
7
+ "checkpoint_sha256": "25680fbc63925526707d1ff523fa6aa39ae445c1310c30de61aa9db10d87c9bd",
8
+ "source_config_sha256": "87376a228c7048a9d763f5116f2908eb278de2ec07a0f30080cb7826c42d7825",
9
+ "source_job_id": "347623",
10
+ "evaluation": "full validation; nearest exterior angle and outside all training-known Species cones",
11
+ "candidate_counts": {
12
+ "order": 55,
13
+ "family": 929,
14
+ "genus": 6819,
15
+ "species": 11846
16
+ },
17
+ "units": "percent; micro",
18
+ "validation": {
19
+ "val_seen": {
20
+ "total": 14757,
21
+ "rejected": 372,
22
+ "reject_percent": 2.5208375686115065,
23
+ "top1_rank": "species",
24
+ "top1_correct": 14692,
25
+ "top1_percent": 99.55953107000067,
26
+ "ordered_processids_sha256": "047de23d9407f8c087e6bdd6453a109c67cdd88e39db3d5913916b12fd8ab66e"
27
+ },
28
+ "val_unseen": {
29
+ "total": 8819,
30
+ "rejected": 7300,
31
+ "reject_percent": 82.7758249234607,
32
+ "top1_rank": "genus",
33
+ "top1_correct": 7566,
34
+ "top1_percent": 85.79203991382244,
35
+ "ordered_processids_sha256": "075b2f9addb2a2fc70708d130d1338bbf395d0af2c2bd1f374564fea22b38bfc"
36
+ }
37
+ },
38
+ "source_evaluation_completed_utc": "2026-11-12T18:22:53.752698+00:00",
39
+ "note": "Additional40epoch checkpoint; original15epoch UniReps weights are retained. Validation results are not test-set results."
40
+ }