Add40epoch DNA-only SSEL weights, inference settings and validation summary
Browse files- README.md +5 -4
- Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/inference_config.json +47 -0
- Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/last.pth +3 -0
- Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/validation_summary.json +40 -0
README.md
CHANGED
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
|
| 12 |
# Model Card for SSEL
|
| 13 |
|
| 14 |
-
Checkpoints and extracted DNA embeddings for **Hierarchical Embedding of DNA Barcode Taxonomy with Hyperbolic Entailment Cones**. This repository contains the nine 768D experiments presented in the iBOL poster
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
|
|
@@ -34,18 +34,19 @@ The DNA branch starts from [BarcodeBERT](https://huggingface.co/bioscan-ml/clibd
|
|
| 34 |
| EL | [el](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 35 |
| SEL | [sel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 36 |
| Positive EL + CL | [positive-el-cl](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/config.yaml) | No |
|
| 37 |
-
| SSEL | [ssel](
|
|
|
|
| 38 |
| No direct placement | [no-direct-placement](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/config.yaml) | Yes |
|
| 39 |
| Frozen labels | [frozen-labels](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 40 |
| SEL + nesting | [sel-nesting](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 41 |
| SEL + separation | [sel-separation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 42 |
| SEL + allocation | [sel-allocation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 43 |
|
| 44 |
-
Each selected checkpoint is the exact **last.pth** used for its reported result.
|
| 45 |
|
| 46 |
## Files and Usage
|
| 47 |
|
| 48 |
-
|
| 49 |
|
| 50 |
```text
|
| 51 |
Ver_1_0/
|
|
|
|
| 11 |
|
| 12 |
# Model Card for SSEL
|
| 13 |
|
| 14 |
+
Checkpoints and extracted DNA embeddings for **Hierarchical Embedding of DNA Barcode Taxonomy with Hyperbolic Entailment Cones**. This repository contains the nine 768D experiments presented in the iBOL poster (eight also appear in the UniReps submission), plus an additional 40-epoch DNA-only SSEL checkpoint.
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
|
|
|
|
| 34 |
| EL | [el](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_EL_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 35 |
| SEL | [sel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_no_radius_barrier_4rank_posneg_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 36 |
| Positive EL + CL | [positive-el-cl](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_MERU_style_4rank_posEL02_CL1_768d_nonres_gap05_15epochs_seed42/config.yaml) | No |
|
| 37 |
+
| SSEL (40 epochs) | [ssel-40epochs](Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/last.pth) | — | [Inference config](Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/inference_config.json) | No (additional checkpoint) |
|
| 38 |
+
| SSEL (15 epochs, UniReps) | [ssel](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/SEL_structure_v2_768d_dna_nonres_margin05_gap05_weight10_15epochs_seed42/config.yaml) | Yes |
|
| 39 |
| No direct placement | [no-direct-placement](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_no_direct_placement_768d_nonres_gap05_15epochs_seed42_retry_20261008/config.yaml) | Yes |
|
| 40 |
| Frozen labels | [frozen-labels](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_full_frozen_labels_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 41 |
| SEL + nesting | [sel-nesting](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_nesting_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 42 |
| SEL + separation | [sel-separation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_sibling_separation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 43 |
| SEL + allocation | [sel-allocation](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/last.pth) | [DNA](Ver_1_0/extracted_embedding/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/extracted_feature_from_test_split.hdf5) | [Config](Ver_1_0/ckpt/bioscan_clip/bioscan_5m/UniReps_SEL_basic_plus_allocation_768d_nonres_gap05_15epochs_seed42/config.yaml) | Yes |
|
| 44 |
|
| 45 |
+
Each selected checkpoint is the exact **last.pth** used for its reported result. The nine original `Ver_1_0` runs use 768 dimensions, 15 epochs and seed 42. The additional `ssel-40epochs` checkpoint uses 768 dimensions, 40 epochs and seed 42; its [full validation summary](Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/validation_summary.json) reports 99.56% seen Species nearest-label accuracy, 82.78% unseen-species detection and 2.52% seen false rejection on 14,757 seen and 8,819 unseen validation queries. It is separate from the original 15-epoch UniReps checkpoint. EL and SEL omit minimum distance; the other listed variants include it. Positive EL + CL is our DNA–taxonomy adaptation, not an exact reproduction of image–text MERU.
|
| 46 |
|
| 47 |
## Files and Usage
|
| 48 |
|
| 49 |
+
The original poster artifacts are under **Ver_1_0/**. The added 40-epoch checkpoint and its inference-only configuration are under **Ver_1_1/**; no test embeddings are published for this checkpoint. The layout follows CLIBD's `ckpt/` and `extracted_embedding/` structure, with the version directory placed at the outside:
|
| 50 |
|
| 51 |
```text
|
| 52 |
Ver_1_0/
|
Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/inference_config.json
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"source_config_sha256": "87376a228c7048a9d763f5116f2908eb278de2ec07a0f30080cb7826c42d7825",
|
| 3 |
+
"config": {
|
| 4 |
+
"model_config": {
|
| 5 |
+
"model_output_name": "SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42",
|
| 6 |
+
"dna_output_pipeline": "transformed_hidden_state_mean",
|
| 7 |
+
"output_dim": 768,
|
| 8 |
+
"for_bio_clip": false,
|
| 9 |
+
"dna": {
|
| 10 |
+
"model": "barcode_bert",
|
| 11 |
+
"input_type": "sequence"
|
| 12 |
+
},
|
| 13 |
+
"hyperbolic_space": {
|
| 14 |
+
"curv_init": 1.0,
|
| 15 |
+
"min_radius": 0.1,
|
| 16 |
+
"sel_clamp_feature_alpha_max": true,
|
| 17 |
+
"entailment_geometry": "hyperbolic",
|
| 18 |
+
"nearest_neighbor_metric_cross_modality": "angle",
|
| 19 |
+
"inference_project_to_hyperbolic_space": true,
|
| 20 |
+
"stacked_entailment": {
|
| 21 |
+
"embedding_dim": 768,
|
| 22 |
+
"label_table": {
|
| 23 |
+
"enabled": true,
|
| 24 |
+
"add_dna_bin_level": false
|
| 25 |
+
},
|
| 26 |
+
"dna_projection": {
|
| 27 |
+
"enabled": true,
|
| 28 |
+
"type": "mlp",
|
| 29 |
+
"activation": "gelu",
|
| 30 |
+
"dropout": 0.0,
|
| 31 |
+
"input_dim": 768,
|
| 32 |
+
"hidden_dim": 1536,
|
| 33 |
+
"output_dim": 768,
|
| 34 |
+
"residual": false,
|
| 35 |
+
"normalize": false
|
| 36 |
+
}
|
| 37 |
+
}
|
| 38 |
+
}
|
| 39 |
+
},
|
| 40 |
+
"barcodebert_setting": {
|
| 41 |
+
"old_model_setting": {
|
| 42 |
+
"k": 5,
|
| 43 |
+
"max_len": 660
|
| 44 |
+
}
|
| 45 |
+
}
|
| 46 |
+
}
|
| 47 |
+
}
|
Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:25680fbc63925526707d1ff523fa6aa39ae445c1310c30de61aa9db10d87c9bd
|
| 3 |
+
size 452784372
|
Ver_1_1/ckpt/bioscan_clip/bioscan_5m/SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42/validation_summary.json
ADDED
|
@@ -0,0 +1,40 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "ssel-40epochs",
|
| 3 |
+
"model_output_name": "SSEL_granularity_comparison_768d_dna_only_nonres_40epochs_seed42",
|
| 4 |
+
"epochs": 40,
|
| 5 |
+
"modality": "DNA-only",
|
| 6 |
+
"dimension": 768,
|
| 7 |
+
"checkpoint_sha256": "25680fbc63925526707d1ff523fa6aa39ae445c1310c30de61aa9db10d87c9bd",
|
| 8 |
+
"source_config_sha256": "87376a228c7048a9d763f5116f2908eb278de2ec07a0f30080cb7826c42d7825",
|
| 9 |
+
"source_job_id": "347623",
|
| 10 |
+
"evaluation": "full validation; nearest exterior angle and outside all training-known Species cones",
|
| 11 |
+
"candidate_counts": {
|
| 12 |
+
"order": 55,
|
| 13 |
+
"family": 929,
|
| 14 |
+
"genus": 6819,
|
| 15 |
+
"species": 11846
|
| 16 |
+
},
|
| 17 |
+
"units": "percent; micro",
|
| 18 |
+
"validation": {
|
| 19 |
+
"val_seen": {
|
| 20 |
+
"total": 14757,
|
| 21 |
+
"rejected": 372,
|
| 22 |
+
"reject_percent": 2.5208375686115065,
|
| 23 |
+
"top1_rank": "species",
|
| 24 |
+
"top1_correct": 14692,
|
| 25 |
+
"top1_percent": 99.55953107000067,
|
| 26 |
+
"ordered_processids_sha256": "047de23d9407f8c087e6bdd6453a109c67cdd88e39db3d5913916b12fd8ab66e"
|
| 27 |
+
},
|
| 28 |
+
"val_unseen": {
|
| 29 |
+
"total": 8819,
|
| 30 |
+
"rejected": 7300,
|
| 31 |
+
"reject_percent": 82.7758249234607,
|
| 32 |
+
"top1_rank": "genus",
|
| 33 |
+
"top1_correct": 7566,
|
| 34 |
+
"top1_percent": 85.79203991382244,
|
| 35 |
+
"ordered_processids_sha256": "075b2f9addb2a2fc70708d130d1338bbf395d0af2c2bd1f374564fea22b38bfc"
|
| 36 |
+
}
|
| 37 |
+
},
|
| 38 |
+
"source_evaluation_completed_utc": "2026-11-12T18:22:53.752698+00:00",
|
| 39 |
+
"note": "Additional40epoch checkpoint; original15epoch UniReps weights are retained. Validation results are not test-set results."
|
| 40 |
+
}
|