Super-squash branch 'main' using huggingface_hub

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+SpectraVision-PeakViT filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,47 @@
+---
+license: cc-by-nc-nd-4.0
+tags:
+- spectravision
+- msms
+- proteomics
+- vision
+---
+
+# SpectraVision
+The paper is under review.
+
+[[Github Repo](https://github.com/pcdslab/SpectraVision)] | [[Model Collection](https://huggingface.co/collections/SaeedLab/SpectraVision)] | [[Dataset](https://huggingface.co/datasets/SaeedLab/SpectraVision-Data)]
+
+## Abstract
+
+Converting irregularly spaced mass spectrometry (MS/MS) data into computable representation is a foundational architectural choice that sets the upper bound for both computational efficiency and model accuracy. Existing MS/MS representations for machine-learning (ML) models can be divided into two parts: (1) fine-grained binned vectors that preserve spectra resolution but are sparse; (2) transformer-sequence encoders that can avoid sparse binning but must process variable-length inputs with continuous, shift-sensitive m/z coordinates. Critically, both strategies trade computational efficiency for representation quality, creating significant time and memory bottlenecks. In this paper, we present SpectraVision, which encodes MS/MS spectra into compact image-tensors, preserves high-resolution m/z information and supports efficient learning. Efficacy of these image-tensors to extract spatial features from the spectrum image is demonstrated with a CNN model and a Vision Transformer to validate the ability of image-tensors to preserve long-range spectral dependencies. Both CNN and ViT models then exhibit superior Top-k peptide-retrieval accuracy when compared with binned-Vector and transformer-sequence encoders. An added advantage of SpectraVision based models, necessary for training large models, is usage of 87% fewer parameters (~6.4M versus 51.8M) than binned-vector approach. Zero-shot evaluation on multiple species, non-tryptic peptides, and immunopeptides showcases the robustness of vision-based models to extend and improve ML models for MS-based proteomics.
+
+
+## Peptide retrieval search
+
+Install [uv](https://docs.astral.sh/uv/getting-started/installation/), then clone the repository and search an MGF against a peptide FASTA:
+
+```bash
+git clone https://github.com/pcdslab/SpectraVision.git
+cd SpectraVision
+uv sync
+uv run python retrieval_search/run_search.py \
+  --mgf retrieval_search/sample_data/sample_data.mgf \
+  --fasta retrieval_search/sample_data/sample_fasta.fasta \
+  --output-dir outputs/search \
+  --ppm-tolerance 100 \
+  --download_weight=true
+```
+
+The command downloads the default `SpectraVision-3C-CNN` safetensors weights and saves assigned peptides to `outputs/search/matches.csv`. The search considers peptides within 100 ppm of the spectrum's precursor m/z. Select another checkpoint with `--model SpectraVision-1C-CNN` or `--model SpectraVision-PeakViT`.
+
+## Cite
+The paper is under review. As soon as it is accepted, we will update this section.
+
+## License
+
+This model and associated code are released under the CC-BY-NC-ND 4.0 license and may only be used for non-commercial, academic research purposes with proper attribution. Any commercial use, sale, or other monetization of this model and its derivatives, which include models trained on outputs from the model or datasets created from the model, is prohibited and requires prior approval. Downloading the model requires prior registration on Hugging Face and agreeing to the terms of use. By downloading this model, you agree not to distribute, publish or reproduce a copy of the model. If another user within your organization wishes to use the model, they must register as an individual user and agree to comply with the terms of use. Users may not attempt to re-identify the deidentified data used to develop the underlying model. If you are a commercial entity, please contact the corresponding author.
+
+## Contact
+
+For any additional questions or comments, contact Fahad Saeed (fsaeed@fiu.edu).

SpectraVision-1C-CNN.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:811b22547c347032c6654fb7208bcdef9813418b2dbdd79e6703e1c9b79e82ae
+size 25697472

SpectraVision-3C-CNN.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfcc657f70b4f5ed1c8206ff0e3d27b251ab7e77ec43fe1cebbbc58b1b92f75a
+size 25711528

SpectraVision-PeakViT.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06fd0eae52c8e4ca3667eb870ba503390d2e0890738e305338202411a79b055a
+size 26879240

config.json

@@ -0,0 +1,69 @@
+{
+  "evaluation": {
+    "batch_size": 1024,
+    "num_workers": 8,
+    "device": "auto",
+    "forward_batch_size": 64,
+    "cuda_autocast": true,
+    "cudnn_enabled": true,
+    "cudnn_benchmark": true,
+    "cudnn_deterministic": false
+  },
+  "loss": {
+    "name": "multi_positive_info_nce_with_decoy",
+    "temperature": 0.07,
+    "threshold": 0.99,
+    "decoy_weight": 1.0
+  },
+  "models": {
+    "SpectraVision-1C-CNN": {
+      "encoding": "SpectraVision-1C",
+      "encoding_params": {
+        "max_mz": 5000,
+        "num_peaks": 200,
+        "bin_multiply_factor": 10
+      },
+      "model_params": {
+        "img_size": [224, 224]
+      },
+      "weights": "weights/SpectraVision-1C-CNN.safetensors"
+    },
+    "SpectraVision-3C-CNN": {
+      "encoding": "SpectraVision-3C",
+      "encoding_params": {
+        "max_mz": 5000,
+        "num_peaks": 200,
+        "bin_multiply_factor": 10
+      },
+      "model_params": {
+        "img_size": [224, 224]
+      },
+      "weights": "weights/SpectraVision-3C-CNN.safetensors"
+    },
+    "SpectraVision-PeakViT": {
+      "encoding": "SpectraVision-1C",
+      "encoding_params": {
+        "max_mz": 5000,
+        "num_peaks": 200,
+        "bin_multiply_factor": 10
+      },
+      "model_params": {
+        "img_size": [224, 224],
+        "patch_size": 16,
+        "in_channels": 1,
+        "d_model": 512,
+        "embedding_dim": 256,
+        "num_layers": 2,
+        "nhead": 8,
+        "position_encoding": "learned",
+        "mask_empty_patches": true,
+        "bin_multiply_factor": 10,
+        "max_mz": 5000,
+        "intensity_channel": 0,
+        "min_mz_wavelength": 0.2,
+        "max_mz_wavelength": 1000
+      },
+      "weights": "weights/SpectraVision-PeakViT.safetensors"
+    }
+  }
+}