Image Feature Extraction
timm
Safetensors
microscopy
single-cell
self-supervised
dinov2
vision-transformer
biology
Instructions to use CSEM-AI4LS/scdino-v2-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- timm
How to use CSEM-AI4LS/scdino-v2-base with timm:
import timm model = timm.create_model("hf-hub:CSEM-AI4LS/scdino-v2-base", pretrained=True) - Notebooks
- Google Colab
- Kaggle
File size: 1,598 Bytes
b7d994b c6d0b0e b7d994b c6d0b0e b7d994b 838e50b b7d994b 0336833 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 | ---
library_name: timm
license: mit
pipeline_tag: image-feature-extraction
inference: false # the widget cannot feed 5-channel TIFFs
tags:
- microscopy
- single-cell
- self-supervised
- dinov2
- vision-transformer
- biology
---
# scdino-v2-base
Self-supervised Vision Transformer (DINOv2) for 5-channel
single-cell microscopy crops of human peripheral blood mononuclear cells (PBMCs). It returns one
128-dimensional embedding per crop.
- **Input:** 50×50 px crops with 5 channels (H, W, C), in this order:
| # | Channel | Markers |
|---|---|---|
| 1 | 647 nm | CD3 (APC), CD14 (Alexa Fluor 647) |
| 2 | Brightfield | – |
| 3 | DAPI | – |
| 4 | 488 nm | CD4, CD19 (FITC) |
| 5 | 594 nm | CD8, CD16, CD56 (PE), CD20 (Alexa Fluor 594) |
- **Data:** A labelled set of more than 1.3 million single-cell images of seven immune cell types is openly available: [Morphologically annotated single-cell images of human PBMCs](https://doi.org/10.3929/ethz-c-000806089).
## Usage
See the README of the code repository, https://github.com/JonasMeirer/scDINOv2, for how to load the model,
preprocess crops and evaluate embeddings.
Usage on images from other microscopes, stains, cells or crop sizes might need new normalization statistics and retraining.
**Not a diagnostic tool, and not for clinical use.**
## Citation
The publication describing this model is currently under review. This section
will be updated with the reference once it is published.
## License
MIT, like the scDINO code. Training used timm (Apache-2.0) and code vendored from Lightly (MIT).
|