File size: 1,598 Bytes
b7d994b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c6d0b0e
 
 
 
 
 
 
 
 
 
b7d994b
 
 
 
 
c6d0b0e
 
 
 
 
b7d994b
 
 
838e50b
 
b7d994b
 
 
0336833
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
---
library_name: timm
license: mit
pipeline_tag: image-feature-extraction
inference: false   # the widget cannot feed 5-channel TIFFs
tags:
  - microscopy
  - single-cell
  - self-supervised
  - dinov2
  - vision-transformer
  - biology
---

# scdino-v2-base

Self-supervised Vision Transformer (DINOv2) for 5-channel
single-cell microscopy crops of human peripheral blood mononuclear cells (PBMCs). It returns one
128-dimensional embedding per crop.

- **Input:** 50×50 px crops with 5 channels (H, W, C), in this order:

  | # | Channel | Markers |
  |---|---|---|
  | 1 | 647 nm | CD3 (APC), CD14 (Alexa Fluor 647) |
  | 2 | Brightfield | – |
  | 3 | DAPI | – |
  | 4 | 488 nm | CD4, CD19 (FITC) |
  | 5 | 594 nm | CD8, CD16, CD56 (PE), CD20 (Alexa Fluor 594) |
  
- **Data:** A labelled set of more than 1.3 million single-cell images of seven immune cell types is openly available: [Morphologically annotated single-cell images of human PBMCs](https://doi.org/10.3929/ethz-c-000806089).

## Usage

See the README of the code repository, https://github.com/JonasMeirer/scDINOv2, for how to load the model,
preprocess crops and evaluate embeddings.

Usage on images from other microscopes, stains, cells or crop sizes might need new normalization statistics and retraining.

**Not a diagnostic tool, and not for clinical use.**

## Citation

The publication describing this model is currently under review. This section
  will be updated with the reference once it is published.

## License

MIT, like the scDINO code. Training used timm (Apache-2.0) and code vendored from Lightly (MIT).