Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags: [image-classification, plankton, PISCO, vision-transformer]
|
| 3 |
+
license: mit
|
| 4 |
+
---
|
| 5 |
+
# M181_binary
|
| 6 |
+
|
| 7 |
+
First stage of the PISCO dual-ViT: **living vs not-living**. Fine-tuned
|
| 8 |
+
`google/vit-base-patch16-224-in21k` on expert-validated crops from cruise
|
| 9 |
+
**M181** (tropical Atlantic, April-May 2022). Test accuracy 97.65%.
|
| 10 |
+
|
| 11 |
+
**Classes (2):** living, not-living
|
| 12 |
+
|
| 13 |
+
## Important: this model is coupled to its preprocessing
|
| 14 |
+
Trained on crops produced by the **231204 LUCYD deconvolution**
|
| 15 |
+
(`lucyd-edof-plankton_231204.pth`, the pipeline default) with **non-isolated**
|
| 16 |
+
crops (neighbouring particles present). Running it on crops from a different
|
| 17 |
+
deconvolution model, or on neighbour-isolated crops, is an out-of-domain shift:
|
| 18 |
+
measured on ATAIR-BSH, swapping the deconvolution alone collapsed the living
|
| 19 |
+
rate by 83-93% at unchanged confidence. Treat deconvolution + crop isolation +
|
| 20 |
+
classifier as one versioned unit.
|
| 21 |
+
|
| 22 |
+
Preprocessing: resize longest edge to 224, centre-pad to 224x224 with white
|
| 23 |
+
(255), normalise mean=std=0.5. No rotation at inference. Crops must carry no
|
| 24 |
+
scale bar (or have it removed with `utils.strip_scale_bar`).
|
| 25 |
+
|
| 26 |
+
## Use in the pipeline
|
| 27 |
+
These are the pipeline defaults (`--binary-model-dir` / `--living-model-dir`),
|
| 28 |
+
or from any machine:
|
| 29 |
+
```
|
| 30 |
+
process_pisco_profiles.py --binary-model-hf Veit/M181_binary --living-model-hf Veit/M181_multiclass
|
| 31 |
+
process_pisco_profiles.py --dualvit-model M181 # resolves both from the Hub when not local
|
| 32 |
+
```
|