EdgeCVS-5M (fold 0)
Browse files- README.md +62 -0
- edgecvs-5m/config.yaml +65 -0
- edgecvs-5m/edgecvs-5m-fold0.safetensors +3 -0
README.md
CHANGED
|
@@ -1,3 +1,65 @@
|
|
| 1 |
---
|
| 2 |
license: cc-by-nc-4.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: cc-by-nc-4.0
|
| 3 |
+
library_name: pytorch
|
| 4 |
+
tags:
|
| 5 |
+
- surgical-video
|
| 6 |
+
- laparoscopic-cholecystectomy
|
| 7 |
+
- critical-view-of-safety
|
| 8 |
+
- image-classification
|
| 9 |
+
- semantic-segmentation
|
| 10 |
+
- knowledge-distillation
|
| 11 |
---
|
| 12 |
+
|
| 13 |
+
# EdgeCVS
|
| 14 |
+
|
| 15 |
+
Models from [**EdgeCVS: Democratization of Surgical AI with a Distilled Edge-Deployable
|
| 16 |
+
Critical View of Safety (CVS) Model**](https://papers.miccai.org/miccai-2026/paper/1745_paper.pdf) (MICCAI 2026).
|
| 17 |
+
|
| 18 |
+
EdgeCVS assesses the three Critical View of Safety criteria in laparoscopic cholecystectomy
|
| 19 |
+
from single frames, with a small model distilled from large multi-task teachers that runs in
|
| 20 |
+
real time on a CPU.
|
| 21 |
+
|
| 22 |
+
Code: [github.com/IMSY-DKFZ/edgecvs](https://github.com/IMSY-DKFZ/edgecvs)
|
| 23 |
+
|
| 24 |
+
## Models
|
| 25 |
+
|
| 26 |
+
Each model lives in its own folder, named like the code's `exp` option:
|
| 27 |
+
|
| 28 |
+
| Model (`exp`) | Backbone | Params | Weights | SAGES-CVS 2024 test mAP |
|
| 29 |
+
|---|---|---|---|---|
|
| 30 |
+
| [`edgecvs-5m`](edgecvs-5m/) | EdgeNeXt-Small | 5.6M | fp16, 11 MB | 66.4 |
|
| 31 |
+
|
| 32 |
+
```
|
| 33 |
+
edgecvs-5m/
|
| 34 |
+
├── config.yaml model configuration used to build the network
|
| 35 |
+
└── edgecvs-5m-fold0.safetensors weights (fold 0, fp16; loaded into an fp32 model)
|
| 36 |
+
```
|
| 37 |
+
|
| 38 |
+
## EdgeCVS-5M
|
| 39 |
+
|
| 40 |
+
- **Input:** RGB frame, resized to 448×448, ImageNet normalization
|
| 41 |
+
- **Output:** probabilities for C1 (two structures), C2 (hepatocystic triangle) and
|
| 42 |
+
C3 (cystic plate); optional 7-class anatomy segmentation (background, cystic plate,
|
| 43 |
+
hepatocystic triangle, cystic artery, cystic duct, gallbladder, tool)
|
| 44 |
+
- **Deployment:** the segmentation head is optional; the classifier alone is used for the CSV
|
| 45 |
+
predictions and the speed figures below
|
| 46 |
+
|
| 47 |
+
|
| 48 |
+
## License
|
| 49 |
+
|
| 50 |
+
CC BY-NC 4.0: the models are trained on data released for non-commercial use.
|
| 51 |
+
|
| 52 |
+
## Citation
|
| 53 |
+
|
| 54 |
+
```bibtex
|
| 55 |
+
@InProceedings{YamAmi_EdgeCVS_MICCAI2026,
|
| 56 |
+
author = { Yamlahi, Amine AND Hennighausen, Jakob AND Hansen, Pascal AND Leeb, David AND Maier-Hein, Lena},
|
| 57 |
+
title = { { EdgeCVS: Democratization of surgical AI with a Distilled Edge-Deployable Critical View of Safety (CVS) model } },
|
| 58 |
+
booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026},
|
| 59 |
+
year = {2026},
|
| 60 |
+
publisher = {Springer Nature Switzerland},
|
| 61 |
+
volume = {LNCS 16892},
|
| 62 |
+
month = {September},
|
| 63 |
+
page = {pending}
|
| 64 |
+
}
|
| 65 |
+
```
|
edgecvs-5m/config.yaml
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
exp: edgecvs-5m
|
| 2 |
+
vmodel: SegFormerAuxSeg
|
| 3 |
+
strategy: aux_seg_disk
|
| 4 |
+
aux_seg: true
|
| 5 |
+
model_name: edgenext_small.usi_in1k
|
| 6 |
+
height: 448
|
| 7 |
+
width: 448
|
| 8 |
+
target_size: 3
|
| 9 |
+
col0: C1
|
| 10 |
+
n_fold: 5
|
| 11 |
+
trn_fold:
|
| 12 |
+
- 0
|
| 13 |
+
seed: 1
|
| 14 |
+
nworkers: 4
|
| 15 |
+
aspp:
|
| 16 |
+
pretrained: false
|
| 17 |
+
encoder_out_indices:
|
| 18 |
+
- 0
|
| 19 |
+
- 1
|
| 20 |
+
- 2
|
| 21 |
+
- 3
|
| 22 |
+
bottleneck_out_channels: 256
|
| 23 |
+
aspp_input_channels: 256
|
| 24 |
+
aspp_out_channels: 128
|
| 25 |
+
aspp_dilations:
|
| 26 |
+
- 1
|
| 27 |
+
- 3
|
| 28 |
+
- 6
|
| 29 |
+
- 9
|
| 30 |
+
decoderblock: Upsample
|
| 31 |
+
decoder_hidden_dim: 64
|
| 32 |
+
scale: 4
|
| 33 |
+
seg:
|
| 34 |
+
seg_input_size:
|
| 35 |
+
height: 448
|
| 36 |
+
width: 448
|
| 37 |
+
classes:
|
| 38 |
+
- background
|
| 39 |
+
- cystic_plate
|
| 40 |
+
- calot_triangle
|
| 41 |
+
- cystic_artery
|
| 42 |
+
- cystic_duct
|
| 43 |
+
- gallbladder
|
| 44 |
+
- tool
|
| 45 |
+
aux_weight: 0.1
|
| 46 |
+
valid:
|
| 47 |
+
tta: false
|
| 48 |
+
transforms:
|
| 49 |
+
- name: Resize
|
| 50 |
+
params:
|
| 51 |
+
height: 448
|
| 52 |
+
width: 448
|
| 53 |
+
p: 1.0
|
| 54 |
+
- name: Normalize
|
| 55 |
+
params:
|
| 56 |
+
mean:
|
| 57 |
+
- 0.485
|
| 58 |
+
- 0.456
|
| 59 |
+
- 0.406
|
| 60 |
+
std:
|
| 61 |
+
- 0.229
|
| 62 |
+
- 0.224
|
| 63 |
+
- 0.225
|
| 64 |
+
- name: ToTensorV2
|
| 65 |
+
params: {}
|
edgecvs-5m/edgecvs-5m-fold0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0af2a5f7f333afb86ae1f03f507d36cc334e8aac96886418b99950ef0a0a8174
|
| 3 |
+
size 11271366
|