feat: no VRAM plan, the prediction config asks for a measured batch
Browse filesThe apps declare no `vram_plan` any more and their `Prediction.yml` says `batch_size: 0`: konfai measures the batch its forward fits on the GPU (one patch at a time on a CPU). Needs the konfai release that measures the batch: an older konfai refuses a batch of 0.
- README.md +1 -1
- body/Prediction.yml +1 -1
- body/app.json +0 -26
README.md
CHANGED
|
@@ -37,7 +37,7 @@ impact-seg-konfai segment body -i input.nii.gz -o output/
|
|
| 37 |
|
| 38 |
## ⚡ Performance & VRAM
|
| 39 |
|
| 40 |
-
Benchmarked on a single **NVIDIA RTX PRO 5000 (24 GB)** with a real whole-body CT (295 × 259 × 219, 2 mm). The batch size is **
|
| 41 |
|
| 42 |
| Free VRAM | Batch (auto) | Peak VRAM | Time / case |
|
| 43 |
|:--|:--|:--|:--|
|
|
|
|
| 37 |
|
| 38 |
## ⚡ Performance & VRAM
|
| 39 |
|
| 40 |
+
Benchmarked on a single **NVIDIA RTX PRO 5000 (24 GB)** with a real whole-body CT (295 × 259 × 219, 2 mm). The batch size is **measured on your GPU** (a forward of one patch, then of two, then the batch the free VRAM holds).
|
| 41 |
|
| 42 |
| Free VRAM | Batch (auto) | Peak VRAM | Time / case |
|
| 43 |
|:--|:--|:--|:--|
|
body/Prediction.yml
CHANGED
|
@@ -38,7 +38,7 @@ Predictor:
|
|
| 38 |
subset: None
|
| 39 |
dataset_filenames:
|
| 40 |
- ./Dataset/:mha
|
| 41 |
-
batch_size:
|
| 42 |
num_workers: None
|
| 43 |
pin_memory: false
|
| 44 |
prefetch_factor: None
|
|
|
|
| 38 |
subset: None
|
| 39 |
dataset_filenames:
|
| 40 |
- ./Dataset/:mha
|
| 41 |
+
batch_size: 0
|
| 42 |
num_workers: None
|
| 43 |
pin_memory: false
|
| 44 |
prefetch_factor: None
|
body/app.json
CHANGED
|
@@ -83,31 +83,5 @@
|
|
| 83 |
"color": "#43AA8B"
|
| 84 |
}
|
| 85 |
},
|
| 86 |
-
"vram_plan": {
|
| 87 |
-
"8": {
|
| 88 |
-
"patch_size": [
|
| 89 |
-
1,
|
| 90 |
-
192,
|
| 91 |
-
192
|
| 92 |
-
],
|
| 93 |
-
"batch_size": 160
|
| 94 |
-
},
|
| 95 |
-
"16": {
|
| 96 |
-
"patch_size": [
|
| 97 |
-
1,
|
| 98 |
-
192,
|
| 99 |
-
192
|
| 100 |
-
],
|
| 101 |
-
"batch_size": 320
|
| 102 |
-
},
|
| 103 |
-
"24": {
|
| 104 |
-
"patch_size": [
|
| 105 |
-
1,
|
| 106 |
-
192,
|
| 107 |
-
192
|
| 108 |
-
],
|
| 109 |
-
"batch_size": 512
|
| 110 |
-
}
|
| 111 |
-
},
|
| 112 |
"task": "segmentation"
|
| 113 |
}
|
|
|
|
| 83 |
"color": "#43AA8B"
|
| 84 |
}
|
| 85 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 86 |
"task": "segmentation"
|
| 87 |
}
|