VBoussot commited on
Commit
d6cf30b
·
verified ·
1 Parent(s): 09dee1f

feat: no VRAM plan, the prediction config asks for a measured batch

Browse files

The apps declare no `vram_plan` any more and their `Prediction.yml` says `batch_size: 0`: konfai measures the batch its forward fits on the GPU (one patch at a time on a CPU). Needs the konfai release that measures the batch: an older konfai refuses a batch of 0.

Files changed (3) hide show
  1. README.md +1 -1
  2. body/Prediction.yml +1 -1
  3. body/app.json +0 -26
README.md CHANGED
@@ -37,7 +37,7 @@ impact-seg-konfai segment body -i input.nii.gz -o output/
37
 
38
  ## ⚡ Performance & VRAM
39
 
40
- Benchmarked on a single **NVIDIA RTX PRO 5000 (24 GB)** with a real whole-body CT (295 × 259 × 219, 2 mm). The batch size is **auto-selected from your free GPU VRAM**.
41
 
42
  | Free VRAM | Batch (auto) | Peak VRAM | Time / case |
43
  |:--|:--|:--|:--|
 
37
 
38
  ## ⚡ Performance & VRAM
39
 
40
+ Benchmarked on a single **NVIDIA RTX PRO 5000 (24 GB)** with a real whole-body CT (295 × 259 × 219, 2 mm). The batch size is **measured on your GPU** (a forward of one patch, then of two, then the batch the free VRAM holds).
41
 
42
  | Free VRAM | Batch (auto) | Peak VRAM | Time / case |
43
  |:--|:--|:--|:--|
body/Prediction.yml CHANGED
@@ -38,7 +38,7 @@ Predictor:
38
  subset: None
39
  dataset_filenames:
40
  - ./Dataset/:mha
41
- batch_size: 32
42
  num_workers: None
43
  pin_memory: false
44
  prefetch_factor: None
 
38
  subset: None
39
  dataset_filenames:
40
  - ./Dataset/:mha
41
+ batch_size: 0
42
  num_workers: None
43
  pin_memory: false
44
  prefetch_factor: None
body/app.json CHANGED
@@ -83,31 +83,5 @@
83
  "color": "#43AA8B"
84
  }
85
  },
86
- "vram_plan": {
87
- "8": {
88
- "patch_size": [
89
- 1,
90
- 192,
91
- 192
92
- ],
93
- "batch_size": 160
94
- },
95
- "16": {
96
- "patch_size": [
97
- 1,
98
- 192,
99
- 192
100
- ],
101
- "batch_size": 320
102
- },
103
- "24": {
104
- "patch_size": [
105
- 1,
106
- 192,
107
- 192
108
- ],
109
- "batch_size": 512
110
- }
111
- },
112
  "task": "segmentation"
113
  }
 
83
  "color": "#43AA8B"
84
  }
85
  },
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
86
  "task": "segmentation"
87
  }