constructelligence commited on
Commit
0beec36
·
verified ·
1 Parent(s): cbda986

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +21 -5
README.md CHANGED
@@ -243,11 +243,27 @@ so the numbers below are re-derivable from `benchmark/records/`:
243
  | painted-coverage MAE | 0.162 |
244
 
245
  The all-`other` floor is mIoU **0.110**, so the model clears the floor by a wide
246
- margin. On the hard substrate/condition questions it is **not** Q4: on 117
247
- reviewed *wild* photographs the wallpaper head's precision is ~0.50 and the
248
- drywall head still calls ~50% of painted walls "bare board" — that gap is the
249
- next stage of work (`docs/ROADMAP.md`, Phase 1) and is stated rather than
250
- hidden. `train.py` reports the same metric families on any dataset you supply.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
251
 
252
  ## Intended use and limitations
253
 
 
243
  | painted-coverage MAE | 0.162 |
244
 
245
  The all-`other` floor is mIoU **0.110**, so the model clears the floor by a wide
246
+ margin. Two readings matter, and both are stated rather than hidden.
247
+
248
+ **On its own validation data it looks strong:** painted-coverage error is about
249
+ **7.5 points**, and it never marks a wall complete that is not (false-complete
250
+ rate **0.0**).
251
+
252
+ **On 117 real photographs it was never tuned on, the substrate and condition
253
+ questions are not solved** — the honest half:
254
+
255
+ | Question (117 wild photos) | Result |
256
+ | --- | --- |
257
+ | Finding the wall | **117 / 117** |
258
+ | Wallpaper precision (22 positives) | **0.50** — half its alarms are false |
259
+ | Painted wall called "bare board" (drywall) | **50%** raw · **65%** calibrated |
260
+ | Damage (peeling / rust), AUROC | **0.52** — close to a coin flip; it flags most sound walls |
261
+ | Sign-off on bare drywall | **1 of 19** walls marked finished — a real robot would leave that wall unpainted |
262
+
263
+ The quickest gain is fixing those real-photo numbers: **hard negatives for
264
+ painted vs drywall/wallpaper**, or swapping in **SAM 2 / Depth Anything**
265
+ (`docs/ROADMAP.md`, Phase 1–2). `train.py` reports the same metric families on
266
+ any dataset you supply.
267
 
268
  ## Intended use and limitations
269