upload diagram-type classifier (DINOv3 fine-tune + probe)

README.md

@@ -0,0 +1,51 @@
+---
+license: apache-2.0
+tags: [image-classification, dinov3, construction, building-regulations, comfyui]
+pipeline_tag: image-classification
+---
+
+# BuildwellAI Diagram-Type Classifier
+
+Classifies a UK building-regulations / construction figure into its **diagram type**, to route a ComfyUI
+restyle workflow to the class-appropriate prompt/ControlNet.
+
+## Classes
+- `COMPOUND`
+- `CROSS_SECTION`
+- `ISOMETRIC_UPDATE`
+- `SCHEMATIC_FLOW`
+- `SITE_PLAN`
+- `TABLE_DATA`
+
+## How it was built
+- **Labels**: distilled from a Qwen3.5-VL teacher over 2315 diagram crops (`classifications_pool.json`).
+- **Encoder**: DINOv3 ViT-L/16 (frozen features for the probe; last blocks fine-tuned for `ft_model.pt`).
+- **Finding**: encoder size was not the bottleneck (DINOv2-base == DINOv3-large at 234 samples); data
+  scale (234→2315) and fine-tuning to the line-drawing domain were.
+
+## Results (5-fold CV / held-out val)
+```
+val_acc=0.790 val_bal=0.818
+
+                  precision    recall  f1-score   support
+
+        COMPOUND      0.727     0.762     0.744        84
+   CROSS_SECTION      0.855     0.707     0.774       133
+ISOMETRIC_UPDATE      0.703     0.867     0.776        30
+  SCHEMATIC_FLOW      0.562     0.750     0.643        12
+       SITE_PLAN      0.667     0.870     0.755        23
+      TABLE_DATA      0.935     0.951     0.943        61
+
+        accuracy                          0.790       343
+       macro avg      0.742     0.818     0.772       343
+    weighted avg      0.802     0.790     0.791       343
+
+```
+
+## Files
+- `ft_model.pt` — fine-tuned DINOv3 + linear head (state_dict, classes, encoder id).
+- `class_probe.joblib` — frozen-feature logistic-regression probe (lighter, sklearn).
+- `report.txt` — per-class validation report.
+
+## Use in ComfyUI
+Load DINOv3 + this head in a custom node that maps `IMAGE -> (class, confidence)` and drives Switch nodes.

class_probe.joblib

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0b9abb4974d2470cd37ee97b27550fbf03d4178e66126aa1929dff48af5a3f6
+size 55332

ft_model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1decb4e7efaf6332f20b8d510267d0da2b2a64c0000855849030cd3772d9cd5b
+size 1212699940

report.txt

@@ -0,0 +1,14 @@
+val_acc=0.790 val_bal=0.818
+
+                  precision    recall  f1-score   support
+
+        COMPOUND      0.727     0.762     0.744        84
+   CROSS_SECTION      0.855     0.707     0.774       133
+ISOMETRIC_UPDATE      0.703     0.867     0.776        30
+  SCHEMATIC_FLOW      0.562     0.750     0.643        12
+       SITE_PLAN      0.667     0.870     0.755        23
+      TABLE_DATA      0.935     0.951     0.943        61
+
+        accuracy                          0.790       343
+       macro avg      0.742     0.818     0.772       343
+    weighted avg      0.802     0.790     0.791       343